PC sometimes boot faster after being completely powered off

I have noticed that my PC sometimes boots up faster when I start it from a completely powered-off state compared to when I restart it from Windows. This seems counterintuitive because I would expect a cold boot to take longer, so I am trying to understand what might be causing this inconsistency and whether it indicates a deeper issue with my system.