PC sometimes won't start

[Bababagginz]

So, here's the story
When I turn off my PC I always go through the windows menu (windows 10), however, every once in a while when I do this my headphones (which are plugged in through USB) still stay on (i know this because the L.E.D. stay on). This wouldn't really bother me much, however, when this happens, I have noticed that my pc won't start up again. When this happens, NOTHING turns on, no fans, no output to monitors, nothing. I have been able to find a workaround by simply turning off my power supply, holding down the power switch, and turning the PSU back on again and then it works fine. (I'm basically cleansing the system of all power and when I do this the headphone LED turns off) This is good and all, however, I would really like to know exactly what is causing this and try to keep it from happening. 
Here are my specs, incase this helps:

Ryzen 5 2400g 

MSI B350 Gaming Plus MB

MSI RX 560 (itx)

16 gb Vengeance RAM

 

Edit: I have not overclocked anything

[Lemtea]

Have you overclocked anything (memory, gpu, cpu)? Have you tried clearing the cmos? Is the cmos battery good?

[Bababagginz]

13 minutes ago, Lemtea said:

Have you overclocked anything (memory, gpu, cpu)? Have you tried clearing the cmos? Is the cmos battery good?

no, nothing is overclocked, however, I have not cleared the CMOS, and the battery is good