Weird noise from PC

[DarkBlade2117]

I think I know what it might be, either coil whine or some electrical noise (more complicated name for it that I forgot). It only ever happens if I shut down my PC and don't drain the capacitors by turning off PSU and holding power button. The noise happens off and on, whether there is something stressing the PC or not. It will happen for as long as my PC is on and until shut down and drain caps. It doesn't happen if I just do a soft reset of the PC.

[DarkBlade2117]

52 minutes ago, Abyssal Radon said:

Did this just start happening? Because this can one of two scenarios. 1 electrical noise is typically caused by a electrical fluctuations and don't worry about it. 2 a early sign something is dying. If it's your PSU making this noise, then I would perhaps get ready to replace/RMA it. But only if it has started to make the noise. If it's your GPU, coil whine, nothing new there. 

It's not the GPU, I've been through 3 GPUS (various reasons) and noise has followed them all. It's been happening for awhile, fairly certain it isn't the PSU either.