Bad power supply?

[Hybrid72SW]

Hello guys, so this is my story so far. A month ago I started running into an issue with my system. I would press the power button, would get no display signal and the power supply would ram up to full. It usually took somewhere between 1-3 attempts to finally boot up correctly. One day it got so bad it wouldn't boot up at all. So I started unplugging things. The system had no problem booting up if I unplugged all my harddrives and GPU. Then I tried to boot of an USB and it did it again. After a while I figured out no specific device was causing it, because everytime I got it working, plugging in any new device, be it usb, PCI Express or SATA would cause it all over again. I managed somehow to get it working after randomly plugging devices in for two hours. Then I tested ram with mem test, no issues found. I assumed the issue was something going wrong with the motherboard and I wanted a new ryzen CPU anyway, so I replaced the motherboard and CPU. But my trouble didn't stop. Now I don't have the issue with not booting up, I always end up in windows but the PSU still has starts where it ramps up and doesn't want to stop unless I reboot the computer and it can still take a few attempts. I am now pretty sure this is a PSU issue but I am asking here to be certain and I also want to know if it can damage my new components?