Been having problems with my computer for a month or two now, started happening when I plugged in my molex powered fan controller (now removed from system), when I did this the computer didn't start, it just sat there no fancy lights on the motherboard, but the CPU and RAM lights on the motherboard lit up, I had to hold down the reset and power button to get it to start back up. I thought everything was fine, but after a little bit of testing I have found out that the system stays fine and turns back on when shut down if I keep the power plug connected, as soon as I unplug and plug it back in then start it up, the problem comes back and I have to hold down the power and reset buttons to start it back up. Now i'm assuming its the power supply that's the problem(being that it was connected to the fan controller when it messed up), but just wanted to see if anyone would be able to offer help or thoughts on what the problem is.
System
Ryzen 3 1300x
Gigabyte AB350-Gaming 3
16gb G.Skill Ripjaws RAM
Sapphire RX 570 4gb
2 TB Seagate barracuda HDD
EVGA Supernova Nex 650W power supply
Rosewill GRAM ATX mid tower