there is left over current inside the PSU. Think of it this way, when you disconnect your monitor from AC power, the LED to show it has power will remain on till the left over power is consumed.
I have had the same thing with my pc as well, its normal. It will only do it once. If you try again you will see that nothing will happen, assuming PSU is still off.