It's nuts how the little changes make a big difference it's why animated GIFs are removed from the dark mode extension, they can chew up 2-5% of GPU 3D overhead... hell so can you animated forum profile image @cbigfoot
It's really a matter of getting the max out of your system is to not be on it, using it etc. headless is best.
if you're folding on your daily driver you have to accept your OS is a 3D environment for most OS's these days, browsing, video etc. all messes with your GPU / PPD.
Even a benchmarking tool can mess with it if it's showing overlays, live updates, etc.