Try lowering your RAM speed to 3000 or 2800 MHz and see if it helps. I'm no expert in overclocking, but it sounds like your motherboard can't handle such high frequencies. I recently purchased an ASRock b450 pro4 motherboard, and only installed 1 8 gig stick clocked at 3000MHz. My motherboard forced it to 2133MHz, and I was unable to set it anywhere past 2733MHz. As it happens, it appears that the problem is in the RAM itself, not the motherboard, and you may have to RMA it.