Well, if you're gaming on a screen connected to the motherboard, then it'll be using your processor's integrated graphics. Which isn't good.
If you use integrated graphics for the screens you're not using for gaming, then you might gain a small amount of performance.
But just plug them all into your 970, it's going to be a generally better experience.