RAM could be the issue here. The 1080 also seems to be getting a bit hot but nothing extreme. I would probably use a tool to check your GPU usage and temps while gaming. Also make sure all your settings are set to high performance in windows power management and the nvidia control panel.