I played GTA5 on both and I couldn't tell a difference between the two. I only noticed when the differences when pointed out.
I will agree with the above comment aswell sometimes the UI can be clunky due to back ground operations on the Xbox.
I play a lot of Forza so the Xbox was my first choice it does good IMO. My PS4 takes the back seat most of the time because the controller is always dieing.