I have used RealVNC across a Mac, Windows, and a Linux Machine.
It works superb and you can also a phone or a tablet to connect to them.
This was happening to me but the performance of VNC does depend on your computer.
When comparing VNC on my Linux machine that runs an Intel Q8300 and my 2019 27in i5 Mac, the Mac is smoother but there is no response latency.
Try it for yourself you might like it.