need screen monitoring software that outputs to python/java

[Jako613]

Hi,

 

i currently have a unity face and hand recognition and gesture software where it outlines your hand in a green square and identifies what gesture you are doing. I want to output the movements to a java or python program (unsure which one) to control a robotic arm I have built. But the unity file has no way of recording coordinates and I am asking if anyone knows anything else I can use, how i can get the coordinates, or if there is software that can track the green square across my screen and create coordinates based off my monitor.