I’m reverse-engineering the Google AI mouse pointer and making it Open Source!
It sees your screen.
You can freeform paint anything and ask AI to modify it.
It understands the app or window you mean.
It can click, type, edit, navigate, and even write execute code.
A tiny cursor becoming a real computer-use agent.
Made with the help of
@trycua which is an AMAZING reference for computer use
Sorry
@GoogleDeepMind but I had to do this
@heyclicky Started a revolution and we will be the ones to win
Also credits to
@BuildwithOmkarr for the help
Feel free to modify it , update it and make it your own, we gotta beat them at this. Link to the repo in the comments: