vercel-labs/agent-desktop โ computer-use for AI agents via accessibility tree, no screenshots required
npm install -g agent-desktop # or: brew install agent-desktop
agent-desktop status # check platform support and permissions
agent-desktop permissions --guide # (macOS) grant Accessibility access
agent-desktop snapshot --app Finder -i # see the full accessibility tree as JSON
agent-desktop click @<ref-from-snapshot> # act on a stable element ref
agent-desktop snapshot --app Finder -i # verify the action changed state