agent-desktop is a robust CLI tool for automating desktop tasks, designed for AI agents. Built using Rust, it provides structured access to applications through OS accessibility trees, eliminating the need for screenshots or pixel matching. Key features include a native CLI with no runtime dependencies, support for 54 commands encompassing observation, interaction, and window management, and a progressive skeleton traversal system that significantly reduces token usage during interaction with dense applications.

The program supports a wide range of functionalities, including clipboard management, keyboard shortcuts, and mouse actions. It also has structured JSON output for machine-readable responses, enhancing its usability for developers. Installation can be done via npm or from source, and it requires accessibility permissions on macOS. Overall, agent-desktop provides a powerful solution for automating tasks across various applications.