lahfir/agent-desktop
Native desktop automation CLI for AI agents. Control any application through OS accessibility trees with structured JSON output and deterministic element refs. observed · 2026-09-03
Health v2 · maintenance only
82/100
- Activity 100
- Release rhythm 99
- Longevity 13
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: 1
- age_days: 195
- days_rel: 6
- days_push: 0
- n_releases_24m: 36
Adoption not part of the score
1034 stars · 70 forks observed · 2026-09-03
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded
A native Rust CLI that lets AI agents control desktop applications through OS accessibility trees, returning structured JSON with deterministic element references instead of screenshots. It also ships a C-ABI library for embedding from other languages and MCP integration.
Use cases
- let an AI agent click buttons and fill forms in native desktop apps
- automate macOS applications without pixel-based screenshot matching
- give an LLM agent structured access to a GUI's accessibility tree
- reduce token usage when agents observe dense desktop UIs
- drive desktop apps from Python or Swift via a C-ABI library
- build computer-use agents that interact with any application
When to choose
- you need deterministic, structured UI element references for agent-driven desktop automation
- you want to avoid brittle screenshot/pixel-matching approaches
- you're on macOS and want a fast single-binary CLI with MCP support
When to avoid
- you need cross-platform desktop automation beyond macOS
- you're automating web apps, where browser automation tools fit better
- you need pixel-level visual verification of the UI
Facets
cli-tool · maturity active
cli workflow-automation mcp developer-tools developer-tools accessibility operating-systems cli rust desktop-automation accessibility-tree ai-agents mcp-server gui-automation structured-output automation macos
1 source
- readme: https://github.com/lahfir/agent-desktop · fetched 2026-09-03 · dd9981501b7c
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| lahfir/agent-desktop | main | 82 |
For agents
markdown · JSON · MCP: product_card(name="lahfir/agent-desktop")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem