simular-ai/Agent-S

Health v2 · maintenance only

Adoption not part of the score

12193 stars · 1424 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Agent S is an open-source agentic framework that uses multimodal LLMs to operate computers like a human, controlling GUIs via clicking, typing, and screen understanding. It includes an Agent-Computer Interface, planning, memory, and self-improving in-context learning, and has surpassed human performance on the OSWorld benchmark.

Use cases

• automate desktop tasks by controlling the mouse and keyboard with an AI agent
• build a computer-use agent that operates GUI applications
• run an AI agent that completes tasks on Windows, macOS, or Linux
• benchmark GUI agents on OSWorld
• automate repetitive clicking and typing workflows with LLMs
• build agents that see the screen and take actions like a human

When to choose

• you need an open-source computer-use agent that operates GUIs across Windows, macOS, and Linux
• you want a research-backed framework with state-of-the-art OSWorld results
• you want planning, memory, and self-improvement built into a GUI agent

When to avoid

• you only need browser automation rather than full desktop control
• you need a fully deterministic RPA pipeline with predefined actions
• you cannot run or pay for the multimodal LLM backends the agent requires

Facets

framework · maturity active

agent-framework computer-vision rag machine-learning gui artificial-intelligence computer-vision large-language-models windows python cross-platform computer-use gui-agents computer-automation agent-computer-interface mllm osworld in-context-reinforcement-learning screen-understanding ai-agents automation linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="simular-ai/Agent-S")