OthersideAI/self-operating-computer
A framework to enable a multimodal model to operate a computer. observed · 2026-08-28
Health v2 · maintenance only
48/100
- Activity 42
- Release rhythm 40
- Longevity 73
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-09-03. Adoption (stars, forks) is never an input.
- gap_med: 0
- age_days: 1033
- days_rel: 551
- days_push: 348
- n_releases_24m: 6
Adoption not part of the score
10291 stars · 1421 forks observed · 2026-08-28
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
A Python framework that lets multimodal LLMs operate a computer by viewing the screen and issuing mouse and keyboard actions to reach a stated objective. It integrates with models like GPT-4o, Gemini Pro Vision, Claude 3, and Qwen-VL and is driven via the `operate` CLI.
Use cases
- automate computer tasks with an ai agent
- let an llm control mouse and keyboard
- computer-use agent framework
- automate gui interactions with gpt-4o
- ai that operates a desktop like a human
- run multimodal model to complete on-screen objectives
When to choose
- you want an open-source computer-use agent that works with multiple multimodal model providers
- you need to automate desktop GUI tasks via screen understanding
- you want a pip-installable CLI for AI-driven OS automation
When to avoid
- you need only browser automation rather than full desktop control
- you cannot grant screen-recording and accessibility permissions to your terminal
- you require a fully sandboxed or headless automation environment
Facets
framework · maturity active
agent-framework workflow-automation computer-vision llm-inference cli artificial-intelligence developer-tools python windows cli computer-use multimodal-models screen-control pyautogui gui-automation ai-agents automation macos linux
1 source
- readme: https://github.com/OthersideAI/self-operating-computer · fetched 2026-08-28 · d64ad4f2b617
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| OthersideAI/self-operating-computer | main | 48 |
For agents
markdown · JSON · MCP: product_card(name="OthersideAI/self-operating-computer")
Data as of 2026-08-30T08:39:29.467469+00:00 · Report a problem