OpenBMB/AgentCPM-GUI

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1407 stars · 133 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

AgentCPM-GUI is an open-source 8B-parameter on-device GUI agent built on MiniCPM-V that takes Android screenshots as input and autonomously executes user tasks. It is fine-tuned for Chinese and English apps and enhanced with reinforcement fine-tuning for improved planning and reasoning.

Use cases

• automate tasks on android apps from screenshots
• build a gui agent that operates chinese apps like dianping and bilibili
• run an on-device llm agent for phone automation
• ground ui elements like buttons and input boxes from screenshots
• evaluate gui agents on android task benchmarks
• fine-tune a multimodal model for app automation with rft

When to choose

• you need an open-source gui agent optimized for chinese android apps
• you want on-device inference with a compact 8b model and short action sequences
• you need screenshot-based ui grounding and task execution

When to avoid

• you need to automate ios or desktop applications
• you lack a gpu for model inference
• you need a no-code automation tool rather than a model and codebase

Facets

library · maturity active

machine-learning agent-framework computer-vision llm-inference reinforcement-learning artificial-intelligence mobile-development python gui-agent on-device-llm android-automation screen-understanding reinforcement-fine-tuning multimodal ai-agents natural-language-processing android gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="OpenBMB/AgentCPM-GUI")