TencentQQGYLab/AppAgent

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

6896 stars · 759 forks observed · 2026-09-30

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

AppAgent is an LLM-based multimodal agent framework that operates smartphone apps through human-like interactions such as tapping and swiping, using vision-language models like GPT-4V. It builds a knowledge base via autonomous exploration or observing human demonstrations, enabling task execution across diverse Android applications without system back-end access.

Use cases

• automate tasks on android apps with an llm agent
• control a smartphone using gpt-4v vision
• build a gui agent that taps and swipes like a human
• let an ai agent explore and learn new mobile apps
• run smartphone app tasks from an android emulator
• test mobile app ui flows with an autonomous agent

When to choose

• you want an open-source multimodal agent to operate android apps via the gui
• you need an agent that learns app navigation through exploration or human demos
• you want to research or extend llm-based smartphone automation

When to avoid

• you need to automate ios or desktop applications
• you require system-level or back-end api automation rather than gui interaction
• you need a production-ready, fully supported product rather than a research framework

Facets

framework · maturity active

agent-framework machine-learning computer-vision llm-inference workflow-automation artificial-intelligence large-language-models mobile-development python cross-platform multimodal-agent gui-agent gpt4v smartphone-automation android llm-agent ui-automation ai-agents automation

Member repositories

For agents

markdown · JSON · MCP: product_card(name="TencentQQGYLab/AppAgent")