microsoft/Magma

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1937 stars · 163 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Magma is Microsoft Research's foundation model for multimodal AI agents, released as an 8B vision-language model that understands images and videos and generates goal-driven action plans. The repository provides model weights, inference code, and training tooling for agentic tasks across digital UIs and physical environments.

Use cases

• build a UI navigation agent that clicks through apps and websites
• control a robot arm for manipulation tasks from visual input
• run spatial reasoning and video understanding on images and video
• fine-tune a multimodal agent model on my own agentic trajectories
• evaluate a single model across GUI, robotics, and VQA benchmarks

When to choose

• you need one multimodal model that spans UI navigation, robotics, and image/video understanding
• you want a research-grade open-weights VLM agent foundation with MIT licensing
• you're reproducing or extending CVPR 2025 agentic AI research

When to avoid

• you need a lightweight model for CPU-only or edge deployment
• you want a production-ready turnkey agent product rather than a research model
• your task is text-only and doesn't benefit from vision

Facets

library · maturity active

machine-learning deep-learning agent-framework computer-vision nlp artificial-intelligence computer-vision large-language-models robotics python multimodal foundation-model ui-navigation robot-manipulation vision-language-model cvpr-2025 ai-agents gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/Magma")