alibaba/MNN

Health v2 · maintenance only

Adoption not part of the score

15973 stars · 2417 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

MNN is a lightweight, high-performance deep learning inference engine developed by Alibaba, supporting LLMs, vision, audio, and multimodal models on mobile and embedded devices. It includes backends for CPU, GPU (Vulkan, Metal), and Qualcomm Hexagon DSPs, plus companion apps like MNN Chat for on-device LLMs.

Use cases

• run LLMs locally on Android or iOS phones
• deploy deep learning models on embedded ARM devices
• accelerate inference with Vulkan or Hexagon DSP backends
• build an offline chatbot app with on-device ASR and TTS
• run vision models like image editing on mobile
• convert and quantize models for edge deployment

When to choose

• you need fast on-device inference on mobile or embedded hardware
• you want to run LLMs, ASR, TTS, or vision models fully offline
• you need broad backend support including GPU and DSP acceleration
• you want a battle-tested engine with production use at Alibaba

When to avoid

• you need server-side GPU training or fine-tuning rather than inference
• you want a Python-first training framework like PyTorch
• your target is cloud deployment with abundant compute
• you need a model training pipeline, not a runtime

Facets

library · maturity active

llm-inference machine-learning deep-learning computer-vision speech-recognition tts gpu-computing deep-learning machine-learning large-language-models mobile-development embedded-systems computer-vision cross-platform cpp embedded on-device-inference edge-ai mobile-llm vulkan qualcomm-hexagon transformer android ios gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="alibaba/MNN")