Tencent/ncnn

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

23753 stars · 4492 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

ncnn is a high-performance neural network inference framework written in C++ and optimized for mobile, embedded, and desktop deployment. It has no third-party runtime dependencies, supports CPU and Vulkan GPU backends, and includes tools like pnnx for converting PyTorch and ONNX models.

Use cases

• run deep learning models on android and ios apps
• deploy neural network inference on edge devices without dependencies
• convert pytorch or onnx models to a mobile-friendly format
• accelerate inference with vulkan gpu on phones and pcs
• run computer vision models like object detection on mobile
• embed neural network inference in c++ applications

When to choose

• you need fast on-device inference on mobile or embedded hardware
• you want a dependency-free c++ inference runtime
• you need cpu (arm neon) and vulkan gpu support
• you are deploying models in production mobile apps

When to avoid

• you need training or fine-tuning, not just inference
• you want a python-first workflow with rich ecosystem tooling
• you need large transformer/llm serving features out of the box
• you prefer a framework with extensive prebuilt model zoo and cloud integration

Facets

library · maturity stable

machine-learning llm-inference computer-vision image-processing gpu-computing deep-learning artificial-intelligence mobile-development embedded-systems cross-platform cpp cross-platform wasm windows embedded neural-network-inference vulkan arm-neon simd model-conversion pnnx onnx pytorch edge-deployment mobile-ai android ios mobile desktop linux macos gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Tencent/ncnn")