apache/tvm

Health v2 · maintenance only

Adoption not part of the score

13691 stars · 3959 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

Apache TVM is an open machine learning compiler framework that takes pre-trained models and compiles them into optimized, deployable modules with minimal runtimes. It follows a Python-first development model and supports universal deployment from data center GPUs to edge devices.

Use cases

• compile a trained PyTorch model for deployment on edge devices
• optimize deep learning model inference for a specific GPU
• generate minimal deployable runtime modules from ML models
• auto-tune tensor kernels for custom hardware backends
• deploy LLM inference with a compiled minimal runtime
• cross-compile models for embedded or mobile targets
• customize ML compiler pipelines in Python

When to choose

• you need to deploy ML models across diverse hardware (GPU, CPU, mobile, embedded)
• you want minimal runtime overhead and small deployable artifacts
• you need to optimize or auto-tune kernels for custom or emerging hardware
• you want a Python-first compiler API to customize compilation pipelines

When to avoid

• you just need a simple inference runtime without compilation or tuning
• your target is only mainstream hardware well-served by vendor libraries like cuDNN or TensorRT
• you need a plug-and-play solution with minimal compiler expertise on the team

Facets

framework · maturity active

compiler machine-learning llm-inference gpu-computing benchmarking machine-learning compilers deep-learning gpu-computing performance python cpp windows cross-platform wasm ml-compilation tensor-compiler code-generation model-deployment auto-tuning tensorir relax edge-deployment opencl vulkan metal rocm spirv linux macos gpu android ios

Member repositories

For agents

markdown · JSON · MCP: product_card(name="apache/tvm")