microsoft/BitNet

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

40203 stars · 3723 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

bitnet.cpp is Microsoft's official inference framework for 1-bit large language models (BitNet b1.58), providing optimized CPU kernels with GPU support. It enables fast, energy-efficient inference of ternary-quantized LLMs and embedding models on edge devices.

Use cases

• run 1-bit LLMs locally on CPU
• efficient inference of ternary-quantized models on edge devices
• convert and run BitNet embedding models with I2_S kernels
• speed up LLM inference without GPUs
• deploy small language models on resource-constrained hardware

When to choose

• you need to run BitNet b1.58 or 1-bit embedding models efficiently on CPU
• you target edge or low-power hardware for LLM inference
• you want Microsoft's official, optimized kernels for ternary LLMs

When to avoid

• you need to serve standard full-precision or mainstream quantized models (use llama.cpp or vLLM)
• you require broad model-family support beyond BitNet-style ternary models
• you need a managed API rather than a self-hosted inference engine

Facets

library · maturity active

llm-inference machine-learning cli gpu-computing large-language-models machine-learning deep-learning developer-tools cpp python windows cli 1-bit-llm ternary-quantization bitnet cpu-inference edge-inference quantization embeddings linux macos gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/BitNet")