microsoft/Llama-2-Onnx

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1026 stars · 94 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Microsoft's optimized ONNX export of Meta's Llama 2 models (7B and 13B, pretrained and fine-tuned, float16/float32), distributed via Git submodules with example code for running inference. It enables running Llama 2 with ONNX Runtime instead of the original PyTorch weights.

Use cases

• run llama 2 with onnx runtime
• convert llama 2 to onnx format
• text generation with llama 2 on cpu or gpu
• deploy llama 2 without pytorch
• try llama 2 inference examples
• benchmark llama 2 onnx performance

When to choose

• you want to run Llama 2 using ONNX Runtime for optimized inference
• you need pretrained or fine-tuned 7B/13B Llama 2 weights in ONNX format
• you want a minimal example of LLM text completion with ONNX

When to avoid

• you need other LLMs than Llama 2
• you want to fine-tune or train models rather than run inference
• you cannot accept the gated access and Llama Community License restrictions
• you need the latest models like Llama 3

Facets

library · maturity maintenance

llm-inference machine-learning deep-learning large-language-models machine-learning developer-tools python cross-platform onnx llama-2 model-optimization inference microsoft

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/Llama-2-Onnx")