mistralai/mistral-inference
Some data may be outdated — see provenance labels.
Official inference library for Mistral models observed · 2026-09-22
Health v2 · maintenance only
10/100
- Activity 79
- Release rhythm 8
- Longevity 80
Flags: archived
How is this computed?
round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10) — computed 2026-10-22. Adoption (stars, forks) is never an input.
- gap_med: n/a
- age_days: 1120
- days_rel: 580
- days_push: 127
- n_releases_24m: 1
Adoption not part of the score
10824 stars · 1063 forks observed · 2026-09-22
What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded
The official minimal Python library from Mistral AI for running inference with Mistral open-weight models such as Mistral 7B, Mixtral, Codestral, and Pixtral locally on GPUs. The repository is now archived and no longer actively maintained.
Use cases
- run mistral 7b locally on my gpu
- generate text with mixtral 8x7b
- run codestral for code completion locally
- chat with a mistral instruct model from python
- run pixtral vision model locally
- self-host mistral open weights
When to choose
- you need the official minimal reference implementation for running Mistral open-weight models
- you want a lightweight local inference setup without a heavy serving framework
- you are reproducing tutorials or research based on Mistral model weights
When to avoid
- you need actively maintained software with bug fixes and new model support
- you want production serving with batching, quantization, or an OpenAI-compatible API (use vLLM or similar)
- you have no GPU, since installation requires xformers and a GPU
- you want to use the Mistral cloud API instead of local weights
Facets
library · maturity abandoned
llm-inference machine-learning large-language-models machine-learning artificial-intelligence python mistral open-weights transformers archived chat-models gpu linux
7 sources
- readme: https://github.com/mistralai/mistral-inference · fetched 2026-09-22 · d3102c41556e
- homepage: https://mistral.ai/ · fetched 2026-08-29 · f0b4c411ac9d
- site_page: https://docs.mistral.ai · fetched 2026-08-29 · e616637c1e71
- site_page: https://mistral.ai/about · fetched 2026-08-29 · de97b67551c6
- site_page: https://mistral.ai/pricing · fetched 2026-08-29 · eff2324488f8
- site_page: https://mistral.ai/pricing/api · fetched 2026-08-29 · 246e18e81945
- site_page: https://mistral.ai/pricing/enterprise-deployments · fetched 2026-08-29 · a067af91b924
Member repositories
| Repository | Role | Health v2 |
|---|---|---|
| mistralai/mistral-inference | main | 10 |
For agents
markdown · JSON · MCP: product_card(name="mistralai/mistral-inference")
Data as of 2026-10-19T08:05:51.212177+00:00 · Report a problem