mistralai/mistral-inference

Health v2 · maintenance only

Flags: archived

Adoption not part of the score

10832 stars · 1056 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

The official minimal Python library from Mistral AI for running inference with Mistral open-weight models such as Mistral 7B, Mixtral, Codestral, and Pixtral locally on GPUs. The repository is now archived and no longer actively maintained.

Use cases

• run mistral 7b locally on my gpu
• generate text with mixtral 8x7b
• run codestral for code completion locally
• chat with a mistral instruct model from python
• run pixtral vision model locally
• self-host mistral open weights

When to choose

• you need the official minimal reference implementation for running Mistral open-weight models
• you want a lightweight local inference setup without a heavy serving framework
• you are reproducing tutorials or research based on Mistral model weights

When to avoid

• you need actively maintained software with bug fixes and new model support
• you want production serving with batching, quantization, or an OpenAI-compatible API (use vLLM or similar)
• you have no GPU, since installation requires xformers and a GPU
• you want to use the Mistral cloud API instead of local weights

Facets

library · maturity abandoned

llm-inference machine-learning large-language-models machine-learning artificial-intelligence python mistral open-weights transformers archived chat-models gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="mistralai/mistral-inference")