deepseek-ai/DeepSeek-MoE

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1969 stars · 310 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

DeepSeekMoE 16B is a Mixture-of-Experts language model with fine-grained expert segmentation and shared expert isolation, released with base and chat checkpoints. The repository provides model code, evaluation details, and quick-start instructions for running the model on a single 40GB GPU.

Use cases

• run a mixture-of-experts language model on a single GPU
• research MoE expert specialization architectures
• deploy a 16B parameter chat model without quantization
• compare MoE efficiency against dense 7B models
• fine-tune or evaluate an open MoE base model

When to choose

• you need an open MoE LLM checkpoint for research
• you want to study fine-grained expert segmentation and shared expert isolation
• you have a single 40GB GPU and want a capable chat model

When to avoid

• you need a maintained production LLM stack with active updates
• you lack a GPU with at least 40GB memory
• you need multilingual support beyond English and Chinese

Facets

library · maturity maintenance

machine-learning llm-inference deep-learning large-language-models machine-learning artificial-intelligence python mixture-of-experts model-weights research-model huggingface gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="deepseek-ai/DeepSeek-MoE")