MiaAI-Lab/DeepSeek-v4-Flash-DSpark-2x-DGX-Spark resource

Health v2 · maintenance only

Flags: no_releases young

Adoption not part of the score

1176 stars · 165 forks observed · 2026-09-03

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A deployment recipe for serving DeepSeek-V4-Flash-0731 across two NVIDIA DGX Spark nodes using vLLM with tensor parallelism and DSpark speculative decoding. It provides environment configuration, weight caching scripts, and validation tooling for a two-node inference cluster.

Use cases

• serve deepseek v4 flash on two dgx spark nodes
• run vllm with tensor parallelism across multiple machines
• set up speculative decoding for faster llm inference
• deploy a large language model on a small gpu cluster
• configure nccl networking for multi-node inference
• self-host deepseek models with 1m token context

When to choose

• you own two DGX Spark devices and want a tested serving recipe
• you need high-throughput DeepSeek V4 Flash inference with long context
• you want preconfigured vLLM multi-node deployment scripts

When to avoid

• you have a single GPU or non-DGX hardware
• you need training or fine-tuning rather than inference
• you want a general-purpose serving stack rather than a model-specific recipe

Facets

infra-config · maturity active

llm-inference deployment gpu-computing developer-tools large-language-models gpu-computing self-hosted infrastructure-as-code self-hosted python vllm dgx-spark speculative-decoding deepseek multi-node tensor-parallelism recipe linux docker gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="MiaAI-Lab/DeepSeek-v4-Flash-DSpark-2x-DGX-Spark")