antirez/ds4

Health v2 · maintenance only

Flags: no_releases young

Adoption not part of the score

21807 stars · 2017 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

DwarfStar (ds4) is a self-contained native LLM inference engine written in C, optimized for DeepSeek V4 Flash and PRO and GLM 5.2, with support for Metal, CUDA, and ROCm backends. It includes model loading, prompt rendering, tool calls, KV caching, an HTTP server, and a coding agent, plus tools for GGUF quantization and benchmarking.

Use cases

• run DeepSeek V4 Flash locally on a MacBook with Metal
• serve a multi-user LLM server on old CUDA cards with micro batching
• run large models on machines without enough RAM using SSD streaming
• use tensor parallelism across two Macs with RDMA
• run inference on Strix Halo systems with ROCm
• quantize models to GGUF with imatrix and evaluate quality and speed

When to avoid

• you need a general-purpose GGUF runner for arbitrary models
• you prefer a mature multi-model framework like llama.cpp or vLLM
• you are uncomfortable with AI-assisted developed code

Facets

application · maturity active

llm-inference http-server gpu-computing large-language-models artificial-intelligence self-hosted cli metal cuda rocm deepseek gguf local-inference tensor-parallelism ssd-streaming macos linux gpu web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="antirez/ds4")