danveloper/flash-moe

Health v2 · maintenance only

Flags: no_releases young no_license

Adoption not part of the score

4086 stars · 510 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

An application for running large language models locally on small laptops, written in Objective-C. It enables on-device inference of big models on consumer hardware.

Use cases

• run a large language model on my laptop
• run big LLM locally without a GPU server
• on-device inference of mixture-of-experts models
• chat with a large model offline on a Mac
• run MoE models on Apple Silicon

When to choose

• you want to run large models on consumer laptop hardware
• you prefer native macOS performance without cloud dependency
• you need offline, private LLM inference

When to avoid

• you need multi-GPU or datacenter-scale serving
• you want a cross-platform Linux/Windows-first tool
• you need fine-tuning or training capabilities

Facets

application · maturity active

llm-inference machine-learning large-language-models machine-learning gpu-computing cpp mixture-of-experts on-device-inference apple-silicon quantization macos desktop

Member repositories

For agents

markdown · JSON · MCP: product_card(name="danveloper/flash-moe")