ROCm/FastFlowLM

Health v2 · maintenance only

Adoption not part of the score

1809 stars · 144 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

FastFlowLM (FLM) is an NPU-first LLM inference runtime purpose-built and deeply optimized for AMD Ryzen AI NPUs (XDNA2), offering an Ollama-like single-command CLI experience. It supports text, vision, audio (Whisper), embedding, and MoE models with context lengths up to 256k tokens in an ultra-lightweight ~17 MB runtime.

Use cases

• run llms locally on amd ryzen ai npu
• ollama alternative for amd npu
• run whisper speech transcription on npu
• run vision models like gemma3 on npu
• serve local llm with openai-compatible api
• power-efficient on-device llm inference without gpu
• run moe models like gpt-oss on npu

When to choose

• you have an AMD Ryzen AI chip with XDNA2 NPU (Strix, Strix Halo, Kraken, Gorgon Point) and want maximum efficiency
• you want a simple Ollama-like CLI for local LLMs without a GPU
• power efficiency and long context (up to 256k) matter more than broad hardware support

When to avoid

• you don't have AMD Ryzen AI NPU hardware
• you need NVIDIA/Apple Silicon or CPU inference
• you need fine-grained control over inference engines like llama.cpp or vLLM

Facets

application · maturity active

llm-inference cli speech-recognition machine-learning http-server large-language-models machine-learning developer-tools speech-processing computer-vision windows cli npu amd-ryzen-ai ollama-alternative on-device-inference local-llm xdna2 moe whisper embeddings linux amd

Member repositories

For agents

markdown · JSON · MCP: product_card(name="ROCm/FastFlowLM")