AlexsJones/llmfit

Health v2 · maintenance only

Adoption not part of the score

37664 stars · 2417 forks observed · 2026-10-07

What it is AI-extracted, prompt v1, taxonomy v1, 2026-09-28, confidence 0.97

llmfit is a Rust‑based command‑line and TUI tool that inspects your system’s CPU, RAM, GPU and other accelerators to recommend which open‑source LLMs can run comfortably. It also provides a lightweight REST API for programmatic queries and benchmarking of model performance.

Use cases

• determine which LLM models fit within my laptop’s memory and GPU constraints
• benchmark token‑per‑second throughput of a downloaded model on my hardware
• quickly compare model sizes and quantizations before downloading
• expose a local API to query compatible models from other tools
• share measured performance numbers with the community

When to choose

• you need a fast, offline way to match LLMs to your current hardware
• you prefer a terminal UI or simple REST endpoint over heavyweight orchestration
• you want to contribute real‑world benchmark data back to the project

When to avoid

• you require a production‑grade serving solution with scaling and monitoring
• your hardware uses unsupported accelerators or proprietary drivers
• you need integrated model training or fine‑tuning capabilities

Facets

cli-tool · maturity active

cli http-server artificial-intelligence large-language-models windows cli hardware-detection model-compatibility tui benchmarking gguf quantization linux macos web-server

Member repositories

For agents

markdown · JSON · MCP: product_card(name="AlexsJones/llmfit")