Andyyyy64/whichllm

Health v2 · maintenance only

Adoption not part of the score

6488 stars · 354 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

whichllm is a Python CLI tool that auto-detects your GPU, CPU, and RAM, then ranks local LLMs from HuggingFace that will actually run and perform well on your hardware. It uses recency-aware benchmarks rather than parameter count and supports simulating GPUs before purchase.

Use cases

• find the best local LLM that runs on my GPU
• recommend a model that fits my VRAM
• check which LLM my hardware can run before buying a GPU
• compare models for RTX 4090 vs RTX 5090
• find what GPU I need to run llama 3 70b
• get a list of fast local models for my machine

When to choose

• you want a one-command recommendation for local LLMs matched to your hardware
• you're deciding which GPU to buy and want to simulate its model capacity
• you want recency-aware rankings instead of guessing by parameter count

When to avoid

• you need to actually serve or deploy models at scale rather than pick one
• you want cloud/API model recommendations
• you need fine-grained benchmarking of inference throughput on your own workloads

Facets

cli-tool · maturity active

llm-inference cli developer-tools large-language-models machine-learning developer-tools cli python cross-platform windows local-llm hardware-recommendation gpu vram huggingface model-selection benchmarking command-line macos linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Andyyyy64/whichllm")