janhq/awesome-local-ai resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

2016 stars · 269 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A curated awesome-list of open-source and local AI tools, focused on local LLM inference engines, UIs, and related solutions. It catalogs projects like llama.cpp, Ollama, and vLLM with comparisons of model formats, hardware support, and platforms.

Use cases

• find tools to run LLMs locally
• compare local LLM inference engines
• discover open-source AI software
• find local AI alternatives to cloud services
• research which model formats each inference engine supports
• find local LLM tools with a web UI

When to choose

• you want a curated starting point for the local AI ecosystem
• you need to compare inference engines by format, CPU/GPU support, and UI
• you prefer self-hosted, offline AI tools

When to avoid

• you need a runnable tool rather than a list of links
• you need cloud-based or managed AI services
• you need guaranteed up-to-date information, since curated lists can lag behind

Facets

learning-resource · maturity active

llm-inference developer-tools artificial-intelligence large-language-models awesome-lists self-hosted cross-platform cli awesome-list local-ai curated-list llm-tools open-source-ai desktop

Member repositories

For agents

markdown · JSON · MCP: product_card(name="janhq/awesome-local-ai")