rafska/awesome-local-llm resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

2787 stars · 362 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A curated awesome-list of platforms, tools, models, tutorials, and resources for running large language models locally on your own hardware. It covers inference platforms, UIs, agent frameworks, RAG tooling, fine-tuning, and hardware guidance.

Use cases

• find tools to run LLMs offline on my own machine
• discover local alternatives to ChatGPT
• compare local LLM inference platforms
• learn how to self-host large language models
• find RAG and agent frameworks for local models
• get started with local AI on my GPU

When to choose

• you want a starting point to discover the local LLM ecosystem
• you need curated links to self-hosted AI tools and tutorials
• you're evaluating options for running models offline

When to avoid

• you need a runnable tool rather than a directory of links
• you want cloud-hosted or API-based LLM solutions
• you need in-depth reviews rather than brief descriptions

Facets

learning-resource · maturity active

llm-inference rag agent-framework developer-tools large-language-models artificial-intelligence self-hosted awesome-lists self-hosted cross-platform awesome-list local-llm curated-resources offline-ai

Member repositories

For agents

markdown · JSON · MCP: product_card(name="rafska/awesome-local-llm")