0xSojalSec/LLMs-local resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1087 stars · 126 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A curated awesome-list of platforms, tools, models, and resources for running large language models locally. It covers inference engines, UIs, agent frameworks, RAG, fine-tuning, hardware, and tutorials.

Use cases

• find tools to run llms locally
• compare local llm inference engines like ollama and llama.cpp
• discover offline chatgpt alternatives
• find agent frameworks and rag tools for local models
• learn how to fine-tune models on my own hardware
• pick hardware for a local llm rig

When to choose

• you want a curated starting point for the local LLM ecosystem
• you need to discover tools across inference, agents, RAG, and hardware in one place

When to avoid

• you need runnable software rather than a list of links
• you need a maintained tool with a license and support rather than a reference list

Facets

learning-resource · maturity active

llm-inference rag agent-framework mcp llm-training developer-tools large-language-models artificial-intelligence self-hosted awesome-lists tutorials cross-platform self-hosted awesome-list local-llm curated-resources inference offline-ai gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="0xSojalSec/LLMs-local")