Open-source large-language-models software

3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

3737 products, primary matches first, then adoption-weighted; health v2 shown.

Product	Health v2	Stars	Maturity
OpenClaw OpenClaw is an open‑source AI assistant that runs on your own hardware and connects to dozens of chat platforms. It provides a gateway, plu…	80	392291	active
ECC ECC is an open‑source agent harness operating system that provides skills, agents, and security rules for LLM‑powered coding assistants. It…	83	276571	stable
Hermes Agent Hermes Agent is an open‑source autonomous AI agent that runs on the command line or as a native desktop app. It continuously learns from in…	86	254714	active
deepseek-ai/deepseek-harness DeepSeek Harness is an open‑source framework for building AI agents using a fully pluggable architecture. It provides a CLI and web UI to c…	66	247609	active
OpenCode OpenCode is an open source AI coding agent that helps developers write code from the terminal, desktop app, or IDE extension. It supports 7…	83	215433	active
AutoGPT AutoGPT is an open‑source platform that lets users describe a goal in plain English and automatically builds, runs, and monitors AI agents …	94	187630	active
AutoGPT AutoGPT is an open-source platform for building, deploying, and running AI agents that execute complete workflows, via natural-language cha…	94	187630	active
Ollama Ollama is a local server and CLI tool for running and managing open large language models. It provides a REST API, integrations with coding…	93	183649	active
f/prompts.chat prompts.chat is an open‑source web application that hosts the world’s largest curated library of AI prompts. It can be self‑hosted for priv…	77	172880	active
Transformers Hugging Face Transformers is a Python library that serves as the model-definition framework for state-of-the-art machine learning models ac…	95	167798	stable
DietrichGebert/ponytail Ponytail is a JavaScript library that provides a ruleset for AI coding agents to write the minimal amount of code needed. It integrates wit…	81	166288	active
Dify Dify is an open‑source platform for building production‑ready AI agents, RAG pipelines and agentic workflows with a visual no‑code studio. …	92	158944	active
langflow-ai/langflow Langflow is an open‑source Python‑based platform that provides a visual low‑code editor for building, testing, and deploying AI agents and …	95	155852	active
Open WebUI Open WebUI is a self‑hosted, web‑based interface for interacting with large language models. It supports local Ollama models, OpenAI‑compat…	88	152948	active
LangChain LangChain is an open-source Python library for building LLM-powered applications and autonomous agents. It provides composable components, …	95	148099	active
LangChain LangChain is an open-source Python framework for building LLM-powered agents and applications, providing a configurable agent harness (crea…	95	148099	stable
farion1231/cc-switch CC Switch is a cross-platform desktop application (built with Tauri and Rust) that acts as an all-in-one manager for AI coding CLI agents s…	85	143857	active
ggml-org/llama.cpp llama.cpp is a high-performance C/C++ library for running large language models locally. It provides both a library API and ready-to-use co…	93	131193	active
Pi Pi is a TypeScript toolkit that provides a unified multi‑provider LLM API, an agent runtime with tool calling, and a terminal‑based coding …	82	115982	active
Pi Pi is a TypeScript AI agent toolkit providing a unified multi-provider LLM API, an agent runtime with tool calling, a terminal UI library, …	82	115982	active
JuliusBrussee/caveman Caveman is a set of tools that reduce token usage of AI coding agents by applying a skill that strips filler and a local proxy that compres…	82	113485	active
TradingAgents TradingAgents is a Python framework that enables multi‑agent LLM‑driven financial trading strategies. It provides data access contracts, mo…	87	109273	active
TradingAgents TradingAgents is a Python framework that orchestrates multiple LLM-powered agents to analyze financial markets and make trading decisions. …	87	109273	active
deepseek-ai/DeepSeek-V3 Official repository for DeepSeek-V3, a 671B-parameter Mixture-of-Experts language model (37B activated per token) with open weights, infere…	26	104498	active
karpathy/autoresearch A framework by Andrej Karpathy where AI agents autonomously run LLM research experiments on a single-GPU nanochat training setup. The agent…	45	98112	active
vLLM vLLM is a Python library that provides fast, high‑throughput inference and serving for large language models. It supports advanced features…	98	94014	active
vLLM vLLM is a high-throughput, memory-efficient inference and serving engine for large language models, featuring PagedAttention, continuous ba…	98	94014	active
deepseek-ai/DeepSeek-R1 DeepSeek-R1 is a family of open-weight large language models trained with large-scale reinforcement learning for reasoning, including DeepS…	21	91900	active
NextChat NextChat is an open‑source, cross‑platform AI chat assistant that lets users interact with many LLMs (GPT‑5, Claude, Gemini, etc.) without …	73	88834	active
NextChat NextChat is a lightweight, fast open-source AI chat assistant web UI supporting multiple LLM providers like OpenAI GPT-4, Claude, Gemini, D…	73	88834	active
Odysseus AI Workspace Odysseus is a self‑hosted AI workspace that combines chat, agents, document editing, email, notes, and calendar features with local model s…	57	87526	active
Odysseus AI Workspace Odysseus is a self-hosted, privacy-first AI workspace that combines chat, autonomous agents, tools/MCP integration, model serving, and deep…	57	87526	active
Egonex-AI/Understand-Anything Understand Anything turns codebases, knowledge bases, and docs into interactive knowledge graphs that can be explored, searched, and querie…	77	86084	active
bytedance/deer-flow DeerFlow is an open‑source super‑agent harness that lets you compose, run, and manage complex AI agent workflows with memory, tools, and sa…	82	84032	active
LobeHub LobeHub is a web‑based platform that lets you hire, schedule, and monitor a team of AI agents 24/7. It provides a unified workspace for bui…	94	83367	active
opendatalab/MinerU MinerU is a document parsing tool that converts PDFs, images, DOCX, PPTX, and XLSX files into machine-readable Markdown and JSON. It handle…	86	80546	active
abi/screenshot-to-code An AI-powered application that converts screenshots, mockups, Figma designs, and screen recordings into clean functional code (HTML/Tailwin…	71	80005	active
Elasticsearch Elasticsearch is a free and open source, distributed, RESTful search and analytics engine built on Apache Lucene. It stores structured, uns…	95	78300	stable
Unsloth Unsloth is an open‑source desktop application that lets you run, fine‑tune and deploy large language models and diffusion models locally. I…	90	78197	active
OmniRoute OmniRoute is an open‑source AI gateway that provides a single OpenAI‑compatible endpoint routing requests across hundreds of LLM providers.…	78	77757	active
OmniRoute OmniRoute is a free, MIT-licensed AI gateway that exposes a single OpenAI-compatible endpoint routing to 350+ LLM providers (90+ with free …	78	77757	active
GPT4All GPT4All is an open‑source desktop application that runs large language models locally on Windows, macOS and Linux. It provides a private AI…	39	77391	active
BettaFish MiroFish is a Python-based swarm intelligence prediction engine that builds high-fidelity parallel digital worlds populated by thousands of…	67	76494	active
ruvnet/ruflo Ruflo is an open-source agent meta-harness for deploying multi-agent swarms and coordinating autonomous AI workflows, with adaptive memory,…	83	76107	active
hiyouga/LlamaFactory LlamaFactory is an open‑source Python platform that streamlines fine‑tuning, quantization, and inference of over 100 LLM and VLM models. It…	81	75500	active
headroomlabs-ai/headroom Headroom is a Python/TypeScript library and proxy server that compresses tool outputs, logs, files, and RAG chunks before they are sent to …	79	75458	active
binary-husky/gpt_academic GPT Academic is a self-hosted Python application providing a practical chat interface for LLMs like GPT, GLM, Qwen, DeepSeek, and Claude, w…	47	71417	active
FoundationAgents/MetaGPT MetaGPT is an open‑source Python library that provides a multi‑agent framework for orchestrating LLMs as product managers, architects, engi…	45	70839	active
Open Interpreter 01 Open Interpreter is a terminal‑based coding agent that lets you interact with large language models to write, run, and debug code. It provi…	96	68541	active
Open Interpreter 01 Open Interpreter is a Rust-based terminal coding agent optimized for low-cost open models like Kimi K3, DeepSeek, and Qwen. It emulates pro…	96	68541	active
xtekky/gpt4free GPT4Free (g4f) is a Python-based application that aggregates multiple free LLM providers and offers a unified interface. It includes a web …	93	66757	active
AnythingLLM AnythingLLM is an all‑in‑one self‑hosted AI application that lets you chat with your documents, run AI agents, and use local LLMs. It provi…	96	66696	active
AnythingLLM AnythingLLM is an all-in-one, local-first AI application for chatting with your documents, running AI agents, and building workflows entire…	96	66696	active
mem0ai/mem0 Mem0 provides a drop‑in memory infrastructure for AI agents and applications, enabling persistent, token‑efficient context across sessions.…	89	65721	active
virattt/ai-hedge-fund An educational AI-powered hedge fund simulator where LLM-driven agents modeled after famous investors analyze stocks and make simulated tra…	87	63827	active
upstash/context7 Context7 is a platform that provides up-to-date, version‑specific code documentation and examples directly to LLMs and AI code editors. It …	81	62588	active
mvanhorn/last30days-skill last30days is an AI agent skill that aggregates content from Reddit, X, YouTube, Hacker News, Polymarket and other web sources, then synthe…	80	62570	active
Pathway Live Data Framework Pathway is a Python ETL framework designed for stream processing, real-time analytics, and building LLM pipelines. It provides a high‑level…	94	62243	active
LiteLLM LiteLLM is an open‑source Python library and self‑hosted gateway that provides a single OpenAI‑compatible interface to call 100+ LLM provid…	93	61456	active
LiteLLM LiteLLM is an open-source AI gateway and Python SDK that provides a unified OpenAI-format interface to 100+ LLM providers (OpenAI, Anthropi…	93	61456	active
Alishahryar1/free-claude-code Free Claude Code is an open‑source Python CLI and library that lets you access multiple LLM coding agents (Claude, Codex, Pi, OpenCode, etc…	79	61286	active
MadsLorentzen/ai-job-search An AI-powered job application framework built on Claude Code that runs locally: it evaluates job postings, tailors CVs, writes cover letter…	83	60836	active
MemPalace/mempalace MemPalace is a local‑first AI memory system that stores conversation and project data verbatim and makes it searchable via semantic search.…	82	59621	active
CrewAI CrewAI is an open‑source Python framework for building and orchestrating collaborative AI agents. It provides high‑level abstractions for c…	90	59546	active
karpathy/nanochat nanochat is a minimal, hackable full-stack LLM training harness that covers tokenization, pretraining, finetuning, evaluation, and inferenc…	59	58750	active
FoundationAgents/OpenManus OpenManus is an open-source framework for building general-purpose AI agents, created by the MetaGPT team as an open alternative to Manus. …	66	58639	active
zylon-ai/private-gpt PrivateGPT is an open‑source API framework that turns locally hosted LLMs into production‑grade AI services. It provides a Claude‑style API…	90	57558	active
goose goose is an open-source, extensible general-purpose AI agent built in Rust that runs locally as a desktop app, CLI, and API. It connects to…	86	55171	active
CLIProxyAPI A Go-based proxy server that exposes OpenAI/Gemini/Claude/Codex-compatible API endpoints backed by CLI AI assistant accounts (Claude Code, …	82	54756	active
BMad Method BMAD-METHOD is an open-source framework and methodology for Agile AI-driven development, providing structured agents and workflows that tur…	87	54038	active
Cherry Studio Cherry Studio is a cross‑platform desktop client that provides a unified AI workstation with smart chat, autonomous agents, and hundreds of…	88	52721	active
LlamaIndex LlamaIndex is an open‑source framework for building LLM‑powered applications that ingest, parse, and index documents. It provides tools for…	93	52325	active
moeru-ai/airi Project AIRI is an open-source, self-hosted AI companion (waifu/virtual character) platform inspired by Neuro-sama, supporting Live2D and V…	87	50294	active
LocalAI LocalAI is an open‑source AI runtime that provides a single binary exposing OpenAI‑compatible APIs for text, vision, audio, and video model…	93	49392	active
LocalAI LocalAI is an open-source, self-hosted AI inference runtime that runs LLMs, vision, speech, image, and video models behind OpenAI/Anthropic…	93	49392	active
Aider Aider is an open-source CLI tool that lets developers pair program with LLMs (Claude, GPT-4o, DeepSeek, Gemini, local models) directly in t…	66	49387	active
HKUDS/nanobot nanobot is an ultra‑lightweight, open‑source AI agent framework written in Python. It provides a WebUI, terminal, and chat‑app interfaces w…	82	49064	active
New API New API is a self-hosted LLM gateway and AI asset management system that aggregates 30+ model providers behind a single unified endpoint. I…	88	48905	active
exo-explore/exo exo is a Python application that turns a collection of devices (Macs, GPUs, etc.) into a distributed AI cluster for running large language …	82	47847	active
oobabooga/textgen TextGen is an open-source desktop application for running large language models locally with full privacy and no telemetry. It provides a c…	83	47700	active
zhayujie/CowAgent CowAgent is an open‑source AI assistant and agent harness that can plan tasks, run tools and custom skills, and maintain a personal knowled…	98	47220	active
LibreChat LibreChat is an open‑source, self‑hosted ChatGPT‑style web application written in TypeScript. It provides a unified UI for multiple LLM pro…	85	46021	active
LibreChat LibreChat is an open-source, self-hosted web application providing a unified ChatGPT-style interface for multiple AI providers (OpenAI, Ant…	85	46021	active
janhq/jan Jan is an open‑source desktop application that provides a ChatGPT‑like experience running large language models locally. It includes a GUI,…	96	44984	active
vectorize-io/hindsight Hindsight is an open-source agent memory system that gives AI agents persistent long-term memory that learns and consolidates knowledge ove…	78	44347	active
Wei-Shaw/sub2api Sub2API is a self-hosted AI API gateway written in Go that converts Claude, OpenAI, Gemini, and Grok subscriptions into unified API access.…	80	44264	active
LifeOS Fabric is an open-source framework for augmenting humans with AI by organizing crowdsourced AI prompts (called patterns) into a modular, re…	89	44214	active
ray-project/ray Ray is a unified open-source framework for scaling AI and Python applications, consisting of a core distributed runtime (tasks, actors, obj…	99	44057	stable
chatanywhere/GPT_API_free GPT_API_free is a hosted API service that provides free access to multiple large language models such as GPT, DeepSeek, Claude, Gemini, and…	72	43890	active
LangGraph LangGraph is a low‑level Python library for building, managing, and deploying long‑running, stateful agents. It provides durable execution,…	92	43532	active
LangGraph LangGraph is a low-level orchestration framework and runtime for building, managing, and deploying long-running, stateful AI agents in Pyth…	92	43532	stable
JustVugg/colibri Colibrì is a pure C inference engine that runs frontier Mixture-of-Experts language models by streaming weights from disk. It provides CLI …	81	42762	active
Agno Agno is a Python‑based SDK and runtime for building, deploying, and managing AI agent platforms. It provides a full stack—from agent defini…	95	42675	active
BettaFish MiroFish is a Python‑based multi‑agent AI engine that creates a high‑fidelity digital twin of real‑world scenarios. It lets users inject se…	75	42341	active
chatboxai/chatbox Chatbox is a cross‑platform desktop and mobile client for interacting with LLMs such as ChatGPT, Claude, Gemini and others. It provides a G…	96	41982	active
tinyhumansai/openhuman OpenHuman is a native desktop application that provides a personal AI super‑intelligence with built‑in agent orchestration and memory manag…	78	41842	active
AstrBot AstrBot is an open-source AI agent assistant and development framework written in Python. It provides multi‑platform LLM chatbots with plug…	95	41689	active
AstrBot AstrBot is a multi-platform LLM chatbot and agentic AI assistant development framework written in Python. It integrates many instant messag…	95	41689	active
HKUDS/DeepTutor DeepTutor is an open‑source, agentic framework that combines large language models with retrieval‑augmented generation to deliver lifelong,…	79	41457	active
hpcaitech/ColossalAI ColossalAI is a Python library that provides efficient parallelization techniques for training large deep learning models. It supports data…	75	41430	active