Open-source large-language-models software

3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

3737 products, primary matches first, then adoption-weighted; health v2 shown.

Product	Health v2	Stars	Maturity
lfnovo/open-notebook Open Notebook is an open-source, privacy-focused alternative to Google's Notebook LM that lets users organize multi-modal sources (PDFs, vi…	90	40397	active
BitNet BitNet is a C++ inference framework for 1-bit large language models, providing both CPU and GPU kernels. It enables ultra‑low‑memory, high‑…	62	40295	active
BitNet bitnet.cpp is Microsoft's official inference framework for 1-bit large language models (BitNet b1.58), providing optimized CPU kernels with…	62	40295	active
HKUDS/LightRAG LightRAG is a Python library that implements a simple and fast Retrieval-Augmented Generation framework using graph structures and vector e…	84	40153	active
THU-MAIC/OpenMAIC OpenMAIC is an open-source web application that provides an immersive multi‑agent learning environment. It lets users launch and interact w…	81	39947	active
lyogavin/airllm AirLLM is a Python library that enables running extremely large language models on a single low‑VRAM GPU. It achieves this without quantiza…	95	39932	active
2noise/ChatTTS ChatTTS is a generative text-to-speech model optimized for conversational dialogue scenarios such as LLM assistants, supporting English and…	64	39885	active
Yeachan-Heo/oh-my-claudecode oh-my-claudecode is a TypeScript-based framework that orchestrates multiple AI agents such as Claude, Gemini, and Codex for code‑related ta…	79	39798	active
mindsdb/mindshub MindsHub is an open‑source agent workspace that lets users run AI agents for research, analysis, content creation, and software development…	84	39759	active
QuivrHQ/quivr Quivr is an opinionated RAG (Retrieval-Augmented Generation) library, available as the quivr-core Python package, that lets developers inge…	76	39579	active
shiyu-coder/Kronos Kronos is an open‑source decoder‑only foundation model trained on financial candlestick (K‑line) data from dozens of global exchanges. It p…	50	39500	active
Project NOMAD Project NOMAD is a self-hosted, offline-first knowledge and education server that packages Wikipedia, books, courses, offline maps, and opt…	85	39414	active
volcengine/OpenViking OpenViking is an open-source context database designed for AI agents. It provides a virtual filesystem interface for storing, retrieving, a…	77	39101	active
RSSNext/Folo Folo is an open-source AI-powered RSS reader that aggregates and summarizes content feeds across desktop and mobile platforms. It integrate…	85	39029	active
anthropics/financial-services A collection of reference AI agents, skills, and data connectors for financial-services workflows like investment banking, equity research,…	59	38868	active
chatchat-space/Langchain-Chatchat Langchain-Chatchat is an open-source, offline-deployable RAG and Agent application built on Langchain and LLMs such as ChatGLM, Qwen, and L…	41	38672	active
linshenkx/prompt-optimizer Prompt Optimizer is an AI prompt optimization tool that helps users write, refine, test, and evaluate prompts for better LLM outputs. It sh…	89	38597	active
VectifyAI/PageIndex PageIndex is a Python SDK that provides a vectorless, reasoning‑based retrieval engine for long documents. It builds a hierarchical tree in…	86	38442	active
stanfordnlp/dspy DSPy is a Python library that lets you program language models using declarative signatures instead of hand‑written prompts. It provides mo…	93	38406	active
CopilotKit/CopilotKit CopilotKit is an open‑source SDK that lets developers embed LLM‑driven agents into web, mobile and collaboration front‑ends. It provides Re…	92	37919	active
khoj-ai/khoj Khoj is a self-hostable personal AI assistant ('second brain') that answers questions from your own documents and the web using local or on…	83	37738	active
AlexsJones/llmfit llmfit is a Rust‑based command‑line and TUI tool that inspects your system’s CPU, RAM, GPU and other accelerators to recommend which open‑s…	77	37664	active
Claude Code Router Claude Code Router is a local control plane that routes requests from AI agents to multiple LLM providers and can fuse capabilities like vi…	85	37369	active
Claude Code Router Claude Code Router (CCR) is a self-hosted local model gateway and control plane that routes AI coding agent requests (Claude Code, Codex, G…	85	37369	active
SGLang SGLang is an open‑source, high‑performance serving framework for large language models and vision‑language models. It provides an OpenAI‑co…	94	37257	active
songquanpeng/one-api One API is a self-hosted LLM API gateway and key management system that unifies OpenAI, Azure, Anthropic Claude, Google Gemini, DeepSeek, a…	52	37040	stable
reworkd/AgentGPT AgentGPT is a web application for assembling, configuring, and deploying autonomous AI agents directly in the browser. Users name a custom …	10	36296	active
DayuanJiang/next-ai-draw-io A Next.js web application that combines AI chat with draw.io diagram editing, letting users create and modify diagrams through natural lang…	87	36162	active
Langfuse Langfuse is an open‑source platform for tracing, evaluating, and monitoring LLM applications. It provides unified observability, prompt man…	94	36043	active
Langfuse Langfuse is an open-source AI engineering platform for LLM observability, tracing, evaluation, prompt management, and metrics, deployable a…	94	36043	active
esengine/DeepSeek-Reasonix Reasonix is a DeepSeek-native AI coding agent that runs locally as a single Go binary. It provides a terminal‑first workflow with optional …	78	35837	active
HKUDS/Vibe-Trading Vibe-Trading is an open-source AI finance research agent that turns natural-language prompts into runnable market research, backtests, and …	82	35591	active
agentscope-ai/QwenPaw QwenPaw is a self-hosted personal AI assistant built in Python that connects to multiple chat channels (DingTalk, Feishu, QQ, Discord, iMes…	80	35441	active
OpenBMB/ChatDev ChatDev 2.0 (DevAll) is a zero‑code multi‑agent platform that lets users configure and run complex LLM‑driven workflows without writing cod…	75	34379	active
Tabby Tabby is a self-hosted, open-source AI coding assistant that serves as an on-premises alternative to GitHub Copilot. It provides LLM-powere…	76	33888	active
SillyTavern SillyTavern is a locally installed, web‑based user interface for interacting with text‑generation LLMs, image generators, and TTS models. I…	91	33851	active
SillyTavern SillyTavern is a locally installed, self-hosted web UI for interacting with text generation LLMs, image generation engines, and TTS voice m…	91	33851	active
alchaincyf/nuwa-skill Nuwa.skill is an Agent Skills-compatible package that distills how a person thinks—mental models, decision heuristics, and expression style…	56	33624	active
iOfficeAI/AionUi AionUi is a free, open‑source desktop application that lets users work 24/7 with multiple AI agents in a collaborative UI. It supports a wi…	79	33584	active
Yeachan-Heo/oh-my-codex Oh My Codex (OMX) is a TypeScript‑based CLI that adds a multi‑agent orchestration layer on top of the OpenAI Codex CLI. It provides command…	79	33576	active
openai/codex-plugin-cc An official OpenAI plugin that integrates Codex into Claude Code, providing slash commands for AI-powered code review and background task d…	70	33519	active
xai-org/x-algorithm X-Algorithm is an open-source Rust library that powers the For You feed on X. It combines in‑network and out‑of‑network content, applies fi…	60	33483	active
zeroclaw-labs/zeroclaw ZeroClaw is a lightweight, single‑binary personal AI assistant written in Rust. It runs on any OS, connects to dozens of LLM providers and …	81	32990	active
tashfeenahmed/freellmapi FreeLLMAPI is an open‑source, self‑hosted router that aggregates free tiers from dozens of LLM providers behind a single OpenAI‑compatible …	82	32961	active
AgentScope AgentScope is a Python library for building, orchestrating, and deploying multi‑agent LLM applications. It provides a full‑stack framework …	92	32785	active
onyx-dot-app/onyx Onyx is an open‑source AI platform that provides a chat interface powered by large language models and a context layer that indexes knowled…	93	32566	active
Antigravity Tools Antigravity Tools is a desktop application built with Tauri v2, React, and Rust that manages multiple AI service accounts and provides one-…	80	32370	active
hsliuping/TradingAgents-CN A Chinese-enhanced fork of the TradingAgents multi-agent LLM framework for stock analysis and trading research, supporting A-shares, Hong K…	62	32318	active
Conductor Conductor is an open-source durable execution and workflow orchestration engine for microservices, event-driven workflows, and AI agents, o…	93	32278	active
p-e-w/heretic Heretic is a command-line tool that automatically removes censorship (safety alignment) from transformer-based language models using direct…	73	32267	active
Zep Graphiti is an open-source Python framework for building and querying temporal knowledge graphs (Context Graphs) for AI agents. It incremen…	87	31991	active
BigPizzaV3/CodexPlusPlus Codex++ is an open-source external launcher and management tool for the OpenAI Codex / ChatGPT desktop apps, built with Rust and Tauri. It …	76	31876	active
openai/openai-python The official OpenAI Python library provides a convenient wrapper around the OpenAI REST API. It supports both synchronous and asynchronous …	96	31870	active
stanford-oval/storm STORM is an LLM-powered system that researches a topic via internet search and generates full-length, cited, Wikipedia-like reports. It is …	32	31520	active
ScrapeGraphAI ScrapeGraphAI is a Python library that uses LLMs and direct graph logic to build web scraping pipelines for websites and local documents (X…	87	31358	active
Cognee Cognee is an open‑source AI memory platform that provides persistent, long‑term memory for AI agents. It builds a knowledge graph from docu…	90	31294	active
Cognee Cognee is an open-source Python library and platform that gives AI agents persistent long-term memory by ingesting data in any format and b…	90	31294	active
Tencent/WeKnora WeKnora is an open‑source LLM‑powered knowledge platform that transforms raw documents into a queryable RAG system and autonomous reasoning…	84	31280	active
karpathy/llm.c llm.c is a pure C/CUDA implementation for training large language models like GPT-2 and GPT-3, with no dependency on PyTorch or Python. It …	34	31176	active
Supermemory Supermemory is a fast, scalable memory and context engine for AI agents, offered as a hosted API with self‑hosted options. It provides auto…	89	31077	active
GBrain GBrain is a self-hosted 'brain layer' for AI agents that combines a knowledge graph, vector search, and a synthesis engine to return cited …	79	30972	active
mksglu/context-mode An open-source MCP plugin that optimizes AI coding agent context windows by intercepting large tool outputs, storing them in a local FTS5 i…	73	30787	active
ComposioHQ/composio Composio is a developer SDK and CLI that provides AI agents with access to 1,000+ pre‑authenticated toolkits, per‑user sessions, and a sand…	89	30635	active
decolua/9router 9Router is a self-hosted AI gateway/router that connects AI coding tools like Claude Code, Cursor, Codex, and Cline to 60+ LLM providers th…	74	30634	active
DeepAgents Deep Agents is a production‑ready, extensible agent harness for building LLM‑driven applications. It provides built‑in filesystem access, c…	82	30425	active
DeepAgents Deep Agents is an open-source, batteries-included agent harness from LangChain built on LangGraph, providing an opinionated agent with file…	82	30425	active
tobi/qmd QMD is a local, on-device CLI search engine that indexes markdown notes, docs, meeting transcripts, and knowledge bases. It combines BM25 f…	80	30141	active
sipeed/picoclaw PicoClaw is an ultra‑lightweight AI assistant written in Go that runs on $10 hardware with less than 10 MB RAM. It provides a self‑containe…	76	30013	active
GPT Researcher GPT Researcher is a Python‑based autonomous AI agent that performs deep, multi‑source research and generates detailed reports with citation…	95	29943	active
GPT Researcher GPT Researcher is an open-source autonomous deep research agent that plans research questions, scrapes web and local sources, and produces …	95	29943	active
labring/FastGPT FastGPT is an open‑source AI agent building platform that combines knowledge‑base retrieval, RAG, and visual workflow orchestration. It let…	94	29869	active
modular/modular Modular Platform is an open‑source stack that includes the Mojo systems programming language and the MAX framework for building, optimizing…	90	29847	active
Kestra Kestra is an open-source, event-driven orchestration and scheduling platform for data, AI, and infrastructure workflows, written in Java. I…	95	29837	stable
openai/openai-agents-python OpenAI Agents SDK is a lightweight Python framework for building multi-agent LLM workflows with agents, handoffs, tools, guardrails, sessio…	82	29800	active
Chroma Chroma is an open-source search and retrieval database for AI applications, supporting dense vector, sparse (BM25/SPLADE), full-text, regex…	87	29471	active
alibaba/page-agent Page Agent is a JavaScript library that embeds an AI GUI agent directly into any web page with a single script, letting users control the i…	82	29343	active
rohitg00/agentmemory AgentMemory is a TypeScript library that provides persistent, local‑first memory for AI coding agents. It captures, compresses, and recalls…	78	28900	active
Mastra Mastra is a modern TypeScript framework for building AI-powered applications and autonomous agents. It provides model routing, workflow orc…	87	28892	active
Mastra Mastra is a TypeScript framework for building AI-powered applications and autonomous agents, with model routing across 40+ providers, graph…	87	28892	active
MLX MLX is an array computation framework for machine learning on Apple silicon, developed by Apple ML research. It offers NumPy-like Python AP…	95	28839	active
ATH-MaaS/Pixelle-Video Pixelle-Video is an AI-powered fully automated short video engine that turns a single topic into a finished video. It automatically writes …	61	28735	active
Crush Crush is a terminal‑based coding assistant that connects to various LLMs via OpenAI‑compatible APIs. It provides session‑aware, LSP‑enhance…	83	28696	active
Crush Crush is a terminal-based agentic coding assistant from Charm that wires your codebase, tools, and workflows into the LLM of your choice. I…	83	28696	active
firecrawl/open-lovable Open Lovable is an AI-powered web application that lets users chat with an LLM to clone and recreate any website as a modern React app. It …	63	28681	active
Semantic Kernel Semantic Kernel is a model‑agnostic SDK that lets developers integrate large language models and build AI agents quickly. It provides tools…	90	28582	active
MLflow MLflow is an open‑source AI engineering platform that supports the full lifecycle of machine‑learning, LLM, and agent applications. It prov…	100	28441	active
MLflow MLflow is an open source AI engineering platform for agents, LLMs, and traditional ML models, providing experiment tracking, model registry…	100	28441	stable
pingdotgg/t3code T3 Code is an open-source 'agent harness control surface' that lets you orchestrate coding agents like Claude Code, Codex, Cursor, Grok Bui…	83	28386	active
Gas City Beads (bd) is a dependency-aware, Dolt-backed distributed issue tracker designed for AI coding agents, providing persistent structured memo…	80	27995	active
PrefectHQ/fastmcp FastMCP is a Pythonic framework for building Model Context Protocol (MCP) servers, clients, and interactive applications. It handles schema…	84	27979	active
Kilo Kilo Code is an open-source (MIT) AI coding agent available as a VS Code extension, JetBrains plugin, and CLI, with cloud agents and a mode…	84	27653	active
virattt/dexter Dexter is an autonomous AI agent built in TypeScript that performs deep financial research by planning tasks, executing them with real-time…	82	27647	active
TencentCloud/TencentDB-Agent-Memory TencentDB Agent Memory is a team-level memory hub that stores and serves conversational, document, and code embeddings for AI agents. It pr…	79	27532	active
Fosowl/agenticSeek AgenticSeek is a fully local, privacy-focused AI assistant that serves as an open-source alternative to Manus AI. It runs reasoning models …	64	27482	active
vercel/ai Vercel AI is a TypeScript SDK that provides a unified API for interacting with large language models across many providers. It includes uti…	93	27251	active
xai-org/grok-build Grok Build is SpaceXAI's terminal-based AI coding agent, written in Rust, that runs as a full-screen interactive TUI. It understands codeba…	57	27197	active
Planning with Files Suite A persistent file-based planning skill/plugin for AI coding agents that maintains task_plan.md, findings.md, and progress.md on disk and re…	77	27093	active
Haystack Haystack is an open‑source Python framework for orchestrating LLM‑powered pipelines, agents and RAG applications. It provides modular compo…	99	26720	active
Haystack Haystack is an open-source Python AI orchestration framework by deepset for building production-ready LLM applications, agents, and RAG sys…	99	26720	stable
Typesense Search Engine Typesense is an open-source, in-memory search engine written in C++ that provides fast, typo-tolerant full-text search with sub-50ms latenc…	85	26616	stable