Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| MeteorNOX/DeepSeek-Balance-Whale-Widget A DSH (DeepSeek Harness) plugin that adds a cute floating whale widget to the web interface, showing DeepSeek API balance, daily usage, and… | 80 | 5670 | active |
| Recursive Language Models (RLM) A plug-and-play Python inference library for Recursive Language Models (RLMs), a paradigm where an LLM programmatically examines and decomp… | 76 | 5669 | active |
| vercel/streamdown Streamdown is a React component library that serves as a drop-in replacement for react-markdown, purpose-built for rendering Markdown strea… | 84 | 5665 | active |
| executeautomation/mcp-playwright A Model Context Protocol (MCP) server that exposes Playwright browser automation to LLM clients like Claude Desktop, Cline, and Cursor IDE.… | 44 | 5664 | active |
| nextai-translator/bob-plugin-openai-translator A Bob plugin for macOS that uses OpenAI, Google Gemini, MiniMax, or OpenAI-compatible APIs to translate text, polish wording, and fix gramm… | 93 | 5651 | active |
| vercel/eve eve is a filesystem-first TypeScript framework by Vercel for building durable AI agents, where an agent is defined by a conventional direct… | 78 | 5643 | active |
| ConnectAI-E/feishu-openai A self-hosted Go application that integrates OpenAI models (GPT-4, GPT-4V, DALL·E-3, Whisper) into Feishu/Lark as a chatbot. It supports vo… | 32 | 5633 | active |
| lm-sys/RouteLLM RouteLLM is a Python framework for serving and evaluating LLM routers that route queries between strong and weak models to cut costs. It pr… | 25 | 5626 | active |
| sohzm/cheating-daddy Cheating Daddy is a free, open-source Electron desktop app that acts as a real-time AI assistant during video calls, interviews, and meetin… | 72 | 5616 | active |
| ZenML ZenML is an open-source MLOps framework for building, deploying, and managing production ML pipelines, LLM workflows, and AI agents on any … | 97 | 5601 | active |
| workweave/router Workweave Router is a model router for agentic AI systems that routes each prompt to the most cost-effective model capable of handling it, … | 66 | 5594 | active |
| MiniGPT-4 Official code for MiniGPT-4 and MiniGPT-v2, vision-language models that align a frozen visual encoder with a frozen LLM (Vicuna) via a sing… | 30 | 25605 | maintenance |
| karpathy/llm-council A local web app that sends a user's question to multiple LLMs via OpenRouter, has them anonymously review and rank each other's answers, an… | 37 | 25563 | maintenance |
| ngxson/smolvlm-realtime-webcam A browser-based demo that streams webcam frames to a llama.cpp server running SmolVLM 500M for real-time object detection and scene descrip… | 26 | 5577 | active |
| modstart-lib/aigcpanel AIGCPanel is an open-source, all-in-one AI digital human desktop application built with TypeScript, Vue3, and Electron for Windows, macOS, … | 86 | 5572 | active |
| EverMind-AI/Raven Raven is an open-source, self-improving agent harness built on EverOS that combines terminal-first execution, local tracing, long-term memo… | 82 | 5546 | active |
| ATH-MaaS/ComfyUI-Copilot ComfyUI-Copilot is an AI-powered custom node for ComfyUI that acts as an intelligent assistant for building, debugging, and optimizing imag… | 61 | 5539 | active |
| father-bot/chatgpt_telegram_bot A self-hostable Telegram bot that brings ChatGPT and Claude models into Telegram using your own OpenAI/Anthropic/OpenRouter API keys. It su… | 73 | 5538 | active |
| HKUDS/ClawTeam ClawTeam is a framework-agnostic Python CLI that orchestrates swarms of AI coding agents (Claude Code, Codex, Cursor, and any CLI agent) to… | 60 | 5536 | active |
| mosaicml/composer Composer is an open-source PyTorch-based deep learning training library by MosaicML (now Databricks) for training neural networks faster an… | 66 | 5499 | active |
| BIT-DataLab/Edit-Banana Edit Banana is an open-source Python framework that converts static images and PDFs of diagrams, flowcharts, and charts into fully editable… | 59 | 5498 | active |
| Claude Desktop for Linux (unofficial repackaging) An unofficial repackaging project that distributes Anthropic's official Claude Desktop Linux .deb as .rpm, AppImage, Nix flake, and AUR pac… | 85 | 5473 | active |
| karpathy/minGPT A minimal, clean PyTorch re-implementation of OpenAI's GPT covering both training and inference in roughly 300 lines of code. It is designe… | 32 | 24956 | maintenance |
| PeterGriffinJin/Search-R1 Search-R1 is an open-source reinforcement learning framework for training LLMs that interleave reasoning with search engine calls, built on… | 40 | 5446 | active |
| GitHub Agentic Workflows GitHub Agentic Workflows (gh-aw) is a GitHub CLI extension that lets developers define AI-powered repository automation in Markdown with YA… | 82 | 5435 | active |
| 54yyyu/zotero-mcp A Model Context Protocol (MCP) server that connects a Zotero research library to AI assistants like Claude, ChatGPT, Cursor, and Cherry Stu… | 87 | 5420 | active |
| agentgateway/agentgateway Agentgateway is an open-source, Rust-based proxy and gateway for agentic AI traffic, handling LLM provider routing, MCP tool servers, and A… | 83 | 5420 | active |
| docker/genai-stack A Docker Compose-based starter stack for building GenAI applications, combining LangChain, Ollama for local LLM inference, and Neo4j as a d… | 70 | 5416 | active |
| TaskingAI/TaskingAI TaskingAI is an open-source Backend-as-a-Service (BaaS) platform for developing and deploying LLM-based AI agents. It unifies access to hun… | 17 | 5406 | active |
| NVIDIA/Model-Optimizer NVIDIA Model Optimizer (ModelOpt) is a Python library of state-of-the-art model optimization techniques including quantization, pruning, di… | 92 | 5386 | active |
| deepseek-ai/DeepSeek-VL2 DeepSeek-VL2 is a series of Mixture-of-Experts vision-language models (Tiny, Small, and 4.5B activated parameters) with inference code and … | 22 | 5376 | active |
| looplj/axonhub AxonHub is an open-source AI gateway written in Go that lets any SDK call 100+ LLMs through a unified API. It provides built-in failover, l… | 81 | 5375 | active |
| milind-soni/OpenMausBot OpenMausBot is an open-source, local-first desktop chat application (Electron, TypeScript) where each contact is an AI agent powered by Cla… | 77 | 5374 | active |
| lmstudio-ai/lms lms is the official command-line tool for LM Studio, built on the lmstudio.js SDK. It lets users manage local LLMs (list, download, load, u… | 70 | 5368 | active |
| winfunc/deepreasoning DeepReasoning is a high-performance Rust-based LLM inference API and chat UI that combines DeepSeek R1's chain-of-thought reasoning traces … | 28 | 5361 | active |
| nanbingxyz/5ire 5ire is a cross-platform desktop AI assistant and MCP (Model Context Protocol) client that connects to major LLM providers like OpenAI, Ant… | 80 | 5354 | active |
| superduper-io/superduper Superduper is an open-source Python framework for building database-integrated AI applications and agents, connecting models, embeddings, a… | 44 | 5329 | active |
| FunnyWolf/Viper VIPER is a self-hosted red teaming and adversary simulation platform with a web UI, 100+ post-exploitation modules covering MITRE ATT&CK, a… | 79 | 5327 | active |
| beclab/Olares Olares is an open-source personal cloud operating system built on Kubernetes that turns your own hardware into a self-hosted AI platform fo… | 90 | 5299 | active |
| FailproofAI/failproofai Failproof AI is an open-source observability and enforcement layer for AI agent harnesses like Claude Code, Codex, Hermes, and OpenClaw, ca… | 82 | 5268 | active |
| neo4j-labs/llm-graph-builder A web application that transforms unstructured data (PDFs, DOCs, TXTs, YouTube videos, web pages) into a knowledge graph stored in Neo4j us… | 88 | 5264 | active |
| vitali87/code-graph-rag Code-Graph-RAG is a Python CLI tool and MCP server that parses multi-language codebases with Tree-sitter, builds a knowledge graph of code … | 86 | 5258 | active |
| camel-ai/oasis OASIS is an open-source social media simulator that uses large language model and rule-based agents to mimic the behavior of up to one mill… | 72 | 5245 | active |
| su-kaka/gcli2api A self-hosted Python service that converts GeminiCLI and Antigravity into OpenAI-, Gemini-, and Claude-compatible API endpoints. It can be … | 63 | 5243 | active |
| pollinations/pollinations Pollinations is an open-source generative AI platform offering free APIs for text, image, and vision model inference without requiring API … | 77 | 5228 | active |
| MCP-UI-Org/mcp-ui mcp-ui is an SDK implementing the MCP Apps standard for delivering interactive UI over the Model Context Protocol. It provides client SDKs … | 72 | 5227 | active |
| Kode AI Agent Platform Learn Claude Code is a Python library that provides a minimal harness for building Claude-like AI agents. It includes CLI tools and tutoria… | 60 | 5225 | active |
| InternLM/xtuner XTuner is an open-source LLM training engine from InternLM designed for fine-tuning ultra-large-scale Mixture-of-Experts (MoE) models, with… | 68 | 5211 | active |
| Kiln-AI/Kiln Kiln is a free desktop app and MIT-licensed Python library for the full AI development loop: evals, prompt optimization, RAG, agents, fine-… | 91 | 5207 | active |
| linuxhsj/openclaw-zero-token OpenClaw Zero Token is a fork of OpenClaw that provides a unified gateway to major LLM providers (ChatGPT, Claude, Gemini, DeepSeek, Qwen, … | 71 | 5206 | active |
| kodu-ai/claude-coder Kodu (Claude Coder) is an autonomous AI coding agent distributed as a VS Code extension. It takes natural-language task descriptions and bu… | 28 | 5205 | active |
| Transformer Lab Transformer Lab is an open-source desktop application (built with Electron and Python) that provides a unified GUI for training, fine-tunin… | 82 | 5195 | active |
| hiyouga/EasyR1 EasyR1 is an efficient, scalable reinforcement learning training framework for large language models and vision-language models, built as a… | 62 | 5192 | active |
| AgnesAI-Labs/AgnesAI-Models Official gateway and model catalog for Agnes AI, providing OpenAI-compatible API access to multimodal foundation models covering text, imag… | 55 | 5192 | active |
| h2oai/h2o-llmstudio H2O LLM Studio is a framework and no-code GUI for fine-tuning state-of-the-art large language models, built by H2O.ai. It supports LoRA and… | 96 | 5184 | active |
| Waishnav/devspace DevSpace is a self-hosted MCP server and CLI that gives ChatGPT or Claude Web a secure connection to your local machine so they can read, e… | 78 | 5183 | active |
| SaladDay/cc-switch-cli A cross-platform CLI and interactive TUI tool for managing configurations of AI coding assistants like Claude Code, Codex, and Gemini CLI. … | 76 | 5181 | active |
| Marker-Inc-Korea/AutoRAG AutoRAG 2.0 is a self-evolving librarian agent that searches local document collections (PDFs, wikis, notes) and curates results into struc… | 94 | 5157 | active |
| vllm-project/aibrix AIBrix is an open-source, cloud-native framework from the vLLM project providing essential building blocks for scalable, cost-efficient Gen… | 88 | 5149 | active |
| OpenBMB/AgentVerse AgentVerse is a Python framework for deploying multiple LLM-based agents, offering two frameworks: task-solving (multi-agent collaboration … | 21 | 5141 | active |
| elie222/rakazo Rakazo is an open-source, self-hosted platform for running persistent AI teammates (bots) that can use a browser, terminal, and desktop, re… | 81 | 5124 | active |
| ccch1mneyyy/dsh-TUI dsh-TUI is a Claude Code-style full-screen terminal UI plugin for DeepSeek Harness (DSH), built with Ink/React and mounted via Cordis patch… | 80 | 5122 | active |
| icip-cas/PPTAgent PPTAgent is an agentic Python framework that automatically generates PowerPoint presentations from documents using a two-stage, edit-based … | 79 | 5122 | active |
| mangiucugna/json_repair A Python library that repairs malformed JSON strings, such as broken output from LLMs, APIs, logs, or user input. It works as a drop-in fal… | 92 | 5119 | active |
| pytorch/executorch ExecuTorch is PyTorch's framework for exporting and running AI models on-device across mobile, embedded, and edge hardware, with a tiny (~5… | 94 | 5113 | active |
| ztxz16/fastllm fastllm is a high-performance C++ LLM inference library with its own custom operators, requiring no PyTorch dependency. It supports tensor-… | 75 | 5112 | active |
| tencentmusic/supersonic SuperSonic is an AI+BI platform that combines Chat BI (natural language querying powered by LLMs) with Headless BI (a governed semantic lay… | 62 | 5112 | active |
| Home Assistant MCP Server An unofficial Model Context Protocol (MCP) server that lets AI assistants like Claude Desktop, Claude.ai, and ChatGPT control Home Assistan… | 81 | 5100 | active |
| manycore-research/SpatialLM SpatialLM is a 3D large language model that processes point cloud data (from monocular video, RGBD images, or LiDAR) and generates structur… | 59 | 5094 | active |
| huggingface/text-embeddings-inference Text Embeddings Inference (TEI) is a Rust-based toolkit from Hugging Face for deploying and serving open-source text embedding, re-ranker, … | 93 | 5079 | active |
| Magic MagiCrew (dtyq/magic) is an open-source, enterprise-grade all-in-one AI productivity platform combining a generalist AI agent, workflow eng… | 60 | 5049 | active |
| deepseek-ai/DeepSeek-V2 DeepSeek-V2 is a strong, economical Mixture-of-Experts language model released with open weights, inference code, and evaluation tooling. T… | 25 | 5042 | active |
| unicity-aos/capsule-react A Rust ReAct loop coordinator that implements a stateless state machine for the reasoning-and-action cycle in agent systems. It is part of … | 70 | 5041 | active |
| developersdigest/llm-answer-engine A Perplexity-inspired AI answer engine built with Next.js, the Vercel AI SDK, LangChain.JS, Groq/Mixtral, Brave Search, Serper, and OpenAI.… | 58 | 5035 | active |
| Gaia node GaiaNet node is a shell-based installer and runtime for running your own decentralized AI agent service locally. It deploys an LLM inferenc… | 45 | 5015 | active |
| AG2 AG2 (formerly AutoGen) is an open-source Python framework for building AI agents and orchestrating multi-agent systems, supporting LLM inte… | 85 | 5003 | active |
| gd3kr/BlenderGPT A Blender add-on that integrates OpenAI's GPT-4/GPT-3.5 into Blender's UI, letting users control the 3D software with natural language comm… | 31 | 4987 | active |
| mistralai/mistral-vibe Mistral Vibe is an open-source command-line coding agent powered by Mistral's models, providing a conversational interface to explore and m… | 76 | 4986 | active |
| LangWatch LangWatch is an open-source LLMOps platform for LLM evaluation, AI agent testing, tracing, and production observability. It combines agent … | 91 | 4983 | active |
| going-doer/Paper2Code PaperCoder is a multi-agent LLM system that automatically generates a code repository from a machine learning research paper via a planning… | 49 | 4982 | active |
| EvoScientist EvoScientist is a Python-based multi-agent framework for building self-evolving AI scientists that plan, research, code, analyze data, and … | 83 | 4980 | active |
| apple/embedding-atlas Embedding Atlas is an open-source tool from Apple for interactive visualization of large embeddings and their metadata, supporting clusteri… | 86 | 4969 | active |
| microsoft/poml POML is a markup language from Microsoft for structuring, templating, and styling prompts for large language models, with an HTML-like synt… | 48 | 4965 | active |
| FellouAI/eko Eko is a production-ready JavaScript framework for building reliable AI agents and agentic workflows from natural language, running in both… | 57 | 4961 | active |
| Zep A repository of example code, framework integration packages, ingestion tooling, and memory benchmarks for Zep Cloud, a managed agent memor… | 97 | 4959 | active |
| campfirein/byterover-cli ByteRover CLI (brv) is a TypeScript-based interactive REPL/TUI tool that gives AI coding agents a persistent, structured memory layer via a… | 10 | 4958 | active |
| atilaahmettaner/tradingview-mcp An MCP server exposing TradingView market data, technical indicators, screeners, and backtesting as tools for AI assistants like Claude, Ch… | 63 | 4957 | active |
| joonspk-research/generative_agents The official code release for the Stanford 'Generative Agents' research paper, implementing computational agents powered by LLMs that simul… | 29 | 22237 | maintenance |
| conorbronsdon/avoid-ai-writing A portable agent skill that audits and rewrites text to remove AI writing patterns ('AI-isms'). It supports detect-only, rewrite, and edit-… | 82 | 4947 | active |
| withcoral/coral Coral is a local SQL query engine that exposes APIs, files, and live data sources as read-only tables you can query and join with standard … | 79 | 4943 | active |
| SolaceLabs/solace-agent-mesh Solace Agent Mesh is an open-source Python framework for building event-driven multi-agent AI systems where specialized agents collaborate … | 10 | 4923 | active |
| qixing-jk/all-api-hub All API Hub is an open-source browser extension (Chrome, Edge, Firefox, Safari) that acts as an all-in-one manager for AI relay/proxy site … | 80 | 4919 | active |
| Martian-Engineering/lossless-claw A Lossless Context Management (LCM) plugin for OpenClaw that replaces sliding-window context truncation with a DAG-based summarization syst… | 83 | 4909 | active |
| ACI.dev ACI.dev is an open-source tool-calling platform that connects 600+ SaaS tools to AI agents and agentic IDEs via direct function calling or … | 59 | 4905 | active |
| darrenhinde/OpenAgentsControl OpenAgentsControl (OAC) is an AI agent framework built on OpenCode that enforces plan-first development workflows with approval-based execu… | 69 | 4896 | active |
| babaohuang/GeminiProChat A minimal web chat interface for Google's Gemini Pro API, built with TypeScript and Astro. It can be self-hosted via Vercel, Railway, Zeabu… | 58 | 4894 | active |
| llm-d llm-d is a Kubernetes-native distributed LLM inference serving stack that orchestrates model servers like vLLM and SGLang across clusters. … | 83 | 4891 | active |
| nguyenphutrong/quotio Quotio is a native macOS menu bar app (SwiftUI) that unifies multiple AI provider accounts (Claude, Gemini, OpenAI, Qwen, Antigravity, and … | 78 | 4882 | active |
| jlcodes99/vscode-antigravity-cockpit A VS Code extension that monitors Google Antigravity AI model quotas via a Webview dashboard or native QuickPick mode. It shows remaining q… | 67 | 4850 | active |
| Agenta-AI/agenta Agenta is an open-source, self-hostable workspace where teams build, run, and share AI agents and automations by chatting with them. It pro… | 93 | 4835 | active |