Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| Codium-ai/AlphaCodium Official implementation of the AlphaCodium paper, a test-based, multi-stage, iterative flow for LLM code generation on competitive programm… | 27 | 3966 | maintenance |
| withkynam/vibecode-pro-max-kit A spec-driven coding harness that gives AI coding agents (Claude Code, Codex, Cursor, etc.) a plan-first workflow with gated phases, self-h… | 67 | 1143 | active |
| microsoft/onnxruntime-genai ONNX Runtime GenAI is a C++ library with Python, C#, C/C++, and Java APIs for running generative AI models (LLMs, Whisper, vision-language … | 94 | 1142 | active |
| wandb/weave Weave is a Python/TypeScript toolkit by Weights & Biases for developing AI-powered applications, providing LLM tracing, agent observability… | 93 | 1142 | active |
| massgen/MassGen MassGen is an open-source multi-agent scaling system that runs in the terminal, orchestrating multiple frontier LLM agents to work on the s… | 66 | 1142 | active |
| RUC-NLPIR/DeepAgent DeepAgent is a general reasoning agent framework that dynamically searches for and uses tools from large toolsets (e.g., 16,000+ RapidAPIs)… | 49 | 1142 | active |
| xiaochong/hi-kid HiKid is a free, open-source Electron desktop app that lets children in non-English-speaking countries practice English speaking and listen… | 48 | 1142 | active |
| LLM-Pruner LLM-Pruner is a PyTorch library implementing structural pruning of large language models based on gradient information, as published at Neu… | 30 | 1142 | active |
| KoboldAI/KoboldAI-Client KoboldAI Client is a browser-based front-end for AI-assisted writing and text adventure gameplay that connects to multiple local and remote… | 67 | 3953 | maintenance |
| muapi CLI muapi-cli and its Generative Media Skills provide a schema-driven CLI, skill library, and MCP server that let AI agents (Claude Code, Curso… | 90 | 1141 | active |
| jianjieyiban/JJYB_AI_VideoAutoCut JJYB_AI 智剪 is a local-first desktop AI video creation workbench that combines material analysis, smart shot segmentation, commentary script… | 80 | 1141 | active |
| DeepMyst/Mysti Mysti is a VS Code extension that orchestrates a team of AI coding agents from 12 providers (Claude Code, OpenAI Codex, Gemini, Copilot, Cl… | 72 | 1141 | active |
| OpenLAIR/dr-claw Dr. Claw is an open-source, model-agnostic AI research assistant that provides a desktop and mobile UI for Claude Code, Cursor CLI, Codex, … | 78 | 1139 | active |
| Rath-Team/OpenRath OpenRath is a PyTorch-like Python framework for building dynamic multi-agent and multi-session workflows. It models runtime state as explic… | 76 | 1139 | active |
| mrphrazer/reverser_ai ReverserAI is a Binary Ninja plugin that provides automated reverse engineering assistance using locally-hosted large language models runni… | 63 | 1139 | active |
| flagos-ai/FlagGems FlagGems is a high-performance operator library for large language models written in the Triton language, providing backend-neutral GPU ker… | 88 | 1137 | active |
| XiaoLuoLYG/GOD GOD (Govern, Observe, Direct) is a real-time control room for inspecting and steering societies of LLM-powered agents, letting operators pa… | 74 | 1137 | active |
| EuniAI/Prometheus Prometheus is a knowledge-graph-driven AI agent platform that maps, understands, and repairs complex codebases through reasoning rather tha… | 63 | 1136 | active |
| HacxGPT-Official/HacxGPT-CLI HacxGPT-CLI is a Python command-line chat client for accessing uncensored, unrestricted language models, including HacxGPT's own paid API m… | 74 | 1135 | active |
| mongodb-js/mongodb-mcp-server A Model Context Protocol (MCP) server that lets AI assistants and LLM clients connect to MongoDB databases and MongoDB Atlas clusters. It e… | 84 | 1134 | active |
| rayenfeng/riko_project Project Riko is an anime-themed conversational voice assistant that combines OpenAI's GPT for dialogue, GPT-SoVITS for voice synthesis, and… | 28 | 1134 | active |
| wasabeef/claude-code-cookbook A collection of commands, roles, and automation hooks that extend Claude Code with custom slash commands for common development tasks. It a… | 63 | 1133 | active |
| NativeMindBrowser/NativeMindExtension NativeMind is an open-source browser extension that provides a fully private, on-device AI assistant by connecting to local LLMs via Ollama… | 60 | 1133 | active |
| openresponses/openresponses Open Responses is an open-source specification for multi-provider, interoperable LLM interfaces modeled on the OpenAI Responses API, defini… | 61 | 1132 | active |
| machinepulse-ai/world2agent World2Agent (W2A) is an open protocol that standardizes how AI agents perceive real-world data via interchangeable sensors emitting structu… | 56 | 1132 | active |
| NovaSearch-Team/RAG-Retrieval A Python library and toolkit for unified fine-tuning, inference, and distillation of RAG retrieval models, including embedding models, ColB… | 57 | 1131 | active |
| vndee/llm-sandbox LLM Sandbox is a lightweight Python library for safely executing LLM-generated code in isolated container environments with support for Doc… | 89 | 1128 | active |
| jjsantos01/qgis_mcp A Model Context Protocol integration that lets LLMs like Claude control QGIS Desktop via a socket-based QGIS plugin and an MCP server. It s… | 37 | 1127 | active |
| lasgroup/SDPO SDPO (Self-Distilled Policy Optimization) is a research library implementing a reinforcement learning framework for post-training large lan… | 53 | 1126 | active |
| RUC-NLPIR/ARPO ARPO (Agentic Reinforced Policy Optimization) is a reinforcement learning algorithm and training framework for LLM agents, published at ICL… | 52 | 1126 | active |
| amazon-science/RAGChecker RAGChecker is an automatic evaluation framework for diagnosing Retrieval-Augmented Generation (RAG) systems. It provides holistic and diagn… | 15 | 1126 | active |
| futantan/OpenGpt OpenGpt is an open-source web platform for instantly running and creating small ChatGPT-powered prompt applications, with a browsable marke… | 39 | 3888 | maintenance |
| nnsight nnsight is a Python library for interpreting and intervening on the internals of deep learning models, built on PyTorch. It lets researcher… | 96 | 1125 | active |
| ollama-ui/ollama-ui A simple HTML/JavaScript chat interface for Ollama, runnable locally via a Makefile-served page or installed as a Chrome extension. It lets… | 60 | 1125 | active |
| ATH-MaaS/Pixelle-MCP Pixelle MCP is an open-source omnimodal AIGC framework that converts ComfyUI workflows (local or RunningHub cloud) into MCP tools with zero… | 41 | 1125 | active |
| localgpt-app/localgpt LocalGPT is a local-only AI assistant built in Rust that ships as a single binary with a CLI, desktop GUI, embedded web UI, HTTP API, and M… | 61 | 1124 | active |
| PRIME-RL/TTRL TTRL is an open-source implementation of Test-Time Reinforcement Learning, a method for training LLMs with RL on unlabeled data using major… | 49 | 1124 | active |
| datadreamer-dev/DataDreamer DataDreamer is an open-source Python library for prompting LLMs, generating synthetic datasets, and training or aligning models in reproduc… | 32 | 1124 | active |
| m1guelpf/chatgpt-telegram A Go application that runs a Telegram bot letting users chat with OpenAI's ChatGPT from a single command or Docker container. It handles au… | 23 | 3881 | maintenance |
| nobodywho-ooo/nobodywho NobodyWho is an open-source (EUPL-1.2) on-device LLM inference engine written in Rust, built on llama.cpp, with SDKs for Kotlin, Swift, Pyt… | 83 | 1122 | active |
| THUDM/SwissArmyTransformer SwissArmyTransformer (sat) is a PyTorch library for developing custom Transformer model variants where models like BERT, GPT, T5, GLM, and … | 23 | 1122 | active |
| plasma-umass/ChatDBG ChatDBG is an AI-assisted debugging tool that integrates large language models into standard debuggers (pdb, lldb, gdb) for C/C++/Python/Ru… | 65 | 1121 | active |
| Deep-ai-inc/ch.at A lightweight LLM chat service in Go, deployable as a single static binary, accessible via web, curl, SSH, DNS TXT queries, and an OpenAI-c… | 62 | 1121 | active |
| FlagAI-Open/FlagAI FlagAI is a Python toolkit for training, fine-tuning, and deploying large-scale AI models across NLP, CV, and vision-language tasks. It int… | 61 | 3870 | maintenance |
| vamplabAI/sgr-agent-core SGR Agent Core is an open-source Python framework for building research agents using Schema-Guided Reasoning, with an extensible BaseAgent … | 79 | 1120 | active |
| XYZ-AI-Lab/AxisAgentic AxisAgentic is an extensible Python runtime for long-horizon AI agents that handles multi-turn execution, tool orchestration, context manag… | 52 | 1120 | active |
| iFurySt/RedNote-MCP A Model Context Protocol (MCP) server that lets AI clients access RedNote (Xiaohongshu) content, including keyword search and note retrieva… | 16 | 1120 | active |
| HITsz-TMG/Uni-MoE Uni-MoE is a family of open-source Mixture-of-Experts (MoE) based omnimodal large language models that understand and generate across text,… | 65 | 1118 | active |
| KoljaB/RealtimeVoiceChat A Python client-server application enabling natural spoken conversations with LLMs, streaming browser audio via WebSockets through Realtime… | 30 | 3857 | maintenance |
| prometheus-eval/prometheus-eval Prometheus-Eval is a Python library for evaluating LLM generation outputs using the Prometheus family of open evaluator models and GPT-4 as… | 20 | 1117 | active |
| Doriandarko/make-it-heavy A Python framework that emulates Grok Heavy-style deep analysis by orchestrating multiple specialized AI agents in parallel via OpenRouter'… | 29 | 1116 | active |
| manaflow-ai/manaflow Manaflow is an open-source application for orchestrating multiple AI coding agent CLIs (Claude Code, Codex CLI, Gemini CLI, Cursor CLI, etc… | 69 | 1115 | active |
| Code Interpreter API A Python library providing an open-source implementation of the ChatGPT Code Interpreter, built on LangChain. It lets LLM agents execute sa… | 20 | 3844 | maintenance |
| easydoc-ai/easydoc EasyDoc is a multimodal document processing API that converts unstructured documents like PDFs into hierarchical, machine-readable JSON. It… | 32 | 1114 | active |
| AITuberKit AITuberKit is an all-in-one web application toolkit for building and deploying AI character chat experiences, including streaming-oriented … | 88 | 1113 | active |
| Onelevenvy/flock Flock is a cross-platform desktop multi-agent harness built with Rust, Tauri, and React, powered by the langgraph-rust engine. It provides … | 77 | 1113 | active |
| Yargı Legal Data Access A FastMCP-based Model Context Protocol server that provides access to Turkish legal databases, including Yargıtay, Danıştay, Anayasa Mahkem… | 79 | 1112 | active |
| yeahhe365/Gemini-Nexus Gemini Nexus is a Chrome extension (Manifest V3) that adds an AI assistant layer to the browser, integrating Gemini Web, the Gemini API, an… | 79 | 1112 | active |
| codestable/CodeStable CodeStable is a set of lightweight skill contracts (installed as Codex/Claude plugins) that structure AI-assisted coding around requirement… | 74 | 1111 | active |
| dp-archive/archive Skill Compose is an open-source agent builder and runtime platform for creating skill-powered AI agents, written in Python. It deliberately… | 54 | 1111 | active |
| BytedTsinghua-SIA/MemAgent MemAgent is a reinforcement-learning framework for training LLM agents that process arbitrarily long contexts via a memory mechanism within… | 52 | 1111 | active |
| brenpoly/be-more-agent An offline-first conversational AI agent that turns a Raspberry Pi into a fully local voice assistant. It combines OpenWakeWord, Whisper.cp… | 59 | 1110 | active |
| gabber-dev/gabber Gabber is an open-source engine for building real-time multimodal AI applications that can see, hear, and speak, using graph-based orchestr… | 41 | 1110 | active |
| yoheinakajima/babyagi BabyAGI is an experimental Python framework for building self-building autonomous agents, built around a 'functionz' system that stores, ma… | 56 | 22363 | experimental |
| prehisle/relay-pulse RelayPulse is a self-hosted monitoring service for LLM API relay/proxy services that probes endpoints with real token-consuming API calls a… | 78 | 1108 | active |
| TheAiSingularity/graphrag-local-ollama A local adaptation of Microsoft's GraphRAG that runs LLM and embedding extraction entirely through Ollama models like llama3, mistral, gemm… | 57 | 1108 | active |
| google-ai-edge/litert-torch LiteRT Torch is a Python library that converts PyTorch models into .tflite format for running with LiteRT on Android, iOS, and IoT devices.… | 86 | 1107 | active |
| orailnoor/cross-platform-llm-client PrivateLM is a cross-platform AI chat client built with Flutter that unifies local on-device LLM inference (GGUF models with Vulkan GPU acc… | 67 | 1105 | active |
| alishobeiri/thread-notebook Thread is an AI-powered Jupyter Notebook alternative that integrates an AI copilot into the notebook editing experience. It runs locally an… | 56 | 1105 | active |
| sourcegraph/cody-public-snapshot Cody is an open-source AI coding assistant by Sourcegraph that uses LLMs and codebase context (via Sourcegraph's search) to help developers… | 10 | 3805 | maintenance |
| wilpel/caveman-compression A Python tool that compresses text for LLM contexts by stripping predictable grammar while preserving factual content, reducing token usage… | 38 | 1103 | active |
| jackdark425/aigroupapp AI Group is an open-source Android mobile assistant app that integrates multiple large language models such as OpenAI, Claude, Gemini, ERNI… | 36 | 1103 | active |
| vocodedev/vocode-core Vocode is an open-source Python library for building real-time, voice-based LLM applications and agents. It orchestrates streaming transcri… | 22 | 3797 | maintenance |
| EmbeddedLLM/JamAIBase JamAI Base is an open-source backend-as-a-service platform for AI that combines an embedded SQLite database and LanceDB vector database wit… | 66 | 1102 | active |
| vifreefly/kimuraframework Kimuraframework (Kimurai) is a Ruby web scraping framework with an AI-assisted DSL: an LLM generates XPath selectors from a schema on first… | 57 | 1102 | active |
| paean-ai/deeptide DeepTide is an AI coding agent tuned for DeepSeek models, shipped as a Swift-native macOS app plus cross-platform terminal CLIs (TypeScript… | 55 | 1102 | active |
| synth-inc/onit Onit SideKick is an open-source macOS AI chat sidebar that docks to any application, letting users chat with LLMs using highlighted text or… | 76 | 1100 | active |
| MrSibe/KnowNote KnowNote is a local-first, open-source desktop application built with Electron that serves as an alternative to Google NotebookLM. It lets … | 52 | 1100 | active |
| raindrop-ai/workshop Raindrop Workshop is an open-source local debugger for AI agents that streams live traces of tokens, tool calls, and decisions into a brows… | 75 | 1099 | active |
| xiaobright/dsh-anchored-standard A community plugin providing DeepSeek Harness (DSH) agent presets that bootstrap a session with a minimal tool schema and then promote to a… | 55 | 3777 | maintenance |
| 170-carry/codex-tools A desktop GUI and CLI/TUI tool for managing multiple OpenAI Codex accounts, switching local Codex login state, and viewing usage quotas. It… | 77 | 1094 | active |
| xataio/agent Xata Agent is an open-source AI agent that acts as a PostgreSQL expert, monitoring database logs and metrics, diagnosing root causes of iss… | 10 | 1094 | active |
| Minidoracat/mcp-feedback-enhanced An enhanced MCP server that provides interactive user feedback and command execution capabilities for AI-assisted development workflows, su… | 84 | 3758 | maintenance |
| hinthornw/trustcall A Python library that improves LLM tool calling reliability by having models generate JSON patch operations instead of full JSON blobs. It … | 35 | 1093 | active |
| langchain-ai/agent-inbox Agent Inbox is a web-based inbox UI for reviewing and responding to human-in-the-loop interrupts raised by LangGraph agents. It connects to… | 10 | 1093 | active |
| yandex/YaLM-100B YaLM-100B is a GPT-like pretrained language model with 100 billion parameters, trained by Yandex on English and Russian text using DeepSpee… | 32 | 3756 | maintenance |
| LycheeMem/LycheeMem LycheeMem is a lightweight long-term memory framework for LLM agents, combining working session context, a compact semantic memory store (S… | 55 | 1092 | active |
| K9i-0/ccpocket CC Pocket is a Flutter-based mobile and desktop client for controlling Codex and Claude Code coding-agent sessions remotely. A self-hosted … | 79 | 1091 | active |
| RUC-NLPIR/Arbor Arbor is a generalist autonomous research agent that takes a benchmark and a goal, then proposes hypotheses, edits code, and runs real expe… | 74 | 1091 | active |
| spring-ai-alibaba/Lynxe Lynxe (formerly JManus) is a Java-based, code-free 'Prompt Programming' studio implementing a Manus-style multi-agent system with high exec… | 70 | 1090 | active |
| NVlabs/Fast-dLLM NVIDIA's official implementation of Fast-dLLM, a family of training-free and fine-tuning-based acceleration techniques for diffusion-based … | 54 | 1090 | active |
| wenge-research/x-agent X-Agent (智川) is an open-source, self-hosted enterprise agent development platform by Wenge that lets users build AI applications with zero … | 32 | 1090 | active |
| cisco-ai-defense/mcp-scanner MCP Scanner is a Python tool and SDK from Cisco AI Defense that scans Model Context Protocol (MCP) servers, tools, prompts, and resources f… | 84 | 1089 | active |
| Microsoft 365 Agents SDK The Microsoft 365 Agents SDK is a multichannel SDK for building full-stack, trusted agents deployable to Microsoft 365 Copilot, Teams, Copi… | 67 | 1089 | active |
| mymusise/ChatGLM-Tuning A Python toolkit for fine-tuning the ChatGLM-6B large language model using LoRA (Low-Rank Adaptation) with the Alpaca dataset. It provides … | 10 | 3738 | maintenance |
| VoAPI/VoAPI VoAPI is a self-hosted AI large-model API aggregation and distribution gateway written in Go, deployed via Docker. It proxies requests to m… | 57 | 1088 | active |
| lastmile-ai/aiconfig AIConfig is an open-source framework that manages generative AI prompts, models, and model parameters as JSON-serializable configs, separat… | 45 | 1088 | active |
| jae-jae/fetcher-mcp A Model Context Protocol (MCP) server that fetches web page content using a Playwright headless browser, executing JavaScript to handle dyn… | 45 | 1088 | active |
| rhymes-ai/Aria Aria is an open multimodal native Mixture-of-Experts (MoE) model with 25.3B total parameters (3.9B activated per token) and a 64K multimoda… | 23 | 1088 | active |
| titanwings/ex-skill A Python tool that generates Claude Code / OpenClaw agent 'skills' capturing a specific person's texting persona from chat history (WeChat,… | 56 | 1087 | active |