Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| eastlondoner/vibe-tools vibe-tools is a TypeScript CLI that gives AI coding agents like Cursor an 'AI team' of subagents and advanced skills such as browser automa… | 35 | 4822 | active |
| rivet-dev/agentos agentOS is a library that gives AI agents a lightweight operating system running inside your existing backend process, using WebAssembly an… | 94 | 4809 | active |
| Chonkie Chonkie is a lightweight Python library for chunking text in RAG pipelines, offering multiple chunking algorithms, embeddings, and integrat… | 81 | 4790 | active |
| eugeniughelbur/obsidian-second-brain A cross-platform AI agent skill that gives CLI coding agents like Claude Code, Codex, and Gemini CLI persistent long-term memory stored as … | 83 | 4786 | active |
| SakuraLLM/SakuraLLM SakuraLLM is a series of fine-tuned open large language models for Japanese-to-Chinese translation specialized in light novel and Galgame (… | 57 | 4785 | active |
| SeldonIO/seldon-core Seldon Core 2 is an MLOps and LLMOps framework for deploying, managing, and scaling machine learning models and modular AI applications on … | 66 | 4782 | active |
| facebookresearch/lingua Meta Lingua is a minimal, fast LLM training and inference library built on easy-to-modify PyTorch components for research purposes. It supp… | 33 | 4771 | active |
| openai/chatgpt-retrieval-plugin A FastAPI-based retrieval backend that provides semantic search over personal or organizational documents using natural language queries, w… | 31 | 21249 | maintenance |
| liveblocks/liveblocks Liveblocks is a realtime collaboration infrastructure and SDK toolkit for adding multiplayer features, comments, notifications, and AI copi… | 95 | 4758 | stable |
| MemeCalculate/moyin-creator Moyin Creator is a production-grade AI film creation desktop application that covers the full pipeline from script to finished video, with … | 73 | 4756 | active |
| infiniflow/infinity Infinity is an AI-native database built for LLM applications, offering high-performance hybrid search across dense vectors, sparse vectors,… | 99 | 4740 | active |
| Kimi-Audio Kimi-Audio is an open-source audio foundation model (7B parameters) that unifies audio understanding, generation, and speech conversation i… | 28 | 4736 | active |
| deepseek-ai/Engram Official implementation of Engram, a conditional memory module from DeepSeek that modernizes N-gram embeddings for O(1) lookup as a new spa… | 41 | 4735 | active |
| latitude-dev/latitude-llm Latitude is an open-source, MIT-licensed AI agent observability and monitoring platform that captures production agent traffic as traces an… | 87 | 4728 | active |
| VectifyAI/OpenKB OpenKB is an open-source CLI tool that compiles raw documents (PDF, Word, Markdown, HTML, and more) into a structured, interlinked wiki-sty… | 71 | 4717 | active |
| PrimeIntellect-ai/verifiers verifiers is a Python library for creating environments to train and evaluate large language models with reinforcement learning. It integra… | 88 | 4712 | active |
| GeekAI GeekAI is an open-source, self-hosted AI content creation platform integrating chat, image generation (MidJourney, DALL-E, Stable Diffusion… | 92 | 4709 | active |
| Rivet Rivet is an open-source visual AI programming environment consisting of a desktop IDE for building AI agents and prompt chains via a node-b… | 73 | 4708 | active |
| x-cmd/x-cmd X-CMD is a POSIX shell (bash/zsh/ash/dash) toolkit offering 300+ shell/awk modules and a 600+ curated CLI package system, installable witho… | 93 | 4695 | active |
| u14app/deep-research Deep Research is a web application that uses any large language model (Gemini, OpenAI, Anthropic, DeepSeek, Grok, Ollama, etc.) combined wi… | 66 | 4691 | active |
| OpenNMT/CTranslate2 CTranslate2 is a C++ and Python library for fast, memory-efficient inference of Transformer models on CPU and GPU. It uses quantization, la… | 94 | 4684 | stable |
| OpenMinis OpenMinis is a free, open-source mobile AI agent app for iOS and Android that connects leading LLM providers (Claude, GPT, Gemini, etc.) vi… | 76 | 4673 | active |
| PKU-Alignment/align-anything Align-Anything is a modular Python framework for aligning any-to-any (all-modality) large models with human intentions and values using fee… | 45 | 4671 | active |
| microsoft/PyRIT PyRIT is Microsoft's open-source Python framework for identifying security and safety risks in generative AI systems. It provides automatio… | 88 | 4668 | active |
| inkeep/open-knowledge OpenKnowledge is an AI-native WYSIWYG markdown editor and knowledge base app for humans and LLM agents, available as a desktop app (macOS, … | 78 | 4656 | active |
| ruc-datalab/DeepAnalyze DeepAnalyze is the first agentic LLM (DeepAnalyze-8B, built on Qwen) for autonomous data science, capable of running the full pipeline from… | 61 | 4655 | active |
| langflow-ai/openrag OpenRAG is an open-source, pre-packaged Retrieval-Augmented Generation platform from IBM that combines Langflow, Docling, and OpenSearch in… | 86 | 4652 | active |
| IBM/mcp-context-forge ContextForge is an open-source AI gateway, registry, and proxy from IBM that federates MCP, A2A, and REST/gRPC APIs behind a unified endpoi… | 86 | 4646 | active |
| promptslab/Promptify Promptify is a Python library that turns LLMs into task-based NLP engines, providing high-level APIs for NER, classification, QA, and custo… | 62 | 4636 | active |
| NateBJones-Projects/OB1 Open Brain is a self-hosted personal memory infrastructure combining a vector-search database, an AI gateway, and an MCP server so any AI t… | 58 | 4632 | active |
| gradio-app/fastrtc FastRTC is a Python library that turns any Python function into a real-time audio and video stream over WebRTC or WebSockets. It includes b… | 52 | 4631 | active |
| Memgraph Memgraph is a high-performance, in-memory graph database written in C++ that is Cypher-compatible and ACID-compliant, with built-in vector,… | 100 | 4625 | stable |
| TencentCloudADP/youtu-agent Youtu-Agent is a Python framework for building, running, and evaluating autonomous LLM agents, supporting ReAct-style single agents and pla… | 52 | 4622 | active |
| JetBrains/koog Koog is a JetBrains-built Kotlin/Java framework for creating fault-tolerant, enterprise-ready AI agents on the JVM, with multiplatform depl… | 86 | 4617 | active |
| mini-swe-agent SWE-agent is a Python framework that lets a language model autonomously use tools to fix GitHub issues, find cybersecurity vulnerabilities,… | 67 | 20450 | maintenance |
| VRSEN/agency-swarm Agency Swarm is a Python framework for building multi-agent AI applications on top of the OpenAI Agents SDK. It lets developers define spec… | 91 | 4601 | active |
| FareedKhan-dev/all-agentic-architectures A Python library packaging 35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, etc.) as runnable Arch… | 58 | 4600 | active |
| kyegomez/tree-of-thoughts A Python library implementing the Tree of Thoughts algorithm for deliberate, multi-step problem solving with large language models. It prov… | 64 | 4595 | active |
| fixie-ai/ultravox Ultravox is a fast multimodal LLM that understands human speech directly without a separate ASR stage, by projecting audio into the LLM's e… | 40 | 4577 | active |
| thirdlayerinc/autoagent AutoAgent is a Python-based meta-agent harness that autonomously builds and iterates on AI agent harnesses. It edits an agent's system prom… | 45 | 4575 | active |
| phodal/auto-dev AutoDev is an AI-native multi-agent coding development platform built on Kotlin Multiplatform, distributed as an IntelliJ IDEA plugin, VS C… | 79 | 4548 | active |
| 0xNyk/council-of-high-intelligence A shell-based skill/plugin that runs structured multi-persona deliberation for hard decisions across AI coding agents like Claude Code, Cod… | 72 | 4539 | active |
| kirodotdev/KiroCrew Kiro Crew is an open-source persistent development workspace where AI agent crews run multi-step tasks unattended, remember context across … | 81 | 4534 | active |
| JoshuaC215/agent-service-toolkit A full toolkit for building and running an AI agent service using LangGraph, FastAPI, and Streamlit. It provides a template including a Lan… | 68 | 4531 | active |
| Embabel Agent Framework Embabel Agent is an agentic AI framework for the JVM, written in Kotlin with first-class Java and Spring Boot support. It provides typed, g… | 87 | 4528 | active |
| kaixindelele/ChatPaper ChatPaper is a Python tool that uses ChatGPT to summarize arXiv papers, translate full PDFs, polish academic writing, and simulate peer rev… | 59 | 19943 | maintenance |
| pydantic/logfire Pydantic Logfire is an AI observability platform built on OpenTelemetry that traces LLM calls, agent runs, and application telemetry in one… | 86 | 4512 | active |
| IvanMurzak/Unity-MCP A Unity plugin, MCP server, and CLI that lets AI agents (Claude, Cursor, Copilot, Gemini, Codex, etc.) build, edit, and playtest Unity game… | 84 | 4512 | active |
| FlowElement-xinliuyuansu/m_flow M-flow is a Python bio-inspired cognitive memory engine that treats graph topology as the retrieval scoring engine rather than a supportive… | 58 | 4511 | active |
| openai/harmony OpenAI's Rust library (with first-class Python bindings) for rendering and parsing the harmony response format used by its open-weight gpt-… | 49 | 4506 | active |
| microsoft/LMOps A Microsoft research initiative collecting code and papers on fundamental techniques for building AI products with large language models, c… | 75 | 4484 | active |
| MarkusPfundstein/mcp-obsidian An MCP (Model Context Protocol) server that lets AI assistants like Claude interact with an Obsidian vault through the Local REST API commu… | 63 | 4484 | active |
| crmne/ruby_llm RubyLLM is a Ruby framework providing a unified, expressive interface to all major AI providers (OpenAI, Anthropic, Google, Ollama, and any… | 88 | 4472 | active |
| gptme gptme is a free, open-source personal AI agent that runs in the terminal, equipped with local tools for shell execution, code writing, file… | 98 | 4457 | active |
| EvolvingLMMs-Lab/lmms-eval lmms-eval is a unified Python framework for evaluating large multimodal models across text, image, video, and audio tasks, with 100+ benchm… | 87 | 4453 | active |
| memory-lancedb-pro A LanceDB-backed long-term memory plugin for OpenClaw agents that stores preferences, decisions, and project context, then automatically re… | 72 | 4453 | active |
| mosaicml/llm-foundry LLM Foundry is a PyTorch-based codebase for training, finetuning, evaluating, and deploying large language models from 125M to 70B+ paramet… | 61 | 4449 | active |
| zhukunpenglinyutong/desktop-cc-gui Desktop CC GUI (ccgui) is an open-source multi-engine AI coding desktop client built with Tauri 2, React 19, TypeScript, and Rust. It wraps… | 78 | 4445 | active |
| zgsm-ai/costrict CoStrict is an open-source, enterprise-focused AI coding assistant delivered as VS Code and JetBrains extensions, offering strict-mode code… | 81 | 4444 | active |
| meta-llama/PurpleLlama Purple Llama is Meta's umbrella project of tools and benchmarks for assessing and improving the security of large language models. It inclu… | 72 | 4444 | active |
| ragapp/ragapp RAGapp is a self-hosted, Docker-deployable application for building Agentic RAG chatbots, configurable through an admin UI similar to OpenA… | 27 | 4441 | active |
| docker/docker-agent Docker Agent is an open-source CLI (and Docker CLI plugin) that lets developers build, run, and share AI agents defined declaratively in YA… | 80 | 4433 | active |
| Observal/Observal Observal is a self-hosted registry and control plane for coding agent extensions such as Skills, MCP servers, and Agents, with a built-in i… | 82 | 4429 | active |
| zai-org/GLM-4.5 GLM-4.5 (and successors GLM-4.6/4.7) is a family of open-weight Mixture-of-Experts foundation models from Z.ai focused on agentic tasks, re… | 44 | 4424 | active |
| modelscope/ms-agent MS-Agent is a lightweight Python framework from ModelScope for building LLM-powered agents with autonomous exploration capabilities. It sup… | 85 | 4416 | active |
| microsoft/FLAML FLAML is a lightweight Python library for automated machine learning (AutoML) and hyperparameter tuning. It efficiently finds quality model… | 94 | 4414 | active |
| open-compass/VLMEvalKit VLMEvalKit is an open-source Python toolkit for evaluating large vision-language models (LMMs/LVLMs) across 80+ benchmarks with support for… | 61 | 4412 | active |
| GPT-Vis A Model Context Protocol (MCP) server, written in TypeScript, that exposes tools for generating 26+ chart types using the AntV visualizatio… | 71 | 4391 | active |
| archestra-ai/archestra Archestra is an open-source, self-hosted enterprise AI platform combining an agentic chat UI, agent runtime, LLM gateway/proxy, MCP gateway… | 82 | 4386 | active |
| open-webui/mcpo mcpo is a lightweight Python proxy that takes any MCP (Model Context Protocol) server command and exposes its tools as a standard OpenAPI-c… | 64 | 4385 | active |
| Kiro Kiro is an agentic IDE and CLI that helps developers go from prototype to production using spec-driven development, agent hooks, powers, an… | 64 | 4372 | active |
| Cloudflare MCP Server A collection of Model Context Protocol (MCP) servers from Cloudflare that let MCP clients like Cursor or Claude manage Cloudflare services … | 81 | 4365 | active |
| Doriandarko/maestro Maestro is a Python framework that uses an orchestrator LLM (originally Claude Opus) to break down objectives into sub-tasks, delegate them… | 26 | 4357 | active |
| Dimillian/CodexMonitor CodexMonitor is a Tauri-based desktop application for orchestrating multiple OpenAI Codex agents across local workspaces. It provides works… | 54 | 4341 | active |
| UditAkhourii/adhd ADHD is a TypeScript skill for coding agents built on the Claude and Codex Agent SDKs that implements parallel divergent ideation via tree-… | 61 | 4326 | active |
| 53AI Hub 53AI Hub is an open-source AI portal and knowledge base platform for publishing and operating AI agents, prompts, and AI tools. It integrat… | 84 | 4323 | active |
| ymcui/Chinese-LLaMA-Alpaca A project releasing Chinese-adapted LLaMA and instruction-tuned Alpaca large language models with extended Chinese vocabulary, plus pre-tra… | 53 | 18936 | maintenance |
| ModelTC/LightLLM LightLLM is a Python-based LLM inference and serving framework designed for lightweight deployment, easy scalability, and high throughput. … | 81 | 4317 | active |
| tloen/alpaca-lora A repository of scripts for reproducing Stanford Alpaca-style instruction tuning of LLaMA models using low-rank adaptation (LoRA) on consum… | 31 | 18899 | maintenance |
| Mike Mike is an open-source, self-hostable legal AI platform combining a Next.js frontend and Express backend for document review, drafting, and… | 77 | 4308 | active |
| algorithmicsuperintelligence/optillm OptiLLM is an OpenAI API-compatible optimizing inference proxy that applies 20+ inference-time techniques (e.g., Mixture of Agents, MCTS, c… | 84 | 4307 | active |
| composio-community/open-claude-cowork An open-source desktop chat application powered by the Claude Agent SDK and Composio Tool Router, offering 500+ SaaS app integrations (Gmai… | 50 | 4289 | active |
| google-gemini/gemini-skills A collection of agent skills (context packages) for the Gemini API, SDKs, and model interactions, installable into AI coding assistants via… | 60 | 4279 | active |
| robinebers/openusage OpenUsage is a free, open-source native macOS menu bar app that tracks usage of AI coding subscriptions like Claude, Codex, Cursor, Copilot… | 80 | 4275 | active |
| nolabs-ai/nono nono is a Rust-based CLI and SDK that runs AI coding agents and their tool invocations in ephemeral, kernel-enforced micro sandboxes with c… | 76 | 4273 | active |
| wang2122/sprix-sage-router Sprix SAGE Router is a Python decision layer for Agent2Agent (A2A) networks that routes tasks across three modes—SELF, COLLABORATE, and HAN… | 63 | 4261 | active |
| leetcode-mafia/cheetah Cheetah is a macOS app that provides real-time AI coaching for software engineering interviews. It transcribes conversation audio locally w… | 21 | 4260 | active |
| ThilinaRajapakse/simpletransformers Simple Transformers is a Python library built on Hugging Face Transformers that lets users train, fine-tune, and evaluate Transformer model… | 57 | 4256 | active |
| CodeGraphContext/CodeGraphContext CodeGraphContext (CGC) is an MCP server and CLI tool that indexes local codebases into a graph database, exposing code structure and relati… | 81 | 4251 | active |
| haris-musa/excel-mcp-server A Model Context Protocol (MCP) server that lets AI agents create, read, and modify Excel workbooks without Microsoft Excel installed. It su… | 88 | 4245 | active |
| openagents-org/openagents OpenAgents is an open-source platform (Apache-2.0) for building, connecting, and orchestrating collaborative multi-agent AI systems. It com… | 84 | 4245 | active |
| danveloper/flash-moe An application for running large language models locally on small laptops, written in Objective-C. It enables on-device inference of big mo… | 44 | 4238 | active |
| basicmachines-co/basic-memory Basic Memory is an open-source, local-first MCP server that gives AI assistants persistent memory as a knowledge graph of plain Markdown fi… | 82 | 4235 | active |
| nyldn/claude-octopus A Claude Code plugin that orchestrates multiple AI model providers (Codex, Copilot, Gemini, Ollama, and others) against the same task, usin… | 79 | 4224 | active |
| zhayujie/bot-on-anything Bot on Anything is a lightweight Python framework for building AI chatbots that connect large language models (ChatGPT, Claude, Gemini, ERN… | 59 | 4222 | active |
| eth-sri/lmql LMQL is a query/programming language for large language models, implemented as a Python-based superset that lets developers interleave prom… | 29 | 4221 | active |
| SylphAI-Inc/AdalFlow AdalFlow is a PyTorch-like Python library for building and auto-optimizing LLM application workflows such as chatbots, RAG pipelines, and a… | 62 | 4220 | active |
| thinking-machines-lab/tinker-cookbook Tinker Cookbook is a Python library of realistic examples and abstractions for post-training (fine-tuning) language models via the Tinker A… | 84 | 4199 | active |
| darkzOGx/youtube-automation-agent AgentTube is a self-hosted Node.js application that uses AI agents to run a YouTube channel end to end: researching topics, writing scripts… | 80 | 4186 | active |
| Chevey339/kelivo Kelivo is an open-source, cross-platform LLM chat client built with Flutter that runs on Android, iOS, HarmonyOS, Windows, macOS, and Linux… | 84 | 4176 | active |