Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| phuryn/pm-skills PM Skills Marketplace is a curated library of over 100 AI‑driven product management skills, commands, and plugins for Claude and other assi… | 75 | 26583 | active |
| huggingface/open-r1 Open R1 is Hugging Face's fully open reproduction of the DeepSeek-R1 training pipeline, providing scripts for supervised fine-tuning, GRPO … | 65 | 26481 | active |
| MiniCPM MiniCPM-V and MiniCPM-o are a series of small multimodal large language models for efficient image, video, and audio understanding, deploya… | 59 | 26452 | active |
| mozilla-ai/llamafile Llamafile packages LLMs and Whisper models into a single, portable executable. It runs locally on most operating systems without any instal… | 90 | 26224 | active |
| promptfoo/promptfoo Promptfoo is an open‑source command‑line tool and library for evaluating, testing, and red‑teaming LLM applications, agents, and RAG pipel… | 93 | 26091 | active |
| Agent2Agent (A2A) Protocol Agent2Agent (A2A) is an open protocol, hosted under the Linux Foundation, that standardizes communication and interoperability between opaq… | 80 | 26020 | active |
| Cinnamon/kotaemon Kotaemon is an open-source RAG-based application providing a clean, customizable UI for chatting and doing question answering with your own… | 79 | 25795 | active |
| TOON TOON (Token-Oriented Object Notation) is a compact, human‑readable serialization format for JSON data designed for LLM prompts. It provides… | 78 | 25440 | active |
| TOON TOON (Token-Oriented Object Notation) is a compact, human-readable encoding of the JSON data model designed to reduce token usage in LLM pr… | 78 | 25440 | active |
| microsoft/OmniParser OmniParser is a screen parsing tool from Microsoft that converts UI screenshots into structured, understandable elements to ground vision-l… | 55 | 25431 | active |
| microsoft/JARVIS JARVIS (HuggingGPT) is a system that uses an LLM as a controller to plan tasks and orchestrate numerous expert ML models from the HuggingFa… | 42 | 25307 | active |
| titanwings/distilly Distilly is a Python tool that distills a person's experience, judgment, voice, and working style from messages, documents, interviews, and… | 59 | 25182 | active |
| Dao-AILab/flash-attention Official implementation of FlashAttention, FlashAttention-2, -3, and -4: fast and memory-efficient exact attention kernels for GPUs. It acc… | 92 | 25116 | active |
| haotian-liu/LLaVA LLaVA (Large Language and Vision Assistant) is an open-source multimodal large language model framework implementing visual instruction tun… | 21 | 25067 | active |
| google-ai-edge/gallery Google AI Edge Gallery is a mobile and desktop app that lets you run large language models and multimodal AI directly on your device. It pr… | 87 | 25018 | active |
| deepseek-ai/DeepSeek-Coder DeepSeek Coder is a series of open code language models (1B to 33B) trained from scratch on 2T tokens of code and natural language, with a … | 47 | 24295 | active |
| OpenWork OpenWork is a free, open-source desktop app for building and sharing AI agent workflows, positioned as an open-source alternative to Claude… | 79 | 24170 | active |
| PaddlePaddle PaddlePaddle is an industrial-grade deep learning framework written in C++ with Python APIs, supporting high-performance single-machine and… | 92 | 24105 | active |
| SuperClaude-Org/SuperClaude_Framework SuperClaude is a configuration framework that enhances Claude Code with 30 specialized slash commands, 20 cognitive personas, 7 behavioral … | 74 | 23914 | active |
| verl-project/verl Verl is a flexible, efficient, and production‑ready reinforcement learning library for large language models. It provides a modular API to … | 84 | 23828 | active |
| vanna-ai/vanna Vanna is an open-source Python framework for building user-aware AI agents that translate natural-language questions into SQL queries, char… | 10 | 23812 | active |
| sinaptik-ai/pandas-ai PandasAI is a Python library that lets users query data in SQL, CSV, or parquet format using natural language, powered by LLMs and RAG. It … | 52 | 23808 | active |
| QwenAudio/CosyVoice CosyVoice is a multilingual large voice generation model (TTS) with full-stack inference, training, and deployment support. It offers zero-… | 58 | 23763 | active |
| Archon Archon is an open-source workflow engine for AI coding agents that lets you define development processes (planning, implementation, validat… | 89 | 23704 | active |
| antirez/ds4 DwarfStar (ds4) is a native inference engine for running large language models like DeepSeek V4 Flash and GLM 5.x on consumer hardware. It … | 57 | 23620 | active |
| HKUDS/RAG-Anything RAG-Anything is a Python-based, all‑in‑one Retrieval‑Augmented Generation framework that supports text, images, tables, and math. It provid… | 86 | 23584 | active |
| mlc-ai/mlc-llm MLC LLM is a machine learning compiler and high-performance deployment engine for large language models, built on TVM-based ML compilation.… | 61 | 23176 | active |
| 1Panel-dev/MaxKB MaxKB is an open-source, self-hosted platform for building enterprise-grade AI agents with RAG pipelines, workflow orchestration, and MCP t… | 96 | 22992 | active |
| jundot/omlx oMLX is a macOS‑native LLM inference server that runs on Apple Silicon and provides continuous batching and tiered KV caching. It can be ma… | 79 | 22914 | active |
| HKUDS/AI-Trader AI-Trader is an agent-native trading platform where autonomous AI agents register, trade, and compete with live mark-to-market scoring and … | 53 | 22799 | active |
| NemoClaw NVIDIA NemoClaw is an open-source reference stack for running AI coding agents such as OpenClaw, Hermes, and LangChain Deep Agents Code sec… | 69 | 22754 | active |
| Opik Opik is an open‑source platform for LLM observability, evaluation and agent tracing. It provides dashboards, automated metrics and a conver… | 93 | 22726 | active |
| Opik Opik is an open-source LLM observability and evaluation platform by Comet for tracing, evaluating, and monitoring LLM applications, RAG pip… | 93 | 22726 | active |
| wavetermdev/waveterm Wave Terminal is an open-source, cross-platform terminal emulator with integrated AI assistance, durable SSH sessions, file previews, a bui… | 89 | 22405 | active |
| Builder.io A Node.js/TypeScript crawler that scrapes one or more websites and generates knowledge files (JSON) for creating custom GPTs or OpenAI assi… | 28 | 22405 | active |
| microsoft/unilm Microsoft's collection of large-scale self-supervised pre-trained models spanning tasks, 100+ languages, and modalities (text, image, layou… | 66 | 22219 | active |
| PromtEngineer/localGPT LocalGPT is a fully private, on-premise document intelligence platform that lets users chat with, summarize, and query their own documents … | 71 | 22197 | active |
| ONNX Runtime ONNX Runtime is a cross-platform, high-performance machine-learning accelerator for running inference and training on ONNX models. It suppo… | 100 | 22115 | stable |
| PrimeIntellect-ai/prime-agent Prime Agent is an open‑source autonomous coding and research assistant built in Rust. It runs as a persistent REPL that can call sub‑agents… | 82 | 22065 | active |
| Agent Development Kit (ADK) The Agent Development Kit (ADK) is an open‑source, code‑first SDK for building, evaluating, and deploying AI agents across multiple languag… | 83 | 21903 | active |
| snarktank/ralph Ralph is an autonomous AI agent loop that repeatedly runs AI coding tools like Amp or Claude Code until all items in a product requirements… | 42 | 21874 | active |
| jina-ai/serve Jina-serve is a Python framework for building and deploying multimodal AI services that communicate via gRPC, HTTP, and WebSockets. It prov… | 36 | 21854 | active |
| Guidance Guidance is a Python library that provides a domain‑specific language for steering large language models. It lets developers embed conditio… | 73 | 21799 | active |
| Guidance Guidance is a Python library providing an efficient programming paradigm for steering large language models, letting you interleave control… | 73 | 21799 | active |
| huggingface/peft 🤗 PEFT is a Python library that provides state‑of‑the‑art parameter‑efficient fine‑tuning methods for large pretrained models. It integrate… | 95 | 21795 | active |
| coze-dev/coze-studio Coze Studio is an open-source, all-in-one AI agent development platform with visual, no-code/low-code tools for building, debugging, and de… | 67 | 21698 | active |
| KKKKhazix/khazix-skills Khazix Skills is a Python‑based collection of ready‑to‑use AI Agent Skills that follow the open Agent Skills standard. Each skill is a stru… | 59 | 21494 | active |
| AI4Finance-Foundation/FinGPT FinGPT is an open-source financial large language model project from the AI4Finance Foundation, providing domain-tuned models, fine-tuning … | 76 | 21352 | active |
| huggingface/candle Candle is a minimalist machine learning framework for Rust focused on performance and ease of use, with CPU and CUDA GPU support. It ships … | 74 | 21182 | active |
| pydantic/pydantic-ai Pydantic AI is a typed Python SDK for building AI agents and LLM applications. It provides an extensible agent loop, multi‑modal capabiliti… | 87 | 20670 | active |
| openai/gpt-oss gpt-oss provides open-weight large language models (120B and 20B) with full chain‑of‑thought reasoning and native agentic capabilities. The… | 66 | 20428 | active |
| kortix-ai/suna Kortix is an open-source AI operating system that lets teams build, run, and govern AI agents from a single git‑based repository. It provid… | 86 | 20288 | active |
| karpathy/llama2.c A minimal, dependency-free implementation of the Llama 2 LLM architecture that trains in PyTorch and runs inference in a single ~700-line p… | 29 | 20192 | active |
| SETA OWL is a multi-agent collaboration framework built on the CAMEL-AI framework for automating real-world tasks through dynamic agent interact… | 65 | 20153 | active |
| LLM Wiki LLM Wiki is a cross-platform desktop application that automatically turns your documents into an organized, interlinked knowledge base. Unl… | 76 | 20016 | active |
| Alibaba-NLP/DeepResearch Tongyi DeepResearch is an open-source agentic large language model (30.5B total parameters, 3.3B activated per token) plus training and inf… | 49 | 20014 | active |
| QwenLM/Qwen3-VL Qwen3-VL is a series of open-weight multimodal vision-language models from Alibaba's Qwen team, available in Dense and MoE architectures wi… | 49 | 19998 | active |
| dzhng/deep-research An AI-powered deep research agent that iteratively generates search queries, scrapes web content, and refines its research direction using … | 52 | 19779 | active |
| teng-lin/notebooklm-py notebooklm-py is an unofficial Python SDK that provides programmatic access to Google Gemini Notebook (formerly NotebookLM). It includes a … | 83 | 19708 | active |
| elizaOS/eliza elizaOS is an open‑source TypeScript framework and product stack for building autonomous AI agents. It provides a runtime, CLI, cloud servi… | 90 | 19622 | active |
| kvcache-ai/ktransformers KTransformers is a Python library that provides a high‑performance framework for heterogeneous CPU‑GPU inference and fine‑tuning of large l… | 91 | 19618 | active |
| openai/evals OpenAI Evals is a Python framework for evaluating large language models and LLM-based systems, with an open-source registry of benchmark ev… | 63 | 19500 | active |
| LifeOS Fabric is an open‑source Go framework that lets users organize and invoke AI prompts as modular building blocks. It provides a CLI and REST… | 79 | 19387 | active |
| LifeOS LifeOS is an open-source, AI-powered 'life operating system' that captures your goals, context, and ideal state, then uses that personal co… | 79 | 19387 | active |
| openai/tiktoken tiktoken is a fast byte pair encoding (BPE) tokenizer library for Python built for OpenAI's language models, converting text into reversibl… | 84 | 19312 | stable |
| WebLLM WebLLM is a high‑performance in‑browser LLM inference engine written in TypeScript. It runs large language models directly in the browser u… | 90 | 19160 | active |
| lss233/kirara-ai Kirara AI is a self-hosted, DIY multimodal AI chatbot framework that connects large language models (DeepSeek, ChatGPT, Claude, Gemini, Oll… | 43 | 19123 | active |
| nesquena/hermes-webui Hermes WebUI is a lightweight, dark-themed web interface for the Hermes Agent, providing full CLI parity from a browser or phone. It runs a… | 78 | 18980 | active |
| state-spaces/mamba Mamba is a PyTorch library implementing the selective state space model (SSM) architecture for linear-time sequence modeling, with hardware… | 80 | 18874 | active |
| confident-ai/deepeval DeepEval is an open-source Python framework for evaluating LLM applications with pytest-style unit tests and 50+ research-backed metrics in… | 95 | 18733 | active |
| meta-llama/llama-cookbook The Llama Cookbook is a collection of Jupyter notebooks and scripts that demonstrate how to use Meta's Llama models for inference, fine‑tun… | 54 | 18559 | active |
| vercel-labs/json-render json-render is a Generative UI framework that lets AI generate dynamic, personalized interfaces from natural language prompts, constrained … | 76 | 18472 | active |
| microsoft/agent-lightning Agent Lightning is a lightweight (~3,500-line) agentic reinforcement learning framework from Microsoft for training LLM-powered agents with… | 82 | 18410 | active |
| browser-use/browser-harness Browser Harness is a self-healing Python harness that connects LLM agents directly to a real browser via a single editable CDP websocket. A… | 79 | 18360 | active |
| arc53/DocsGPT DocsGPT is an open-source AI platform for building private agents, assistants, and enterprise search over your own documents. It includes a… | 97 | 18312 | active |
| Parlant Parlant is an open-source Python framework that acts as an interaction control harness for building reliable, customer-facing LLM agents. I… | 78 | 18298 | active |
| LangBot LangBot is an open-source, production-grade platform for building AI-powered instant messaging bots, connecting LLMs and agent workflows to… | 95 | 18291 | active |
| LangChain LangChain.js is a TypeScript framework for building LLM-powered applications, providing standard interfaces for agents, models, embeddings,… | 95 | 18284 | active |
| xming521/WeClone WeClone is an end-to-end Python framework for creating a personal AI digital twin by fine-tuning large language models on your exported cha… | 78 | 18278 | active |
| RightNow-AI/openfang OpenFang is an open-source Agent Operating System written in Rust that runs autonomous AI agents on schedules, 24/7, with pre-built capabil… | 63 | 18208 | active |
| NVIDIA/Megatron-LM NVIDIA's GPU-optimized library for training large transformer models at scale, comprising Megatron-LM (reference training scripts) and Mega… | 100 | 18178 | active |
| DeepWiki / Grok Wiki DeepWiki-Open (now Grok-Wiki) is an open-source, AI-powered tool that automatically generates interactive wikis, documentation, diagrams, a… | 62 | 18138 | active |
| NVIDIA/SkillSpector SkillSpector is a security scanner for AI agent skills used by Claude Code, Codex CLI, Gemini CLI, and MCP-based agents. It detects vulnera… | 79 | 18115 | active |
| rowboatlabs/rowboat Rowboat is an open-source desktop AI coworker that indexes your email, meetings, Slack, and conversations into a living backlinked knowledg… | 86 | 17974 | active |
| camel-ai/camel CAMEL is an open-source Python framework for building multi-agent AI systems, providing agents, role-based societies, memory, RAG pipelines… | 82 | 17834 | active |
| WrenAI WrenAI is an open-source generative BI (GenBI) engine that turns natural-language questions into governed SQL, charts, and dashboards acros… | 87 | 17826 | active |
| rocketride-org/rocketride-server RocketRide is an open-source AI pipeline engine with a high-throughput C++ runtime and 100+ Python-extensible nodes for building, debugging… | 82 | 17760 | active |
| deepseek-ai/Janus Janus-Series is DeepSeek's family of unified multimodal models (Janus, Janus-Pro, JanusFlow) that combine multimodal understanding and imag… | 23 | 17755 | active |
| lidge-jun/opencodex opencodex is a lightweight local proxy (installed via npm, running on a bundled Bun runtime) that translates OpenAI Codex's Responses API a… | 77 | 17631 | active |
| microsoft/SkillOpt SkillOpt is a Python library from Microsoft that trains reusable natural-language skills for frozen LLM agents using trajectory-driven edit… | 73 | 17295 | active |
| QwenLM/Qwen-Agent Qwen-Agent is a Python framework for building LLM agent applications on top of Qwen models, providing function calling, MCP support, code i… | 58 | 17128 | active |
| cft0808/edict Edict is a multi-agent orchestration system for OpenClaw that organizes 12 specialized AI agents into a Tang-dynasty Three Departments and … | 59 | 16979 | active |
| MemoriLabs/Memori Memori is agent-native memory infrastructure that turns LLM agent execution and conversation into structured, persistent state. It ships as… | 76 | 16866 | active |
| HKUDS/DeepCode DeepCode is an open agentic coding framework from HKUDS that orchestrates multi-agent LLM pipelines to autonomously generate production-gra… | 87 | 16710 | active |
| MCP Toolbox for Databases MCP Toolbox for Databases is an open source Model Context Protocol (MCP) server, written in Go, that connects AI agents, IDEs, and applicat… | 92 | 16669 | active |
| xbtlin/ai-berkshire A collection of AI research skills for Claude Code and Codex that systematizes the value investing methodologies of Buffett, Munger, Duan Y… | 60 | 16597 | active |
| memvid/memvid Memvid is a single-file memory layer for AI agents that packages data, embeddings, and search indexes into one portable .mv2 file. It repla… | 72 | 16550 | active |
| ai-shifu/ChatALL ChatALL is an Electron desktop application that sends prompts to multiple AI chatbots (ChatGPT, Claude, Bing Chat, ChatGLM, ERNIE, and more… | 72 | 16503 | active |
| Trigger.dev Trigger.dev is an open-source TypeScript platform for building and deploying durable background jobs, long-running AI workflows, and AI age… | 94 | 16478 | active |
| ag-ui-protocol/ag-ui AG-UI is an open, lightweight, event-based protocol that standardizes how AI agent backends connect to user-facing frontend applications. I… | 82 | 16423 | active |