Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| BeehiveInnovations/pal-mcp-server PAL MCP (formerly Zen MCP) is a Model Context Protocol server that lets AI coding CLIs like Claude Code, Gemini CLI, and Codex CLI orchestr… | 44 | 11773 | active |
| tensorzero/tensorzero TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation behi… | 10 | 11716 | active |
| CocoIndex CocoIndex is an open-source incremental data framework for AI, with a Rust engine and a declarative Python API that keeps sources (files, S… | 84 | 11711 | active |
| microsoft/autogen AutoGen is a Python framework from Microsoft for building multi-agent AI applications where LLM-powered agents can act autonomously or coll… | 62 | 61080 | maintenance |
| elder-plinius/G0DM0D3 G0DM0D3 is an open-source, multi-model AI chat interface designed for red-teaming, cognition research, and unrestricted LLM interaction. It… | 53 | 11643 | active |
| UI-TARS UI-TARS is ByteDance's open-source multimodal AI agent stack, comprising Agent TARS (a CLI/Web UI multimodal agent that operates terminals,… | 46 | 11567 | active |
| MemTensor/MemOS MemOS is a memory operating system for LLMs and AI agents that unifies storing, retrieving, and managing long-term, multi-modal memory thro… | 83 | 11513 | active |
| linyqh/NarratoAI NarratoAI is an open-source, self-hosted AI-powered video commentary and automated editing tool. It uses large language models to generate … | 86 | 11474 | active |
| EKKOLearnAI/hermes-studio Hermes Studio is a local-first multi-agent workspace that provides a desktop app, local runtime, and web console for coordinating AI agent … | 78 | 11462 | active |
| kangarooking/cangjie-skill Cangjie Skill is a Python-based tool that distills methodologies from high-value content like books, long-form videos, and podcasts into ex… | 78 | 11455 | active |
| getagentseal/codeburn CodeBurn is a free, local-first tool that tracks AI coding token usage and cost across 41 AI coding tools (Claude Code, Cursor, Codex, Gemi… | 78 | 11447 | active |
| holaboss-ai/holaOS holaOS is an open-source, local-first agentic desktop workspace built with Electron and TypeScript that lets enterprises assemble their own… | 63 | 11447 | active |
| cobusgreyling/loop-engineering A collection of patterns, starter templates, and npm CLI tools for 'loop engineering' — designing automated loops that prompt and orchestra… | 76 | 11446 | active |
| wangrongding/wechat-bot A Node.js-based multi-platform instant messaging AI agent built on Wechaty that connects WeChat, Telegram, WhatsApp, and Lark to LLM provid… | 65 | 11421 | active |
| salesforce/LAVIS LAVIS is a Python library from Salesforce AI Research providing a unified toolkit for language-vision (multimodal) intelligence, including … | 10 | 11264 | active |
| kyutai-labs/moshi Moshi is a speech-text foundation model and full-duplex spoken dialogue framework from Kyutai, built around the Mimi streaming neural audio… | 56 | 11263 | active |
| github/copilot-cli GitHub Copilot CLI brings the Copilot coding agent to the terminal, letting developers build, debug, and refactor code through natural lang… | 95 | 11253 | active |
| MiniCPM MiniCPM is a family of compact multimodal large language models designed for efficient image, video, and audio understanding on mobile devi… | 74 | 11232 | active |
| MiniCPM MiniCPM is a family of small, state-of-the-art on-device language models from OpenBMB, with MiniCPM5-1B being a dense 1B Transformer for lo… | 74 | 11232 | active |
| openai/openai-node The official JavaScript/TypeScript SDK for the OpenAI REST API, auto-generated from OpenAI's OpenAPI specification. It provides typed acces… | 96 | 11225 | stable |
| Doriandarko/claude-engineer An interactive AI assistant framework built on Anthropic's Claude 3.5 Sonnet that can autonomously generate and manage its own tools during… | 24 | 11211 | active |
| Pocket Flow Pocket Flow is a minimalist 100-line LLM framework in Python with zero dependencies, modeling LLM applications as a graph of nodes connecte… | 51 | 11208 | active |
| petergyang/no-ai-slop An AI agent skill/plugin that removes 20+ patterns of AI-generated writing clichés ('slop') from text while preserving the author's persona… | 74 | 11204 | active |
| tambo-ai/tambo Tambo is an open-source generative UI SDK for React that lets developers register components with Zod schemas so an AI agent can choose and… | 80 | 11182 | active |
| huggingface/tokenizers Hugging Face Tokenizers is a fast, Rust-based library implementing state-of-the-art tokenization algorithms (BPE, WordPiece, Unigram) with … | 95 | 11181 | stable |
| huggingface/skills A collection of Agent Skills (SKILL.md folders) that teach AI coding agents how to use the Hugging Face ecosystem, including the hf-cli ski… | 61 | 11176 | active |
| TEN-framework/ten-framework TEN is an open-source framework for building real-time multimodal conversational AI agents, with a focus on low-latency voice assistants. I… | 86 | 11173 | active |
| aden-hive/hive OpenHive is a model-agnostic multi-agent harness and runtime layer for production AI workloads, organizing specialized agents into 'colonie… | 72 | 11090 | active |
| bytebot-ai/bytebot Bytebot is a self-hosted, open-source AI desktop agent that operates a full containerized Linux desktop, using screen vision, mouse, and ke… | 10 | 11077 | active |
| Triton Inference Server NVIDIA Triton Inference Server is an open-source inference serving software that deploys AI models from multiple frameworks (TensorRT, PyTo… | 98 | 11075 | stable |
| langchain-ai/open-swe Open SWE is an open-source framework from LangChain for building an organization's internal asynchronous coding agent, built on LangGraph a… | 87 | 11049 | active |
| ValueCell-ai/valuecell ValueCell is a community-driven, multi-agent platform for financial applications, providing AI investment agents for stock selection, resea… | 54 | 11031 | active |
| SparkAudio/Spark-TTS Spark-TTS is an LLM-based text-to-speech system built on Qwen2.5 that generates speech directly from single-stream decoupled speech tokens.… | 24 | 10998 | active |
| huggingface/chat-ui Chat UI is the open source SvelteKit web application powering HuggingChat, providing a browser-based chat interface for LLMs. It connects t… | 79 | 10987 | active |
| trycompai/crm Comp AI CRM is an open-source, agentic-first customer relationship management application designed to be operated by autonomous AI agents r… | 75 | 10986 | active |
| NoeFabris/opencode-antigravity-auth An OpenCode plugin that authenticates against Google's Antigravity IDE via OAuth, letting users access Gemini and Claude models with their … | 10 | 10983 | active |
| alibaba/spring-ai-alibaba Spring AI Alibaba is a production-ready agentic AI framework for Java developers, built on Spring AI and a DAG-based Graph runtime. It prov… | 77 | 10966 | active |
| karpathy/minbpe A minimal, clean Python implementation of the byte-level Byte Pair Encoding (BPE) algorithm used for tokenization in modern LLMs like GPT-4… | 26 | 10830 | stable |
| multimodal-art-projection/YuE YuE is a family of open-source foundation models based on the LLaMA2 architecture that generate full songs (up to five minutes) with vocals… | 87 | 10822 | active |
| OpenPipe/ART ART (Agent Reinforcement Trainer) is an open-source Python framework for training multi-step LLM agents using reinforcement learning techni… | 85 | 10813 | active |
| WasmEdge WasmEdge is a lightweight, high-performance, extensible WebAssembly runtime hosted by CNCF, designed for cloud native, edge, and decentrali… | 98 | 10811 | active |
| sashabaranov/go-openai An unofficial Go client library for the OpenAI API covering chat completions, the Responses API, embeddings, image generation, audio transc… | 96 | 10778 | active |
| mcp-use mcp-use is a fullstack TypeScript framework for building MCP (Model Context Protocol) servers, ChatGPT Apps, and Claude connectors, with fu… | 83 | 10774 | active |
| VoltAgent/voltagent VoltAgent is an open-source TypeScript framework for building production-ready AI agents with memory, tools, RAG, guardrails, MCP, voice, a… | 82 | 10773 | active |
| numman-ali/openskills OpenSkills is a universal CLI that installs and loads Anthropic SKILL.md-format skills for any AI coding agent, including Claude Code, Curs… | 50 | 10767 | active |
| Tabnine Tabnine is an AI code completion and coding assistant that provides all-language autocompletion across major IDEs (VS Code, JetBrains, Subl… | 10 | 10767 | active |
| ChatGPTBox-dev/chatGPTBox A browser extension that deeply integrates ChatGPT into your browsing experience across Chrome, Edge, Firefox, Safari, and Android. It prov… | 91 | 10757 | active |
| presenton/presenton Presenton is an open-source AI presentation generator and API that creates editable PPTX and PDF slide decks from prompts, documents, or cu… | 80 | 10756 | active |
| thesysdev/openui OpenUI is an open-source, renderer-agnostic Generative UI framework built around OpenUI Lang, a compact streaming-first DSL that lets LLM a… | 85 | 10732 | active |
| open-gsd/gsd-core GSD Core is a meta-prompting, context-engineering, and spec-driven development framework that orchestrates AI coding agents (Claude Code, C… | 82 | 10725 | active |
| AntonOsika/gpt-engineer gpt-engineer is a Python CLI platform for experimenting with AI code generation, letting users specify software in natural language and wat… | 10 | 55049 | maintenance |
| chathub-dev/chathub ChatHub is an all-in-one AI chat client, originally a Chrome/Edge browser extension and now also a web app and mobile/desktop apps, that le… | 58 | 10658 | active |
| lencx/ChatGPT A cross-platform ChatGPT desktop application built with Tauri (Rust) for Mac, Windows, and Linux. It wraps the ChatGPT web experience in a … | 23 | 54645 | maintenance |
| abetlen/llama-cpp-python Python bindings for llama.cpp providing low-level ctypes access to the C API plus a high-level API for text completion with OpenAI-like int… | 92 | 10638 | active |
| bigscience-workshop/petals Petals is a Python library that lets you run and fine-tune large language models (Llama 3.1, Mixtral, Falcon, BLOOM) on a BitTorrent-style … | 23 | 10614 | active |
| dontbesilent2025/dbskill A Chinese-language AI Skills toolbox (31 skills) distilled from dontbesilent's public tweets, designed for agents like Claude Code, Codex, … | 76 | 10606 | active |
| a16z-infra/ai-town AI Town is a deployable starter kit for building a virtual town where AI characters live, chat, and socialize, inspired by the Generative A… | 70 | 10589 | active |
| NVIDIA/personaplex PersonaPlex is a real-time, full-duplex speech-to-speech conversational model from NVIDIA that supports persona control via text role promp… | 44 | 10567 | active |
| facebookresearch/xformers xFormers is a PyTorch-based library of hackable, optimized Transformer building blocks with custom CUDA kernels for fast, memory-efficient … | 87 | 10565 | active |
| GitHub Copilot SDK Awesome Copilot is a community‑curated collection of agents, instructions, skills, and plugins that extend GitHub Copilot. It provides read… | 79 | 10557 | active |
| GitHub Copilot SDK A multi-platform SDK exposing the GitHub Copilot CLI agent runtime for programmatic use, with official SDKs for Python, TypeScript, Go, .NE… | 79 | 10557 | active |
| akitaonrails/ai-memory A Rust CLI and MCP server that provides long-term memory for AI coding agent CLIs like Claude Code, Codex, and Devin. It captures session c… | 78 | 10555 | active |
| trailhq/Graft Graft is an open-source context layer for large codebases that builds a deterministic code graph using tree-sitter AST parsing and exposes … | 59 | 10536 | active |
| FalkorDB FalkorDB is an ultra-fast, multi-tenant property graph database built on GraphBLAS sparse adjacency matrices, queryable via OpenCypher with… | 92 | 10490 | active |
| sigoden/aichat AIChat is an all-in-one command-line LLM client written in Rust that connects to 20+ providers including OpenAI, Claude, Gemini, and Ollama… | 60 | 10471 | active |
| RunAnywhere RunAnywhere is a set of cross-platform SDKs (Swift, Kotlin, React Native, Flutter, TypeScript, C++) over a shared C++ core for running AI m… | 86 | 10332 | active |
| Kuberwastaken/claurst Claurst is an open-source, multi-provider terminal coding agent written in Rust, originally a clean-room reimplementation of Claude Code. I… | 82 | 10325 | active |
| StarTrail-org/PixelRAG PixelRAG is a Python library and hosted service for visual retrieval-augmented generation: it renders web pages and documents into screensh… | 77 | 10320 | active |
| chaitin/PandaWiki PandaWiki is an open-source, AI large-language-model-driven knowledge base system for building intelligent product docs, technical document… | 82 | 10309 | active |
| Metaflow Metaflow is a human-centric Python framework from Netflix for building, managing, and deploying real-life AI/ML and data science systems. I… | 92 | 10280 | stable |
| Astrid Astrid is a portable, capability-secure operating system for composable software, where every component runs as a sealed WebAssembly capsul… | 82 | 10279 | active |
| deepseek-ai/DeepEP DeepEP is a high-performance GPU communication library for expert parallelism (EP) in MoE training and inference, providing high-throughput… | 55 | 10263 | active |
| xai-org/grok-1 xAI's open release of the Grok-1 open-weights model (314B-parameter Mixture-of-Experts LLM) with JAX example code for loading and running i… | 26 | 52232 | maintenance |
| Narcooo/inkos InkOS is an AI agent system for story creation and multilingual translation, supporting long-form novels, scripts, interactive games, and I… | 79 | 10222 | active |
| InternVL InternVL is a family of open-source multimodal large language models (vision-language models) that combine vision transformers with LLMs to… | 34 | 10163 | active |
| open-jarvis/OpenJarvis OpenJarvis is a Python framework for building local-first personal AI agents that run on your own hardware, with cloud APIs as an optional … | 70 | 10144 | active |
| GetBindu/Bindu Bindu is an open-source Python framework that provides the identity, communication, and payments layer for AI agents, implementing the A2A … | 77 | 10062 | active |
| OpenRLHF/OpenRLHF OpenRLHF is a high-performance, production-ready open-source RLHF framework built on Ray + vLLM + DeepSpeed for scalable reinforcement lear… | 89 | 10040 | active |
| companion-inc/feynman Feynman is an open-source AI research agent that reads papers, searches the web, writes cited research drafts, plans experiments, and ranks… | 78 | 9938 | active |
| huggingface/accelerate Hugging Face Accelerate is a Python library that lets you run the same PyTorch training and inference code on any device or distributed con… | 94 | 9916 | stable |
| gorse-io/gorse Gorse is an AI-powered open-source recommender system engine written in Go that ingests items, users, and interaction feedback and automati… | 95 | 9876 | active |
| yihong0618/bilingual_book_maker A Python CLI tool that uses AI translation services (ChatGPT, Claude, Gemini, DeepL, and others) to create bilingual versions of epub, txt,… | 96 | 9825 | active |
| Tiiny-AI/PowerInfer PowerInfer is a CPU/GPU hybrid LLM inference engine that exploits activation locality to run large language models fast on consumer-grade h… | 60 | 9814 | active |
| HKUDS/AutoAgent AutoAgent is a fully-automated, zero-code framework for creating and deploying LLM agents using natural language alone. It acts as an auton… | 39 | 9806 | active |
| microsoft/UFO UFO³ is Microsoft's open-source framework for LLM-powered GUI agents that automate Windows applications and orchestrate workflows across mu… | 90 | 9789 | active |
| tmc/langchaingo Langchaingo is the Go language port of LangChain, providing composable building blocks for writing LLM-powered applications in Go. It offer… | 87 | 9712 | active |
| TencentCloud/Octop Octop is an open-source, self-hosted AI assistant built on a multi-agent, multi-user architecture that runs entirely on your own machine. I… | 81 | 9697 | active |
| mshumer/gpt-prompt-engineer A Jupyter Notebook-based tool that automatically generates, tests, and ranks LLM prompts for a given task using GPT-4, GPT-3.5-Turbo, or Cl… | 47 | 9681 | active |
| xorbitsai/inference Xinference is an open-source model serving platform for deploying LLMs, embedding, speech, image, and multimodal models via a unified OpenA… | 93 | 9616 | active |
| Mobilerun Mobilerun is an open-source Python framework for controlling Android and iOS devices with LLM-powered agents using natural language command… | 82 | 9613 | active |
| anthropics/claude-for-legal A suite of Claude plugins, skills, and MCP connectors from Anthropic for legal workflows across practice areas like commercial, privacy, li… | 58 | 9611 | active |
| CursorTouch/Windows-MCP Windows-MCP is a lightweight open-source MCP server that bridges LLM-based AI agents and the Windows operating system, letting agents contr… | 87 | 9590 | active |
| Higress Higress is a CNCF Sandbox, cloud-native AI-native API gateway built on Istio and Envoy, extensible with Wasm plugins written in Go, Rust, o… | 99 | 9568 | active |
| backnotprop/plannotator Plannotator is a local, browser-based review tool for AI coding agents like Claude Code, Codex, and Gemini CLI. It hooks into the agent's p… | 80 | 9548 | active |
| Spring AI Spring AI is an application framework for AI engineering that provides Spring-friendly, portable abstractions for integrating AI models int… | 94 | 9542 | active |
| GoogleCloudPlatform/knowledge-catalog A collection of tools, agents, and samples for Google Cloud's Knowledge Catalog (formerly Dataplex), an AI-powered data catalog and metadat… | 60 | 9505 | active |
| MakazhanAlpamys/Soup Soup is a Python CLI that fine-tunes and post-trains LLMs from a single YAML config, supporting 23 methods (SFT, DPO, ORPO, SimPO, KTO, etc… | 79 | 9486 | active |
| Claude Code Action A GitHub Action that runs Claude Code on pull requests and issues, answering questions, reviewing code, and implementing changes triggered … | 82 | 9434 | active |
| BAML BAML is a domain-specific programming language for building LLM agents, with a Rust-like type system, typed errors, built-in tests/evals, a… | 92 | 9423 | active |
| oumi-ai/oumi Oumi is an open-source Python framework and platform for the end-to-end lifecycle of open-weight LLMs: data synthesis, fine-tuning (SFT, Lo… | 91 | 9407 | active |