Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| simonw/files-to-prompt A Python CLI tool that concatenates a directory of files into a single prompt suitable for pasting into LLMs, with filtering by extension, … | 27 | 2790 | active |
| HarleyCoops/Math-To-Manim-lfs-archive A Python project that turns math and physics questions into reasoned visual explanations rendered as Manim animations and study notes. It u… | 80 | 2789 | active |
| filip-michalsky/SalesGPT SalesGPT is an open-source, context-aware AI sales agent built with LLMs that automates sales outreach across voice, email, SMS, and messag… | 21 | 2778 | active |
| Promptflow Prompt flow is a suite of Python SDK, CLI, and VS Code extension tools for the end-to-end development of LLM-based AI applications, linking… | 76 | 11254 | maintenance |
| FasterDecoding/Medusa Medusa is a framework that accelerates LLM text generation by adding multiple decoding heads to an existing model, avoiding the need for a … | 19 | 2776 | active |
| notlikeDev/CCPlugins CCPlugins is a collection of professional slash commands and plugins for the Claude Code CLI that automate repetitive development tasks. It… | 10 | 2775 | active |
| google-research/tabfm TabFM is a scikit-learn compatible tabular foundation model from Google Research that performs zero-shot classification and regression on t… | 63 | 2769 | active |
| sparfenyuk/mcp-proxy A Python CLI tool that bridges MCP (Model Context Protocol) transports, converting between stdio and SSE/Streamable HTTP. It lets MCP clien… | 74 | 2765 | active |
| QwenAudio/qwen-audio-agent A realtime voice runtime and frontend for AI coding agents like Claude Code, Codex, and Qwen Code, letting agents talk, listen, and report … | 78 | 2763 | active |
| stellarlinkco/myclaude A multi-agent orchestration workflow system for AI coding assistants that coordinates backends like Claude Code, Codex, Gemini, and OpenCod… | 57 | 2751 | active |
| iamsrikanthnani/pluely Pluely is a privacy-first desktop AI assistant that runs as an invisible always-on-top overlay, providing live meeting transcription, on-sc… | 82 | 2746 | active |
| codeany-ai/open-agent-sdk-typescript An open-source TypeScript Agent SDK that runs the full agent loop in-process without CLI or subprocess dependencies, as an alternative to c… | 54 | 2746 | active |
| lightseekorg/tokenspeed TokenSpeed is a high-performance LLM inference engine designed for agentic workloads, aiming for TensorRT-LLM-level performance with vLLM-l… | 78 | 2743 | active |
| codedogQBY/ReadAny ReadAny is a local-first, AI-powered cross-platform e-book reader for desktop and mobile. It combines RAG-based chat with your books, hybri… | 79 | 2738 | active |
| heshengtao/super-agent-party Super Agent Party is a self-hosted, all-in-one AI desktop companion that combines VRM-based virtual characters, agent skills, MCP tool supp… | 85 | 2736 | active |
| Zero6992/chatGPT-discord-bot A self-hosted Discord bot that integrates ChatGPT-style AI chat into Discord servers, supporting multiple AI providers including a free pro… | 84 | 2735 | active |
| 1rgs/nanocode A minimal Claude Code alternative implemented as a single ~250-line Python file with zero dependencies. It runs an agentic loop with file a… | 41 | 2735 | active |
| BigDawnGhost/wenyi Wenyi is a Python CLI tool that translates EPUB books into Chinese using LLMs, with whole-book context analysis, real-time glossary extract… | 80 | 2733 | active |
| artidoro/qlora QLoRA is the official implementation of the QLoRA paper, an efficient finetuning approach that backpropagates through a frozen 4-bit quanti… | 30 | 11035 | maintenance |
| huggingface/OpenEnv OpenEnv is a Hugging Face framework for creating, deploying, and consuming isolated execution environments used in agentic reinforcement le… | 85 | 2728 | active |
| simonlin1212/Vibe-Research Vibe-Research is an open-source, local-first personal AI investment research dashboard for China A-shares (plus US and HK stocks), built wi… | 81 | 2725 | active |
| Haleclipse/CodexDesktop-Rebuild A cross-platform Electron rebuild of the OpenAI Codex Desktop app, distributed for macOS, Windows, and Linux. It packages the Codex coding … | 76 | 2725 | active |
| intel/neural-compressor Intel Neural Compressor is an open-source Python library providing state-of-the-art low-bit quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4),… | 95 | 2723 | active |
| HuaYaoAI/FinGenius FinGenius is an open-source AI financial analysis platform for China's A-share stock market, built on a multi-agent architecture where spec… | 32 | 2723 | active |
| AmberSahdev/Open-Interface Open Interface is a cross-platform desktop application that lets users control their computer using natural language requests processed by … | 62 | 2721 | active |
| devflowinc/trieve Trieve is an all-in-one API platform for semantic vector search, typo-tolerant full-text and neural search, recommendations, RAG, and analy… | 54 | 2718 | active |
| zilliztech/memsearch memsearch is a persistent, cross-platform memory layer for AI coding agents like Claude Code, Codex, DeepSeek Harness, OpenClaw, and OpenCo… | 80 | 2711 | active |
| getumbrel/llama-gpt LlamaGPT is a self-hosted, offline ChatGPT-like chatbot powered by Llama 2 and Code Llama models via llama.cpp, with all data staying on th… | 29 | 10926 | maintenance |
| memohai/Memoh Memoh is an open-source multi-agent platform where each AI agent gets its own dedicated cloud computer with a filesystem, desktop, browser,… | 84 | 2707 | active |
| KimMeen/Time-LLM Time-LLM is the official PyTorch implementation of an ICLR 2024 paper that reprograms frozen large language models (Llama, GPT-2, BERT) for… | 44 | 2707 | active |
| Danghuangshang AI Court Danghuangshang is an open-source multi-agent collaboration system built on the OpenClaw framework, modeling an AI 'imperial court' after Mi… | 49 | 2703 | active |
| ZHZisZZ/dllm dLLM is a Python library that unifies training, inference, and evaluation of diffusion language models such as LLaDA and Dream. It builds o… | 56 | 2699 | active |
| TavernAI TavernAI is an atmospheric frontend application for roleplay chat and story writing with AI language models, connecting to backends like Ko… | 58 | 2698 | active |
| huggingface/text-generation-inference Text Generation Inference (TGI) is a Rust, Python and gRPC toolkit for deploying and serving large language models with high performance, p… | 10 | 10877 | maintenance |
| Mobile-Artificial-Intelligence/maid Maid is a free, open-source Android chat application (built with React Native) for talking to large language models. It runs GGUF models fu… | 81 | 2695 | active |
| openai/openai-dotnet The official .NET library for accessing the OpenAI REST API, generated from the OpenAPI specification in collaboration with Microsoft. It p… | 85 | 2694 | active |
| itayinbarr/little-coder little-coder is a terminal coding agent built on the pi agent loop, tuned for small local language models like Qwen via Ollama or llama.cpp… | 79 | 2691 | active |
| yaojingang/yao-meta-skill Yao Meta Skill (YAO = Yielding AI Outcomes) is a Python-based system for engineering, evaluating, packaging, and governing reusable AI agen… | 56 | 2688 | active |
| wassim249/fastapi-langgraph-agent-production-ready-template A production-ready FastAPI template for building AI agent backends with LangGraph integration. It provides stateful conversations, long-ter… | 63 | 2687 | active |
| JIA-Lab-research/LISA LISA (Large Language Instructed Segmentation Assistant) is a multimodal large language model that performs reasoning-based image segmentati… | 29 | 2687 | active |
| MetapriseAI/OrgKernel OrgKernel is an open-source trust layer for AI agents providing cryptographic agent identity (Ed25519), scoped execution tokens, SHA-256 ha… | 53 | 2685 | active |
| bestruirui/octopus Octopus is a self-hosted LLM API aggregation gateway that unifies multiple provider channels behind a single endpoint, converting between O… | 79 | 2682 | active |
| stochasticai/xTuring xTuring is a Python library for fine-tuning, evaluating, and running open-source large language models such as LLaMA, GPT-J, GPT-2, Qwen, a… | 65 | 2675 | active |
| abi/secret-llama Secret Llama is a fully private LLM chatbot that runs entirely in the browser with no server or installation required, powered by the WebLL… | 25 | 2675 | active |
| LigphiDonk/academic-figure-generator A self-hosted AI-powered platform that generates high-quality academic paper figures: users upload a paper (PDF/DOCX/TXT), Claude analyzes … | 56 | 2674 | active |
| AMAP-ML/SkillClaw SkillClaw is a Python-based framework that lets AI agent skills evolve collectively from real interactions across sessions, agents, devices… | 55 | 2669 | active |
| vllm-project/production-stack vLLM Production Stack is a reference implementation for deploying vLLM LLM inference at scale on Kubernetes, distributed via Helm charts. I… | 88 | 2667 | active |
| om-ai-lab/OmAgent OmAgent is a Python library for building multimodal language agents, wrapping worker orchestration, task queues, and graph-based workflow o… | 28 | 2667 | active |
| Bright Data MCP A Model Context Protocol (MCP) server by Bright Data that gives AI agents and LLMs real-time access to public web data through 69 tools cov… | 86 | 2663 | active |
| openlake-project/openlake OpenLake is a high-performance distributed storage engine written in Rust (built on io_uring, RDMA, and GPUDirect) designed to feed GPUs du… | 78 | 2662 | active |
| kingjulio8238/Memary Memary is an open-source memory layer for autonomous AI agents that emulates human memory using knowledge graphs. It is a Python library (p… | 16 | 2661 | active |
| NeMo Agent Toolkit NVIDIA NeMo Agent Toolkit is an open-source Python library for connecting, orchestrating, and optimizing teams of AI agents across any agen… | 85 | 2660 | active |
| kordoc An MCP server and CLI that exposes Korea's Ministry of Government Legislation (법제처) open APIs — statutes, precedents, ordinances, treaties,… | 83 | 2653 | active |
| papersgpt/papersgpt-for-zotero PapersGPT is a Zotero plugin that lets researchers chat with single PDFs, multiple documents, or their entire library using cloud LLMs (Cha… | 81 | 2653 | active |
| AnswerDotAI/llms-txt A proposal and Python tooling for the /llms.txt standard, a markdown file placed at a website root to give language models and agents conci… | 79 | 2650 | active |
| aardio/ImTip ImTip is a lightweight (under 1 MB) Windows desktop assistant that shows real-time input method and keyboard state indicators at the text c… | 76 | 2646 | active |
| Pinvou/pinvou-agent Pinvou Agent is an open-source, local-first desktop AI agent workspace built with Rust and Tauri that combines chat, file operations, perso… | 67 | 2645 | active |
| org2AI/ORG2 ORG-2 is a native desktop application (Rust + Tauri) that acts as a system of record for AI coding agents, running a built-in harness plus … | 79 | 2631 | active |
| agentclientprotocol/claude-agent-acp An ACP (Agent Client Protocol) adapter that exposes the Claude Agent SDK to any ACP-compatible client. It bridges protocol features like to… | 80 | 2617 | active |
| run-llama/sec-insights SEC Insights is a full-stack reference application built by LlamaIndex that uses RAG to answer questions about SEC 10-K and 10-Q financial … | 29 | 2610 | active |
| Agent-Field/agentfield AgentField is an open-source AI backend that lets you build, deploy, and govern AI agents like APIs and scale them like microservices. It p… | 79 | 2605 | active |
| kayba-ai/agentic-context-engine Agentic Context Engine (ACE) is a Python library that lets LLM-based agents learn from experience by maintaining and evolving an evolving c… | 82 | 2602 | active |
| Memento-Teams/Memento Memento is a Python framework for building LLM agents that continually improve from experience via memory-based case-based reasoning, witho… | 36 | 2601 | active |
| miantiao-me/hacker-podcast An AI-powered Chinese podcast application that automatically scrapes daily Hacker News top stories, generates Chinese summaries and scripts… | 66 | 2597 | active |
| CodeGeeX CodeGeeX is a family of open multilingual code generation large language models (13B and successors CodeGeeX2/CodeGeeX4) pre-trained on 20+… | 24 | 2597 | active |
| BAAI-Agents/Cradle Cradle is a Python framework for General Computer Control (GCC), enabling foundation agents to perform complex computer tasks using screens… | 26 | 2594 | active |
| microsoft/foundry-local Foundry Local is Microsoft's end-to-end local AI runtime and SDK suite (C#, JavaScript, Python, Rust) for running optimized models entirely… | 87 | 2592 | active |
| srbhptl39/MCP-SuperAssistant A browser extension (Chrome and Firefox) that brings Model Context Protocol (MCP) tool support to web-based AI chat platforms like ChatGPT,… | 55 | 2592 | active |
| zarazhangrui/lark-coding-agent-bridge A TypeScript bot that bridges Feishu/Lark messenger with a locally installed Claude Code or Codex CLI coding agent. It streams agent replie… | 56 | 2591 | active |
| liou666/polyglot Polyglot is a cross-platform desktop (and web) application for practicing spoken language with AI conversation partners, built on ChatGPT f… | 36 | 2591 | active |
| Lealone Lealone is a Java-based full-stack, self-evolving general-purpose AI agent built on top of a high-performance NewSQL/RDBMS engine with asyn… | 67 | 2588 | active |
| Griptape Griptape is a modular Python framework for building generative AI applications, providing abstractions for agents, pipelines, workflows, RA… | 92 | 2581 | active |
| CoderLuii/HolyClaude HolyClaude is a Docker-based AI coding workstation that bundles Claude Code, a web UI, eight AI coding CLIs (Gemini, OpenAI Codex, Cursor A… | 81 | 2579 | active |
| Sourcegraph Sourcegraph is a code intelligence platform providing universal code search, code navigation, batch changes, and the Cody AI coding assista… | 10 | 10299 | maintenance |
| YeQing17-2026/OmniAgent OmniAgent is an open-source Python agent framework that self-evolves across skills, context, memory, and its underlying model during intera… | 54 | 2570 | active |
| pykeio/ort ort is a safe, fast Rust binding for Microsoft's ONNX Runtime, providing hardware-accelerated machine learning inference and training for O… | 91 | 2569 | active |
| mirage-project/mirage Mirage Persistent Kernel (MPK) is a compiler and runtime that transforms multi-GPU LLM inference into a single fused megakernel, reducing i… | 82 | 2569 | active |
| apache/burr Apache Burr is a Python framework for building stateful applications that make decisions, such as chatbots, agents, and simulations, using … | 90 | 2567 | active |
| samanhappy/mcphub MCPHub is a self-hosted hub that centrally manages multiple Model Context Protocol (MCP) servers and exposes them through unified Streamabl… | 84 | 2567 | active |
| huggingface/lighteval Lighteval is Hugging Face's all-in-one toolkit for evaluating large language models across multiple inference backends (Transformers, vLLM,… | 72 | 2563 | active |
| google-gemini/live-api-web-console A React-based starter application for building real-time multimodal experiences with Google's Gemini Live API over WebSockets. It provides … | 58 | 2562 | active |
| ymcui/Chinese-BERT-wwm A collection of Chinese pre-trained language models (BERT-wwm, BERT-wwm-ext, RoBERTa-wwm-ext, RBT3, etc.) built with Whole Word Masking, re… | 63 | 10231 | maintenance |
| fogsightai/fogsight Fogsight is an open-source AI agent and animation engine powered by large language models that turns abstract concepts or words into polish… | 63 | 2561 | active |
| Hugging Face JavaScript SDK A collection of TypeScript JavaScript libraries for interacting with the Hugging Face ecosystem, including Hub repository management, unifi… | 95 | 2560 | active |
| aurora-develop/aurora A Go service that exposes ChatGPT Web capabilities as an OpenAI-compatible API, including chat completions, responses, file Q&A, image gene… | 89 | 2558 | active |
| Piebald Claude Code tweakcc is a command-line tool for customizing Claude Code's appearance (theme colors, thinking verbs) and inspecting or modifying its syst… | 82 | 2554 | active |
| AIGC-Audio/AudioGPT AudioGPT is a Python framework that wraps multiple audio foundation models (for speech, singing, sound, and talking-head tasks) behind a GP… | 31 | 10168 | maintenance |
| data-infra/cube-studio CubeStudio is an open-source, cloud-native, all-in-one AI platform covering the full machine learning lifecycle (MLOps/MaaS/LLMOps), includ… | 74 | 2546 | active |
| Zleap-AI/SAG SAG is an open-source retrieval architecture and knowledge base application that replaces both traditional RAG and GraphRAG with event-enti… | 83 | 2545 | active |
| alexgreensh/token-optimizer A Claude Code plugin/skill that finds and removes wasted 'ghost tokens' in agent context windows, helping sessions survive compaction witho… | 78 | 2544 | active |
| SafeAILab/EAGLE EAGLE is the official implementation of the EAGLE family of speculative decoding algorithms (EAGLE-1/2/3) for accelerating LLM text generat… | 54 | 2542 | active |
| Perplexity API Platform The official Model Context Protocol (MCP) server for the Perplexity API Platform, exposing real-time web search, reasoning, and research to… | 62 | 2541 | active |
| aingdesk/AingDesk AingDesk is an open-source, MIT-licensed AI assistant application for running local AI models (e.g., via Ollama) and third-party model APIs… | 57 | 2539 | active |
| X-PLUG/mPLUG-Owl mPLUG-Owl is a family of open-source multimodal large language models that combine visual encoders with LLMs (built on LLaMA) for image and… | 33 | 2539 | active |
| nikmcfly/MiroFish-Offline MiroFish-Offline is a fully local, English-language fork of MiroFish, a multi-agent swarm intelligence engine that simulates public opinion… | 44 | 2538 | active |
| VITA-MLLM/VITA VITA is an open-source interactive omni multimodal large language model (VITA-1.5) that supports real-time vision and speech interaction, s… | 26 | 2536 | active |
| Lamini The official Python client and SDK for Lamini's hosted API for building generative AI applications. It lets developers call Lamini's LLM in… | 34 | 2533 | active |
| alecm20/story-flicks Story-Flicks is a Python + FastAPI application with a React frontend that generates high-definition story short videos from a user-provided… | 22 | 2531 | active |
| cixingguangming55555/wechat-bot A free toolset (funtool) providing proxy executables that let the Claude Code CLI use free NVIDIA-hosted large models such as Kimi K2.5, GL… | 58 | 2521 | active |
| KittyLitter Litter is a native iOS and Android client for OpenAI's Codex and Local Studio, letting users manage sessions and run agentic coding workflo… | 81 | 2520 | active |