Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| hydropix/TranslateBooksWithLLMs A desktop application that translates full-length books, subtitles, and documents using local or cloud LLMs (Ollama, OpenAI-compatible APIs… | 82 | 2517 | active |
| nitrocloudofficial/nitrostack NitroStack is an enterprise-grade TypeScript framework for building production-ready MCP (Model Context Protocol) servers and AI-native app… | 78 | 2516 | active |
| CJackHwang/AIstudioProxyAPI A self-hosted proxy server that exposes Google AI Studio's web chat interface as an OpenAI-compatible API using FastAPI and Camoufox/Playwr… | 64 | 2513 | active |
| youssofal/MTPLX MTPLX is a native macOS app and CLI that runs local LLMs on Apple Silicon roughly twice as fast using native multi-token prediction (MTP) s… | 80 | 2511 | active |
| InternLM/HuixiangDou HuixiangDou is an LLM-based professional knowledge assistant designed for group chat scenarios, using a three-stage pipeline of preprocess,… | 41 | 2501 | active |
| sdyckjq-lab/llm-wiki-skill A personal knowledge base Skill based on Andrej Karpathy's llm-wiki methodology, installable into AI CLI agents like Claude Code, Codex, Op… | 54 | 2497 | active |
| yctimlin/mcp_excalidraw An MCP server, CLI, and agent skill that gives AI coding agents a live, stateful Excalidraw canvas they can draw on, inspect via screenshot… | 75 | 2496 | active |
| google/tunix Tunix is a lightweight JAX-based library for post-training large language models, supporting supervised fine-tuning, preference optimizatio… | 81 | 2491 | active |
| neavo/LinguaGacha LinguaGacha is an AI-powered desktop text translator that batch-translates novels, game scripts, subtitles, and ebooks using LLM APIs (Open… | 81 | 2488 | active |
| Nano-Collective/nanocoder Nanocoder is an open-source, terminal-based AI coding agent built by a community collective. It runs agentic coding workflows against any m… | 77 | 2488 | active |
| 24mlight/A_Share_investment_Agent A Python-based multi-agent AI investment analysis system for China's A-share market that uses LLMs (Gemini/OpenAI-compatible) with bull/bea… | 56 | 2482 | active |
| darrenburns/elia Elia is a keyboard-centric terminal user interface (TUI) application for chatting with large language models like ChatGPT, Claude, Gemini, … | 21 | 2481 | active |
| mohsen1/yek Yek is a fast Rust CLI tool that serializes text files in a repository or directory into a single stream or chunked output optimized for LL… | 75 | 2477 | active |
| Live-GalGame/LiveGalGame LiveGalGame is a playful app that overlays a visual-novel (galgame) interface onto real-life conversations, providing real-time speech-to-t… | 52 | 2477 | active |
| microsoft/PIKE-RAG PIKE-RAG is a Microsoft framework for building Retrieval-Augmented Generation systems that extract, understand, and apply specialized domai… | 10 | 2475 | active |
| vercel/ai-elements AI Elements is a React component library and custom shadcn/ui registry from Vercel providing pre-built, composable UI components for AI-nat… | 71 | 2471 | active |
| kaqijiang/Auto-GPT-ZH A Chinese-language community fork and translation of AutoGPT, the autonomous AI agent platform, kept in sync with the upstream stable branc… | 34 | 2464 | active |
| theJayTea/WritingTools A system-wide AI writing assistant for Windows, Linux, and macOS that proofreads, rewrites, and summarizes text in any application via a ho… | 77 | 2460 | active |
| xusenlinzy/api-for-open-llm A Python server that exposes open-source large language models (LLaMA, ChatGLM, Qwen, Baichuan, Falcon, etc.) behind an OpenAI-compatible A… | 21 | 2459 | active |
| dsphper/lanhu-mcp A Model Context Protocol (MCP) server that integrates the Lanhu design collaboration platform with AI coding assistants like Cursor, Claude… | 81 | 2458 | active |
| sqliteai/warp WARP is a dependency-free, embeddable C inference engine that runs trillion-parameter mixture-of-experts models like Kimi K3 by streaming a… | 77 | 2457 | active |
| Unakar/Logic-RL Logic-RL is a research framework that reproduces R1-Zero-style LLM reasoning via rule-based reinforcement learning (GRPO) on logic puzzles,… | 23 | 2452 | active |
| volcengine/ai-app-lab AI App Lab from Volcano Engine (Volcengine) provides Arkitect, a high-code Python SDK for building LLM applications, plus Demohouse, a coll… | 78 | 2451 | active |
| ggozad/oterm oterm is a terminal-based chat client for LLMs, supporting Ollama, OpenAI, Anthropic, and any pydantic-ai-supported provider. It offers a r… | 95 | 2448 | active |
| subsy/ralph-tui Ralph TUI is an AI Agent Loop Orchestrator delivered as a terminal UI (TUI) that runs AI coding agents like Claude Code, OpenCode, and Fact… | 72 | 2447 | active |
| AI-Hypercomputer/maxtext MaxText is a high-performance, scalable open-source LLM training library written in pure Python/JAX, targeting Google Cloud TPUs and GPUs. … | 98 | 2446 | active |
| 1sdv/TripStar TripStar is an AI-powered travel planning application built on the HelloAgents multi-agent framework, using LLMs to generate personalized t… | 58 | 2446 | active |
| FullAgent/fulling Fulling is an AI-powered full-stack engineer agent platform that provides dedicated AI workspaces combining skills, files, memory, and runt… | 63 | 2445 | active |
| she-llac/claude-counter A minimal browser extension (and userscript) that overlays token counts, cache countdown timers, and session/weekly usage bars on claude.ai… | 51 | 2440 | active |
| erew123/alltalk_tts AllTalk TTS is a text-to-speech application built on the Coqui TTS engine, usable standalone or as an extension for Text-generation-webui, … | 41 | 2439 | active |
| CopilotKit/OpenGenerativeUI An open-source framework and showcase for building generative UI, where an AI agent (CopilotKit + LangChain Deep Agents) generates interact… | 59 | 2438 | active |
| lmnr-ai/index Index is an open-source browser agent that autonomously performs complex tasks on the web by turning any website into an accessible API. It… | 10 | 2438 | active |
| open-webui/pipelines Pipelines is a UI-agnostic, OpenAI API-compatible plugin framework for adding custom Python logic and workflows to any client that speaks t… | 38 | 2437 | active |
| iliane5/meridian Meridian is an open-source AI-powered news intelligence system that scrapes hundreds of RSS sources, clusters and analyzes articles with LL… | 27 | 2437 | active |
| NovaSky-AI/SkyRL SkyRL is a modular full-stack reinforcement learning library for post-training large language models, combining a training framework (skyrl… | 83 | 2436 | active |
| RAIT-09/obsidian-agent-client An Obsidian plugin that brings AI coding agents like Claude Code, Codex, and Gemini CLI into the vault via the Agent Client Protocol (ACP).… | 82 | 2435 | active |
| Yuyz0112/claude-code-reverse A tool that reverse engineers Claude Code by capturing and visualizing its LLM API interactions. It monkey-patches Claude Code's request co… | 34 | 2432 | active |
| Konnect AI-assisted KiCAD tool A Model Context Protocol (MCP) server that lets AI assistants like Claude directly control KiCAD for printed circuit board design. It expos… | 84 | 2431 | active |
| jackmpcollins/magentic A Python library for seamlessly integrating LLMs into Python code via @prompt and @chatprompt decorators that return typed, structured outp… | 69 | 2428 | active |
| microsoft/chat-copilot Chat Copilot is a sample application from Microsoft for building your own LLM-powered chat copilot, built on Semantic Kernel. It consists o… | 10 | 2428 | active |
| Alan AI SDK Alan AI SDK is a set of client libraries for embedding Alan AI's conversational AI agents and intelligent app layer into web, iOS, Android,… | 91 | 2427 | active |
| wan-h/awesome-digital-human-live2d An open-source digital human application that combines Live2D avatars with LLM-powered conversation, integrating ASR, LLM, TTS, and agent o… | 58 | 2427 | active |
| trymirai/uzu Uzu is a high-performance inference engine written in Rust for running AI models directly on-device, with Python, TypeScript, and Swift bin… | 87 | 2423 | active |
| Prism Prism is a Laravel package providing a unified, fluent interface for working with Large Language Models across providers like OpenAI, Anthr… | 63 | 2423 | active |
| zurawiki/gptcommit gptcommit is a git prepare-commit-msg hook written in Rust that uses large language models like GPT to automatically generate clear, descri… | 85 | 2418 | active |
| knowsuchagency/mcp2cli mcp2cli is a Python CLI tool that turns any MCP server, OpenAPI spec, or GraphQL endpoint into a command-line interface at runtime with zer… | 60 | 2418 | active |
| kevinluosl/deepbot DeepBot is a system-level AI assistant desktop application (Electron/TypeScript) that automates enterprise and personal workflows through m… | 52 | 2418 | active |
| sdi2200262/agentic-project-management APM (Agentic Project Management) is an open-source JavaScript framework and CLI for managing complex software projects with AI coding assis… | 70 | 2415 | active |
| tavily-ai/tavily-mcp A Model Context Protocol (MCP) server that exposes Tavily's web search, page extraction, site mapping, and crawling tools to AI assistants … | 65 | 2415 | active |
| glidea/banana-prompt-quicker A Chrome extension that lets users quickly insert curated and custom prompts into Google AI Studio, Gemini, and any website input box via r… | 58 | 2414 | active |
| X-PLUG/mPLUG-DocOwl mPLUG-DocOwl is a family of multimodal large language models from Alibaba for OCR-free document understanding, including DocOwl1.5 and DocO… | 37 | 2413 | active |
| llmsresearch/paperbanana An open-source, community implementation of Google Research's PaperBanana paper, providing an agentic Python framework that generates publi… | 74 | 2411 | active |
| Jittor/JittorLLMs JittorLLMs is a large language model inference library built on the Jittor deep learning framework, supporting models like ChatGLM, LLaMA/L… | 31 | 2406 | active |
| FrancyJGLisboa/agent-skill-creator Agent Skill Creator is a Python tool that turns human expertise (sentences, documents, scripts) into tested, installable agent skills for A… | 60 | 2404 | active |
| BloopAI/bloop bloop is a fast code search engine and desktop app that lets developers search their codebase with natural language, regex, and symbol quer… | 10 | 9488 | maintenance |
| Olive Olive is Microsoft's AI model optimization toolkit for the ONNX Runtime, automating finetuning, conversion, quantization, and compression o… | 89 | 2402 | active |
| spacedriveapp/spacebot Spacebot is an opinionated AI agent harness written in Rust for teams, communities, and multi-user environments, deployable as a single sel… | 73 | 2400 | active |
| The-Vibe-Company/companion Companion is an open-source tool for launching and managing fleets of task-optimized AI agents (built around Claude Code and Codex), with a… | 71 | 2400 | active |
| drl990114/MarkFlowy MarkFlowy is a lightweight, cross-platform Markdown and text editor built with Tauri, React, and Prosemirror, offering WYSIWYG and source-c… | 99 | 2398 | active |
| gkamradt/needle-in-a-haystack A benchmarking tool (niah / needlehaystack) that pressure-tests LLM long-context retrieval by sweeping context length x needle depth cells … | 66 | 2397 | active |
| Agency Orchestrator Agency Orchestrator is a cross‑platform desktop and CLI application that lets users compose multi‑agent AI workflows with a single sentence… | 83 | 2396 | active |
| yawiii/ComfyUI-Prompt-Assistant A ComfyUI plugin that provides an all-in-one prompt assistant, connecting to cloud LLM/VLM APIs (Zhipu, SiliconFlow, Gemini, Baidu) and loc… | 64 | 2394 | active |
| 12306 Ticket Search A Model Context Protocol (MCP) server that exposes 12306 (China Railway) ticket search capabilities to large language models. It provides A… | 78 | 2393 | active |
| VCP VCPToolBox is a Node.js middleware layer deployed between LLM APIs and frontend applications, providing a unified Variable & Command Protoc… | 80 | 2389 | active |
| langfengQ/verl-agent verl-agent is an extension of the veRL framework for training LLM and VLM agents via reinforcement learning, featuring step-independent mul… | 51 | 2388 | active |
| heshengtao/comfyui_LLM_party A ComfyUI plugin providing a comprehensive set of nodes for building LLM agent workflows, including MCP server support, RAG/GraphRAG, TTS, … | 62 | 2384 | active |
| aiwithremy/claude-skills-llm-council A Claude Code skill that runs a user's question through five independent AI advisors who peer-review each other's answers, then synthesizes… | 47 | 2384 | active |
| Bionic Bionic is an open-source, self-hosted enterprise AI platform written in Rust that provides a ChatGPT-like workspace with agentic runtime, R… | 91 | 2383 | active |
| showlab/Paper2Video Paper2Video is a Python pipeline that automatically generates academic presentation videos from scientific papers, taking a paper PDF, a sp… | 46 | 2381 | active |
| 0xMassi/webclaw webclaw is a Rust-based web extraction toolkit that turns any URL into clean, LLM-ready markdown, JSON, or token-optimized text, including … | 77 | 2379 | active |
| cytostack/openwolf OpenWolf is a Node.js CLI that maintains a single portable project memory (a .wolf/ directory) shared across coding agents like Claude Code… | 79 | 2378 | active |
| apple/axlearn AXLearn is a Python deep learning library built on JAX and XLA for developing and training large-scale models, with an object-oriented conf… | 69 | 2375 | active |
| agentuniverse-ai/agentUniverse agentUniverse is a Python-based multi-agent framework built on large language models, providing extensible components for building individu… | 69 | 2374 | active |
| XiaomiMiMo/MiMo Xiaomi's MiMo is a 7B-parameter reasoning language model trained from pretraining through posttraining with reinforcement learning, release… | 28 | 2373 | active |
| Apache Ossie Apache Ossie (incubating, formerly Open Semantic Interchange) is a vendor-neutral JSON/YAML specification for exchanging semantic metadata—… | 61 | 2372 | active |
| FMInference/FlexLLMGen FlexLLMGen is a high-throughput generation engine for running large language models on a single GPU with limited memory. It uses IO-efficie… | 10 | 9346 | maintenance |
| bowenliang123/dsh-context A DeepSeek Harness plugin that provides context insight and management for AI agent sessions. It offers a Context dashboard tab and a /cont… | 77 | 2370 | active |
| Tongyi-MAI/MAI-UI Qwen-UI-Agent (MAI-UI) is a foundation GUI agent model from Alibaba's Tongyi-MAI team that unifies mobile, desktop, browser, and deep-resea… | 57 | 2369 | active |
| cortexkit/magic-context Magic Context is a TypeScript library that gives coding agents self-managing, unbounded memory so a single session can last indefinitely. I… | 79 | 2368 | active |
| uptrain-ai/uptrain UpTrain is an open-source Python platform for evaluating and improving LLM applications, offering 20+ preconfigured evaluation checks cover… | 23 | 2366 | active |
| Draculabo/AntigravityManager Antigravity Manager is an Electron-based desktop application for managing multiple Google Gemini and Claude accounts used with the Antigrav… | 84 | 2363 | active |
| orhanerday/open-ai A community-maintained PHP SDK for accessing the OpenAI API, supporting GPT-3/GPT-4 chat completions, DALL-E image generation, and ChatGPT-… | 24 | 2363 | active |
| IBM/AssetOpsBench AssetOpsBench is an open-source benchmark and framework from IBM for building, orchestrating, and evaluating domain-specific AI agents for … | 65 | 2362 | active |
| EasyRec EasyRec is a TensorFlow-based framework from Alibaba for building large-scale deep learning recommendation models covering matching, rankin… | 59 | 2361 | active |
| E2B An open-source AI agent that controls a secure cloud Linux desktop (via E2B Desktop Sandbox) using keyboard, mouse, and shell commands, pow… | 60 | 2359 | active |
| UnicomAI/wanwu Yuanjing Wanwu is China Unicom's enterprise-grade, multi-tenant AI agent development platform built in Go. It provides all-in-one tooling f… | 83 | 2358 | active |
| NVIDIA-NeMo/DataDesigner NeMo Data Designer is an open-source Python orchestration framework from NVIDIA for generating high-quality synthetic datasets from scratch… | 85 | 2357 | active |
| Karben233/bili-hardcore A Rust CLI tool that automatically answers Bilibili's 'hardcore member' daily quiz questions using LLM APIs. It also ships as an agent skil… | 85 | 2355 | active |
| GalTransl/GalTransl GalTransl is an automated translation tool for visual novels (galgames) that leverages large language models like GPT-4, Claude, Deepseek, … | 97 | 2353 | active |
| 1backend/1backend 1Backend is an AI-native microservices platform written in Go that combines a framework, proxy, and runtime for building distributed applic… | 70 | 2349 | active |
| comeonzhj/Auto-Redbook-Skills A Claude Code plugin/skill set that automatically writes Xiaohongshu (Redbook) notes, renders them into themed 3:4 card images via Playwrig… | 56 | 2346 | active |
| fruitbars/simple-one-api A single-binary Go gateway that unifies access to multiple LLM providers (Qianfan, iFlytek Spark, Tencent Hunyuan, MiniMax, DeepSeek, etc.)… | 90 | 2345 | active |
| maitrix-org/llm-reasoners LLM Reasoners is a Python library that provides a standardized modular framework for advanced LLM reasoning, implementing algorithms like M… | 28 | 2345 | active |
| 1517005260/graph-rag-agent A Python framework that integrates GraphRAG, LightRAG, and Neo4j-based graph building to construct knowledge graphs and perform explainable… | 40 | 2343 | active |
| iamlukethedev/Claw3D Claw3D is a self-hosted 3D virtual office that visualizes AI agents working in real time, letting users watch agents review pull requests, … | 69 | 2333 | active |
| refuel-ai/autolabel Autolabel is a Python library for labeling, cleaning, and enriching text datasets using large language models like GPT-4, Claude, and open-… | 22 | 2330 | active |
| facebookresearch/schedule_free A PyTorch library implementing schedule-free optimizers (SGD, AdamW, RAdam variants) that remove the need for learning rate schedules or sp… | 64 | 2329 | active |
| jwadow/kiro-gateway A self-hosted proxy API gateway for the Kiro API (Amazon Q Developer / AWS CodeWhisperer) that exposes Claude and other models through Open… | 59 | 2325 | active |
| Picotron Picotron is a minimalist, hackable distributed training framework for pre-training Llama-like large language models using 4D parallelism (d… | 37 | 2325 | active |
| PhialsBasement/Chain-of-Recursive-Thoughts CoRT (Chain of Recursive Thoughts) is a tool that makes LLMs recursively refine their answers by generating multiple alternative responses,… | 25 | 2325 | active |