Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| edison7009/EchoBird EchoBird is a cross-platform desktop application (Tauri + Rust) that provides one-click installation, launching, and model configuration fo… | 79 | 3387 | active |
| LangGraph.js LangGraph.js is a TypeScript/JavaScript framework for building stateful, long-running LLM agents as graphs of nodes and edges, mixing deter… | 90 | 3371 | active |
| oxylabs/chatgpt-scraper Code examples and documentation for Oxylabs' ChatGPT Scraper, a commercial Web Scraper API endpoint that sends prompts to ChatGPT and retur… | 61 | 3370 | active |
| Metorial Metorial is an open-source identity and access control plane for AI agents, providing 1200+ verified MCP integrations with centralized auth… | 65 | 3367 | active |
| lxf746/any-auto-register A desktop application (Mac/Windows, built on Python/FastAPI with an embedded React UI) that automates registration and lifecycle management… | 70 | 3364 | active |
| ANative-Lab/EvoAgentX EvoAgentX is an open-source Python framework for building, evaluating, and automatically evolving LLM-based agents and agentic workflows. I… | 78 | 3363 | active |
| ColeMurray/background-agents An open-source, self-hostable background coding agent system (Open-Inspect) inspired by Ramp's Inspect, where AI agents work on tasks in sa… | 61 | 3363 | active |
| OpenGVLab/Ask-Anything VideoChat/Ask-Anything is a family of multimodal chat models and demos that combine video understanding with large language models, letting… | 68 | 3354 | active |
| Lagrange-Labs/deep-prove DeepProve is a Rust framework for generating zero-knowledge proofs of neural network inference, including end-to-end proving of full LLM fo… | 57 | 3352 | active |
| Sophomoresty/gemini-web2api A single-file Python server that exposes Google Gemini's web interface as an OpenAI-compatible API, supporting chat completions, streaming,… | 54 | 3346 | active |
| nicedreamzapp/claude-code-local An MLX-native server for Apple Silicon that exposes an Anthropic-API-compatible endpoint so Claude Code and similar agents can run entirely… | 75 | 3344 | active |
| fuxicodex/Fuxi FuXi is a terminal-based AI coding agent built in Go that reads code, edits files, runs commands, and drives tools through a rich TUI using… | 78 | 3341 | active |
| QiuYannnn/Local-File-Organizer A privacy-focused desktop application that uses on-device AI models (Llama3.2 3B and Llava v1.6 via Nexa SDK) to scan, understand, and reor… | 14 | 3340 | active |
| giancarloerra/SocratiCode SocratiCode is a codebase context engine distributed as an MCP server, Claude Code plugin, and VS Code extension that indexes code, depende… | 82 | 3336 | active |
| Bytez-com/docs Bytez is a serverless model inference platform offering a unified API with a single key to run 175k+ open and closed-source AI models (LLMs… | 53 | 3329 | active |
| microsoft/ResearchStudio ResearchStudio is a Microsoft collection of AI agent skills that cover the entire research lifecycle, from an under-specified research dire… | 57 | 3328 | active |
| AtomicBot-ai/atomic-agent Atomic Agent is a local-first AI agent that runs entirely on your machine, using quantized models via llama.cpp to browse the web, edit fil… | 78 | 3326 | active |
| LLM-as-a-Verifier A Python framework that uses LLM token logprobs to produce fine-grained verification scores for agent trajectories without additional train… | 59 | 3322 | active |
| johnbean393/Sidekick Sidekick is a native macOS app for chatting with local LLMs powered by a built-in llama.cpp backend, with RAG over local files, folders, an… | 75 | 3320 | active |
| microsoft/LoRA loralib is the official PyTorch implementation of LoRA (Low-Rank Adaptation), which fine-tunes large language models by injecting trainable… | 23 | 13868 | maintenance |
| Mercury Agent Mercury Agent is a soul-driven AI assistant that runs 24/7 from the CLI, Telegram, Discord, Slack, Signal, or web, with 40+ permission-hard… | 81 | 3315 | active |
| cita-777/metapi Metapi is a self-hosted meta-aggregation gateway that unifies multiple AI relay/proxy sites (New API, One API, OneHub, DoneHub, Veloera, et… | 70 | 3308 | active |
| ikawrakow/ik_llama.cpp A fork of llama.cpp offering state-of-the-art quantization types and improved CPU/CUDA inference performance for large language models. It … | 60 | 3304 | active |
| minitap-ai/mobile-use An open-source Python AI agent framework that controls real Android and iOS devices using natural language commands, built on LangGraph. It… | 71 | 3298 | active |
| liaohch3/claude-tap claude-tap is a local proxy and trace viewer for AI coding agents like Claude Code, Codex CLI, and Gemini CLI. It intercepts real API traff… | 79 | 3295 | active |
| rag-web-ui/rag-web-ui RAG Web UI is a self-hosted intelligent dialogue application that builds Q&A systems over your own knowledge base using Retrieval-Augmented… | 64 | 3294 | active |
| Snailclimb/interview-guide An open-source AI-powered interview platform built with Spring Boot 4.1, Java 25, Spring AI 2.0, React, PostgreSQL/pgvector, and Redis. It … | 59 | 3292 | active |
| itsOwen/CyberScraper-2077 CyberScraper 2077 is an AI-powered web scraping application with a Streamlit GUI that uses OpenAI, Gemini, or local Ollama models to intell… | 68 | 3291 | active |
| jehna/humanify A Rust CLI tool that unminifies and deobfuscates JavaScript by using LLMs (OpenAI, Anthropic, Gemini, OpenRouter, or local Ollama) to sugge… | 82 | 3288 | active |
| PrismML-Eng/Bonsai-demo A demo repository for running PrismML's Bonsai family of 1-bit and ternary-quantized language models locally via llama.cpp and MLX. It prov… | 59 | 3286 | active |
| microsoft/lida LIDA is a Python library from Microsoft that uses large language models to automatically generate, execute, edit, explain, evaluate, and re… | 31 | 3285 | active |
| KouriChat/KouriChat KouriChat is a Python-based emotional companionship program powered by LLMs that lets users chat with realistic AI personas. It integrates … | 85 | 3281 | active |
| nexu-io/nexu nexu is an open-source desktop client that runs an OpenClaw AI agent inside messaging apps like WeChat, Feishu, Slack, and Discord with one… | 61 | 3280 | active |
| gptscript-ai/gptscript GPTScript is a Go-based framework that lets LLMs operate and interact with systems such as local executables, OpenAPI endpoints, SDKs, and … | 10 | 3279 | active |
| pezzolabs/pezzo Pezzo is an open-source, cloud-native LLMOps platform for managing the lifecycle of AI-powered features, including prompt design, versionin… | 62 | 3275 | active |
| zai-org/ChatGLM3 ChatGLM3 is a series of open bilingual (Chinese-English) conversational large language models from Zhipu AI and Tsinghua University, includ… | 28 | 13646 | maintenance |
| aandrew-me/tgpt tgpt is a cross-platform command-line tool written in Go that lets users interact with AI chatbots (GPT, Llama, Mixtral, etc.) directly fro… | 96 | 3271 | active |
| FastMCP FastMCP is a TypeScript framework for building MCP (Model Context Protocol) servers with tools, resources, prompts, sessions, and authentic… | 82 | 3269 | active |
| Soju06/codex-lb A self-hosted load balancer and proxy for ChatGPT/Codex accounts that pools multiple accounts behind OpenAI-compatible endpoints. It includ… | 76 | 3267 | active |
| Norman-bury/research-writing-skill A research/academic writing assistant skill for AI coding agents (Claude Code, Cursor, Codex, Gemini CLI) that turns paper writing into a t… | 51 | 3261 | active |
| AprilNEA/AChat AChat is an open-source, self-hosted, local-first AI chat platform for enterprises and teams, supporting multiple LLM providers like OpenAI… | 52 | 3259 | active |
| eracle/OpenOutreach OpenOutreach is a self-hosted, open-source AI agent for B2B lead generation. You describe your product and target market, and it discovers … | 77 | 3254 | active |
| jjyaoao/HelloAgents HelloAgents is a Python multi-agent framework built on OpenAI-compatible APIs, offering tool response protocols, context engineering, sessi… | 84 | 3250 | active |
| dsh-tauri-desk/deepseek-harness-desktop A lightweight Tauri 2-based desktop application that runs DeepSeek Harness with zero environment setup — no Node.js, pnpm, or Docker requir… | 77 | 3248 | active |
| cursor-byok cursor-byok is an open-source local implementation of Cursor's backend that runs a gateway service on your machine, connecting the Cursor e… | 76 | 3246 | active |
| Harbor Harbor is a CLI tool that spins up a complete, pre-wired local LLM stack with a single command, using Docker Compose to orchestrate hundred… | 84 | 3241 | active |
| makecindy/cindy Cindy is an open-source AI agent client (desktop and mobile apps) that unifies multiple agent harnesses like Claude Code, Codex, and Pi wit… | 81 | 3239 | active |
| zai-org/GLM-4-Voice GLM-4-Voice is an end-to-end bilingual (Chinese/English) speech dialogue model from Zhipu AI, built on GLM-4-9B with a speech tokenizer and… | 22 | 3237 | active |
| Off Grid AI Off Grid AI (OGAM) is a cross-platform mobile and desktop application that runs AI entirely on-device: GGUF LLM chat with vision, Whisper s… | 78 | 3234 | active |
| langchain-ai/agent-chat-ui A Next.js web application for chatting with any LangGraph agent (Python or TypeScript) through a chat interface. It connects to a LangGraph… | 66 | 3234 | active |
| guaguaguaxia/weekly_report A web application that generates complete weekly work reports from brief descriptions of work content, powered by the OpenAI GPT-3.5 API. I… | 74 | 3231 | active |
| AutoMaker-Org/automaker Automaker is an open-source, local agentic IDE that lets users manage software tasks on a Kanban board and have autonomous AI agents (power… | 62 | 3228 | active |
| google-gemini/computer-use-preview A Python reference implementation of Gemini's computer-use agent that lets the model control a browser (via Playwright or Browserbase) to c… | 59 | 3224 | active |
| alexrudall/ruby-openai A Ruby gem providing a client for the OpenAI API, supporting chat completions, the Responses API, streaming, vision, audio (Whisper), image… | 66 | 3223 | active |
| Alpha-Dojo/DojoAgents DojoAgents is a full-market AI copilot framework for personal investment, built around a Loop-Driven Cognitive Portfolio Agent that reasons… | 57 | 3221 | active |
| Josh-XT/AGiXT AGiXT is an open-source AI agent automation platform that orchestrates instruction management and complex task execution across multiple AI… | 82 | 3216 | active |
| TanStack/ai TanStack AI is a type-safe, provider-agnostic TypeScript SDK for building AI applications with streaming chat, tool calling, agents, struct… | 81 | 3213 | active |
| OpenGVLab/InternGPT InternGPT (iGPT) is an open-source demo platform for showcasing AI models through a pointing-language-driven visual interactive system, sup… | 30 | 3206 | active |
| dosco/graphjin GraphJin is a Go compiler and runtime that turns GraphQL queries into optimized, policy-checked SQL across many databases, files, and APIs,… | 95 | 3204 | active |
| blazickjp/arxiv-mcp-server A Model Context Protocol (MCP) server that lets AI agents search, download, and analyze arXiv papers, including reading original LaTeX sect… | 88 | 3202 | active |
| ExplosiveCoderflome/AI-Novel-Writing-Assistant An AI-native open-source workspace for producing complete long-form novels, orchestrating planning, worldbuilding, character assets, chapte… | 84 | 3202 | active |
| mayneyao/eidos Eidos is a local-first, single-file relational spreadsheet built on standard SQLite, usable from a desktop app, browser editor, or agent-fi… | 93 | 3198 | active |
| mikubaka88/CCFA-Skills A family of 17 agent skills for shaping the research storyline of CCF-A academic papers, covering ideation, literature retrieval, experimen… | 80 | 3198 | active |
| xiamuceer-j/MuMuAINovel MuMuAINovel is a self-hosted AI-powered novel writing assistant built with FastAPI and React. It helps authors generate outlines, character… | 84 | 3188 | active |
| zilliztech/attu Attu is an AI-native management GUI for the Milvus vector database, available as a web app (Docker/Kubernetes) or desktop app. It lets user… | 97 | 3186 | active |
| Miles Miles is an open-source, enterprise-grade reinforcement learning framework for large-scale LLM and VLM post-training, forked from and co-ev… | 84 | 3185 | active |
| LLM for Zotero A Zotero plugin that integrates large language models into the Zotero PDF reader, enabling grounded paper chat, summarization, figure extra… | 78 | 3184 | active |
| MiniMax AI Platform MiniMax-M1 is an open-weight, large-scale hybrid-attention reasoning language model released by MiniMax under Apache-2.0. The repository pr… | 29 | 3184 | active |
| smartloli/EFAK EFAK (Eagle For Apache Kafka) is an open-source, AI-enhanced monitoring and management platform for Kafka clusters, built on Spring Boot 3.… | 75 | 3182 | active |
| GH05TCREW/pentestagent PentestAgent is a Python-based AI agent framework for black-box penetration testing that orchestrates LLM-driven security testing workflows… | 64 | 3180 | active |
| PenglongHuang/chinese-novelist-skill A Claude Code skill that drives AI to write complete Chinese novels end-to-end. It uses layered interactive Q&A, cross-session preference m… | 58 | 3179 | active |
| tekaratzas/RustGPT A transformer-based large language model implemented entirely in pure Rust with no external ML frameworks, using only ndarray for matrix op… | 35 | 3175 | active |
| cohere-ai/cohere-toolkit Cohere Toolkit is a deployable all-in-one RAG application with prebuilt frontend and backend components for building LLM-based products. It… | 10 | 3171 | active |
| TurixAI/TuriX-CUA TuriX is an open-source computer-use agent (CUA) that lets AI models take real actions on a desktop GUI - clicking, typing, and navigating … | 67 | 3170 | active |
| Javis603/token-monitor A local-first desktop widget that tracks token usage, costs, and account limits across 32+ AI coding tools such as Claude Code, Codex, Curs… | 78 | 3167 | active |
| nesaorg/nesa Nesa is a privacy-preserving AI inference platform that runs models like Llama, Mistral, and Stable Diffusion with end-to-end encryption us… | 22 | 3163 | active |
| KhazP/vibe-coding-prompt-template A collection of structured prompt templates and an npx-installable CLI (vibeworkflow) that guides developers through turning an app idea in… | 80 | 3160 | active |
| Chachamaru127/claude-code-harness A development harness plugin for Claude Code (and Codex CLI, Cursor, Grok) that enforces a disciplined Plan→Work→Review→Release loop with s… | 77 | 3160 | active |
| MaxMiksa/Auto-Company Auto Company is a fully autonomous AI company simulation that runs 24/7 on your own PC, orchestrating 14 autonomous AI agents modeled after… | 83 | 3156 | active |
| FB208/OpenBidKit_Yibiao OpenBidKit Yibiao (易标) is an open-source Electron desktop application that uses LLMs and RAG to generate bid/tender proposal documents from… | 81 | 3149 | active |
| Filimoa/open-parse Open Parse is a Python library that visually parses complex documents (primarily PDFs) into semantically meaningful chunks for LLM and RAG … | 61 | 3148 | active |
| CommandCodeAI/langui LangUI is a collection of 60+ free, open-source Tailwind CSS components designed for building UIs for AI, GPT, and LLM projects. Components… | 30 | 3145 | active |
| BayLing-Models/BayLing-Speech LLaMA-Omni is an end-to-end speech interaction model built on Llama-3.1-8B-Instruct that generates simultaneous text and speech responses f… | 30 | 3144 | active |
| hero8152/Infinite-Canvas An infinite canvas desktop application for orchestrating AI image, video, and LLM generation workflows. It integrates with ComfyUI, OpenAI-… | 55 | 3143 | active |
| ahujasid/ableton-mcp Ableton MCP is an open-source Model Context Protocol server and Ableton Live Remote Script that lets AI assistants like Claude control Able… | 64 | 3139 | active |
| ElevenLabs API SDKs The official Python SDK for the ElevenLabs API, providing programmatic access to text-to-speech, speech-to-text, voice cloning, dubbing, mu… | 93 | 3138 | active |
| datascale-ai/opentalking OpenTalking is an open-source Python framework for building real-time AI digital-human (talking avatar) conversation products. It orchestra… | 61 | 3131 | active |
| SynkraAI/aiox-core AIOX (AI-Orchestrated System) is an open-source framework for orchestrating specialized AI agents, workflows, and CLI-first experiences for… | 80 | 3125 | active |
| supermemoryai/apple-mcp An MCP (Model Context Protocol) server exposing Apple-native apps on macOS—Messages, Notes, Contacts, Mail, Reminders, Calendar, and Maps—a… | 10 | 3124 | active |
| MiroFlow MiroFlow is a performance-first open-source agent framework for building, orchestrating, and benchmarking LLM-powered agents, with MiroThin… | 56 | 3120 | active |
| cocktailpeanut/dalai Dalai is a self-hosted application that makes it simple to run LLaMA (and Alpaca) language models locally with a one-command installer and … | 22 | 12887 | maintenance |
| coder/claudecode.nvim A Neovim plugin that integrates Anthropic's Claude Code AI coding assistant into Neovim via a pure Lua WebSocket MCP implementation. It rev… | 60 | 3115 | active |
| SciSharp/BotSharp BotSharp is an open-source multi-agent AI framework written in C# for .NET, providing an agent abstraction layer, conversation state manage… | 77 | 3114 | active |
| rpamis/comet Comet is an npm-distributed CLI and Skill platform that gives AI coding agents a resumable, phase-guarded workflow for long-running tasks, … | 79 | 3113 | active |
| spiceai/spiceai Spice.ai OSS is a portable Rust runtime (~140 MB binary) that combines federated SQL querying, accelerated data materialization, full-text … | 96 | 3103 | active |
| b4rtaz/distributed-llama A C++ application that connects multiple home devices into a cluster for distributed LLM inference using tensor parallelism. It supports Ll… | 73 | 3100 | active |
| LLMQuant/quant-mind QuantMind is an agent-native Python framework that refines raw financial information such as papers, news, and SEC filings into typed, time… | 61 | 3100 | active |
| AutoCodeRoverSG/auto-code-rover AutoCodeRover is an autonomous software engineering agent that combines LLMs with code structure analysis to automatically resolve GitHub i… | 20 | 3100 | active |
| Litho (deepwiki-rs) Litho (deepwiki-rs) is a Rust-based AI-powered documentation generator that analyzes codebases and produces C4-model architecture documenta… | 81 | 3096 | active |
| DeepSeek PHP Chat A lightweight PHP demo application that calls DeepSeek/OpenAI-compatible chat APIs with streaming (EventSource) output, supporting Markdown… | 33 | 3094 | active |