Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| bevibing/tutor-skills A pair of Claude Code skills that convert documents (PDF, MD, HTML, EPUB) or source codebases into structured Obsidian study vaults with in… | 43 | 1333 | active |
| anyme123/Any-code Any Code is a cross-platform desktop GUI application (built with Tauri, React, and Rust) that wraps AI coding CLIs like Claude Code, OpenAI… | 64 | 1331 | active |
| uluckyXH/OpenMOSS OpenMOSS is a self-hosted multi-agent collaboration platform that organizes AI agents (built on OpenClaw/Claude Code) into an autonomous 'A… | 64 | 1331 | active |
| open-gsd/gsd-pi GSD Pi is a local-first, terminal-based autonomous coding agent that plans, implements, verifies, and tracks project work using spec-driven… | 82 | 1330 | active |
| supermemoryai/opensearch-ai OpenSearch GPT is a personalised AI search engine web application that learns about users and their interests as they browse the web. It is… | 34 | 1330 | active |
| LLaVA-VL/LLaVA-NeXT LLaVA-NeXT is a collection of open large multimodal models (LLaVA-NeXT, LLaVA-Video, LLaVA-OneVision, LLaVA-Critic-R1) that combine vision … | 61 | 4729 | maintenance |
| Vahe1994/AQLM Official PyTorch implementation of AQLM, an extreme LLM compression method via additive quantization, extended with PV-Tuning for finetunin… | 54 | 1329 | active |
| yukkcat/gemini-business2api A self-hosted gateway service that exposes Gemini Business through an OpenAI-compatible API, with multi-account load balancing and an admin… | 52 | 1328 | active |
| apple/python-apple-fm-sdk Python bindings for Apple's Foundation Models framework, giving access to the on-device foundation model behind Apple Intelligence on macOS… | 76 | 1327 | active |
| AntSK AntSK is an enterprise AI knowledge base and agent platform built on .NET 9, Blazor, Semantic Kernel, and Kernel Memory. It supports import… | 72 | 1327 | active |
| alibaba/lumenx LumenX is an AI-native platform for turning novel text into publishable motion comic and short drama videos. It provides a full pipeline fr… | 56 | 1327 | active |
| Tongjilibo/bert4torch bert4torch is a PyTorch library providing an elegant reimplementation of transformer models (BERT, RoBERTa, T5, GPT, ChatGLM, LLaMA, etc.) … | 76 | 1326 | active |
| study8677/repobrain RepoBrain (formerly Antigravity) is an MCP server and AI coding assistant plugin that indexes a codebase into a knowledge base so you can a… | 72 | 1325 | active |
| SSShooter/ebook-to-mindmap A browser-based AI application that parses EPUB and PDF ebooks and converts them into chapter summaries, per-chapter mind maps, or a single… | 68 | 1325 | active |
| jishengpeng/WavTokenizer WavTokenizer is a state-of-the-art discrete neural audio codec that compresses speech, music, and general audio into only 40 or 75 discrete… | 24 | 1325 | active |
| aws-samples/bedrock-chat Bedrock Chat (BrChat) is a multilingual generative AI chat platform built on Amazon Bedrock, deployable via AWS CDK. It supports chat, cust… | 96 | 1324 | active |
| AgentKit AgentKit is Coinbase Developer Platform's framework- and wallet-agnostic toolkit that gives AI agents a crypto wallet and the ability to pe… | 66 | 1324 | active |
| Duxiaoman-DI/XuanYuan XuanYuan is a family of open-source Chinese financial-domain large language models from Duxiaoman, including base, chat, and quantized vari… | 30 | 1324 | active |
| xunbu/docutranslate DocuTranslate is a lightweight local document translation tool powered by large language models, supporting formats such as pdf, docx, xlsx… | 78 | 1322 | active |
| apecloud/ApeRAG ApeRAG is a production-ready RAG platform combining Graph RAG, vector search, and full-text search with AI agents and MCP support. It offer… | 62 | 1322 | active |
| coollabsio/jean Jean is a local-first desktop application (built with Tauri, React, and Rust) that provides a unified workspace for managing multiple codin… | 78 | 1321 | active |
| Henry-23/VideoChat A real-time voice-interactive digital human application that combines ASR, LLM, TTS, and talking-head generation (MuseTalk) into a low-late… | 45 | 1321 | active |
| Capsize-Games/airunner AI Runner is a privacy-focused desktop application for running local AI models offline, combining an AI chat companion with voice conversat… | 92 | 1319 | active |
| ConardLi/easy-llm-cli Easy LLM CLI is an open-source command-line AI agent forked from Gemini CLI that works with multiple LLM providers, including Gemini, OpenA… | 45 | 1319 | active |
| LiteLLM-Labs/litellm-agent-control-plane LiteLLM Agent Control Plane is a self-hosted platform that provides one unified API and UI for creating and running AI agents across multip… | 59 | 1318 | active |
| evilsocket/nerve Nerve is a simple Agent Development Kit (ADK) for building, running, evaluating, and orchestrating LLM-based agents using YAML definitions … | 10 | 1318 | active |
| run-bigpig/jcp JCP (韭菜盘) is a cross-platform desktop application built with Wails, Go, and React that provides AI-driven analysis of Chinese A-share stock… | 10 | 1318 | active |
| darwin-lau/langmanus LangManus is a community-driven Python framework for building hierarchical multi-agent AI automation systems, where a supervisor coordinate… | 22 | 1317 | active |
| SanMuzZzZz/LuaN1aoAgent LuaN1aoAgent is an autonomous AI-driven penetration testing agent built in TypeScript on the Pi SDK, using graph-based cognitive reasoning … | 77 | 1316 | active |
| ChenmienTan/RL2 RL2 (Ray Less Reinforcement Learning) is a concise Python library for post-training large language models with reinforcement learning, SFT,… | 54 | 1316 | active |
| makenotion/notion-mcp-server The official Model Context Protocol (MCP) server for the Notion API, written in TypeScript, exposing Notion pages and data sources as tools… | 61 | 4673 | maintenance |
| HugeCatLab/ChatTutor ChatTutor is a visual and interactive AI tutoring application that gives LLMs the ability to teach on an electronic whiteboard. It combines… | 49 | 1315 | active |
| wild-card-ai/agents-json agents.json is an open specification built on OpenAPI that formally describes contracts for API and agent interactions, translating OpenAPI… | 36 | 1315 | active |
| huggingface/llm-vscode A VSCode extension providing LLM-powered features like Copilot-style ghost-text code completion, with configurable backends including the H… | 65 | 1314 | active |
| LangChat/langchat LangChat is a Java-based enterprise AIGC platform for building AI knowledge bases, chatbots, and agent applications with multi-provider LLM… | 67 | 1313 | active |
| neurogen-dev/NeuroAPI NeuroAPI is a Russian AI API gateway providing unified OpenAI/Anthropic/Gemini-compatible access to models like GPT, Claude, Gemini, and De… | 63 | 1313 | active |
| Alibaba-NLP/ZeroSearch ZeroSearch is a reinforcement learning framework from Alibaba's Tongyi Lab that trains LLMs to use search by simulating search engine resul… | 33 | 1313 | active |
| steipete/claude-code-mcp An MCP server that wraps the Claude Code CLI in one-shot mode, exposing a single claude_code tool so any MCP client (e.g. Cursor, Claude De… | 10 | 1313 | active |
| ai-dynamo/nixl NVIDIA Inference Xfer Library (NIXL) is a C++/Python library that accelerates point-to-point communication in AI inference frameworks like … | 87 | 1312 | active |
| cased/kit kit is a Python toolkit for code intelligence and context engineering, providing codebase mapping, tree-sitter-based symbol extraction, gre… | 52 | 1311 | active |
| deepseek-ai/DeepSeek-Prover-V2 DeepSeek-Prover-V2 is an open-source large language model for formal theorem proving in Lean 4, trained via reinforcement learning with sub… | 31 | 1311 | active |
| Hopsworks Hopsworks is an open-source, data-intensive AI platform (an 'AI Lakehouse') built around a Python-centric Feature Store with online/offline… | 23 | 1310 | active |
| StarlightSearch/EmbedAnything EmbedAnything is a high-performance, memory-safe embedding pipeline written in Rust (with Python bindings) that generates embeddings from t… | 86 | 1309 | active |
| higress-group/himarket HiMarket is an enterprise-grade AI open platform built on the Higress AI Gateway that lets organizations run a private AI capability market… | 84 | 1309 | active |
| mcpjungle/MCPJungle MCPJungle is a self-hosted MCP gateway that lets you register and manage multiple MCP servers behind a single endpoint. It provides central… | 77 | 1309 | active |
| dohooo/helmor Helmor is an open-source, local-first desktop workbench for orchestrating multiple AI coding agents in parallel, each in its own isolated g… | 70 | 1309 | active |
| greyhaven-ai/autocontext Autocontext is a recursive self-improving harness that runs AI agents against evaluations, retains useful lessons, and produces traces, rep… | 60 | 1309 | active |
| tjake/Jlama Jlama is a modern LLM inference engine written in Java, supporting popular transformer models like Llama, Mistral, Gemma, and Qwen with qua… | 48 | 1309 | active |
| aws-samples/claude-prompt-generator A Python web application that generates, translates, and iteratively evaluates prompts for Anthropic Claude 3 via AWS Bedrock, including co… | 10 | 1309 | active |
| openai/simple-evals A lightweight Python library from OpenAI for evaluating language models against benchmarks like MMLU, GPQA, MATH, HumanEval, SimpleQA, Heal… | 57 | 4638 | maintenance |
| griffinmartin/opencode-claude-auth An OpenCode plugin that authenticates Anthropic API requests using existing Claude Code OAuth credentials, eliminating the need for a separ… | 80 | 1307 | active |
| SakanaAI/text-to-lora Text-to-LoRA (T2L) is a hypernetwork that generates LoRA adapters for large language models in a single forward pass, using only a natural … | 28 | 1307 | active |
| DAMO-NLP-SG/VideoLLaMA2 VideoLLaMA 2 is an open-source video large language model that adds spatial-temporal modeling and audio understanding to video-LLMs. It pro… | 25 | 1306 | active |
| turboderp-org/exllamav2 ExLlamaV2 is a fast Python inference library for running large language models locally on modern consumer GPUs, with support for EXL2/GPTQ … | 58 | 4631 | maintenance |
| AI-Prompt-Genius/AI-Prompt-Genius AI Prompt Genius is a Chrome browser extension for curating a personal library of AI prompts with tagging, folders, import/export, and cros… | 66 | 1305 | active |
| dabit3/react-native-ai React Native AI is a full-stack framework for building cross-platform mobile AI apps with React Native and an Express server proxy. It prov… | 70 | 1304 | active |
| neo4j/neo4j-graphrag-python The official Neo4j first-party Python library for building graph retrieval-augmented generation (GraphRAG) applications. It provides retrie… | 92 | 1303 | active |
| yizhongw/self-instruct Self-Instruct is a framework and research codebase for aligning pretrained language models with instructions using data generated by the mo… | 32 | 4612 | maintenance |
| Puppyone Puppyone is a Git-native context drive for AI agents: a persistent, version-controlled file workspace with per-agent scoped permissions, ex… | 76 | 1301 | active |
| caliber-ai-org/ai-setup Caliber is a Node.js CLI that generates, scores, and continuously syncs AI agent context files (CLAUDE.md, .cursor/rules/, AGENTS.md, copil… | 76 | 1301 | active |
| huangkiki/dailypaper-skills A set of Claude Code skills that automates a daily research paper pipeline: fetching new papers from HuggingFace Daily, Trending, and arXiv… | 60 | 1301 | active |
| datalayer/jupyter-mcp-server A Model Context Protocol (MCP) server that lets AI agents connect to, edit, and execute Jupyter Notebooks in real time. It supports STDIO a… | 82 | 1300 | active |
| coleam00/claude-memory-compiler A Python tool that gives Claude Code an evolving memory by capturing conversation transcripts via hooks, extracting decisions and lessons w… | 45 | 1299 | active |
| Agentshire/Agentshire Agentshire is an OpenClaw/QClaw plugin that turns AI agents into living 3D NPCs inside a customizable low-poly game town. It combines a rea… | 59 | 1298 | active |
| s2b-dev/smart-second-brain An open-source Obsidian plugin that adds a privacy-focused AI assistant to your note vault. It embeds your notes and uses a RAG pipeline wi… | 92 | 1296 | active |
| d-kimuson/claude-code-viewer A web-based client for Claude Code that lets users start, resume, and monitor Claude Code sessions from a browser, with real-time conversat… | 78 | 1295 | active |
| rinadelph/Agent-MCP Agent-MCP is a TypeScript framework for building coordinated multi-agent AI systems over the Model Context Protocol (MCP). It provides a pe… | 51 | 1295 | active |
| codefuse-ai/codefuse-chatbot CodeFuse-ChatBot is an open-source AI assistant for the software development lifecycle, combining a multi-agent scheduling framework with D… | 28 | 1295 | active |
| ngxson/wllama wllama is a WebAssembly binding for llama.cpp that enables running LLM inference entirely in the browser, with WebGPU support, multimodal i… | 89 | 1294 | active |
| wisupai/e2m E2M is a Python library that parses and converts many file types (doc, docx, epub, html, url, pdf, ppt, pptx, mp3, m4a) into Markdown using… | 24 | 1293 | active |
| SmythOS/sre SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime, SDK, and CLI for building and running production AI agents acros… | 49 | 1292 | active |
| panyanyany/Twocast Twocast is a self-hostable AI podcast generator that creates two-person conversational podcast episodes from topics, links, documents, or w… | 29 | 1292 | active |
| yym68686/ChatGPT-Telegram-Bot TeleChat is a self-hosted Telegram bot that connects Telegram conversations to OpenAI-compatible large language model APIs, including GPT, … | 62 | 1290 | active |
| ELLA ELLA is an Efficient Large Language Model Adapter that equips text-to-image diffusion models with LLM-based text understanding via a Timest… | 26 | 1289 | active |
| PrunaAI/pruna Pruna is an open-source Python model optimization framework that makes AI models faster, smaller, cheaper, and greener via caching, quantiz… | 80 | 1288 | active |
| ChesterRa/cccc CCCC is a Python-based multi-agent orchestrator that coordinates coding agents (Claude Code, Codex CLI, ChatGPT Web, Gemini CLI, and 13+ ot… | 81 | 1286 | active |
| kubeai-project/kubeai KubeAI is a Kubernetes operator for serving machine learning models in production, supporting LLMs via vLLM and Ollama, vector embeddings, … | 95 | 1284 | active |
| AI-Builder-Club/skills A Claude Code plugin marketplace distributing skills for building 'loop engineers' — autonomous agents that trigger themselves, do work, ve… | 56 | 1283 | active |
| poetiq-ai/poetiq-arc-agi-solver A Python research codebase that reproduces Poetiq's record-breaking, leaderboard-topping submissions to the ARC-AGI-1 and ARC-AGI-2 abstrac… | 39 | 1283 | active |
| fatwang2/search2ai A proxy service that adds online search, news, and webpage summarization capabilities to any OpenAI-compatible LLM API via function calling… | 85 | 1281 | active |
| opendatalab/LabelLLM LabelLLM is an open-source data annotation platform designed to streamline the labeling workflows needed for LLM development. It offers con… | 62 | 1281 | active |
| gomate-community/TrustRAG TrustRAG is a configurable and modular Retrieval-Augmented Generation (RAG) framework in Python built around the principle of reliable inpu… | 50 | 1280 | active |
| charmbracelet/mods Mods is a Go CLI tool that brings LLM-based AI to the command line, designed to work in shell pipelines by ingesting command output and for… | 10 | 4522 | maintenance |
| Willxup/cpa-usage-keeper A standalone usage tracker for CLIProxyAPI (CPA) that persists usage data in SQLite and provides a built-in analytics dashboard. It shows u… | 78 | 1279 | active |
| kellyvv/PhoneClaw PhoneClaw is a mobile-native local AI agent framework that turns phones into on-device agent runtimes, running Gemma models via LiteRT and … | 71 | 1279 | active |
| DreamLM/Dream Dream 7B is an open diffusion large language model (dLLM) with base and instruct checkpoints, plus inference and training code built on Hug… | 40 | 1279 | active |
| ABexit/ASR-LLM-TTS An open-source Python speech interaction pipeline that chains SenseVoice ASR, Qwen2.5 LLMs, and TTS engines (CosyVoice, Edge-TTS, pyttsx3) … | 57 | 1278 | active |
| stair-lab/kg-gen kg-gen is a Python library that extracts knowledge graphs from arbitrary plain text or conversation messages using LLMs, with model routing… | 57 | 1278 | active |
| utkusen/promptmap promptmap2 is an automated prompt injection scanner for custom LLM applications, supporting white-box testing of system prompts and black-b… | 50 | 1278 | active |
| hyperonym/basaran Basaran is an open-source alternative to the OpenAI text completion API that serves Hugging Face Transformers-based text generation models … | 10 | 1278 | active |
| philschmid/mcp-cli A lightweight Bun-based command-line tool for interacting with MCP (Model Context Protocol) servers over stdio and HTTP. It lets users and … | 51 | 1276 | active |
| wong2/weixin-agent-sdk A TypeScript SDK that bridges any AI agent backend into WeChat via a simple Agent interface, with QR-code login and a message loop. It also… | 48 | 1276 | active |
| pipeboard-co/meta-ads-mcp A Model Context Protocol (MCP) server that lets AI assistants like Claude, ChatGPT, Perplexity, and Cursor manage Meta Ads (Facebook/Instag… | 80 | 1275 | active |
| ai-genie/chatgpt-vscode Genie AI is a Visual Studio Code extension that integrates OpenAI's ChatGPT models (GPT-4o, GPT-4, GPT-3.5, o1) as an AI pair programmer. I… | 21 | 1275 | active |
| ModelCloud/GPTQModel GPTQModel is a production-ready Python toolkit for quantizing (compressing) large language models using GPTQ, AWQ, and related methods, wit… | 92 | 1274 | active |
| okisdev/ChatChat Chat Chat is a self-hostable web platform that unifies chat and search interfaces to multiple AI providers such as OpenAI, Anthropic, Coher… | 65 | 1271 | active |
| aiming-lab/Agent0 Agent0 Series is a research framework for training self-evolving LLM agents from zero external data via tool-integrated reasoning and co-ev… | 55 | 1271 | active |
| microsoft/BioGPT BioGPT is Microsoft's domain-specific generative Transformer language model pre-trained on biomedical text, with implementation code and pr… | 10 | 4486 | maintenance |
| Xerxes-2/clewdr ClewdR is a high-performance Rust proxy for Claude.ai and Claude Code that exposes native Claude and OpenAI-compatible API endpoints from a… | 78 | 1270 | active |
| jonexaiorg/jonex Jonex is an end-to-end, self-hosted AI knowledge platform combining a multimodal parsing engine (documents, video, images) with an ontology… | 56 | 1267 | active |