Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| SakanaAI/ShinkaEvolve ShinkaEvolve is a Python framework that combines LLMs with evolutionary algorithms to automatically evolve and improve scientific code. It … | 76 | 1414 | active |
| hesamsheikh/octogent Octogent is a TypeScript dashboard that orchestrates multiple Claude Code sessions, giving each agent scoped context, notes, and a todo.md … | 49 | 1414 | active |
| GreenSheep01201/claw-empire Claw-Empire is a local-first AI agent office simulator that orchestrates CLI, OAuth, and API-connected AI coding agents (Claude Code, Codex… | 56 | 1413 | active |
| lucidrains/self-rewarding-lm-pytorch A PyTorch library implementing the Self-Rewarding Language Model training framework from MetaAI, along with the SPIN training method. It pr… | 17 | 1412 | active |
| SpikingBrain SpikingBrain-7B is a brain-inspired large language model that combines hybrid efficient attention, MoE modules, and spike encoding, with a … | 51 | 1408 | active |
| awaescher/OllamaSharp OllamaSharp is a .NET client library providing bindings for the entire Ollama API, including chat, generation, embeddings, and model manage… | 89 | 1407 | active |
| agentenv/agentflow AgentFlow is a Python library for orchestrating large numbers of LLM agents (Codex, Claude, Kimi, Pi) as programmatic dependency graphs wit… | 58 | 1407 | active |
| robertpiosik/CodeWebChat Code Web Chat (CWC) is a free, privacy-first VS Code extension toolkit for AI-assisted coding that builds unified prompts with static conte… | 67 | 1406 | active |
| jofizcd/Soul-of-Waifu Soul of Waifu is an open-source desktop application for creating AI companion characters with Live2D/VRM avatars, voice chat, and persisten… | 89 | 1404 | active |
| zubair-trabzada/ai-sales-team-claude A collection of 14 Claude Code skills and 5 parallel agents that turn Claude Code into an AI-powered sales team. It researches prospects, q… | 45 | 1404 | active |
| agent0ai/space-agent Space Agent is an AI agent application, created by the Agent Zero team, that runs in the browser/frontend runtime and can build pages, tool… | 64 | 1401 | active |
| RahulSChand/gpu_poor A web-based calculator that estimates GPU memory requirements and inference/finetuning throughput (token/s) for any LLM. It supports quanti… | 19 | 1401 | active |
| vellum-ai/vellum-assistant Vellum is an open-source personal AI assistant that runs 24/7, learns your preferences through eight types of persistent memory, and takes … | 77 | 1400 | active |
| 0nutation/SpeechGPT SpeechGPT is a series of speech large language models that can perceive and generate speech, supporting cross-modal instruction following a… | 30 | 1400 | active |
| McGill-NLP/webllama WebLlama is a framework for building Llama-3-powered agents that browse the web by following natural language instructions and dialogue. It… | 56 | 1399 | active |
| designcomputer/mysql_mcp_server A Model Context Protocol (MCP) server that lets AI assistants securely interact with MySQL databases by listing tables, reading data, and e… | 80 | 1398 | active |
| EvanZhouDev/openai-oauth A TypeScript toolkit that turns a ChatGPT account into an OpenAI-compatible API via a local dev proxy, TypeScript SDK, and client adapters.… | 66 | 1398 | active |
| aws-samples/aws-genai-llm-chatbot A modular, production-ready AWS solution for deploying a multi-LLM, multi-RAG powered chatbot using AWS CDK. It supports Amazon Bedrock, Sa… | 10 | 1398 | active |
| paradigmxyz/centaur Centaur is a self-hosted, open-source platform for running shared AI agents for teams, triggered via Slack mentions or an API. Each convers… | 78 | 1396 | active |
| wuji-labs/nopua NoPUA is an agent skill that improves AI coding assistant behavior by replacing fear-based, threatening prompts with respectful, caring ins… | 71 | 1396 | active |
| explosion/spacy-llm spacy-llm is a Python library that integrates Large Language Models into spaCy NLP pipelines via a serializable llm component. It provides … | 75 | 1395 | active |
| imhuso/cunzhi Cunzhi (寸止) is an MCP tool that intercepts AI assistants when they try to end a conversation prematurely, popping up a dialog so users can … | 57 | 1394 | active |
| aws-samples/generative-ai-use-cases Generative AI Use Cases (GenU) is a well-architected sample application from AWS that demonstrates business use cases for generative AI, bu… | 90 | 1390 | active |
| elirantutia/vibeyard Vibeyard is an Electron-based, terminal-centric IDE designed for AI coding agents like Claude Code, Codex CLI, and Gemini CLI. It provides … | 77 | 1390 | active |
| Dataojitori/nocturne_memory Nocturne Memory is a lightweight, rollbackable long-term memory server for MCP agents, storing persistent, graph-like structured memories i… | 79 | 1389 | active |
| microsoft/azurechat Azure Chat is a solution accelerator from Microsoft that lets organizations deploy a private, enterprise-grade chat application powered by … | 74 | 1388 | active |
| foxhui/WebAI2API WebAI2API is a self-hosted Node.js service that exposes web-based AI services (LMArena, Gemini, ChatGPT, DeepSeek, etc.) as OpenAI-compatib… | 54 | 1388 | active |
| QwenLM/Qwen3-VL-Embedding Qwen3-VL-Embedding and Qwen3-VL-Reranker are state-of-the-art multimodal embedding and reranking models built on the Qwen3-VL foundation mo… | 52 | 1387 | active |
| DrJonaC/Pensieve Pensieve is a local-first dashboard for visualizing, interpreting, and governing the structured memory that LLMs keep about users. It expos… | 58 | 1386 | active |
| zjunlp/KnowLM KnowLM is an open-source framework for building knowledgeable large language models, covering data processing, pre-training, fine-tuning, k… | 31 | 1386 | active |
| Amm1rr/WebAI-to-API A self-hosted Python server that exposes browser-based AI services like Google Gemini through an OpenAI-compatible /v1/chat/completions API… | 89 | 1385 | active |
| meridianlabs-ai/inspect_petri Inspect Petri is an alignment auditing agent that automatically probes language models for concerning behaviors like sycophancy, reward hac… | 81 | 1385 | active |
| soda-inria/tabicl TabICLv2 is an open-source tabular foundation model that performs classification and regression via a single forward pass through a pre-tra… | 83 | 1384 | active |
| Zefan-Cai/KVCache-Factory KVCache-Factory is a unified Python framework implementing many KV cache compression, retrieval, merging, and quantization methods for long… | 65 | 1384 | active |
| P0luz/Ombre-Brain Ombre Brain is a long-term emotional memory system for Claude and other MCP clients, exposing 16 MCP tools over a single /mcp connector. Me… | 77 | 1383 | active |
| jordanrendric/claude-video-vision A Claude Code plugin with an MCP server that gives Claude the ability to watch and understand videos by extracting frames via ffmpeg and tr… | 70 | 1381 | active |
| elevenyellow/handcrafted-persona-engine Persona Engine is a Windows desktop application that drives a Live2D avatar with an AI pipeline: microphone speech recognition, an LLM guid… | 67 | 1381 | active |
| zjunlp/SkillNet SkillNet is open infrastructure for discovering, evaluating, composing, and orchestrating reusable AI agent skills, treating skills as sear… | 60 | 1381 | active |
| YuvDwi/Steve Steve is a Minecraft Forge mod that adds autonomous AI agents ('Cursor for Minecraft') that play the game alongside the player. Players giv… | 56 | 1381 | active |
| nlkitai/nlux NLUX is an open-source React and JavaScript library for building conversational AI chat interfaces powered by large language models. It pro… | 48 | 1380 | active |
| 1rgs/jsonformer Jsonformer is a Python library that wraps Hugging Face causal language models to generate syntactically correct JSON conforming to a given … | 30 | 4936 | maintenance |
| felixrieseberg/clippy A desktop chat application that runs local LLMs (GGUF models via llama.cpp) behind a nostalgic 1990s Microsoft Office Clippy assistant inte… | 42 | 1378 | active |
| ServiceNow/BrowserGym BrowserGym is a Gym-style environment library for web task automation, providing a unified interface to web agent benchmarks like MiniWoB, … | 78 | 1376 | active |
| mpociot/chatgpt-vscode A Visual Studio Code extension that integrates ChatGPT into the editor, letting users ask questions, query selected code snippets, and inse… | 32 | 4920 | maintenance |
| morettt/my-neuro An open-source AI desktop companion framework inspired by Neuro-sama, letting users build a customizable Live2D character with sub-second v… | 81 | 1374 | active |
| lvwzhen/law-cn-ai An AI legal assistant for Chinese law that answers questions using a knowledge base of Chinese legal documents. It is a Next.js app that em… | 30 | 4915 | maintenance |
| LangChain4j AIDeepin LangChain4j-AIDeepin is an open-source, self-hostable AI application platform built on Spring Boot, LangChain4j, and LangGraph4j with Vue 3… | 91 | 1372 | active |
| Lapis0x0/obsidian-yolo YOLO is an agent-native AI assistant plugin for Obsidian that combines chat, writing assistance, knowledge base interaction, and agent orch… | 83 | 1372 | active |
| ClaudioDrews/memory-os Memory OS is a seven-layer persistent memory system for the Hermes Agent, combining Qdrant vector search, structured facts with trust scori… | 57 | 1372 | active |
| ChatWise ChatWise is a fast, privacy-friendly desktop AI chatbot client that connects to multiple LLM providers (OpenAI, Anthropic, Google, Groq, Ol… | 67 | 1371 | active |
| Meituan-AutoML/MobileVLM MobileVLM is a family of compact vision language models (1.4B-3B parameters) designed to run efficiently on mobile devices, combining small… | 17 | 1371 | active |
| OpenPrompt OpenPrompt is a PyTorch-based open-source framework for prompt-learning, providing a standard, flexible pipeline of templates and verbalize… | 23 | 4903 | maintenance |
| HazyResearch/minions Minions is a communication protocol and Python framework that lets small on-device LLMs collaborate with frontier cloud LLMs to cut cloud i… | 49 | 1370 | active |
| OpenRaiser/NanoResearch NanoResearch is an autonomous AI research assistant that runs an end-to-end pipeline from a research idea to a complete LaTeX paper. It exe… | 57 | 1369 | active |
| bytedance/flux Flux is a GPU kernel library from ByteDance that overlaps computation with communication for tensor and expert parallelism in dense and MoE… | 30 | 1369 | active |
| Kuingsmile/word-GPT-Plus Word GPT Plus is a Microsoft Word add-in that integrates LLMs and AI agents directly into Word for generating, translating, summarizing, an… | 83 | 1368 | active |
| OpenPPL/ppl.nn PPLNN is a high-performance deep-learning inference engine written in C++ that runs ONNX models on x86 CPUs and NVIDIA GPUs, with a dedicat… | 32 | 1368 | active |
| ntegrals/10x 10x is an open-source terminal-based AI coding agent that chains multiple LLM models through multi-step 'Superpowers' workflows with smart … | 43 | 1366 | active |
| ThousandBirdsInc/chidori Chidori is an agent framework that runs async TypeScript agents on an embedded pure-Rust JavaScript engine, recording every side effect (LL… | 92 | 1365 | active |
| Team-Commonly/commonly Commonly is an open-source, self-hostable workspace where humans and multiple AI agents (Claude Code, Codex, OpenClaw, or custom runtimes) … | 84 | 1364 | active |
| alibaba/rtp-llm RTP-LLM is Alibaba's high-performance LLM inference engine written in C++/CUDA, optimized with kernels like PagedAttention and FlashAttenti… | 65 | 1364 | active |
| raroque/boop-agent Boop is a self-hosted iMessage-based personal AI agent that runs on either a Claude Code subscription (via the Claude Agent SDK) or a Codex… | 53 | 1364 | active |
| FreedomIntelligence/HuatuoGPT-o1 HuatuoGPT-o1 is a medical large language model project for complex medical reasoning, with open-sourced models (7B-72B), fine-tuning data, … | 22 | 1363 | active |
| mishl-dev/Discord-AI-Chatbot A self-hosted Discord AI chatbot application written in Python that uses the Groq API for fast LLM responses. It supports slash and text co… | 10 | 1363 | active |
| xlang-ai/OpenAgents OpenAgents is an open platform for using and hosting LLM-powered language agents, featuring a Data Agent for Python/SQL analysis, a Plugins… | 29 | 4863 | maintenance |
| Swift Transformers A Swift Package providing a transformers-like API for Swift apps, including fast tokenization, chat templating, and reliable model download… | 97 | 1360 | active |
| 79E/ChatGpt-Web A commercially-viable ChatGPT web application built with React and TypeScript, featuring a full admin backend for managing users, tokens, p… | 24 | 1360 | active |
| amplifthq/opentag OpenTag is a local-first gateway that lets you mention coding agents like Claude Code, Codex, and Cursor from Slack, GitHub, GitLab, Linear… | 81 | 1359 | active |
| fastclaw-ai/fastclaw FastClaw is a lightweight AI agent runtime written in Go, distributed as a single binary. It acts as an agent factory that creates, manages… | 77 | 1359 | active |
| BillHuang2001/evogit EvoGit is a decentralized multi-agent framework that treats software development as an evolutionary process, deploying a population of inde… | 64 | 1358 | active |
| Infinispan Infinispan is an open-source, distributed in-memory key/value data grid and NoSQL cloud data store written in Java. It supports embedded an… | 95 | 1356 | stable |
| paralleldrive/sudolang SudoLang is a pseudocode-style programming language designed for collaborating with AI language models, using natural language constraints,… | 55 | 1356 | active |
| llm-attacks/llm-attacks Official research code for 'Universal and Transferable Adversarial Attacks on Aligned Language Models', implementing the GCG algorithm for … | 29 | 4839 | maintenance |
| MoonshotAI/Kimi-Dev Kimi-Dev-72B is an open-source coding LLM from Moonshot AI specialized in software engineering tasks like issue resolution and bug fixing, … | 35 | 1355 | active |
| vercel-labs/gemini-chatbot An open-source Next.js chatbot template powered by Google Gemini and the Vercel AI SDK, with streaming chat, generative UI, chat history pe… | 60 | 1354 | active |
| JoySafety/JoySafety JoySafety is an open-source large language model safety framework from JD.com, written in Java, providing prompt injection detection, conte… | 42 | 1354 | active |
| lxtGH/OMG-Seg Official research codebase for OMG-Seg (CVPR 2024) and OMG-LLaVA (NeurIPS 2024), unified models for image-level, object-level, and pixel-le… | 68 | 1353 | active |
| first-fluke/oh-my-agent oh-my-agent is a multi-agent orchestration framework for AI-powered IDEs and CLI coding tools like Claude Code, Codex, and Cursor. It decom… | 79 | 1352 | active |
| poco-ai/poco-claw Poco is a self-hostable AI agent execution platform that serves as a more polished alternative to OpenClaw, powered by a Claude Code-based … | 76 | 1352 | active |
| unslop-xyz/noodles Noodles is a Python CLI tool that builds function call graphs from codebases using tree-sitter AST parsing and renders them as interactive … | 44 | 1352 | active |
| nianhua99/PandoraHelper PandoraHelper is a self-hosted web application for centrally managing ChatGPT and Claude accounts and sharing them with other users via iso… | 34 | 1352 | active |
| Abraxas-365/langchain-rust LangChain for Rust is the Rust language implementation of the LangChain framework for building LLM-powered applications through composabili… | 94 | 1350 | active |
| astaxie/TokenHub TokenHub is a self-hosted enterprise AI gateway written in Go that provides a governance layer over AI model access, including model routin… | 79 | 1350 | active |
| ace-agent/ace ACE is a Python framework for Agentic Context Engineering that lets language models self-improve by treating contexts as evolving playbooks… | 58 | 1344 | active |
| LoLLMs LoLLMs WebUI is a local, single-user web interface for running large language models and multimodal AI systems, supporting hundreds of mode… | 64 | 4789 | maintenance |
| hao-ai-lab/LookaheadDecoding A Python library implementing Lookahead Decoding, an exact parallel decoding algorithm that accelerates LLM inference without a draft model… | 28 | 1343 | active |
| basementstudio/xmcp xmcp is a TypeScript framework for building and deploying MCP (Model Context Protocol) servers, with file-system-based auto-discovery of to… | 83 | 1342 | active |
| giuseppe99barchetta/SuggestArr SuggestArr is a self-hosted web application that automatically recommends and requests movies, TV shows, and anime to Jellyseerr/Overseerr … | 89 | 1341 | active |
| specstoryai/getspecstory SpecStory is a local-first tool (VS Code extensions, CLI, and cloud service) that automatically captures AI coding assistant conversations … | 87 | 1341 | active |
| 1692775560/deepseek_project A collection of DeepSeek-related tools including a WeChat chatbot that uses the DeepSeek API for automated replies, a local document upload… | 63 | 1341 | active |
| pullfrog/pullfrog Pullfrog is an open-source, model-agnostic GitHub bot that runs coding agents (Claude, Codex, etc.) inside your repo's GitHub Actions. It t… | 82 | 1340 | active |
| alibaba/graph-learn Graph-Learn (formerly AliGraph) is a distributed framework for developing and applying large-scale graph neural networks, with a training l… | 32 | 1340 | active |
| via007/bilibili-rag A self-hosted RAG application that turns a Bilibili user's favorited videos into a searchable, conversational knowledge base. It pulls favo… | 73 | 1336 | active |
| ChaokunHong/MetaScreener MetaScreener is an open-source AI tool that automates title/abstract and full-text PDF screening for systematic reviews using an ensemble o… | 65 | 1336 | active |
| CarperAI/trlx trlX is a distributed training framework for fine-tuning large language models with reinforcement learning from human feedback (RLHF), supp… | 23 | 4756 | maintenance |
| lean-dojo/LeanCopilot Lean Copilot integrates large language models natively into the Lean 4 theorem prover for proof automation. It provides tactic suggestion, … | 91 | 1335 | active |
| awslabs/dgl-ke DGL-KE is a high-performance Python package built on Deep Graph Library (DGL) for training, evaluating, and inferring knowledge graph embed… | 60 | 1335 | active |
| stulzq/azure-openai-proxy A Go-based proxy service that converts OpenAI official API requests into Azure OpenAI API requests, letting OpenAI-ecosystem tools use Azur… | 21 | 1335 | stable |
| nvk/llm-wiki A plugin that lets AI agents (Claude Code, OpenAI Codex, OpenCode, portable agents) compile and maintain LLM-curated knowledge bases as pla… | 74 | 1334 | active |
| modelscope/sirchmunk Sirchmunk is an agentic, embedding-free search engine that turns raw files into a self-evolving knowledge base in real time, without vector… | 81 | 1333 | active |