Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| langchain-ai/chat-langchain Chat LangChain is a production-ready documentation assistant agent that answers questions about LangChain, LangGraph, and LangSmith, built … | 77 | 6470 | active |
| apfel apfel is a Swift CLI tool that exposes Apple's built-in on-device Foundation Models LLM on Apple Silicon Macs as a UNIX-friendly command, a… | 77 | 6453 | active |
| AIOS AIOS is an 'AI Agent Operating System' that embeds LLMs into an OS-like kernel providing scheduling, context switching, memory, storage, an… | 69 | 6445 | active |
| haifengl/smile SMILE is a comprehensive, high-performance machine learning framework for the JVM with idiomatic APIs for Java, Scala, and Kotlin. It cover… | 100 | 6423 | active |
| kucherenko/jscpd jscpd is a copy/paste detector that finds duplicated code blocks across 223+ programming languages and formats using the Rabin-Karp algorit… | 99 | 6421 | active |
| therealXiaomanChu/ex-skill A Claude Code skill (plugin) that distills an ex-partner into a personalized AI persona. It ingests chat exports (WeChat, QQ), screenshots,… | 46 | 6406 | active |
| lavague-ai/LaVague LaVague is an open-source Python framework for building AI Web Agents powered by a Large Action Model. It combines a World Model that inter… | 26 | 6392 | active |
| huangruiteng/loopx LoopX is a provider-neutral, local-first control plane for long-horizon AI agents that runs on top of agent harnesses like Codex, Claude Co… | 78 | 6388 | active |
| E2B An open-source Next.js template for building AI-generated apps, similar to Claude Artifacts or v0. It uses the E2B SDK to securely execute … | 68 | 6388 | active |
| Materialize Materialize is a streaming database that uses incremental computation to maintain always-fresh, strongly consistent SQL views over data fro… | 100 | 6385 | active |
| ThinkInAIXYZ/deepchat DeepChat is an open-source, local-first AI agent desktop client built with Electron that connects to multiple LLM providers like OpenAI, Cl… | 88 | 6369 | active |
| tensorflow/serving TensorFlow Serving is a flexible, high-performance serving system for machine learning models designed for production environments. It mana… | 89 | 6364 | stable |
| Harbor Harbor is a Python framework from the creators of Terminal-Bench for evaluating and optimizing AI agents and language models in containeriz… | 86 | 6348 | active |
| joeseesun/qiaomu-anything-to-notebooklm A Claude Code Skill that ingests content from 15+ sources (WeChat articles, web pages, YouTube, PDFs, EPUB, Office docs, audio) and uploads… | 69 | 6347 | active |
| canopyai/Orpheus-TTS Orpheus TTS is an open-source text-to-speech system built on a Llama-3b backbone that produces human-sounding speech with emotion control a… | 42 | 6347 | active |
| MaiBot MaiBot (MaiSaka) is an open-source, LLM-powered conversational agent designed to behave like a warm, human-like 'digital life form' in QQ g… | 84 | 6338 | active |
| jacob-bd/gemini-notebook-mcp-cli A Python tool providing programmatic access to Google's Gemini Notebook (formerly NotebookLM) through a CLI and an MCP server. It lets user… | 80 | 6333 | active |
| KunAgent/Kun Kun is a local-first AI agent workspace that lets AI plan, execute, verify, and deliver real work in coding, writing, design, research, and… | 82 | 6318 | active |
| Rivet Rivet Actors is an open-source framework (RivetKit) providing long-running, stateful actor processes as the primitive for AI agents, collab… | 93 | 6309 | active |
| Sylinko/Everywhere Everywhere is a cross-platform desktop AI assistant with on-screen awareness that reads the context of whatever app you're using via access… | 80 | 6295 | active |
| NEKOparapa/AiNiee AiNiee is an AI-powered translation tool focused on automatically translating complex long-form content such as RPG/SLG game text, Epub/TXT… | 93 | 6293 | active |
| neuphonic/neutts NeuTTS is a collection of open-source, on-device text-to-speech models built on small LLM backbones, with instant voice cloning from as lit… | 57 | 6286 | active |
| Eigenwise/atomic-agents Atomic Agents is a lightweight, modular Python framework for building agentic AI pipelines and applications from small, composable componen… | 91 | 6284 | active |
| MinishLab/semble Semble is a fast, CPU-only code search library built for coding agents, providing semantic and hybrid search over codebases with ~99% fewer… | 82 | 6260 | active |
| meta-pytorch/gpt-fast A minimal (<1000 lines) PyTorch-native implementation of fast transformer text generation, demonstrating low-latency LLM inference with int… | 41 | 6259 | active |
| vllm-project/semantic-router vLLM Semantic Router is an open-source programmable routing and control layer for building Mixture-of-Models systems across heterogeneous L… | 80 | 6243 | active |
| JimmyLv/BibiGPT-v1 BibiGPT is an AI-powered web application that summarizes videos and audio from platforms like Bilibili, YouTube, TikTok, and podcasts, gene… | 54 | 6241 | active |
| meta-llama/llama3 The official Meta repository for Llama 3, providing model weights download scripts, tokenizer, and minimal example code for running inferen… | 10 | 29172 | maintenance |
| Helicone Helicone is an open-source LLM observability platform and AI gateway that logs, monitors, and analyzes LLM API requests with a one-line int… | 78 | 6224 | active |
| microsoft/fara Fara1.5 is a family of open-weight computer use agent (CUA) models from Microsoft Research, released at 4B, 9B, and 27B scales and built on… | 60 | 6221 | active |
| jihe520/MathModelAgent MathModelAgent is a multi-agent LLM application that automates mathematical modeling competitions end-to-end: it analyzes a problem, builds… | 87 | 6220 | active |
| agentsview A local-first desktop and web application (with a companion CLI) for browsing, searching, and analyzing AI coding agent sessions, including… | 78 | 6216 | active |
| Q00/ouroboros Ouroboros is an 'Agent OS' that manages AI coding agent workflows through interview-gated requirement capture, staged evaluation, and a bud… | 79 | 6215 | active |
| Shaunwei/RealChar RealChar is an open-source application for creating, customizing, and talking to AI characters/companions in realtime via voice or text. It… | 45 | 6211 | active |
| HelixDB/helix-db HelixDB is an open-source OLTP graph-vector database written in Rust that combines labeled property graphs with native vector, full-text, a… | 84 | 6205 | active |
| lightdash/lightdash Lightdash is an open-source, agentic business intelligence platform that lets data teams define governed metrics, dashboards, AI agents, an… | 96 | 6198 | active |
| PrefectHQ/marvin Marvin is a Python framework for building AI applications with LLMs, offering structured-output utilities (extract, cast, classify, generat… | 85 | 6198 | active |
| ByteDance-Seed/Bagel BAGEL is an open-source unified multimodal foundation model with 7B active parameters (14B total) trained on interleaved multimodal data. I… | 52 | 6191 | active |
| microsoft/TaskWeaver TaskWeaver is a code-first agent framework from Microsoft that plans and executes data analytics tasks by generating and running code snipp… | 10 | 6162 | active |
| YILING0013/AI_NovelGenerator A Python GUI application that uses large language models to generate multi-chapter long-form novels with automatic context continuity, fore… | 62 | 6156 | active |
| Semantic Kernel Semantic Kernel is a model-agnostic SDK and orchestration framework from Microsoft for building AI agents and multi-agent systems in .NET, … | 94 | 28687 | maintenance |
| wenda-LLM/wenda Wenda is a self-hosted LLM invocation platform designed for efficient content generation in constrained environments, integrating local/off… | 31 | 6148 | active |
| FlashDrive DFlash is a lightweight block diffusion model used as a draft model for speculative decoding of large language models, drafting entire toke… | 65 | 6134 | active |
| KServe KServe is a CNCF incubating, Kubernetes-native platform for serving both generative and predictive AI models at scale. It provides a standa… | 94 | 6133 | stable |
| tw93/Kaku Kaku is a fast, macOS-native terminal emulator forked from WezTerm, built for AI-assisted coding with zero-config defaults, tabs/panes, and… | 84 | 6132 | active |
| Cactus Cactus is a hybrid edge-cloud AI inference engine for mobile devices, wearables, smart home devices, and robots, built in C++ with custom q… | 85 | 6111 | active |
| google/agents-cli A Python CLI plus agent skills that equip coding assistants (Claude Code, Codex, Antigravity, etc.) to build, evaluate, and deploy AI agent… | 82 | 6094 | active |
| princeton-nlp/tree-of-thought-llm Official implementation of the Tree of Thoughts (ToT) framework for deliberate LLM problem solving, generalizing chain-of-thought prompting… | 21 | 6071 | stable |
| microsoft/Webwright Webwright is a Python framework from Microsoft that turns coding LLMs into state-of-the-art browser agents by giving them a terminal to lau… | 59 | 6066 | active |
| netease-youdao/LobsterAI LobsterAI is an open-source, desktop-grade AI agent application by NetEase Youdao that performs real work like data analysis, slides, docum… | 76 | 6064 | active |
| oomol-lab/open-connector OpenConnector is an open-source connector gateway that lets users authorize SaaS app accounts once and exposes 1,000+ providers and 10,000+… | 81 | 6046 | active |
| truefoundry/trueforge TrueForge is an open-source agent harness that provides the runtime layer turning an LLM into a working agent, with MCP tools, skills, sand… | 79 | 6032 | active |
| om-ai-lab/VLM-R1 VLM-R1 is a framework for training R1-style large vision-language models using reinforcement learning (GRPO) on top of Qwen2.5-VL. It provi… | 60 | 6029 | active |
| PawanOsman/OpenCursor OpenCursor is an open-source, Cursor-like AI coding agent distributed as a VS Code extension. It provides agentic chat that reads workspace… | 97 | 6023 | active |
| tigerless-labs/autoharness Autoharness is a self-learning skill layer for Claude Code that distills reusable skills from your real coding sessions, merges near-duplic… | 58 | 6020 | active |
| ModelEngine-Group/nexent Nexent is a zero-code, self-hosted platform for auto-generating production-grade AI agents from natural language prompts, built on Harness … | 87 | 6009 | active |
| gluonfield/enchanted Enchanted is an open-source iOS/macOS/visionOS chat app that connects to a self-hosted Ollama server to chat with private local language mo… | 69 | 6008 | active |
| TideDra/zotero-arxiv-daily A Python tool deployed as a GitHub Action that recommends new arXiv (and bioRxiv/medRxiv/chemRxiv) papers daily based on the contents of yo… | 79 | 6002 | active |
| Michael-A-Kuykendall/shimmy Shimmy is a single-binary, OpenAI-compatible LLM inference server written in pure Rust, running GGUF models on a WebGPU-based engine (Airfr… | 86 | 5988 | active |
| generalaction/emdash Emdash is an open-source desktop application (Agentic Development Environment) for running multiple AI coding agents in parallel, each isol… | 81 | 5986 | active |
| alibaba/AliSQL AliSQL is Alibaba Cloud's open-source MySQL branch based on MySQL 8.0.44, adding a DuckDB columnar analytical storage engine and native HNS… | 80 | 5986 | active |
| Lemonade Lemonade is a local AI server that runs optimized LLMs (plus image, speech, and embedding models) on your own GPU and NPU, exposing OpenAI-… | 83 | 5964 | active |
| kuafuai/DevOpsGPT DevOpsGPT is a multi-agent system that combines LLMs with DevOps tools to convert natural language requirements into working software. It a… | 64 | 5963 | active |
| lucidrains/x-transformers A concise PyTorch library implementing full-attention transformer architectures (encoder, decoder, encoder-decoder, and vision transformers… | 83 | 5960 | active |
| fla-org/flash-linear-attention A PyTorch library providing hardware-efficient implementations of emerging sequence model architectures, including linear attention, sparse… | 86 | 5940 | active |
| fengshao1227/ccg-workflow CCG Workflow is a multi-model orchestration engine for Claude Code that coordinates Codex CLI, Gemini CLI, and Antigravity CLI from a singl… | 70 | 5939 | active |
| mostlygeek/llama-swap A Go-based proxy service that lets you run multiple local AI inference servers (llama.cpp, vllm, ComfyUI, etc.) and hot-swap between models… | 86 | 5922 | active |
| samchon/typia Typia is a TypeScript transformer library that compiles pure TypeScript types into super-fast runtime validators, JSON serializers/parsers,… | 93 | 5921 | active |
| Giskard-AI/giskard-oss Giskard is an open-source Python library for testing, evaluating, and red-teaming LLM-based agents and RAG systems. Its v3 rewrite provides… | 95 | 5910 | active |
| mindcraft-bots/mindcraft Mindcraft is a JavaScript application that connects LLM-powered AI agents to Minecraft via the Mineflayer library, letting language models … | 85 | 5910 | active |
| AgentOps-AI/agentops AgentOps is a Python SDK and observability platform for monitoring, debugging, and evaluating AI agents and LLM applications. It auto-instr… | 67 | 5886 | active |
| GPUStack GPUStack is an open-source GPU cluster manager for AI model serving that orchestrates inference engines like vLLM, SGLang, and TensorRT-LLM… | 88 | 5870 | active |
| SamuelSchmidgall/AgentLaboratory Agent Laboratory is an end-to-end autonomous research workflow framework that uses specialized LLM-driven agents to assist human researcher… | 34 | 5869 | active |
| rllm-org/rllm rLLM is an open-source Python framework for training language agents with reinforcement learning, supporting any agent harness (Claude Code… | 75 | 5862 | active |
| sqlchat/sqlchat SQL Chat is a chat-based SQL client and editor that lets users query, modify, add, and delete data using natural language, powered by OpenA… | 63 | 5847 | active |
| MadcowD/ell ell is a lightweight Python library for language model programming that treats prompts as functions (language model programs) rather than s… | 32 | 5847 | active |
| shibing624/MedicalGPT MedicalGPT is a Python training framework for building medical-domain large language models using the full ChatGPT-style training pipeline:… | 85 | 5843 | active |
| areal-project/AReaL AReaL is a large-scale asynchronous reinforcement learning system that bridges foundation model training with agent-based applications, sup… | 86 | 5842 | active |
| OpenAI PHP OpenAI PHP is a community-maintained PHP SDK for interacting with the OpenAI API, covering chat, responses, embeddings, audio, images, fine… | 94 | 5836 | active |
| vercel-labs/open-agents Open Agents is an open-source reference application and template for building cloud-hosted background coding agents on Vercel. It combines … | 58 | 5833 | active |
| pytorch/torchtitan torchtitan is a PyTorch-native platform for large-scale training of generative AI models, offering a clean-room implementation of PyTorch's… | 81 | 5830 | active |
| HKUDS/AI-Researcher AI-Researcher is an autonomous research system that orchestrates the full scientific research pipeline—from literature review and hypothesi… | 38 | 5815 | active |
| Klavis-AI/klavis Klavis AI is an open-source MCP (Model Context Protocol) integration platform that lets AI agents connect to 100+ prebuilt tool integration… | 59 | 5814 | active |
| snailyp/gemini-balance A Python FastAPI proxy and load-balancing service for the Google Gemini API that rotates multiple API keys and exposes both Gemini and Open… | 36 | 5813 | active |
| memovai/mimiclaw MimiClaw is a bare-metal AI agent framework written in pure C that runs an OpenClaw-style personal AI assistant on a $5 ESP32-S3 microcontr… | 67 | 5802 | active |
| Cloudflare Agents SDK A TypeScript SDK for building persistent, stateful AI agents on Cloudflare Workers, powered by Durable Objects. Each agent gets durable ide… | 83 | 5800 | active |
| google-deepmind/gemma The official JAX-based Python library from Google DeepMind for running, sampling from, and fine-tuning the Gemma family of open-weight larg… | 85 | 5796 | active |
| PySpur-Dev/pyspur PySpur is an open-source visual playground and builder for AI agent workflows, letting engineers build agents via drag-and-drop UI or Pytho… | 61 | 5792 | active |
| coze-dev/coze-loop Coze Loop is an open-source, self-hostable platform for full-lifecycle AI agent development, offering prompt engineering with a visual play… | 72 | 5764 | active |
| RuoYi-AI RuoYi AI is an open-source, enterprise-grade full-stack AI assistant platform built in Java on the RuoYi ecosystem and LangChain4j. It unif… | 91 | 5761 | active |
| dnhkng/GLaDOS A real-life implementation of GLaDOS, the sardonic AI from Valve's Portal series, built as a proactive voice assistant with vision, memory,… | 66 | 5735 | active |
| potpie-ai/potpie Potpie is an open-source context engine that turns a codebase and its development history into a living context graph for AI coding agents.… | 87 | 5733 | active |
| Gen-Verse/OpenClaw-RL OpenClaw-RL is a framework for training personalized AI agents through reinforcement learning using natural conversation as feedback. It us… | 49 | 5722 | active |
| Gemma The official PyTorch implementation of Google's Gemma family of open large language models, including text-only and multimodal variants. It… | 10 | 5710 | active |
| serge-chat/serge Serge is a self-hosted web chat interface for running LLMs locally via llama.cpp, built with a SvelteKit frontend and FastAPI backend. It s… | 10 | 5709 | active |
| OpenBMB/UltraRAG UltraRAG is a low-code Python framework from OpenBMB for building complex RAG pipelines using MCP servers and YAML-based orchestration with… | 85 | 5706 | active |
| agentscope-ai/AgentTeams AgentTeams is an open-source collaborative multi-agent runtime platform that orchestrates multiple Agent containers using a Manager-Workers… | 81 | 5698 | active |
| huggingface/alignment-handbook A collection of robust training recipes and scripts from Hugging Face for aligning large language models with human and AI preferences, cov… | 72 | 5696 | active |
| SenseNova A collection of modular Agent Skills for SenseNova models that add end-to-end office capabilities such as slide-deck generation, Excel data… | 58 | 5683 | active |
| the-open-agent/openagent OpenAgent is a self-hosted, single-binary personal AI assistant platform built in Go that combines LLM chat, RAG knowledge bases, and auton… | 93 | 5670 | active |