Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| langchain-ai/local-deep-researcher A fully local web research assistant that runs any LLM via Ollama or LMStudio to iteratively search the web, summarize findings, identify k… | 67 | 9378 | active |
| Future-House/paper-qa PaperQA2 is a Python library and CLI for high-accuracy retrieval augmented generation (RAG) over PDFs, text, Office documents, and source c… | 95 | 9365 | active |
| LearningCircuit/local-deep-research A self-hosted AI research assistant that performs deep, iterative multi-source research using local or cloud LLMs (Ollama, llama.cpp, OpenA… | 82 | 9359 | active |
| alvinunreal/oh-my-opencode-slim A lightweight agent orchestration plugin for OpenCode that delegates tasks to a team of seven specialized sub-agents (Orchestrator, Explore… | 78 | 9344 | active |
| NVIDIA/garak garak is a command-line LLM vulnerability scanner that probes large language models for failures like hallucination, data leakage, prompt i… | 89 | 9332 | active |
| CoAI.Dev (Chat Nio) CoAI.Dev is a self-hostable, multi-tenant AI platform combining a ChatGPT-style chat UI with an enterprise-grade unified LLM gateway suppor… | 50 | 9323 | active |
| shaxiu/XianyuAutoAgent An AI-powered customer service bot for the Xianyu (Goofish) secondhand marketplace that provides 24/7 automated message handling. It uses L… | 56 | 9275 | active |
| MervinPraison/PraisonAI PraisonAI is a Python multi-agent framework for building and deploying autonomous, self-improving AI agents with built-in memory, RAG, and … | 89 | 9274 | active |
| X-PLUG/MobileAgent Mobile-Agent is a family of multimodal GUI agents from Tongyi Lab that perceive and operate mobile and desktop user interfaces using vision… | 64 | 9269 | active |
| miurla/morphic Morphic is an open-source AI-powered search engine that generates grounded, cited answers with a generative UI that renders rich inline com… | 93 | 9181 | active |
| zhu1090093659/dsh-web dsh-web is a plugin aggregation ecosystem package for the DeepSeek Harness (DSH) Web GUI, bundling independently installable plugins such a… | 81 | 9152 | active |
| modelscope/modelscope ModelScope is a Python library and ecosystem built on the 'Model-as-a-Service' concept, providing unified APIs to download, run inference o… | 96 | 9149 | active |
| EvoMap/evolver Evolver is a Node.js-based self-evolving engine for AI agents built on the GEP (Gene Evolution Protocol), letting agents turn experience in… | 77 | 9145 | active |
| mark3labs/mcp-go A Go SDK implementing the Model Context Protocol (MCP), letting developers build MCP servers that expose tools, resources, and prompts to L… | 82 | 9132 | active |
| Nutlope/aicommits Aicommits is a Node.js CLI that automatically generates git commit messages from your staged changes using AI. It supports multiple LLM pro… | 94 | 9100 | active |
| OpenSPG/KAG KAG (Knowledge Augmented Generation) is a Python framework built on the OpenSPG engine and large language models for logical form-guided re… | 46 | 9073 | active |
| Harness Harness is a Claude Code plugin that acts as a meta-skill for designing domain-specific agent teams. From a single prompt, it generates age… | 58 | 9071 | active |
| lencx/Noi Noi is a cross-platform desktop AI browser that unifies multiple AI chat services (ChatGPT, Claude, Gemini, Perplexity, DeepSeek, etc.) int… | 77 | 9063 | active |
| FareedKhan-dev/kimi-k3-in-c A dependency-free C99 inference engine that runs the 2.78-trillion-parameter Kimi K3 model on a single CPU with as little as 8 GB of RAM by… | 79 | 9033 | active |
| deepseek-ai/DeepGEMM DeepGEMM is a high-performance CUDA BLAS kernel library for NVIDIA tensor cores, providing FP8, FP4, and BF16 GEMMs plus fused MoE and othe… | 82 | 8937 | active |
| Rig Rig is a Rust library for building modular, scalable LLM-powered applications and agents, offering a unified API across 20+ model providers… | 87 | 8911 | active |
| iflytek/astron-agent Astron Agent is an enterprise-grade, commercial-friendly agentic workflow platform for building, orchestrating, and deploying multi-agent A… | 83 | 8910 | active |
| BentoML BentoML is a Python framework for building online serving systems for AI apps and model inference, turning model inference scripts into RES… | 91 | 8909 | stable |
| AIClient2API AIClient2API is a self-hosted Node.js proxy that simulates client-only LLM service requests (Antigravity, Codex, Grok, Kiro, Gemini CLI, et… | 82 | 8896 | active |
| chaitanyagiri/munder-difflin Munder Difflin is a free, open-source desktop multi-agent harness that wraps terminal coding agent CLIs (Claude Code, Codex, Grok, Gemini C… | 81 | 8890 | active |
| Strands Agents Strands Agents is an open-source SDK (Python and TypeScript) for building production AI agents with a model-driven approach, supporting any… | 83 | 8884 | active |
| maximhq/bifrost Bifrost is a high-performance, open-source AI gateway written in Go that unifies access to 23+ LLM providers (OpenAI, Anthropic, AWS Bedroc… | 84 | 8865 | active |
| elder-plinius/OBLITERATUS OBLITERATUS is a Python toolkit for abliteration — identifying and removing refusal behaviors from large language models by locating and in… | 79 | 8861 | active |
| rockbenben/ChatGPT-Shortcut AiShort (ChatGPT Shortcut) is a searchable, tag-filterable library of 5000+ ready-to-use AI prompts for ChatGPT, Claude, Gemini, DeepSeek, … | 94 | 8785 | active |
| freecodexyz/free-code A community fork of Anthropic's Claude Code terminal AI coding agent, rebuilt from an exposed source snapshot with telemetry removed, secur… | 54 | 8757 | active |
| a-ghorbani/pocketpal-ai PocketPal AI is an open-source mobile app that runs GGUF language models entirely on-device for private, offline chat. It supports model do… | 87 | 8727 | active |
| DeepDive slime is an open-source LLM post-training framework for reinforcement learning scaling, connecting Megatron-based training with SGLang-base… | 79 | 8606 | active |
| TeamWiseFlow/xiaobei Xiaobei is an open-source multi-agent system that automates social media marketing and customer acquisition for solo entrepreneurs and smal… | 89 | 8574 | active |
| lastmile-ai/mcp-agent mcp-agent is a Python framework for building AI agents on top of the Model Context Protocol (MCP) using simple, composable workflow pattern… | 49 | 8571 | active |
| HKUDS/ClawWork ClawWork is an open-source benchmark and framework that turns AI assistants into 'AI coworkers' which must earn income by completing real p… | 44 | 8560 | active |
| OpenBMB/XAgent XAgent is an open-source, LLM-driven autonomous agent framework for automatically solving complex tasks. It features a dispatcher and plann… | 58 | 8551 | active |
| reorproject/reor Reor is a local-first, AI-powered desktop note-taking app that automatically links related notes, answers questions over your notes via RAG… | 10 | 8549 | active |
| bitsandbytes-foundation/bitsandbytes bitsandbytes is a Python library providing k-bit quantization primitives for PyTorch, enabling 8-bit (LLM.int8()) and 4-bit (QLoRA) quantiz… | 94 | 8514 | active |
| OptimalScale/LMFlow LMFlow is an extensible Python toolkit for finetuning and inference of large foundation models such as LLaMA, GPT-2, and Galactica. It prov… | 61 | 8487 | active |
| idosal/git-mcp GitMCP is a free, open-source remote Model Context Protocol (MCP) server that turns any public GitHub repository or GitHub Pages site into … | 53 | 8465 | active |
| unicity-aos/aos-ce AOS Community Edition is an open-source 'agent operating system' written in Rust that provides a CLI (`aos`), HTTP API, daemon, and MCP ser… | 81 | 8460 | active |
| unicity-aos/capsule-memory A Rust WASM capsule that provides cross-session memory for Astrid OS agents by hooking into prompt assembly and injecting workspace memory … | 70 | 8443 | active |
| OGX OGX (formerly Llama Stack) is an open-source, OpenAI-compatible agentic API server and Python library that bundles inference, vector stores… | 87 | 8441 | active |
| qualcomm/GenieX GenieX is an on-device generative AI inference runtime for Qualcomm Snapdragon devices, running frontier LLMs and VLMs on the Hexagon NPU, … | 87 | 8440 | active |
| AAswordman/Operit Operit AI is an open-source AI agent and chat application for Android built with Kotlin and Jetpack Compose. It connects cloud or local LLM… | 86 | 8416 | active |
| withastro/flue Flue is an open-source TypeScript framework for building autonomous AI agents using a React-like hooks API ('use agent' directive, useModel… | 77 | 8415 | active |
| unicity-aos/capsule-identity A Rust-based system prompt builder that assembles an AI agent's identity from workspace config (spark.toml) and persisted capsule KV state.… | 69 | 8411 | active |
| Dynamo NVIDIA Dynamo is an open-source, datacenter-scale distributed inference serving framework that orchestrates inference engines like vLLM, SG… | 88 | 8345 | active |
| zai-org/ChatGLM-6B ChatGLM-6B is an open-source bilingual (Chinese-English) 6.2B-parameter dialogue language model based on the GLM architecture, optimized fo… | 31 | 40938 | maintenance |
| anthropics/claude-agent-sdk-python The official Python SDK for building agents on top of Claude Code, providing async query APIs, bidirectional conversations, custom tools vi… | 83 | 8311 | active |
| zilliztech/deep-searcher DeepSearcher is an open-source deep research tool that combines LLMs (DeepSeek, OpenAI, Claude, Qwen, etc.) with vector databases like Milv… | 55 | 8292 | active |
| k8sgpt k8sgpt is a CLI tool that scans Kubernetes clusters, diagnoses issues, and triages them in plain English using AI backends like OpenAI, Azu… | 98 | 8255 | active |
| mini-swe-agent A radically minimal AI software engineering agent (~100 lines of core Python) that solves GitHub issues and assists in the command line, sc… | 77 | 8226 | active |
| n4ze3m/page-assist Page Assist is an open-source browser extension that adds a sidebar and web UI for interacting with locally running AI models like Ollama f… | 91 | 8225 | active |
| intitni/CopilotForXcode An Xcode Source Editor Extension that brings GitHub Copilot, Codeium, and ChatGPT-powered AI assistance to Xcode on macOS. It provides inli… | 73 | 8208 | active |
| OpenDCAI/DataFlow DataFlow is a Python framework for preparing, cleaning, and synthesizing data for LLM training and RAG using composable LLM-based operators… | 77 | 8201 | active |
| YaoApp/yao Yao Agents is a self-hosted, AI-native platform for running AI agents and workspaces across your own devices, with a task board, isolated w… | 95 | 8140 | active |
| AI4Finance-Foundation/FinRobot FinRobot is an open-source AI agent platform for financial applications built on large language models, unifying LLMs, reinforcement learni… | 78 | 8140 | active |
| InternLM/lmdeploy LMDeploy is a toolkit for compressing, quantizing, deploying, and serving large language models, built around its high-performance TurboMin… | 96 | 8107 | active |
| NullClaw NullClaw is an autonomous AI assistant/agent runtime written in Zig, distributed as a tiny static binary (~678 KB, ~1 MB RAM, <2 ms startup… | 69 | 8104 | active |
| lm-sys/FastChat FastChat is an open platform for training, serving, and evaluating large language model based chatbots, originally releasing the Vicuna mod… | 54 | 39548 | maintenance |
| superplanehq/superplane SuperPlane is an open source control plane and automation engine for AI-driven engineering, orchestrating workflows across Git, LLMs, CI/CD… | 83 | 8070 | active |
| Osaurus Osaurus is a native Swift macOS application that acts as a local-first AI harness, running open models on Apple Silicon (via MLX and Apple … | 82 | 8060 | active |
| leptonai/search_with_lepton A demo application for building a conversational AI search engine (Perplexity-style) in under 500 lines of code, combining LLMs with search… | 10 | 8054 | active |
| R2R R2R is a production-ready AI retrieval system implementing agentic Retrieval-Augmented Generation (RAG) with a RESTful API. It provides sta… | 47 | 8010 | active |
| evidentlyai/evidently Evidently is an open-source Python framework for evaluating, testing, and monitoring ML and LLM-powered systems, with 100+ built-in metrics… | 97 | 7984 | active |
| RayVentura/ShortGPT ShortGPT is a Python framework that automates AI-driven video content creation, combining LLM script generation, voiceover synthesis, asset… | 31 | 7973 | active |
| OpenCoworkAI/open-codesign Open CoDesign is an open-source, local-first desktop AI design tool that turns prompts into polished artifacts like UI prototypes, slide de… | 79 | 7967 | active |
| Upsonic/Upsonic Upsonic is a Python framework for building autonomous and traditional AI agents, with support for tools, memory, knowledge bases, RAG, mult… | 71 | 7956 | active |
| adithya-s-k/omniparse OmniParse is a self-hosted ingestion and parsing platform that converts unstructured data (documents, images, audio, video, web pages) into… | 46 | 7932 | active |
| ArvinLovegood/go-stock A Wails + NaiveUI desktop application that combines stock market data (A-shares, Hong Kong, US markets) with LLM-powered analysis, includin… | 85 | 7891 | active |
| logancyang/obsidian-copilot Copilot for Obsidian is an Obsidian community plugin that adds AI chat and agent capabilities to your note vault, integrating opencode, Cla… | 94 | 7864 | active |
| rikkahub/rikkahub RikkaHub is a native Android LLM chat client built with Kotlin and Jetpack Compose that supports switching between multiple AI providers su… | 81 | 7859 | active |
| chenyme/grok2api A self-hosted multi-account API gateway for Grok Build, Grok Web, and Grok Console, written in Go with a React frontend. It exposes Grok ca… | 82 | 7797 | active |
| 2FastLabs/agent-squad Agent Squad is an open-source framework for orchestrating multiple AI agents, routing each user query to the most suitable specialized agen… | 89 | 7780 | active |
| Azure Search OpenAI Demo A reference sample application implementing the Retrieval-Augmented Generation (RAG) pattern on Azure, combining Azure AI Search for docume… | 93 | 7776 | active |
| HKUDS/OpenSpace OpenSpace is a skill management layer for AI agents that handles the full lifecycle of agent skills: retrieval, evaluation, sharing, and ev… | 62 | 7756 | active |
| EricLBuehler/mistral.rs mistral.rs is a fast and flexible LLM inference engine written in Rust, supporting many model families with quantization (ISQ/UQFF, GGUF), … | 92 | 7741 | active |
| ERNIE Official repository for Baidu's ERNIE 4.5 family of large multimodal models and ERNIEKit, an industrial-grade training toolkit built on Pad… | 62 | 7737 | active |
| NoneBot2 NoneBot2 is a modern, cross-platform, asynchronous Python chatbot framework with a plugin system, adapter architecture, and built-in depend… | 84 | 7723 | active |
| sweepai/sweep Sweep is an AI coding assistant plugin for JetBrains IDEs (IntelliJ, PyCharm, GoLand, etc.) offering an AI agent, fast next-edit autocomple… | 36 | 7708 | active |
| farzaa/clicky Clicky is an open-source macOS app that acts as an AI teacher living next to your cursor — it can see your screen, talk with you via voice,… | 47 | 7707 | active |
| meta-llama/llama-models Meta's official repository of Llama large language models with Python utilities for working with them, including model cards, licenses, and… | 53 | 7693 | active |
| mufeedvh/code2prompt Code2Prompt is a Rust-based CLI tool that converts an entire codebase into a single structured LLM prompt, including a source tree, file co… | 66 | 7688 | active |
| tailcallhq/forgecode ForgeCode is an open-source, Rust-based CLI coding agent (AI pair programmer) that integrates LLMs from 300+ providers directly into the te… | 85 | 7637 | active |
| ValueCell-ai/ClawX ClawX is an open-source Electron desktop application that provides a graphical interface for OpenClaw AI agents, replacing terminal-based A… | 78 | 7607 | active |
| Osmantic/ODS ODS (Osmantic Deployment System) is a self-hosted AI server installer and runtime that turns a PC, Mac, or Linux machine into a private AI … | 82 | 7605 | active |
| openJiuwen-ai/jiuwenswarm JiuwenSwarm is an open-source multi-agent AI system built on openJiuwen that lets a Leader agent decompose complex tasks and coordinate tea… | 82 | 7602 | active |
| pickle-com/glass Glass by Pickle is an open-source Electron desktop app that acts as a 'digital mind extension', seeing your screen and listening in real ti… | 39 | 7602 | active |
| lllyasviel/Omost Omost is a Python application that converts LLM coding capability into image composition by having pretrained LLMs (based on Llama3 and Phi… | 25 | 7595 | active |
| GoogleCloudPlatform/kubectl-ai kubectl-ai is an AI-powered Kubernetes assistant that translates natural-language user intent into precise kubectl operations. It is a Go C… | 71 | 7587 | active |
| Kimi Code CLI Kimi Code CLI (formerly Kimi CLI) is a terminal-based AI coding agent from Moonshot AI that reads and edits code, executes shell commands, … | 75 | 7576 | active |
| lingfengQAQ/webnovel-writer A Claude Code plugin for long-form serialized webnovel writing, built in Python. It provides slash-command skills for initializing story se… | 84 | 7566 | active |
| BiliNote BiliNote is an open-source AI video note-taking application that turns video links from Bilibili, YouTube, Douyin, and local files into str… | 81 | 7563 | active |
| mnfst/manifest Manifest is an open-source LLM gateway and router that lets AI agents and apps reach all their model providers through one OpenAI- and Anth… | 93 | 7551 | active |
| Refly Refly is an open-source platform for building, versioning, and running reusable AI agent skills through a natural-language 'vibe workflow' … | 74 | 7531 | active |
| guardrails-ai/guardrails Guardrails is a Python framework for building reliable LLM applications by running Input/Output Guards that detect and mitigate risks, and … | 95 | 7527 | active |
| teamchong/pxpipe pxpipe is a local TypeScript proxy that reduces Claude Code input token usage by rewriting bulky text context (system prompts, tool docs, h… | 81 | 7525 | active |
| lijigang/ljg-skills A curated collection of custom skills (prompt packs) for OpenAI Codex and compatible AI agents, installable via the skills CLI in org-mode … | 60 | 7525 | active |
| algorithmicsuperintelligence/openevolve OpenEvolve is an open-source Python implementation of DeepMind's AlphaEvolve, an evolutionary coding agent that uses LLM ensembles to auton… | 86 | 7518 | active |