Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| icebear0828/codex-proxy A lightweight local proxy service that exposes ChatGPT Codex Desktop's Responses API through standard OpenAI, Anthropic, Gemini, and Ollama… | 83 | 1822 | active |
| phodal/routa Routa is a workspace-first multi-agent coordination platform for AI-assisted software delivery, exposing goals, tasks, sessions, traces, an… | 72 | 1822 | active |
| Mellea Mellea is a Python library for writing generative programs, where LLM calls are first-class operations with type-annotated outputs, verifia… | 84 | 1821 | active |
| APIParkLab/APIPark APIPark is an open-source, cloud-native AI gateway and API developer portal for managing, integrating, and deploying AI and REST APIs. It u… | 86 | 1819 | active |
| potamides/DeTikZify DeTikZify is a Python library and research tool that uses multimodal large language models to synthesize TikZ/LaTeX graphics programs from … | 63 | 1819 | active |
| jacoblee93/fully-local-pdf-chatbot A Next.js web application that lets users chat with uploaded PDF documents entirely locally, performing chunking, embedding, vector storage… | 49 | 1817 | active |
| JHubi1/ollama-app A modern, easy-to-use Flutter client app for Ollama that connects to an Ollama server over the local network to chat with local LLMs. It ru… | 59 | 1816 | active |
| gtxx3600/GPTSession2CPAandSub2API A pure client-side single-page web tool that converts ChatGPT Web session JSON into import formats for tools like CPA, sub2api, Cockpit Too… | 50 | 1816 | active |
| NVIDIA-NeMo/Curator NVIDIA NeMo Curator is a scalable, GPU-accelerated toolkit for preprocessing and curating large text, image, video, and audio datasets for … | 88 | 1814 | active |
| sybil-solutions/local-studio Local Studio is a local-first desktop application for launching, managing, and chatting with self-hosted LLM backends like vLLM, SGLang, ll… | 76 | 1813 | active |
| delibae/claude-prism ClaudePrism is an open-source, offline-first desktop application for scientific and academic writing, built with Tauri 2 and Rust. It combi… | 72 | 1813 | active |
| zi-yue-1129/DATAGEN DATAGEN is an AI-powered multi-agent research and data analysis platform built with LangChain, LangGraph, and OpenAI GPT models. It automat… | 68 | 1810 | active |
| AI Insight Daily A Cloudflare Workers-based content aggregation and generation platform that daily curates AI industry news, trending open-source projects, … | 64 | 1809 | active |
| supervc-stack/VectorChord VectorChord is a PostgreSQL extension written in Rust for scalable, disk-efficient vector similarity search, serving as the successor to pg… | 73 | 1807 | active |
| undertheseanlp/underthesea Underthesea is an open-source Python toolkit for Vietnamese natural language processing that has evolved into an agentic AI toolkit with mu… | 91 | 1806 | active |
| PurpleDoubleD/locally-uncensored Locally Uncensored is a free, open-source desktop AI studio (built with Tauri/TypeScript) that bundles uncensored local chat, a coding agen… | 76 | 1799 | active |
| LM Studio SDK lmstudio-js is the official TypeScript/JavaScript client SDK for LM Studio, enabling use of locally running LLMs for chat, completions, emb… | 73 | 1799 | active |
| zai-org/CogVLM CogVLM is an open-source visual language model (17B) combining a vision encoder with a pretrained language model for image understanding an… | 28 | 6745 | maintenance |
| freestylefly/director_ai An AI-powered mobile application for creating comic-style short dramas, generating scripts, storyboards, and composed videos from a single … | 49 | 1797 | active |
| AI-Citizen/SolidGPT SolidGPT is an AI-powered semantic search assistant for developers that lets you chat with your codebase and Notion workspace. It ships as … | 19 | 1797 | active |
| onestardao/WFGY WFGY is an open-source ecosystem of protocols and tools for debugging and improving AI reasoning, RAG pipelines, and agent workflows, curre… | 77 | 1794 | active |
| OS-Copilot/OS-Copilot OS-Copilot is an open-source Python library for building generalist AI agents that interface with operating system elements like the web, t… | 17 | 1794 | active |
| QwenLM/Qwen-VL Official repository for Qwen-VL, Alibaba Cloud's large vision-language model family, including the pretrained Qwen-VL and instruction-tuned… | 29 | 6725 | maintenance |
| vercel-labs/coding-agent-template A deployable Next.js web application template for building multi-agent AI coding platforms that run coding agents like Claude Code, Codex C… | 59 | 1792 | active |
| hitsz-ids/airda airda (Air Data Agent) is a Python-based multi-agent system for data analysis that understands natural language data requirements and gener… | 17 | 1792 | active |
| iBUHub/AIStudioToAPI A self-hosted proxy service that wraps the Google AI Studio Build web interface into OpenAI, Gemini, and Anthropic compatible APIs using br… | 83 | 1789 | active |
| AtomicBot-ai/Atomic-Chat Atomic Chat is an open-source desktop and mobile application with a built-in inference engine for running open-weight LLMs fully locally an… | 82 | 1788 | active |
| 0xSero/turboquant TurboQuant is a Python library implementing near-optimal KV cache quantization for LLM inference, compressing keys to 3-bit and values to 2… | 57 | 1788 | active |
| SmartFlowAI/EmoLLM EmoLLM is a series of open-source large language models fine-tuned for mental health understanding and support, built on models like Intern… | 60 | 1786 | active |
| anthropics/claude-agent-sdk-typescript The Claude Agent SDK is a TypeScript/Node.js library for programmatically building AI agents powered by Claude Code's capabilities. It enab… | 80 | 1785 | active |
| MCP Hub MCP Hub is a Neovim plugin that acts as an MCP (Model Context Protocol) client, integrating MCP servers into the editing workflow. It provi… | 47 | 1785 | active |
| Moonvy/OpenPromptStudio Open Prompt Studio (OPS) is a web-based visual editor for AIGC prompts, primarily targeting Midjourney. It provides Chinese-English prompt … | 31 | 6685 | maintenance |
| DataArcTech/DataArc-SynData-Toolkit DataArc SynData Toolkit is a Python-based synthetic data generation platform for creating customized LLM training data from local corpora, … | 59 | 1783 | active |
| Simple-Efficient/RL-Factory RLFactory is a reinforcement learning post-training framework for training agentic LLM models, decoupling the environment from RL training … | 31 | 1783 | active |
| google-deepmind/concordia Concordia is a Python library for building generative agent-based social simulations, using a tabletop role-playing game pattern where a Ga… | 83 | 1782 | active |
| coulsontl/ai-toolbox A cross-platform desktop application (built with Tauri and Rust) for managing configurations of AI coding assistant CLIs such as Claude Cod… | 80 | 1781 | active |
| FSoft-AI4Code/CodeWiki CodeWiki is an open-source Python framework that uses LLM-powered multi-agent processing to generate holistic, structured documentation for… | 58 | 1778 | active |
| ExtensityAI/symbolicai SymbolicAI is a Python neuro-symbolic framework that blends classical programming with LLM capabilities through composable Symbol primitive… | 93 | 1777 | active |
| Emu Series Emu3 is a suite of state-of-the-art multimodal models from BAAI trained solely with next-token prediction, tokenizing images, text, and vid… | 53 | 1777 | active |
| mex-memory/mex mex is a TypeScript CLI that gives AI coding agents persistent, structured project memory: it maps the codebase into a deterministic code g… | 83 | 1775 | active |
| wwbin2017/bailing Bailing is an open-source voice assistant application similar to GPT-4o, built with an ASR + VAD + LLM + TTS pipeline (FunASR, silero-vad, … | 51 | 1775 | active |
| tickernelz/opencode-mem An OpenCode plugin that gives AI coding agents persistent memory across sessions using an embedded local Turso/libSQL vector database. It a… | 80 | 1772 | active |
| Nutlope/twitterbio A Next.js web application that generates Twitter/X bios using AI models (Qwen 3.5 9B and GPT OSS 20B) served via the Together AI API with s… | 68 | 1770 | active |
| zubair-trabzada/ai-legal-claude A Claude Code skill pack providing an AI legal assistant with 14 slash commands and 5 parallel agents for contract review, risk analysis, N… | 45 | 1768 | active |
| jenslys/opencode-gemini-auth A TypeScript plugin for the Opencode CLI that authenticates with Google via OAuth so users can use their existing Gemini plan and quotas (i… | 82 | 1767 | active |
| AgentDock/AgentDock AgentDock is an open-source, backend-first TypeScript framework for building AI agents with configurable determinism, plus a Next.js refere… | 68 | 1766 | active |
| steven-jianhao-li/zotero-AI-Butler A Zotero plugin that acts as an AI-powered research butler: it automatically scans PDFs added to your Zotero library and sends them to a us… | 77 | 1765 | active |
| lyra81604/zhengxi-views A traceable AI agent skill packaging the complete public statements of E Fund fund manager Zheng Xi (2012–2026 quarterly reports, notes, me… | 68 | 1765 | active |
| AIdea AIdea is a fully open-source cross-platform mobile and desktop app built with Flutter that integrates mainstream large language models (GPT… | 64 | 1765 | active |
| signerlabs/Klee Klee is a native macOS AI chat application that runs large language models entirely on-device using Apple's MLX framework on Apple Silicon.… | 50 | 1765 | active |
| NanmiCoder/dsh-agent-teams A DeepSeek Harness plugin that turns a single session into a captain coordinating durable sub-agents as a team. It provides dependency-awar… | 77 | 1763 | active |
| parthsarthi03/raptor The official Python implementation of RAPTOR (Recursive Abstractive Processing for Tree-Organized Retrieval), a retrieval-augmented generat… | 26 | 1761 | active |
| dongsheng123132/u-claw U-Claw is an open-source portable USB skeleton and installer toolkit that packages the OpenClaw AI assistant framework (plus Claude Code/Co… | 82 | 1759 | active |
| GoogleCloudPlatform/agent-starter-pack A Python package from Google Cloud Platform that provides production-ready templates for building and deploying GenAI agents on Google Clou… | 68 | 6569 | maintenance |
| Maximal Update Parametrization (μP) The `mup` Python package implements Maximal Update Parametrization (μP) for PyTorch models, enabling optimal hyperparameters to remain stab… | 10 | 1756 | stable |
| T5 The official T5 library from Google Research, implementing the text-to-text transfer transformer for NLP tasks like summarization, question… | 67 | 6562 | maintenance |
| mims-harvard/ToolUniverse ToolUniverse is a Python SDK and MCP server that aggregates a large collection of scientific tools (APIs, databases, local ML and cheminfor… | 84 | 1754 | active |
| run-llama/rags A Streamlit web app that lets users build a RAG (retrieval-augmented generation) pipeline over their data using natural language instructio… | 27 | 6551 | maintenance |
| LLM Sherpa LLM Sherpa is a Python client library providing APIs for layout-aware PDF and document parsing to feed LLM applications, backed by the open… | 18 | 1753 | active |
| cubewhy/skid-homework A browser-based, AI-powered homework solver built with Next.js that sends images and PDFs of homework problems to a Gemini or OpenAI-compat… | 60 | 1752 | active |
| facebookresearch/metaseq Metaseq is a PyTorch codebase from Meta AI for training and working with large-scale Open Pre-trained Transformers (OPT), forked from fairs… | 10 | 6544 | maintenance |
| HKUDS/Auto-Deep-Research Auto-Deep-Research is an open-source, cost-efficient alternative to OpenAI's Deep Research, built on the AutoAgent framework. It runs as a … | 38 | 1750 | active |
| richardgill/llm-ui A React component library for rendering LLM output in web applications. It smoothly displays streamed tokens at native frame rate, removes … | 25 | 1746 | active |
| sunny-glow/Auto-BenchMax Auto-BenchMax is a Python pipeline that automatically synthesizes benchmark-targeted training data for LLMs, claiming to more than double a… | 52 | 1745 | active |
| bespokelabsai/curator Bespoke Curator is a Python library for bulk LLM inference and scalable synthetic data curation for post-training and structured data extra… | 89 | 1744 | active |
| yincongcyincong/MuseBot MuseBot is a self-hosted Go chatbot application that connects messaging platforms (Telegram, Discord, Slack, Lark/Feishu, DingTalk, WeCom, … | 84 | 1743 | active |
| 14790897/paper-ai A web application that helps users write academic papers with AI while searching real literature from Semantic Scholar, arXiv, and PubMed a… | 64 | 1740 | active |
| egoist/sitefetch A Node.js CLI tool that crawls an entire website and saves its pages as a single text file, using Mozilla Readability to extract clean cont… | 21 | 1739 | active |
| kwaroran/Risuai RisuAI is a cross-platform AI roleplay and character chatting application built with Svelte, TypeScript, and Tauri. It acts as a frontend f… | 91 | 1737 | active |
| Gitlawb/zero Zero is a terminal-based AI coding agent written in Go that can inspect repositories, edit files, run commands, and manage durable local se… | 80 | 1736 | active |
| qufei1993/skills-hub A cross-platform desktop application built with Tauri and React for managing AI coding agent skills in one central repository. It installs,… | 82 | 1735 | active |
| juliye2025/evil-read-arxiv A collection of Claude Code / OpenAI Codex skills plus a Next.js web app that automates research paper discovery, analysis, and note-taking… | 58 | 1735 | active |
| Codex CLI Integration A ZSH plugin that brings AI-powered code completion to the command line, supporting OpenAI Codex, Google Gemini, and other LLM providers. U… | 34 | 1732 | active |
| NVIDIA/FasterTransformer NVIDIA's highly optimized C++/CUDA library for fast inference of Transformer-based models such as BERT, GPT, and encoder-decoder models, wi… | 23 | 6450 | maintenance |
| McGill-NLP/llm2vec LLM2Vec is a Python library that converts decoder-only large language models into powerful text encoders via bidirectional attention, maske… | 46 | 1729 | active |
| lifan0127/ai-research-assistant Aria is a Zotero plugin that brings GPT-powered AI assistance to reference management, letting researchers chat with their library items, P… | 24 | 1729 | active |
| AvaLovelace1/BrickGPT BrickGPT is the official implementation of an ICCV 2025 Best Paper approach that generates physically stable, buildable toy brick (LEGO) mo… | 54 | 1726 | active |
| mattpocock/evalite Evalite is a TypeScript-native eval runner for testing LLM-powered applications, built on Vitest with a local dev server UI for exploring o… | 55 | 1724 | active |
| facebookresearch/coconut Official PyTorch implementation of Coconut, a method for training large language models to reason in a continuous latent space instead of e… | 58 | 1723 | active |
| LLPhant/LLPhant LLPhant is a comprehensive PHP generative AI framework inspired by LangChain and LlamaIndex, providing tools for working with LLMs, embeddi… | 96 | 1722 | active |
| fish2018/YPrompt YPrompt is a self-hosted web application that uses AI-guided conversation to elicit user requirements and automatically generate profession… | 41 | 1721 | active |
| lotus-data/lotus LOTUS is a Python library providing a Pandas-like API of LLM-powered semantic operators (map, filter, extract, aggregate, top-k) for bulk p… | 85 | 1719 | active |
| openkursar/hello-halo Halo is an open-source desktop AI workstation that wraps frontier coding agents like Claude Code and Codex in a visual GUI, with a pluggabl… | 81 | 1719 | active |
| NeoLabHQ/context-engineering-kit A hand-crafted collection of Claude Code Skills and plugins implementing context engineering techniques to improve AI coding agent output q… | 78 | 1719 | active |
| tenstorrent/tt-metal TT-Metal is Tenstorrent's open-source software stack containing TT-NN, a Python and C++ neural network operator library, and TT-Metalium, a… | 99 | 1718 | active |
| mithun50/openclaw-termux OpenClaw is an AI gateway that can be run on Android as a standalone Flutter app with a built-in terminal, web dashboard, and one-tap setup… | 79 | 1717 | active |
| legeling/PromptHub PromptHub is a local-first desktop application (Electron + React + SQLite) that serves as an all-in-one workbench for managing AI assets su… | 85 | 1716 | active |
| LLMUnity LLMUnity is an open-source Unity plugin that runs large language models locally in Unity games via llama.cpp, enabling AI-driven characters… | 70 | 1716 | active |
| glidea/zenfeed zenfeed is a self-hosted AI-powered RSS reader and information hub built in Go. It aggregates RSS feeds, uses LLMs to filter, summarize, an… | 62 | 1716 | active |
| wyeeeee/hajimi Hajimi is a FastAPI-based proxy for Google's Gemini API that exposes OpenAI-compatible endpoints like /v1/chat/completions. It provides API… | 10 | 1716 | active |
| kingoflolz/mesh-transformer-jax A JAX/Haiku library implementing model-parallel training and inference of transformer models using xmap/pjit operators, similar to Megatron… | 32 | 6384 | maintenance |
| lsdefine/simple_GRPO A minimal (~200 lines) Python implementation of GRPO reinforcement learning for training LLMs to develop r1-like reasoning, built on PyTorc… | 41 | 1714 | active |
| langchain-ai/langmem LangMem is a Python library that helps AI agents learn and adapt from their interactions over time by extracting information from conversat… | 65 | 1713 | active |
| xhongc/ai_story AI Story is a self-hosted platform that automates story video production: given a topic, it generates scripts, storyboards, AI images, came… | 60 | 1713 | active |
| sendaifun/solana-agent-kit Solana Agent Kit is an open-source TypeScript toolkit for connecting AI agents to Solana protocols, enabling 60+ autonomous on-chain action… | 57 | 1713 | active |
| ka-pi-ba-la/AIbijia AIbijia is a price-comparison website and community resource that aggregates AI subscription and token prices across multiple platforms (Ch… | 54 | 1713 | active |
| gi-dellav/zerostack zerostack is a minimal coding agent written in Rust, optimized for a tiny memory footprint (~16 MB RAM) and fast performance. It provides a… | 81 | 1708 | active |
| jiaweizzhao/GaLore GaLore is a PyTorch library implementing Gradient Low-Rank Projection for memory-efficient full-parameter training of large language models… | 26 | 1708 | active |
| noopstudios/interactive-feedback-mcp An MCP server that enables a human-in-the-loop workflow in AI-assisted development tools like Cursor, Cline, and Windsurf. It provides a GU… | 17 | 1708 | active |
| nat/openplayground A self-hosted LLM playground that runs on your laptop, providing a web UI for prompting models from OpenAI, Anthropic, Cohere, HuggingFace,… | 57 | 6348 | maintenance |