Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| jina-ai/thinkgpt ThinkGPT is a Python library implementing Chain of Thought techniques for LLMs, providing memory, self-refinement, knowledge compression, a… | 30 | 1583 | maintenance |
| finic-ai/rag-stack RAGstack is a self-hostable private ChatGPT alternative that deploys open-source LLMs (Llama 2, Falcon, GPT4All) alongside the Qdrant vecto… | 74 | 1581 | maintenance |
| yakGPT/yakGPT YakGPT is a locally running, browser-based ChatGPT UI that connects directly to the OpenAI API with your own key. It adds hands-free voice … | 31 | 1580 | maintenance |
| TsinghuaAI/CPM-1-Generate CPM-Generate provides inference code for CPM-LM, a 2.6B-parameter Chinese pre-trained language model based on the GPT-2 architecture and Me… | 32 | 1579 | maintenance |
| microsoft/TinyTroupe TinyTroupe is an experimental Python library for simulating people with specific personalities, interests, and goals using LLM-powered agen… | 74 | 7612 | experimental |
| microsoft/SoM A research toolbox from Microsoft implementing Set-of-Mark (SoM) visual prompting, which overlays numbered spatial marks on images to impro… | 18 | 1572 | maintenance |
| Frrrrrrrrank/auto_job__find__chatgpt__rpa A free Python RPA script that uses OpenAI's API to automatically generate cover letters from your resume and job descriptions, then sends m… | 27 | 1571 | maintenance |
| Tencent/TurboTransformers A fast, user-friendly C++/Python runtime for transformer model inference (BERT, ALBERT, RoBERTa, GPT2, decoders) on CPU and GPU. It works a… | 34 | 1551 | maintenance |
| GoogleCloudPlatform/localllm A CLI tool and Docker image for running quantized LLMs locally on Google Cloud Workstations using llama-cpp-python's web server. It package… | 10 | 1550 | maintenance |
| ZJU-OmniAI/Data-Copilot Data-Copilot is an LLM-based data analysis agent that autonomously designs and invokes interface tools to query, process, analyze, predict,… | 73 | 1511 | maintenance |
| open-mmlab/Multimodal-GPT Multimodal-GPT is an open-source project for training a multimodal chatbot that combines vision and language instructions, built on OpenFla… | 30 | 1511 | maintenance |
| alexrozanski/LlamaChat LlamaChat is a native macOS app for chatting with LLaMA, Alpaca, GPT4All and similar models running entirely locally on your Mac. It is bui… | 57 | 1508 | maintenance |
| run-llama/llama-lab Llama Lab is a collection of experimental projects built on top of LlamaIndex for exploring cutting-edge LLM agent capabilities. It include… | 30 | 1508 | maintenance |
| OWD-AI/AutoAgents AutoAgents is a Python framework that uses an LLM to automatically generate multiple specialized agent roles that collaborate to accomplish… | 44 | 1495 | maintenance |
| deiucanta/chatpad Chatpad AI is a free, open-source, privacy-focused chat interface for ChatGPT/OpenAI APIs, available as a web app and Electron desktop app.… | 31 | 1485 | maintenance |
| AIChat AIChatWeb is a fork of ChatGPT-Next-Web that adds user registration/login, quota management, invitations, sensitive-word filtering, payment… | 30 | 1474 | maintenance |
| joshpxyne/gpt-migrate GPT-Migrate is a Python CLI tool that uses LLMs (GPT-4 via OpenAI or OpenRouter) to automatically migrate codebases from one framework or l… | 29 | 6972 | experimental |
| CStanKonrad/long_llama LongLLaMA is a large language model handling long contexts of 256k tokens or more, built on OpenLLaMA and fine-tuned with the Focused Trans… | 29 | 1461 | maintenance |
| agi-inc/agent-protocol Agent Protocol is an OpenAPI-defined REST API specification providing a common interface (runs, tasks, steps, artifacts) for interacting wi… | 23 | 1458 | maintenance |
| BigScience BigScience is a research project training large transformer language models (BERT, GPT-style) at scale, built on a fork of Megatron-LM inte… | 32 | 1448 | maintenance |
| OpenLMLab/MOSS-RLHF MOSS-RLHF is the open-source companion code for the paper 'Secrets of RLHF in Large Language Models Part I: PPO', providing implementations… | 29 | 1430 | maintenance |
| mckaywrigley/clarity-ai Clarity AI is an open-source clone of Perplexity.ai that answers user queries by scraping Google search results, parsing the webpages, and … | 31 | 1423 | maintenance |
| mnemox-ai/tradememory-protocol TradeMemory Protocol is an MCP server providing persistent memory and a tamper-evident decision audit trail for AI trading agents, with out… | 79 | 1421 | maintenance |
| InstructLab InstructLab (ilab) is an open-source CLI and Python package for enhancing large language models through community-contributed taxonomy-base… | 10 | 1418 | maintenance |
| ConnorJL/GPT2 A community Python/TensorFlow implementation of GPT-2 model training and text generation that supports both GPUs and TPUs. It includes scri… | 32 | 1414 | maintenance |
| a16z-infra/llama2-chatbot A Streamlit-based chatbot web app for chatting with LLaMA 2 models (7B, 13B, 70B) hosted on Replicate API endpoints. It includes per-sessio… | 29 | 1409 | maintenance |
| safety-research/bloom Bloom is a Python tool that automatically generates behavioral evaluation suites for LLMs, probing target models for behaviors like sycopha… | 52 | 1408 | maintenance |
| ChineseAiDungeon A Chinese-language clone of AI Dungeon that uses OpenAI's ChatGPT API as the storytelling model. It offers both a CLI and a simple GUI app … | 23 | 1404 | maintenance |
| neo4j/NaLLM NaLLM is a demo application from Neo4j exploring synergies between Neo4j graph databases and Large Language Models. It provides a backend A… | 10 | 1404 | maintenance |
| Yifan-Song793/RestGPT RestGPT is an LLM-based autonomous agent that controls real-world applications like TMDB and Spotify by planning and executing RESTful API … | 29 | 1403 | maintenance |
| gotzmann/llama.go A pure-Go reimplementation of llama.cpp-style LLM inference, running LLaMA-family models on CPU without C++ dependencies. It includes tenso… | 21 | 1402 | maintenance |
| CopilotKit/OpenBot OpenBot is a self-hosted agent platform from CopilotKit where each AI agent ('coworker') gets its own computer environment—a browser, files… | 80 | 6562 | experimental |
| anus-dev/ANUS ANUS is a Grok-powered AI agent for the terminal, distributed as an npm CLI, whose stated goal is to evolve into an agent that contributes … | 86 | 6549 | experimental |
| nishiwen1214/ChatReviewer ChatReviewer is a Python application built on the ChatGPT API that analyzes academic papers, summarizing their strengths and weaknesses and… | 31 | 1377 | maintenance |
| microsoft/agent-governance-toolkit A Microsoft open-source toolkit providing policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for au… | 76 | 6454 | experimental |
| hiyouga/FastEdit FastEdit is a Python library and CLI tool for editing large language models, injecting fresh or customized factual knowledge into pretraine… | 20 | 1369 | maintenance |
| keirp/automatic_prompt_engineer Automatic Prompt Engineer (APE) is a Python library implementing the research method from 'Large Language Models Are Human-Level Prompt Eng… | 32 | 1367 | maintenance |
| strnad/CrewAI-Studio CrewAI Studio is a Streamlit-based graphical application for creating, managing, and running CrewAI multi-agent crews and tasks without wri… | 83 | 1360 | maintenance |
| Obot Platform Nanobot is a standalone, open-source MCP host written in Go that combines MCP servers with an LLM to build agent experiences, configurable … | 77 | 1344 | maintenance |
| FreedomIntelligence/HuatuoGPT HuatuoGPT is an open Chinese medical large language model (7B and 13B variants) fine-tuned on a hybrid of distilled and real-world medical … | 30 | 1333 | maintenance |
| vercel/modelfusion ModelFusion is a TypeScript library that provides a unified, vendor-neutral abstraction layer for integrating AI models into JavaScript and… | 10 | 1319 | maintenance |
| ItsPi3141/alpaca-electron Alpaca Electron is an Electron desktop app that provides a simple ChatGPT-style UI for chatting with Alpaca and other LLaMA-based local LLM… | 21 | 1302 | maintenance |
| jtsang4/claude-to-chatgpt A proxy service that translates Anthropic Claude API calls into the OpenAI Chat Completions API format, so Claude can be used anywhere the … | 21 | 1300 | maintenance |
| google-research/multilingual-t5 Code and resources for mT5, a massively multilingual text-to-text transformer pretrained on the mC4 corpus covering 101 languages. It repro… | 10 | 1290 | maintenance |
| NVIDIA-Merlin/Transformers4Rec Transformers4Rec is a Python library by NVIDIA for sequential and session-based recommendation using transformer architectures, bridging NL… | 63 | 1281 | maintenance |
| google-research/deduplicate-text-datasets A Rust implementation of ExactSubstr deduplication for language model training datasets, with Python scripts for running deduplication and … | 10 | 1273 | maintenance |
| apache/maka Apache Maka (Incubating) is a local-first AI agent workspace that runs agents on your machine through a single Runtime Host, executing tool… | 78 | 5861 | experimental |
| goldfishh/chatgpt-tool-hub An open-source Python tool engine that lets ChatGPT (and other LLMs) invoke tools like web search, math computation, code execution, and co… | 21 | 1264 | maintenance |
| andrewyng/translation-agent A Python demonstration library by Andrew Ng implementing an agentic machine translation workflow: an LLM translates text, reflects on its o… | 25 | 5816 | experimental |
| davidmrau/mixture-of-experts A PyTorch re-implementation of the sparsely-gated Mixture-of-Experts layer from the paper 'Outrageously Large Neural Networks' by Shazeer e… | 32 | 1255 | maintenance |
| uclaml/SPIN Official implementation of Self-Play Fine-Tuning (SPIN), a method that improves language models by having them iteratively generate and dis… | 26 | 1254 | maintenance |
| mozilla-ai/any-agent any-agent is a Python library providing a single unified interface for building, serving, and evaluating AI agents across multiple agent fr… | 69 | 1236 | maintenance |
| AGI-Edgerunners/LLM-Adapters LLM-Adapters is a Python framework extending HuggingFace's PEFT library that integrates various adapter types (LoRA, series/parallel adapte… | 31 | 1236 | maintenance |
| google-gemini/deprecated-generative-ai-js The deprecated Google AI JavaScript/TypeScript SDK for the Gemini API, now in limited maintenance with support ending November 30, 2025. Us… | 10 | 1234 | maintenance |
| srush/MiniChain MiniChain is a tiny Python library for building applications with large language models by annotating Python functions that call LLMs and c… | 22 | 1232 | maintenance |
| UMass-Embodied-AGI/3D-LLM 3D-LLM is the research code for a large language model that takes 3D representations (objects and scenes) as input, built on BLIP-2/LAVIS. … | 29 | 1217 | maintenance |
| timqian/openprompt.co OpenPrompt.co is a web application for creating, using, and sharing ChatGPT prompts, with a community-driven catalog of starred prompts. Th… | 74 | 1216 | maintenance |
| m1guelpf/auto-commit A Rust CLI tool that uses OpenAI's GPT-3.5 to automatically generate commit messages from your staged git changes. It supports dry-run outp… | 23 | 1213 | maintenance |
| facebookresearch/BLINK BLINK is a Python entity linking library from Facebook Research that resolves mentions in text to Wikipedia entities using a two-stage bi-e… | 10 | 1211 | maintenance |
| KwaiKEG/KwaiAgents KwaiAgents is an open-source suite from Kuaishou for building generalized information-seeking agents powered by LLMs. It includes KAgentSys… | 27 | 1201 | maintenance |
| henrywoo/chatllama An open-source Python library implementing RLHF-based fine-tuning of Meta's LLaMA models to build ChatGPT-style chat assistants, runnable o… | 22 | 1201 | maintenance |
| meltylabs/melty Melty is an AI-powered code editor where every chat message becomes a git commit, letting you revert, branch, reset, and squash chats like … | 23 | 5462 | experimental |
| LiuHC0428/LAW-GPT A Chinese-language legal conversational model (LawGPT_zh / 獬豸) fine-tuned from ChatGLM-6B with LoRA on legal Q&A datasets, including answer… | 31 | 1194 | maintenance |
| lucidrains/performer-pytorch A PyTorch implementation of the Performer transformer, which uses linear attention via the FAVOR+ (Fast Attention Via positive Orthogonal R… | 23 | 1184 | maintenance |
| IndieKKY/bilibili-subtitle A browser extension (哔哔君) that displays a clickable subtitle list panel for Bilibili videos, enabling jump-to-timestamp navigation, subtitl… | 49 | 1183 | maintenance |
| visual-openllm/visual-openllm An open-source tool that interactively connects different visual models with an LLM, built on ChatGLM, Visual ChatGPT, and Stable Diffusion… | 31 | 1183 | maintenance |
| 1943time/inkdown Inkdown is a WYSIWYG Markdown editor fully compatible with the GitHub Flavored Markdown spec, available as a desktop app (Electron) and a V… | 53 | 1182 | maintenance |
| steven-tey/chathn ChatHN is an open-source AI chatbot web app that lets users query Hacker News using natural language, powered by OpenAI function calling an… | 29 | 1177 | maintenance |
| punica-ai/punica Punica is a Python system for serving many LoRA-finetuned LLMs from a single copy of the base model on one GPU, using a custom CUDA kernel … | 10 | 1175 | maintenance |
| bestony/ChatGPT-Feishu A ChatGPT bot for Feishu (Lark) that lets users chat with OpenAI's models directly in Feishu messages. It is deployed as a single Node.js e… | 22 | 1171 | maintenance |
| abhagsain/ai-cli A GPT-3/ChatGPT-powered command-line tool that answers CLI command questions directly from the terminal. Built with oclif in TypeScript and… | 23 | 1169 | maintenance |
| JuliusBrussee/cavekit Cavekit is a frozen (August 2026) Claude Code plugin that implements compressed spec-driven development via a single SPEC.md file and a sma… | 68 | 1156 | maintenance |
| uber-research/PPLM PPLM (Plug and Play Language Model) is a research implementation for controlled text generation that steers the topic and attributes of GPT… | 32 | 1152 | maintenance |
| sentient-agi/ROMA ROMA (Recursive Open Meta-Agent) is a Python meta-agent framework for building hierarchical, high-performance multi-agent systems. It enabl… | 46 | 5179 | experimental |
| lupantech/chameleon-llm Chameleon is a research framework for plug-and-play compositional reasoning with large language models, where an LLM planner synthesizes pr… | 21 | 1143 | maintenance |
| peterw/Chat-with-Github-Repo A Python application that lets you chat with any GitHub repository. It clones a repo, embeds its documents into Activeloop Deep Lake, and s… | 30 | 1142 | maintenance |
| CASIA-LMC-Lab/AnomalyGPT AnomalyGPT is the first Large Vision-Language Model based method for industrial anomaly detection, identifying the presence and location of… | 29 | 1140 | maintenance |
| IBM/Dromedary Dromedary is an open-source self-aligned language model trained with minimal human supervision using the principle-driven SELF-ALIGN pipeli… | 46 | 1134 | maintenance |
| fixie-ai/ai-jsx AI.JSX is a JavaScript/TypeScript framework for building AI applications using JSX components, supporting prompt engineering, tools, docume… | 30 | 1134 | maintenance |
| google-deepmind/dramatron Dramatron is a research tool from DeepMind that uses pre-trained large language models to hierarchically co-write theatre scripts and scree… | 32 | 1133 | maintenance |
| RafalWilinski/telegram-chatgpt-concierge-bot A self-hosted Telegram bot that lets you chat with OpenAI's ChatGPT via text and voice messages. It uses LangChainJS for conversation histo… | 31 | 1129 | maintenance |
| microsoft/ToRA ToRA is a series of tool-integrated reasoning LLM agents from Microsoft that solve mathematical reasoning problems by interleaving natural … | 28 | 1127 | maintenance |
| LLMPerf LLMPerf is a Python library for benchmarking and validating the performance of LLM APIs. It runs load tests measuring inter-token latency a… | 10 | 1123 | maintenance |
| openTrinity/mycontext MyContext is a local-first desktop application that builds a persistent personal work context layer by connecting signals from instant mess… | 55 | 5018 | experimental |
| keroro824/HashingDeepLearning SLIDE is a C++ research codebase implementing locality-sensitive hashing based training of deep neural networks, from the paper 'In Defense… | 32 | 1104 | maintenance |
| rlancemartin/auto-evaluator A lightweight Streamlit-based evaluation tool for LLM question-answering chains built with LangChain. It auto-generates question-answer pai… | 30 | 1103 | maintenance |
| Syan-Lin/CyberWaifu CyberWaifu is a Python chatbot application that combines LLMs (ChatGPT, Claude) with TTS (edge-tts, Azure) to create realistic conversation… | 30 | 1102 | maintenance |
| DonTizi/rlama RLAMA is a Go CLI tool for building and querying local Retrieval-Augmented Generation (RAG) systems over your documents using Ollama models… | 35 | 1096 | maintenance |
| RUCAIBox/TextBox TextBox 2.0 is a Python/PyTorch library providing a unified pipeline for applying pre-trained language models to text generation tasks. It … | 23 | 1096 | maintenance |
| EleutherAI/math-lm Repository for Llemma, an open language model for mathematics, hosting training code, data preprocessing scripts, and evaluation tooling. I… | 32 | 1095 | maintenance |
| Tencent/TencentPretrain TencentPretrain is a PyTorch-based toolkit for pre-training and fine-tuning transformer models across modalities such as text, vision, and … | 32 | 1094 | maintenance |
| replit/ReplitLM Official repository with inference code, configs, and guides for the ReplitLM family of code-oriented language models, such as replit-code-… | 10 | 1093 | maintenance |
| WangRongsheng/XrayGLM XrayGLM is the first Chinese multimodal medical large language model that generates radiology report summaries from chest X-ray images, bui… | 30 | 1086 | maintenance |
| agentcoinorg/evo.ninja Evo.ninja is a versatile generalist AI agent that adapts in real time by selecting pre-defined agent personas (researcher, CSV analyst, dev… | 29 | 1080 | maintenance |
| openai/automated-interpretability OpenAI's code and tools for automatically generating, simulating, and scoring explanations of neuron behavior in language models, based on … | 10 | 1080 | maintenance |
| thunderbird/thunderbolt Thunderbolt is an open-source, cross-platform AI client from Thunderbird that lets users connect any OpenAI-compatible model or ACP-compati… | 81 | 4791 | experimental |
| databricks/lilac Lilac is an open-source tool for exploring, curating, and quality-controlling datasets used for training, fine-tuning, and monitoring LLMs.… | 10 | 1070 | maintenance |
| ThePrimeagen/99 A Neovim plugin providing an agentic AI coding experience, integrating LLM providers like OpenCode and Claude Code into the editor. It augm… | 52 | 4743 | experimental |
| OpenBMB/VisCPM VisCPM is a family of open-source bilingual (Chinese/English) multimodal large models built on the 10B CPM-Bee language model, comprising V… | 29 | 1062 | maintenance |
| obiscr/ChatGPT A JetBrains IDE plugin that integrates ChatGPT into IntelliJ-based IDEs, providing an in-editor chat interface with OpenAI's language model… | 32 | 1059 | maintenance |