Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| LiyuanLucasLiu/RAdam RAdam is a Python implementation of Rectified Adam, a variant of the Adam optimizer that analytically reduces the large variance of adaptiv… | 32 | 2550 | maintenance |
| Ice-Hazymoon/openai-scf-proxy A small Node.js proxy service that forwards OpenAI API requests, deployable to Tencent Cloud Functions (or Aliyun) in minutes without writi… | 22 | 2543 | maintenance |
| google/ax AX (Agent Executor) is a distributed agent runtime from Google that provisions isolated, suspendable/resumable environments to execute AI a… | 81 | 13629 | experimental |
| IntelligenzaArtificiale/Free-Auto-GPT A simplified open-source reimplementation of Auto GPT that runs autonomous AI agents without any paid APIs, using free access to models via… | 30 | 2529 | maintenance |
| wenge-research/YAYI YAYI is a family of open-source Chinese-optimized large language models (7B/13B) instruction-tuned from LLaMA 2 and BLOOM base models by We… | 10 | 2524 | maintenance |
| young-geng/EasyLM EasyLM is a JAX/Flax-based framework for pre-training, finetuning, evaluating, and serving large language models like LLaMA. It scales trai… | 32 | 2515 | maintenance |
| karpathy/rendergit A Python CLI tool that flattens any GitHub repository into a single static HTML page with syntax highlighting, markdown rendering, and side… | 31 | 2473 | maintenance |
| dataelement/dsh-desktop DSH Desktop is a local-first, cross-platform desktop application that packages the DeepSeek Harness agent runtime as an installable app for… | 80 | 13014 | experimental |
| AkariAsai/self-rag Original implementation of Self-RAG, a framework that trains a language model to adaptively retrieve passages on demand and critique its ow… | 28 | 2433 | maintenance |
| zai-org/CogVLM2 CogVLM2 is an open-source multi-modal vision-language model family built on Meta-Llama-3-8B-Instruct, offering image and video understandin… | 25 | 2429 | maintenance |
| microsoft/DialoGPT DialoGPT is a large-scale pretrained dialogue response generation model from Microsoft, based on GPT-2 and trained on 147M multi-turn Reddi… | 10 | 2422 | maintenance |
| microsoft/Codex-CLI A Python CLI tool that uses OpenAI's GPT-3 Codex model to translate natural language commands into Bash, Zsh, or PowerShell commands. Users… | 32 | 2421 | maintenance |
| OpenBMB/CPM-Bee CPM-Bee is a fully open-source, commercially usable 10-billion-parameter bilingual (Chinese-English) foundation large language model traine… | 68 | 2408 | maintenance |
| allenai/RL4LMs RL4LMs is a modular Python library from AllenAI for fine-tuning language models with reinforcement learning to align with human preferences… | 32 | 2396 | maintenance |
| prompt-engineering/click-prompt ClickPrompt is an open-source web application for prompt writers to view, share, and run prompts for AI tools like ChatGPT, Stable Diffusio… | 10 | 2389 | maintenance |
| IST-DASLab/gptq Reference implementation of GPTQ, a one-shot post-training weight quantization method for large generative transformer models based on appr… | 32 | 2386 | maintenance |
| cogentapps/chat-with-gpt An open-source, self-hostable ChatGPT web app built with TypeScript and React that adds voice features via ElevenLabs text-to-speech and Op… | 31 | 2347 | maintenance |
| glowingjade/obsidian-smart-composer Smart Composer is an Obsidian plugin that adds an AI chat assistant with contextual awareness of your vault, smart writing assistance, and … | 58 | 2331 | maintenance |
| langchain-ai/langserve LangServe is a Python library that deploys LangChain runnables and chains as REST APIs built on FastAPI, with automatic input/output schema… | 10 | 2325 | maintenance |
| Tracer-Cloud/opensre OpenSRE is an open-source Python framework for building AI SRE agents that investigate incidents and perform root cause analysis on your in… | 80 | 12172 | experimental |
| approximatelabs/sketch Sketch is an AI code-writing assistant for pandas users that understands the context of your dataframe content to generate relevant suggest… | 32 | 2281 | maintenance |
| MetaGLM/FinGLM FinGLM is an open, community-driven financial LLM project centered on a dialog-based question-answering system that analyzes Chinese listed… | 28 | 2270 | maintenance |
| TigerResearch/TigerBot TigerBot is a multi-language, multi-task large language model project from TigerResearch, providing pretrained and chat-tuned model weights… | 30 | 2262 | maintenance |
| Mintplex-Labs/vector-admin VectorAdmin is a self-hostable web UI and tool suite for managing vector databases like Pinecone, Chroma, Qdrant, and Weaviate. It provides… | 10 | 2243 | maintenance |
| KaiyangZhou/CoOp A research codebase implementing prompt learning methods (CoOp and CoCoOp) for adapting vision-language models like CLIP to downstream clas… | 32 | 2236 | maintenance |
| epfLLM/meditron Meditron is a suite of open-source medical large language models (7B and 70B) adapted from Llama-2 via continued pretraining on a curated m… | 27 | 2211 | maintenance |
| lucidrains/reformer-pytorch A PyTorch implementation of the Reformer, an efficient Transformer architecture using LSH attention, reversible networks, and chunking to h… | 23 | 2195 | maintenance |
| tensorchord/pgvecto.rs pgvecto.rs is a Postgres extension written in Rust (via pgrx) that adds vector similarity search with high dimension support, quantization,… | 21 | 2189 | maintenance |
| alibaba/EasyNLP EasyNLP is a comprehensive PyTorch-based NLP toolkit from Alibaba that provides training, inference, and deployment for pre-trained languag… | 23 | 2186 | maintenance |
| hwchase17/notion-qa A Python application that lets you ask natural-language questions about a Notion database, built on LangChain and OpenAI. It ingests export… | 32 | 2151 | maintenance |
| omnigent-ai/omnigent Omnigent is an open-source meta-harness that provides a common orchestration layer over AI coding agents like Claude Code, Codex, Cursor, a… | 82 | 10938 | experimental |
| cyberagiinc/DevDocs DevDocs is a free, private, UI-based MCP server that crawls and extracts technical documentation (using Crawl4AI and Playwright) and expose… | 47 | 2108 | maintenance |
| facebookresearch/chameleon Repository for Meta Chameleon, an early-fusion token-based mixed-modal foundation model that understands and generates interleaved images a… | 10 | 2101 | maintenance |
| camenduru/text-generation-webui-colab A collection of Google Colab notebooks that launch the oobabooga text-generation-webui with a Gradio interface for running large language m… | 31 | 2092 | maintenance |
| ai-forever/ru-gpts A repository of Russian GPT-3 language models (ruGPT3XL/Large/Medium/Small and ruGPT2Large) with usage and fine-tuning examples. It provide… | 32 | 2089 | maintenance |
| THUDM/P-tuning-v2 P-tuning v2 is a Python implementation of deep prompt tuning, applying trainable continuous prompts at every transformer layer so prompt tu… | 32 | 2079 | maintenance |
| amazon-science/auto-cot Official implementation of Auto-CoT (ICLR 2023), a method that automatically constructs chain-of-thought demonstrations for large language … | 32 | 2052 | maintenance |
| alibaba/AliceMind AliceMind is Alibaba's collection of pre-trained encoder-decoder language models and related NLP techniques, including StructBERT, PALM, VE… | 23 | 2040 | maintenance |
| xlang-ai/instructor-embedding INSTRUCTOR is an instruction-finetuned text embedding model and Python library that generates task-tailored embeddings by simply providing … | 32 | 2026 | maintenance |
| neulab/prompt2model Prompt2Model is a Python library that takes a natural language task description (like an LLM prompt) and automatically generates a small, s… | 21 | 2023 | maintenance |
| anthropics/jacobian-lens A Python library implementing the Jacobian lens, an interpretability technique that linearly transports residual-stream activations at any … | 56 | 2011 | maintenance |
| sonnylazuardi/chat-ai-desktop An unofficial open-source ChatGPT desktop app for Mac, Windows, and Linux that lives in the menubar, built with Tauri and Rust. It wraps th… | 23 | 1998 | maintenance |
| Fullive-AI/Anima Anima is an open-source Agent OS that gives home hardware perceptive, decision-making, and learning AI capabilities by connecting devices t… | 55 | 639 | active |
| Amazon Q Developer CLI Amazon Q Developer CLI is an open-source Rust-based terminal tool providing an agentic AI chat experience for building applications with na… | 69 | 1983 | maintenance |
| deepseek-ai/DeepSeek-MoE DeepSeekMoE 16B is a Mixture-of-Experts language model with fine-grained expert segmentation and shared expert isolation, released with bas… | 27 | 1981 | maintenance |
| LlmKira/Openaibot Openaibot is a Python-based, event-driven LLM chatbot platform that deploys GPT-powered assistants on Discord, Slack, Kook, and Telegram. I… | 30 | 1966 | maintenance |
| Anse Anse is a minimal, self-hostable web UI for chatting with OpenAI's ChatGPT models (GPT-3.5 Turbo and GPT-4) via the OpenAI API. Built with … | 26 | 1966 | maintenance |
| circlestarzero/EX-chatGPT Ex-ChatGPT is a Python web application that lets ChatGPT call external APIs (Google, WolframAlpha, WikiMedia) to give more accurate, up-to-… | 10 | 1956 | maintenance |
| QwenLM/Qwen-Audio Official repository for Qwen-Audio, Alibaba Cloud's large audio-language model with pretrained and chat variants. It provides model weights… | 28 | 1955 | maintenance |
| liltom-eth/llama2-webui A Gradio-based web UI for running Llama 2 models (7B/13B/70B, GPTQ, GGML, GGUF, CodeLlama) locally on GPU or CPU across Linux, Windows, and… | 20 | 1934 | maintenance |
| nat/natbot natbot is a Python tool that drives a web browser using GPT-3, letting an LLM agent navigate and interact with web pages. It serializes the… | 32 | 1933 | maintenance |
| S-LoRA/S-LoRA S-LoRA is a serving system for large language models that scales to thousands of concurrent LoRA adapters on one or more GPUs. It uses Unif… | 10 | 1926 | maintenance |
| pacifio/atlas Atlas is a native macOS workspace and source-control layer for coding agents, linking every commit to the agent session, prompts, tool call… | 80 | 9556 | experimental |
| OkGoDoIt/OpenAI-API-dotnet An unofficial C#/.NET SDK wrapping the OpenAI API, covering chat completions (GPT-3.5/4), DALL-E image generation, embeddings, moderation, … | 23 | 1894 | maintenance |
| Ucas-HaoranWei/Vary Official ECCV 2024 implementation of Vary, a method for scaling up the vision vocabulary of large vision-language models. It provides train… | 27 | 1890 | maintenance |
| marella/ctransformers CTransformers provides Python bindings for transformer language models implemented in C/C++ using the GGML library. It offers a unified int… | 21 | 1887 | maintenance |
| Forethought-Technologies/AutoChain AutoChain is a lightweight, extensible Python framework for building custom LLM-powered generative agents with custom tools, inspired by La… | 52 | 1882 | maintenance |
| Akegarasu/ChatGLM-webui A Gradio-based web UI for running the THUDM ChatGLM-6B large language model locally. It provides a chat interface with adjustable parameter… | 31 | 1877 | maintenance |
| salesforce/ctrl CTRL is a 1.63 billion-parameter conditional Transformer language model from Salesforce that generates text controllable via control codes … | 10 | 1877 | maintenance |
| alejandro-ao/ask-multiple-pdfs A Streamlit-based Python application built with Langchain that lets users chat with multiple PDF documents using natural language. It extra… | 30 | 1876 | maintenance |
| clue-ai/ChatYuan ChatYuan is an open-source bilingual (Chinese and English) dialogue large language model in ChatGPT style, with a lightweight variant runna… | 32 | 1860 | maintenance |
| sammcj/gollama Gollama is a Go-based TUI tool for managing Ollama models on macOS and Linux. It lets users list, inspect, sort, edit, run, unload, copy, r… | 90 | 1837 | maintenance |
| Nya AI AIaW (AI as Workspace) is a full-featured, lightweight AI chat client supporting multiple LLM providers (OpenAI, Anthropic, Google, DeepSee… | 67 | 1837 | maintenance |
| minimaxir/aitextgen aitextgen is a Python library for training and generating text with GPT-2 and GPT Neo models, built on PyTorch, Hugging Face Transformers, … | 23 | 1835 | maintenance |
| Helixform/CodeCursor CodeCursor is a Visual Studio Code extension that brings the Cursor AI code editor experience into VS Code, offering AI code generation, co… | 10 | 1824 | maintenance |
| openai/gpt-discord-bot An example Discord bot written in Python that uses the OpenAI chat completions API to hold conversations with the gpt-3.5-turbo model and t… | 32 | 1823 | maintenance |
| jquesnelle/yarn Reference implementation of YaRN, an efficient method for extending the context window of large language models, published as an ICLR 2024 … | 29 | 1801 | maintenance |
| ttengwang/Caption-Anything Caption-Anything combines Segment Anything image segmentation, visual captioning, and ChatGPT to generate tailored captions for any object … | 31 | 1777 | maintenance |
| OpenCodeInterpreter/OpenCodeInterpreter OpenCodeInterpreter is a suite of open-source code generation models and deployment code that integrates code execution and iterative refin… | 26 | 1770 | maintenance |
| Synaptrix/ChatGPT-Desktop A cross-platform desktop ChatGPT client built with Tauri, Vue 3, and Arco Design that wraps the OpenAI GPT-3.5-turbo API. It offers a fast … | 10 | 1767 | maintenance |
| nashsu/FreeAskInternet FreeAskInternet is a self-hosted, Perplexity-like search aggregator and answer generator that runs multi-engine searches via SearXNG and fe… | 25 | 8749 | experimental |
| huggingface/transfer-learning-conv-ai A clean, commented PyTorch codebase for training a dialog/chatbot agent by transfer learning from OpenAI GPT/GPT-2 language models. It repr… | 10 | 1757 | maintenance |
| TypeChat TypeChat is a TypeScript library from Microsoft that replaces prompt engineering with 'schema engineering' for building natural language in… | 75 | 8692 | experimental |
| SecureAI-Tools/SecureAI-Tools A self-hosted web application for private AI productivity, offering chat with AI models and chat-with-documents (PDF) backed by local infer… | 18 | 1727 | maintenance |
| 101dotxyz/GPTeam GPTeam is an open-source multi-agent simulation that uses GPT-4 to create multiple AI agents with memory who collaborate and communicate to… | 74 | 1724 | maintenance |
| cvlab-columbia/viper ViperGPT is a research codebase that composes vision-and-language models with code generated by large language models (GPT-3.5/GPT-4) to pe… | 31 | 1720 | maintenance |
| juanjuandog/FinSight-AI FinSight AI is an open-source equity research workspace for A-share companies that turns market data, filings, and financial metrics into s… | 56 | 559 | active |
| imcaspar/gpt2-ml GPT2-ML is a TensorFlow-based GPT-2 training and inference project supporting multiple languages, with a focus on Chinese. It provides 1.5B… | 23 | 1703 | maintenance |
| BotGroup.Chat A multi-user AI group chat application built with React and deployable to Cloudflare Pages, where multiple AI characters with distinct pers… | 67 | 1702 | maintenance |
| techleadhd/chatgpt-retrieval A simple Python script that lets you ask ChatGPT questions about your own files using LangChain and a Chroma vector store. It loads text or… | 30 | 1697 | maintenance |
| zlwaterfield/scramble Scramble is an open-source browser extension that uses LLMs to enhance writing directly on any webpage, acting as a customizable Grammarly … | 31 | 1688 | maintenance |
| TheExplainthis/ChatGPT-Line-Bot A Python application that integrates ChatGPT into the LINE messaging platform, letting users chat with GPT models and generate DALL·E 2 ima… | 22 | 1687 | maintenance |
| mit-han-lab/smoothquant SmoothQuant is a training-free post-training quantization (PTQ) method that enables W8A8 (8-bit weight, 8-bit activation) quantization for … | 32 | 1686 | maintenance |
| eyurtsev/kor Kor is a Python library for extracting structured data from text using large language models. Users define a schema (Kor-style or Pydantic)… | 22 | 1684 | maintenance |
| hamelsmu/evals-skills A collection of skills (prompts/instructions) that guide AI coding agents like Claude Code through building and auditing LLM evaluation pip… | 10 | 1677 | maintenance |
| lxfater/Portal Portal is a cross-platform desktop tool that integrates ChatGPT capabilities into any application via a global keyboard shortcut. It sends … | 10 | 1673 | maintenance |
| LangGraph A Python library for building hierarchical multi-agent systems on top of LangGraph, where a central supervisor agent orchestrates and deleg… | 10 | 1656 | maintenance |
| TrainPPTAgent MultiAgentPPT is a Python-based multi-agent system that generates editable presentation slides from a topic using A2A, MCP, and Google ADK … | 64 | 1643 | maintenance |
| altryne/chatGPT-telegram-bot A Telegram bot that lets users chat with ChatGPT, originally by driving the ChatGPT web interface in Chromium via Playwright, with plans to… | 23 | 1637 | maintenance |
| all-in-aigc/gpts-works GPTs Works is a third-party GPTs store consisting of a website for browsing and discovering custom ChatGPT GPTs, a vector-based index syste… | 20 | 1629 | maintenance |
| tensorflow/mesh Mesh TensorFlow is a Python library and embedded language for specifying distributed tensor computations, letting users define how model di… | 10 | 1629 | maintenance |
| mmz-001/knowledge_gpt KnowledgeGPT is a Streamlit web application that lets users upload documents (primarily PDFs) and ask questions about them, receiving answe… | 10 | 1628 | maintenance |
| timoschick/pet Official implementation of Pattern-Exploiting Training (PET), a semi-supervised method that reformulates text classification and natural la… | 32 | 1622 | maintenance |
| CodeShell CodeShell is a family of 7-billion-parameter code large language models developed by PKU-KCL, trained on 500 billion tokens with an 8192-to… | 28 | 1618 | maintenance |
| wangzhaode/mnn-llm mnn-llm is a C++ library for deploying large language models on-device using Alibaba's MNN inference engine, with demos for CLI, web, Andro… | 21 | 1615 | maintenance |
| lucidrains/PaLM-rlhf-pytorch A PyTorch library implementing Reinforcement Learning from Human Feedback (RLHF) on top of the PaLM transformer architecture, aiming to rep… | 77 | 7861 | experimental |
| easychen/openai-api-proxy A lightweight OpenAI/GPT API reverse proxy deployable with a single Docker command or to Tencent Cloud serverless functions. It supports SS… | 31 | 1611 | maintenance |
| ezyang/codemcp codemcp is an MCP server that turns Claude Desktop into a pair programming assistant that can directly edit files, run tests, and implement… | 34 | 1607 | maintenance |
| sobelio/llm-chain llm-chain is a Rust crate for building chains of large language model calls to complete complex tasks such as text summarization. It provid… | 21 | 1602 | maintenance |
| RomanHotsiy/commitgpt commitgpt is a Node.js CLI tool that automatically generates commit messages using ChatGPT. It runs `git diff --cached`, sends the diff to … | 32 | 1590 | maintenance |