Open-source large-language-models software
3737 open-source libraries, tools and applications tagged large-language-models, ranked by how closely large-language-models is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
3737 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| bilibili/Index-1.9B Index-1.9B is a family of lightweight 1.9-billion-parameter multilingual language models from Bilibili's Index team, released in base, chat… | 68 | 1033 | active |
| am-will/codex-skills A collection of Codex/agent skills written in Shell covering planning, documentation access, prompting, frontend design guidance, Codex too… | 54 | 1033 | active |
| samuel-vitorino/lm.rs A minimal Rust implementation for running LLM inference locally on CPU without ML libraries, supporting Gemma 2, Llama 3.2, and Phi 3.5 (in… | 24 | 1033 | active |
| agents-flex/agents-flex Agents-Flex is a lightweight, modular Java framework for building AI applications and agents, positioned as a Java counterpart to Spring AI… | 91 | 1032 | active |
| negokaz/excel-mcp-server A Model Context Protocol (MCP) server that lets LLM clients read and write Microsoft Excel files (xlsx, xlsm, xltx, xltm). It exposes tools… | 33 | 1032 | active |
| ustcllm/RecFM RecFM is a collection of tools and frameworks from USTCLLM for developing foundation models tailored to recommendation systems. It bundles … | 37 | 1031 | active |
| langchain-ai/mcpdoc An MCP server that exposes llms.txt documentation indexes to IDEs and AI coding apps like Cursor, Windsurf, and Claude Code. It provides a … | 10 | 1030 | active |
| modelcontextprotocol/use-mcp use-mcp is a lightweight React hook library for connecting browser-based AI applications to Model Context Protocol (MCP) servers. It handle… | 10 | 1030 | active |
| xtekky/chatgpt-clone A self-hosted ChatGPT-style web interface written in Python that connects to the OpenAI API (or a reverse proxy) with an improved UI. It su… | 30 | 3497 | maintenance |
| kaito-project/kaito KAITO is a Kubernetes operator suite that automates LLM inference, fine-tuning, and RAG engine deployment using simplified CRD APIs. It aut… | 93 | 1028 | active |
| microsoft/Tutel Tutel is Microsoft's optimized Mixture-of-Experts (MoE) library for efficient training and inference of large language models, featuring dy… | 79 | 1028 | active |
| Alpha-VLLM/Lumina-DiMOO Lumina-DiMOO is an open-source omni diffusion large language model that uses fully discrete diffusion to handle multimodal inputs and outpu… | 51 | 1027 | active |
| 99AI 99AI is a commercially viable, self-hostable AI web platform built with Vue and Node.js that bundles AI chat, image/video/music generation,… | 32 | 1027 | active |
| chatmcp/mcp-server-chatsum An MCP server that queries and summarizes chat messages stored in a local chat database, exposed as a tool for MCP-compatible clients like … | 22 | 1027 | active |
| minimaxir/simpleaichat A Python library providing a minimal, low-complexity interface for building applications on top of chat LLM APIs like ChatGPT and GPT-4. It… | 21 | 3491 | maintenance |
| fla-org/native-sparse-attention Efficient Triton kernel implementations of Native Sparse Attention (NSA), a hardware-aligned, natively trainable sparse attention mechanism… | 47 | 1023 | active |
| MeshAnything MeshAnything is an autoregressive transformer model that generates artist-created 3D meshes (up to 1600 faces in V2) aligned with a given s… | 28 | 1023 | active |
| jucasoliveira/terminalGPT TerminalGPT is a Node.js CLI tool that brings ChatGPT-like LLM chat conversations directly into your terminal. It supports multiple LLM pro… | 22 | 1022 | active |
| SafeAI-Lab-X/ClawKeeper ClawKeeper is a host-agnostic safety middleware layer that sits between AI agents and their tools, blocking risky tool calls, redacting sen… | 55 | 1021 | active |
| HumeAI/tada TADA is an open-source speech-language model from Hume AI that generates expressive, high-fidelity speech via text-acoustic dual alignment,… | 48 | 1020 | active |
| bxx2004/FUNGA FUNGA (Functional Gene Annotation Exploitation Platform) is an AI-powered web platform for mining gene functions, integrating cross-species… | 35 | 1020 | active |
| XGenerationLab/XiYan-SQL XiYan-SQL is a multi-generator ensemble framework for converting natural language questions into SQL queries, achieving SOTA results on ben… | 56 | 1019 | active |
| TRI-ML/prismatic-vlms Prismatic VLMs is a PyTorch-based codebase for training visually-conditioned language models (VLMs) with flexible vision backbones like CLI… | 26 | 1019 | active |
| deepseek-ai/DeepSeek-Math DeepSeekMath is a 7B open language model specialized in mathematical reasoning, initialized from DeepSeek-Coder and trained on 500B math-re… | 26 | 3457 | maintenance |
| hinterdupfinger/obsidian-ollama An Obsidian plugin that integrates locally running Ollama models into your notes. It provides preconfigured prompts (summarize, explain, re… | 19 | 1018 | active |
| facebookresearch/PyTorch-BigGraph PyTorch-BigGraph is a distributed system for learning embeddings of very large graph-structured data, scaling to billions of entities and t… | 10 | 3454 | maintenance |
| bytechefhq/bytechef ByteChef is an open-source, self-hostable platform that combines AI agent orchestration with workflow automation and API integration. It pr… | 98 | 1017 | active |
| octimot/StoryToolkitAI StoryToolkitAI is a desktop film editing tool that transcribes, indexes, and semantically searches video footage locally, using speech reco… | 62 | 1016 | active |
| wangziqi06/724-office A self-evolving, production-running AI agent system written in ~10,000 lines of pure Python with no agent frameworks, featuring 36 tools, M… | 54 | 1016 | active |
| EvolvingLMMs-Lab/Otter Otter is a multi-modal vision-language model built on OpenFlamingo, instruction-tuned on the MIMIC-IT dataset with image and video understa… | 21 | 3445 | maintenance |
| srcbookdev/srcbook Srcbook is a local-first TypeScript notebook application that runs as a CLI with a web interface, supporting executable TypeScript cells, m… | 64 | 3444 | maintenance |
| synthetic-lab/octofriend OctoFriend is a zero-telemetry, terminal-based AI coding assistant that works with any OpenAI- or Anthropic-compatible LLM API, including l… | 65 | 1015 | active |
| talkie-lm/talkie talkie is a Python library and CLI for running inference with the talkie 13B language model family, including a 13B model trained on pre-19… | 49 | 1015 | active |
| 274056675/springboot-openai-chatgpt A full-stack AI chatbot application built on Spring Boot/Spring Cloud that integrates GPT-3.5, GPT-4, Baidu ERNIE Bot, Stable Diffusion, an… | 33 | 1012 | active |
| ZTE-AICloud/Co-Sight Co-Sight is an open-source Python framework from ZTE for building Manus-like autonomous AI agent systems that generate high-quality researc… | 41 | 1011 | active |
| ownthink/Jiagu Jiagu is a Python library for Chinese natural language processing built on deep learning models trained on large-scale corpora. It provides… | 32 | 3425 | maintenance |
| TinyLLaVA/TinyLLaVA_Factory TinyLLaVA Factory is an open-source modular PyTorch/HuggingFace codebase for training small-scale large multimodal models (LMMs) that combi… | 70 | 1009 | active |
| QwenAudio/Fun-Audio-Chat Fun-Audio-Chat is a Large Audio Language Model (8B) for natural, low-latency voice interactions, using dual-resolution speech representatio… | 60 | 1009 | active |
| themanojdesai/python-a2a Python A2A is a Python library implementing Google's Agent-to-Agent (A2A) protocol with Model Context Protocol (MCP) integration. It enable… | 35 | 1008 | active |
| xqdoo00o/chatgpt-web A pure JavaScript ChatGPT web client that ships as a single HTML file and talks directly to the OpenAI API (plus DeepSeek, Gemini, and Clau… | 31 | 1007 | active |
| argilla-io/distilabel Distilabel is a Python framework for building scalable pipelines that generate synthetic data and AI feedback, based on verified research p… | 74 | 3408 | maintenance |
| ZJUI-AI4H/Hulu-Med Hulu-Med is a family of open-source transparent generalist medical vision-language models ranging from 4B to 235B parameters, covering text… | 59 | 1006 | active |
| minimaxir/gpt-2-simple A Python package that simplifies fine-tuning OpenAI's GPT-2 text-generation model (124M/355M) on custom text and generating text from the r… | 23 | 3405 | maintenance |
| MoonshotAI/checkpoint-engine Checkpoint-engine is a lightweight Python middleware for updating model weights in-place across LLM inference engines, a critical step in r… | 78 | 1005 | active |
| ViggoZ/producthunt-daily-hot A Python automation tool that generates a daily Chinese-language digest of Product Hunt's top 30 products, using the Product Hunt API and O… | 69 | 1005 | active |
| facebookresearch/fairscale FairScale is a PyTorch extension library providing composable modules and APIs for high-performance, large-scale distributed training, incl… | 27 | 3403 | maintenance |
| pjlab-sys4nlp/llama-moe LLaMA-MoE is a Python toolkit and model series for building Mixture-of-Experts (MoE) language models from dense LLaMA models via expert con… | 20 | 1004 | active |
| johnhuang316/code-index-mcp A Model Context Protocol (MCP) server that indexes, searches, and analyzes code repositories so LLM-based assistants can navigate codebases… | 77 | 1003 | active |
| Liuhong99/Sophia Official PyTorch implementation of Sophia-G, a scalable stochastic second-order optimizer for language model pre-training, from the paper b… | 30 | 1001 | active |
| WangRongsheng/CareGPT CareGPT is a medical large language model project that aggregates dozens of publicly available medical fine-tuning datasets and open medica… | 10 | 999 | active |
| guangzhengli/ChatFiles ChatFiles is a Next.js web application that lets users upload documents and chat with them using GPT and embeddings via LangChainJS and a S… | 21 | 3335 | maintenance |
| JIA-Lab-research/MGM Official PyTorch implementation of Mini-Gemini, a multimodal vision-language model framework built on LLaVA that supports dense and MoE LLM… | 26 | 3322 | maintenance |
| XYZ-AI-Lab/axrl AxisRL is an agentic reinforcement learning post-training framework for large language models, built on SGLang for high-throughput rollout … | 53 | 984 | active |
| LLM-As-Chatbot A Python application that serves open-source instruction-tuned LLMs as chatbot services via a Gradio web UI or a Discord bot. It integrates… | 31 | 3315 | maintenance |
| X-D-Lab/LangChain-ChatGLM-Webui A Gradio-based web UI that combines LangChain with ChatGLM-6B and other open-source LLMs to answer questions over a local knowledge base. U… | 31 | 3310 | maintenance |
| andrewyng/openworker OpenWorker is an open-source desktop AI agent application that completes real work end-to-end — code security reviews with fix branches, cl… | 80 | 18450 | experimental |
| FreeGPT35 A self-hosted service that exposes the login-free ChatGPT Web's GPT-3.5-Turbo as an OpenAI-compatible /v1/chat/completions API. It can be d… | 10 | 3223 | maintenance |
| eureka-research/Eureka Eureka is a research library from NVIDIA that uses coding LLMs like GPT-4 to automatically generate reward functions for reinforcement lear… | 28 | 3210 | maintenance |
| SilasMarvin/lsp-ai LSP-AI is an open-source language server written in Rust that acts as a backend for AI-powered editor features like LLM chat and code compl… | 18 | 3208 | maintenance |
| ourongxing/chatgpt-vercel A self-hostable ChatGPT web client built with SolidStart and deployed on Vercel edge functions, powered by the OpenAI API. It offers an ele… | 10 | 3206 | maintenance |
| huawei-noah/Pretrained-Language-Model A collection of pretrained language models and optimization techniques from Huawei Noah's Ark Lab, including PanGu-α (200B-parameter Chines… | 32 | 3166 | maintenance |
| project-baize/baize-chatbot Baize is an open-source chat model built on LLaMA using LoRA parameter-efficient tuning, trained on 100k self-chat dialogs generated by Cha… | 21 | 3145 | maintenance |
| microsoft/torchscale A PyTorch library from Microsoft implementing foundation Transformer architectures such as DeepNet, Magneto, RetNet, LongNet, BitNet, and X… | 32 | 3143 | maintenance |
| DAMO-NLP-SG/Video-LLaMA Video-LLaMA is an instruction-tuned audio-visual language model that extends LLaMA with video and audio understanding via cross-modal pretr… | 30 | 3140 | maintenance |
| linyiLYi/bilibot A local chatbot fine-tuned from Bilibili user comments, built on Qwen1.5-32B-Chat using Apple's MLX LoRA fine-tuning. It supports text chat… | 25 | 3127 | maintenance |
| stravu/crystal Crystal (now renamed Nimbalyst) is an open-source Electron desktop app for running multiple Claude Code and Codex AI coding sessions in par… | 57 | 3122 | maintenance |
| 869413421/chatgpt-web A self-hosted web application written in Go that wraps the OpenAI ChatGPT 3.5/4 API into a private chat website with configurable model par… | 22 | 3120 | maintenance |
| dbiir/UER-py UER-py is a PyTorch framework for pre-training transformer language models (BERT, GPT-2, T5, ELMo, etc.) and fine-tuning them on downstream… | 32 | 3114 | maintenance |
| Kyle-Ye/XcodeLLMEligible A shell-based utility that overrides macOS eligibility checks to enable Xcode LLM, Apple Intelligence, and iPhone Mirroring on unsupported … | 10 | 3099 | maintenance |
| salesforce/CodeT5 Official research release of CodeT5 and CodeT5+ open code large language models from Salesforce Research for code understanding and generat… | 10 | 3093 | maintenance |
| qwopqwop200/GPTQ-for-LLaMa A Python library that applies GPTQ 4-bit weight quantization to LLaMA large language models, drastically reducing memory usage and checkpoi… | 31 | 3070 | maintenance |
| bigscience-workshop/promptsource PromptSource is a Python toolkit and repository for creating, sharing, and applying natural language prompts to Hugging Face datasets. It h… | 23 | 3037 | maintenance |
| linsa-io/linsa.io Linsa is a privacy-focused messaging application that combines chat, tasks, notes, files, and payments into a single product with end-to-en… | 72 | 16854 | experimental |
| T5 T5X is a modular, composable framework built on JAX and Flax for high-performance training, evaluation, and inference of sequence models at… | 71 | 3002 | maintenance |
| ElricLiu/AutoGPT-Next-Web A web UI for assembling, configuring, and deploying autonomous AI agents (AutoGPT/AgentGPT-style) directly in the browser, built with Next.… | 21 | 3000 | maintenance |
| yangjianxin1/GPT2-chitchat A GPT2-based Chinese chitchat dialogue model project built on HuggingFace transformers, including training, preprocessing, and interactive … | 32 | 2995 | maintenance |
| mpoon/gpt-repository-loader A Python command-line tool that converts a Git repository's files and structure into a single text format suitable for feeding to LLMs. It … | 31 | 2972 | maintenance |
| johnma2006/mamba-minimal A single-file, readable PyTorch implementation of the Mamba selective state space model architecture. It produces numerically equivalent ou… | 27 | 2968 | maintenance |
| gmpetrov/databerry Databerry (now branded Askli/Chaindesk) is a no-code platform for building custom LLM agents and ChatGPT-style chatbots trained on your own… | 31 | 2966 | maintenance |
| FreedomIntelligence/LLMZoo LLM Zoo is a project providing data, models, and evaluation benchmarks for large language models, including the multilingual Phoenix and Ch… | 31 | 2936 | maintenance |
| muellerberndt/mini-agi MiniAGI is a simple general-purpose autonomous AI agent built on the OpenAI API, compatible with GPT-3.5-Turbo and GPT-4. It combines a rob… | 75 | 2932 | maintenance |
| stanford-crfm/helm HELM is a Python framework from Stanford's CRFM for holistic, reproducible evaluation of foundation models including LLMs and multimodal mo… | 87 | 2924 | maintenance |
| microsoft/genaiscript GenAIScript is a JavaScript/TypeScript framework for programmatically assembling and orchestrating LLM prompts, tools, and data in code. It… | 10 | 2876 | maintenance |
| shreyashankar/gpt3-sandbox A Python library that wraps the OpenAI GPT-3 API to make it easy to prime the model with few-shot examples and launch a local web demo with… | 32 | 2868 | maintenance |
| OpenPipe/OpenPipe OpenPipe is an open-source fine-tuning and model-hosting platform that turns expensive LLM prompts into cheaper fine-tuned models. It offer… | 30 | 2832 | maintenance |
| weaigc/bingo Bingo is a self-hostable web application that recreates the New Bing (Bing AI / Copilot) chat interface, allowing access to Bing AI feature… | 29 | 2825 | maintenance |
| yanqiangmiffy/Chinese-LangChain A Chinese-language local knowledge base question-answering application built on ChatGLM-6B and LangChain, with a Gradio web UI. It supports… | 30 | 2823 | maintenance |
| microsoftarchive/promptbench PromptBench is a unified Python library from Microsoft for evaluating and understanding large language models across many datasets, models,… | 10 | 2820 | maintenance |
| Alpha-VLLM/LLaMA2-Accessory LLaMA2-Accessory is an open-source Python toolkit for pretraining, finetuning, and deploying large language models and multimodal LLMs, inc… | 29 | 2796 | maintenance |
| PhoebusSi/Alpaca-CoT Alpaca-CoT is an instruction-tuning platform that unifies interfaces for instruction data collection, parameter-efficient fine-tuning metho… | 31 | 2788 | maintenance |
| henrywoo/pyllama A Python library that is a modified version of Meta's LLaMA implementation, making it easy to download model weights and run LLaMA models o… | 22 | 2778 | maintenance |
| OpenBMB/BMTools BMTools is an open-source Python library that extends large language models with external tools, letting developers build plugins by writin… | 31 | 2773 | maintenance |
| liucongg/ChatGLM-Finetuning A Python toolkit for fine-tuning ChatGLM-6B, ChatGLM2-6B, and ChatGLM3-6B large language models using Freeze, LoRA, P-Tuning, and full-para… | 21 | 2773 | maintenance |
| Prompt Engine An NPM utility library from Microsoft for building and maintaining prompts for Large Language Models, with generic, code, and chat prompt e… | 10 | 2757 | maintenance |
| paperswithcode/galai galai is the official Python library for loading and running inference with the GALACTICA general-purpose scientific language models from P… | 23 | 2741 | maintenance |
| kyegomez/OpenMythos OpenMythos is an open-source, theoretical PyTorch implementation of a Recurrent-Depth Transformer (RDT) architecture inspired by speculatio… | 49 | 14910 | experimental |
| JIA-Lab-research/LongLoRA LongLoRA is an efficient fine-tuning approach and codebase that extends the context length of pre-trained LLMs (Llama2 7B/13B/70B) using sh… | 28 | 2687 | maintenance |
| ohmplatform/FreedomGPT FreedomGPT is a React and Electron desktop application that runs LLM models locally on Mac, Windows, and Linux using llama.cpp, providing a… | 21 | 2674 | maintenance |
| mckaywrigley/paul-graham-gpt An open-source AI-powered search and chat application built over Paul Graham's essays using OpenAI embeddings, pgvector on Supabase, and GP… | 31 | 2661 | maintenance |
| waooAI/waoowaoo waoowaoo is a self-hosted AI film and video production studio that turns novel or script text into complete videos, automatically generatin… | 71 | 14346 | experimental |