Open-source rag software
1097 open-source libraries, tools and applications tagged rag, ranked by how closely rag is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
1097 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| Live Helper Chat Live Helper Chat is an open-source, self-hosted live support chat application for websites, featuring voice, video, screen sharing, co-brow… | 100 | 2249 | active |
| floneum/kalosm Kalosm is a Rust ecosystem of crates providing simple interfaces for running pre-trained language, audio, and image models locally or remot… | 65 | 2227 | active |
| AnotiaWang/deep-research-web-ui A web UI for the dzhng/deep-research project that performs iterative, AI-driven research by combining search engines, web scraping, and LLM… | 88 | 2223 | active |
| rcortx/kiwiq KiwiQ is a production-grade multi-agent orchestration platform in Python that lets you define AI workflows as JSON/Python graph schemas com… | 46 | 2211 | active |
| atomicstrata/llm-wiki-compiler llmwiki is a Node.js CLI knowledge compiler that turns raw sources (papers, docs, notes, PDFs, URLs) into an interlinked, citation-traceabl… | 81 | 2169 | active |
| Nutlope/notesGPT NotesGPT is an open-source AI-powered voice note-taking web app that records voice notes, transcribes them with Whisper, and generates summ… | 65 | 2155 | active |
| PKU-YuanGroup/LLaVA-CoT LLaVA-CoT is an 11B vision language model with training, inference, and dataset-generation code for spontaneous step-by-step multimodal rea… | 44 | 2131 | active |
| kimjammer/Neuro A local recreation of the Neuro-Sama AI VTuber that runs open-source LLMs on consumer hardware, combining realtime speech-to-text, text-to-… | 28 | 2101 | active |
| NanoNets/docext docext is an on-premises document intelligence toolkit powered by vision-language models, offering OCR-free structured data extraction, PDF… | 47 | 2086 | active |
| ammaarreshi/Gemini-Search A Perplexity-style AI search engine web application powered by Google's Gemini 2.0 Flash model with Google Search grounding. It provides AI… | 21 | 2072 | active |
| lupantech/AgentFlow AgentFlow is a trainable, tool-integrated agentic framework that coordinates planner, executor, verifier, and generator modules through an … | 44 | 2064 | active |
| LangGraph4j LangGraph4j is a Java library for building stateful, multi-agent applications with LLMs, inspired by the Python LangGraph project. It lets … | 89 | 2060 | active |
| Kochava-Studios/witsy Witsy is a cross-platform desktop AI assistant built with Electron and Vue 3 that lets users chat with many LLM providers using their own A… | 63 | 2038 | active |
| AnswerOverflow/AnswerOverflow Answer Overflow is an open-source application that indexes Discord server threads into searchable, SEO-friendly web pages so community know… | 66 | 2020 | active |
| 64bit/async-openai async-openai is a Rust library providing typed, async clients for the OpenAI API, covering chat completions, responses, embeddings, assista… | 94 | 2016 | active |
| Jamailar/Beav Beav (formerly RedBox) is a local-first AI content operations workbench for social media creators, combining a desktop app and a Chrome/Edg… | 82 | 1998 | active |
| szczyglis-dev/py-gpt PyGPT is an open-source, all-in-one desktop AI assistant for Linux, Windows, and Mac, written in Python. It supports chat, agents, vision, … | 93 | 1973 | active |
| jd-opensource/JoyAI-VL-Interaction JoyAI-VL-Interaction is an open 8B-scale vision-language interaction model with a complete deployable real-time streaming system, including… | 59 | 1970 | active |
| MicrosoftDocs/mcp Microsoft's official Model Context Protocol (MCP) server and CLI that gives LLMs and AI agents real-time access to trusted Microsoft Learn … | 64 | 1951 | active |
| getnao/nao nao is an open-source framework for building and deploying analytics agents that answer natural-language questions about data. It combines … | 79 | 1936 | active |
| zakirkun/guardian-cli Guardian is a Python CLI tool that automates penetration testing workflows using LLM providers (OpenAI, Claude, Gemini, Ollama, and others)… | 63 | 1889 | active |
| ginlix-ai/LangAlpha LangAlpha is an open-source agentic AI harness for financial market research and investment decision support, inspired by code-agent harnes… | 83 | 1880 | active |
| nolanx-ai/nolanx.ai NolanX is an open-source multi-modal agent platform for AI filmmaking that orchestrates text, image, audio, and video models into long-runn… | 49 | 1877 | active |
| dphnAI/sonar Sonar is a large-scale LLM inference engine for Hugging Face-compatible language and multimodal models, based on vLLM (formerly the Aphrodi… | 92 | 1871 | active |
| run-llama/semtools SemTools is a Rust command-line toolkit for parsing documents (PDF, DOCX, PPTX, etc.) into markdown via LlamaParse and running fast local s… | 57 | 1870 | active |
| AkaliKong/MiniOneRec MiniOneRec is an open-source framework for generative recommendation built on large language models, covering the full pipeline of semantic… | 59 | 1868 | active |
| u14app/neo-chat Neo Chat is a self-hostable, local-first AI chat workspace built with Next.js, React, and TypeScript. It combines multi-provider chat, agen… | 91 | 1859 | active |
| openreasoner/openr OpenR is an open-source Python framework that integrates search, reinforcement learning, and process supervision to improve chain-of-though… | 23 | 1859 | active |
| Datus-ai/Datus-agent Datus is an open-source (Apache-2.0) AI data engineering agent delivered primarily as a Python CLI, with a VS Code/Cursor extension and opt… | 85 | 1845 | active |
| PurpleDoubleD/locally-uncensored Locally Uncensored is a free, open-source desktop AI studio (built with Tauri/TypeScript) that bundles uncensored local chat, a coding agen… | 76 | 1799 | active |
| LM Studio SDK lmstudio-js is the official TypeScript/JavaScript client SDK for LM Studio, enabling use of locally running LLMs for chat, completions, emb… | 73 | 1799 | active |
| DreamFactory DreamFactory is a self-hosted enterprise data access platform that instantly generates fully governed REST APIs from databases, file stores… | 97 | 1785 | active |
| yobix-ai/extractous Extractous is a fast Rust library for extracting content and metadata from unstructured documents like PDF, Word, Excel, HTML, CSV, and ema… | 25 | 1780 | active |
| LLM Sherpa LLM Sherpa is a Python client library providing APIs for layout-aware PDF and document parsing to feed LLM applications, backed by the open… | 18 | 1753 | active |
| software-mansion/react-native-executorch React Native ExecuTorch is a declarative React Native library for running AI models on-device, powered by Meta's ExecuTorch runtime. It shi… | 88 | 1750 | active |
| bespokelabsai/curator Bespoke Curator is a Python library for bulk LLM inference and scalable synthetic data curation for post-training and structured data extra… | 89 | 1744 | active |
| SonicJs-Org/sonicjs SonicJS is an open-source, edge-native headless CMS built for Cloudflare Workers using TypeScript, Hono, D1, and R2, with sub-100ms API res… | 95 | 1742 | active |
| BeaconBay/ck ck is a grep-compatible code search tool written in Rust that combines traditional BM25/regex search with local embedding-based semantic se… | 77 | 1739 | active |
| xingyaoww/code-act CodeAct is a research framework and agent system that uses executable Python code as a unified action space for LLM agents, enabling multi-… | 27 | 1705 | active |
| bytedance/pasa PaSa is an LLM-powered paper search agent from ByteDance that autonomously invokes search tools, reads papers, and selects relevant referen… | 28 | 1665 | active |
| LlamaEdge/LlamaEdge LlamaEdge is a lightweight Rust and WasmEdge-based runtime for running open-source LLMs locally or on edge devices, with CLI chat apps and … | 64 | 1658 | active |
| huggingface/aisheets Hugging Face AI Sheets is an open-source no-code web application for building, enriching, and transforming datasets using AI models. It can… | 64 | 1652 | active |
| AnswerDotAI/rerankers A lightweight, dependency-free Python library providing a unified API for using all common reranking and cross-encoder models. It lets deve… | 39 | 1640 | active |
| pixeltable/pixeltable Pixeltable is a Python library providing declarative, incremental data infrastructure for multimodal AI applications, unifying storage of i… | 94 | 1639 | active |
| AnalyseDeCircuit/oxideterm OxideTerm is an open-source, local-first desktop workspace for remote server operations, combining SSH/Mosh/Telnet/Serial terminals, SFTP, … | 78 | 1638 | active |
| siddsachar/row-bot Row-Bot is a local-first desktop AI assistant and workbench that combines chat, durable memory, a personal knowledge graph, tool use, paren… | 83 | 1637 | active |
| waybarrios/vllm-mlx vllm-mlx is a vLLM-style LLM inference server for Apple Silicon Macs built on native MLX, exposing both OpenAI and Anthropic compatible API… | 82 | 1618 | active |
| Forsy Agent Apprenticeship is an open ecosystem and CLI tool where AI agents complete real-world tasks through iterative workflow loops, are eval… | 57 | 1617 | active |
| PKU-Alignment/safe-rlhf Beaver is a modular open-source framework from Peking University for training large language models with SFT, RLHF, and Safe RLHF (constrai… | 50 | 1617 | active |
| ModernRelay/omnigraph Omnigraph is a lakehouse-native graph database written in Rust that stores versioned graphs on object storage using the Lance format, with … | 82 | 1616 | active |
| nilsherzig/LLocalSearch LLocalSearch is a self-hosted search aggregator that uses locally running LLM agents to answer questions with web-sourced information, show… | 10 | 5947 | maintenance |
| langchain-ai/deepagentsjs Deep Agents (deepagentsjs) is a TypeScript library from LangChain for building controllable LLM-powered agents on top of LangGraph. It prov… | 82 | 1611 | active |
| LYiHub/mad-professor-public A desktop AI companion application for reading academic papers, built with PyQt6. It combines PDF parsing and translation, RAG-based retrie… | 24 | 1603 | active |
| enoch3712/ExtractThinker ExtractThinker is a Python document intelligence library that uses LLMs to extract and classify structured data from documents like PDFs, i… | 71 | 1601 | active |
| RamiAwar/dataline DataLine is an open-source, privacy-focused AI data analysis and visualization application that lets users chat with their data in natural … | 54 | 1594 | active |
| steedos/steedos-platform Steedos Platform is an open-source, metadata-driven low-code platform for building enterprise applications (CRMs, ERPs, approval workflows)… | 85 | 1581 | active |
| antvis/AVA AVA is an AI-native visual analytics framework from AntV that lets users load data (CSV, JSON, URL), query it in natural language, and get … | 80 | 1581 | active |
| modelscope/AgentEvolver AgentEvolver is an end-to-end self-evolving training framework for LLM-based agents that unifies automatic task generation (self-questionin… | 47 | 1571 | active |
| NanoNets/docstrange DocStrange is a Python library and tool that converts documents (PDF, DOCX, PPTX, XLSX, images, URLs) into Markdown, JSON, CSV, or HTML usi… | 37 | 1569 | active |
| RunAnywhere RCLI is a single-binary CLI that runs open-source AI models locally on your machine, covering chat, vision, speech-to-text, text-to-speech,… | 82 | 1566 | active |
| Prismer-AI/PrismerCloud Prismer Cloud is a hosted/self-hostable knowledge infrastructure platform for AI agents, providing context fetching and compression, docume… | 68 | 1558 | active |
| GitHamza0206/simba Simba is an open-source, production-ready customer service assistant and knowledge management system built around a fully customizable RAG … | 59 | 1546 | active |
| video-db/Director Director is a Python framework for building AI video agents that reason over complex video tasks like search, editing, compilation, and gen… | 38 | 1542 | active |
| DEEIX-AI/DEEIX-Chat DEEIX Chat is an open-source, self-hostable enterprise AI workspace that unifies access to multiple LLM providers behind one entry point, w… | 80 | 1531 | active |
| emcf/thepipe thepipe is a Python package and API that extracts clean markdown, multimodal media, and structured data from tricky documents like PDFs, Wo… | 79 | 1529 | active |
| Ch1rpy2613/Mirrai Mirrai is a self-hosted web application that builds AI 'digital twins' of people from uploaded chat logs, photos, and videos, then lets use… | 55 | 1529 | active |
| import-ai/omnibox OmniBox is a cross-platform, self-hostable AI knowledge hub that lets users collect webpages, files, and voice notes, then parse, index, an… | 89 | 1527 | active |
| Open-Source-Legal/OpenContracts OpenContracts is a self-hosted, MIT-licensed document intelligence platform that turns document repositories into a programmable citation g… | 89 | 1508 | active |
| langchain-ai/open-canvas Open Canvas is an open-source web application for collaborating with LLM agents to write documents and code, inspired by OpenAI's Canvas. I… | 10 | 5477 | maintenance |
| DemonDamon/FinnewsHunter FinnewsHunter is a multi-agent financial intelligence platform built on the AgenticX framework that monitors Chinese financial news sources… | 76 | 1500 | active |
| brave/brave-search-mcp-server An MCP server that exposes the Brave Search API to AI clients, offering web, local, image, video, and news search plus AI summarization ove… | 80 | 1490 | active |
| datalevin/datalevin Datalevin is a durable Datalog database built on LMDB that unifies relational, graph, document, key-value, full-text, and vector search in … | 100 | 1486 | active |
| dust-tt/dust Dust is an open-source platform for building, deploying, and managing custom AI agents powered by large language models. It combines a web … | 95 | 1484 | active |
| karust/openserp OpenSERP is a self-hosted, MIT-licensed SERP API and CLI written in Go that returns structured search results from Google, Bing, Yandex, Ba… | 93 | 1484 | active |
| qwersyk/Newelle Newelle is a GTK4/GNOME virtual assistant application for Linux that connects to local (Ollama, Llama.cpp) and cloud LLM providers. It supp… | 92 | 1477 | active |
| MiroShark/MiroShark MiroShark is a universal swarm-intelligence engine that turns any document or scenario into a simulated world: it builds a Neo4j knowledge … | 60 | 1476 | active |
| ByteDance-Seed/m3-agent M3-Agent is a multimodal agent framework from ByteDance Seed that processes real-time visual and auditory inputs to build entity-centric lo… | 45 | 1459 | active |
| InternAgent InternAgent-1.5 is a Python-based unified agentic framework for long-horizon autonomous scientific discovery, orchestrating multi-agent sys… | 58 | 1454 | active |
| sauravpanda/BrowserAI BrowserAI is a TypeScript library for running LLMs, speech recognition, text-to-speech, and audio separation models directly in the browser… | 73 | 1452 | active |
| Agent-RL/ReCall ReCall is a framework that trains LLMs to reason with arbitrary tool calls via reinforcement learning, without supervised tool-use trajecto… | 26 | 1441 | active |
| argilla-io/argilla Argilla is an open-source collaboration tool for AI engineers and domain experts to build, annotate, and curate high-quality datasets for N… | 78 | 5140 | maintenance |
| callstackincubator/ai A collection of on-device AI primitives for React Native offering Vercel AI SDK-compatible APIs for running LLMs, embeddings, transcription… | 70 | 1415 | active |
| tavily-ai/tavily-python The official Python SDK for the Tavily API, providing search, content extraction, crawling, site mapping, and research capabilities. It let… | 71 | 1409 | active |
| awaescher/OllamaSharp OllamaSharp is a .NET client library providing bindings for the entire Ollama API, including chat, generation, embeddings, and model manage… | 89 | 1407 | active |
| aws-samples/aws-genai-llm-chatbot A modular, production-ready AWS solution for deploying a multi-LLM, multi-RAG powered chatbot using AWS CDK. It supports Amazon Bedrock, Sa… | 10 | 1398 | active |
| arkohut/pensieve Pensieve is a privacy-focused passive screen recording application that automatically takes screenshots of your screens, indexes them with … | 79 | 1393 | active |
| Dataojitori/nocturne_memory Nocturne Memory is a lightweight, rollbackable long-term memory server for MCP agents, storing persistent, graph-like structured memories i… | 79 | 1389 | active |
| P0luz/Ombre-Brain Ombre Brain is a long-term emotional memory system for Claude and other MCP clients, exposing 16 MCP tools over a single /mcp connector. Me… | 77 | 1383 | active |
| joey-zhou/xiaozhi-esp32-server-java A Java enterprise-grade server and management platform for the Xiaozhi ESP32 AI voice assistant hardware, providing a full front-end/back-e… | 73 | 1380 | active |
| morettt/my-neuro An open-source AI desktop companion framework inspired by Neuro-sama, letting users build a customizable Live2D character with sub-second v… | 81 | 1374 | active |
| firecrawl/open-scouts Open Scouts is an AI-powered web monitoring platform where users create automated 'scouts' that run on a schedule to search the web and sen… | 51 | 1373 | active |
| LangChain4j AIDeepin LangChain4j-AIDeepin is an open-source, self-hostable AI application platform built on Spring Boot, LangChain4j, and LangGraph4j with Vue 3… | 91 | 1372 | active |
| Lapis0x0/obsidian-yolo YOLO is an agent-native AI assistant plugin for Obsidian that combines chat, writing assistance, knowledge base interaction, and agent orch… | 83 | 1372 | active |
| ChatWise ChatWise is a fast, privacy-friendly desktop AI chatbot client that connects to multiple LLM providers (OpenAI, Anthropic, Google, Groq, Ol… | 67 | 1371 | active |
| Infinispan Infinispan is an open-source, distributed in-memory key/value data grid and NoSQL cloud data store written in Java. It supports embedded an… | 95 | 1356 | stable |
| JoySafety/JoySafety JoySafety is an open-source large language model safety framework from JD.com, written in Java, providing prompt injection detection, conte… | 42 | 1354 | active |
| LoLLMs LoLLMs WebUI is a local, single-user web interface for running large language models and multimodal AI systems, supporting hundreds of mode… | 64 | 4789 | maintenance |
| specstoryai/getspecstory SpecStory is a local-first tool (VS Code extensions, CLI, and cloud service) that automatically captures AI coding assistant conversations … | 87 | 1341 | active |
| alibaba/graph-learn Graph-Learn (formerly AliGraph) is a distributed framework for developing and applying large-scale graph neural networks, with a training l… | 32 | 1340 | active |
| stenolabs/stenoai Steno is a privacy-first desktop AI notepad and meeting notetaker that records, transcribes, summarizes, and lets you query meetings entire… | 85 | 1338 | active |