Open-source nlp software

1574 open-source libraries, tools and applications tagged nlp, ranked by how closely nlp is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.

1574 products, primary matches first, then adoption-weighted; health v2 shown.

Product	Health v2	Stars	Maturity
opendatalab/MinerU MinerU is a document parsing tool that converts PDFs, images, DOCX, PPTX, and XLSX files into machine-readable Markdown and JSON. It handle…	86	80546	active
tensorflow/models The TensorFlow Model Garden is a repository of official and community implementations of state-of-the-art machine learning models built wit…	82	77653	active
sansan0/TrendRadar TrendRadar is a self-hostable AI-powered public opinion and trending-news monitor that aggregates hot topics across multiple platforms and …	62	62570	active
K-Dense-AI/scientific-agent-skills Scientific Agent Skills is a Python library that provides a collection of validated procedural skills and access to over 100 scientific dat…	80	52679	active
Academic Research Skills Academic Research Skills is a Python library of Claude Code skills that guides researchers through the full academic workflow, from questio…	83	52555	active
LocalAI LocalAI is an open‑source AI runtime that provides a single binary exposing OpenAI‑compatible APIs for text, vision, audio, and video model…	93	49392	active
lfnovo/open-notebook Open Notebook is an open-source, privacy-focused alternative to Google's Notebook LM that lets users organize multi-modal sources (PDFs, vi…	90	40397	active
QuivrHQ/quivr Quivr is an opinionated RAG (Retrieval-Augmented Generation) library, available as the quivr-core Python package, that lets developers inge…	76	39579	active
openai/CLIP OpenAI's CLIP is a PyTorch library providing pretrained contrastive language-image models that encode images and text into a shared embeddi…	62	34362	stable
stanford-oval/storm STORM is an LLM-powered system that researches a topic via internet search and generates full-length, cited, Wikipedia-like reports. It is …	32	31520	active
GBrain GBrain is a self-hosted 'brain layer' for AI agents that combines a knowledge graph, vector search, and a synthesis engine to return cited …	79	30972	active
karakeep-app/karakeep Karakeep is a self‑hostable "bookmark‑everything" application that lets you save links, notes, images and PDFs. It adds AI‑powered automati…	94	29774	active
fastai fastai is a deep learning library built on PyTorch that offers high-level components for quickly achieving state-of-the-art results in visi…	92	28224	stable
titanwings/distilly Distilly is a Python tool that distills a person's experience, judgment, voice, and working style from messages, documents, interviews, and…	59	25182	active
uutils/coreutils uutils coreutils is a Rust reimplementation of the GNU coreutils suite, providing drop‑in replacements for common command‑line utilities. I…	94	24265	active
pytorch/examples A curated collection of short, high‑quality PyTorch example projects covering vision, text, reinforcement learning, and more. The repositor…	46	24052	active
sinaptik-ai/pandas-ai PandasAI is a Python library that lets users query data in SQL, CSV, or parquet format using natural language, powered by LLMs and RAG. It …	52	23808	active
marimo marimo is a reactive Python notebook stored as pure Python files, where running a cell automatically re-runs dependent cells to keep code a…	90	22981	active
PromtEngineer/localGPT LocalGPT is a fully private, on-premise document intelligence platform that lets users chat with, summarize, and query their own documents …	71	22197	active
jianchang512/pyvideotrans pyVideoTrans is an open‑source desktop and web application that translates videos between languages by transcribing speech, translating sub…	95	19430	active
arc53/DocsGPT DocsGPT is an open-source AI platform for building private agents, assistants, and enterprise search over your own documents. It includes a…	97	18312	active
DeepWiki / Grok Wiki DeepWiki-Open (now Grok-Wiki) is an open-source, AI-powered tool that automatically generates interactive wikis, documentation, diagrams, a…	62	18138	active
rowboatlabs/rowboat Rowboat is an open-source desktop AI coworker that indexes your email, meetings, Slack, and conversations into a living backlinked knowledg…	86	17974	active
rocketride-org/rocketride-server RocketRide is an open-source AI pipeline engine with a high-throughput C++ runtime and 100+ Python-extensible nodes for building, debugging…	82	17760	active
deepseek-ai/Janus Janus-Series is DeepSeek's family of unified multimodal models (Janus, Janus-Pro, JanusFlow) that combine multimodal understanding and imag…	23	17755	active
Leon Leon is an open-source personal AI assistant that runs on your own server, combining tools, memory, and agentic execution with speech-to-te…	86	17591	active
memvid/memvid Memvid is a single-file memory layer for AI agents that packages data, embeddings, and search indexes into one portable .mv2 file. It repla…	72	16550	active
duixcom/Duix-Avatar Duix.Avatar is an open-source AI avatar toolkit for offline video generation and digital human cloning, capable of cloning a person's appea…	51	15879	active
Unstructured Unstructured is an open-source ETL library and platform for converting complex documents (PDF, DOCX, HTML, images, and 65+ file types) into…	95	15556	active
ConardLi/easy-dataset Easy Dataset is a self-hosted web application for building high-quality structured datasets for LLM fine-tuning, RAG, and model evaluation.…	66	14989	active
TensorFlow.js A collection of pre-trained machine learning models ported to TensorFlow.js, published as npm packages for use in JavaScript projects. Mode…	59	14812	active
aiming-lab/AutoResearchClaw AutoResearchClaw is a Python framework for fully autonomous, self-evolving research that takes an idea from chat to a generated paper using…	70	14582	active
dlib Dlib is a modern C++ toolkit containing machine learning algorithms, deep learning tools, computer vision, linear algebra, and general-purp…	84	14458	stable
mlfoundations/open_clip OpenCLIP is an open-source PyTorch implementation of CLIP and related multimodal contrastive models, with many pretrained image/text checkp…	80	14157	active
krillinai/KrillinAI KrillinAI is an AI-powered video translation and dubbing tool covering the full pipeline: video download, speech transcription, subtitle tr…	90	13737	active
LangChain4j LangChain4j is an open-source Java library for building LLM-powered applications on the JVM, providing a unified API over 20+ LLM providers…	97	13266	active
PaddlePaddle/PaddleFormers PaddleFormers is a Transformers-style library built on PaddlePaddle providing a model zoo of 100+ large language models and vision-language…	88	12983	active
txtai txtai is an all-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows, built around an embedd…	95	12978	active
Pocket Flow An AI agent built with the Pocket Flow LLM framework that crawls GitHub repositories, analyzes codebases to identify core abstractions, and…	55	12683	active
datalab-to/chandra Chandra OCR 2 is a state-of-the-art open-weight OCR model from Datalab that converts images and PDFs into structured HTML, Markdown, or JSO…	65	12487	active
FlagOpen/FlagEmbedding FlagEmbedding is the official Python toolkit for BAAI's BGE family of embedding models and rerankers, covering inference, evaluation, and f…	82	12242	active
SpeechBrain SpeechBrain is an open-source PyTorch-based speech toolkit for building conversational AI systems. It provides training recipes, pretrained…	85	11845	active
ludwig-ai/ludwig Ludwig is a declarative, low-code deep learning framework for training, fine-tuning, and deploying AI models — from LLMs to tabular, image,…	96	11775	active
cleanlab Cleanlab is a Python library for data-centric AI that automatically detects issues in ML datasets, such as label errors, outliers, duplicat…	56	11692	stable
salesforce/LAVIS LAVIS is a Python library from Salesforce AI Research providing a unified toolkit for language-vision (multimodal) intelligence, including …	10	11264	active
MiniCPM MiniCPM is a family of compact multimodal large language models designed for efficient image, video, and audio understanding on mobile devi…	74	11232	active
WhisperLiveKit WhisperLiveKit is a self-hosted, ultra-low-latency real-time speech-to-text pipeline built on state-of-the-art simultaneous speech research…	85	11096	active
OpenVINO OpenVINO is an open-source toolkit from Intel for optimizing and deploying deep learning inference across CPU, GPU, and NPU hardware. It su…	95	10996	stable
PyMuPDF PyMuPDF is a high-performance Python library built on the MuPDF C engine for extracting, analyzing, converting, rendering, and manipulating…	95	10799	stable
autogluon/autogluon AutoGluon is an AutoML library that automates machine learning on tabular data, time series, text, and images with just a few lines of Pyth…	93	10766	active
bigscience-workshop/petals Petals is a Python library that lets you run and fine-tune large language models (Llama 3.1, Mixtral, Falcon, BLOOM) on a BitTorrent-style …	23	10614	active
dontbesilent2025/dbskill A Chinese-language AI Skills toolbox (31 skills) distilled from dontbesilent's public tweets, designed for agents like Claude Code, Codex, …	76	10606	active
oramasearch/orama Orama is a lightweight (~2kb) search engine and RAG pipeline library written in TypeScript that runs in the browser, server, or edge networ…	81	10561	active
zyddnys/manga-image-translator A Python tool that automatically detects, OCRs, translates, inpaints, and re-typesets text in images, primarily for manga and comics. It ru…	66	10477	active
ESPnet ESPnet is an end-to-end speech processing toolkit built on PyTorch covering speech recognition, text-to-speech, speech translation, enhance…	94	9989	active
HKUSTDial/Supervisor-Skills A collection of structured AI skills distilled from a professor's decade of research experience, designed to act as an AI co-supervisor for…	59	9743	active
anthropics/claude-for-legal A suite of Claude plugins, skills, and MCP connectors from Anthropic for legal workflows across practice areas like commercial, privacy, li…	58	9611	active
xberg-io/xberg Xberg is a polyglot document intelligence framework with a Rust core that extracts text, metadata, tables, images, and structured data from…	88	9400	active
langchain-ai/local-deep-researcher A fully local web research assistant that runs any LLM via Ollama or LMStudio to iteratively search the web, summarize findings, identify k…	67	9378	active
Future-House/paper-qa PaperQA2 is a Python library and CLI for high-accuracy retrieval augmented generation (RAG) over PDFs, text, Office documents, and source c…	95	9365	active
shaxiu/XianyuAutoAgent An AI-powered customer service bot for the Xianyu (Goofish) secondhand marketplace that provides 24/7 automated message handling. It uses L…	56	9275	active
modelscope/modelscope ModelScope is a Python library and ecosystem built on the 'Model-as-a-Service' concept, providing unified APIs to download, run inference o…	96	9149	active
bytedance/Dolphin Dolphin is ByteDance's open-source document image parsing model that converts document images and PDFs into structured content using a two-…	49	9061	active
adithya-s-k/omniparse OmniParse is a self-hosted ingestion and parsing platform that converts unstructured data (documents, images, audio, video, web pages) into…	46	7932	active
microsoft/graphrag GraphRAG is a Python library and CLI pipeline from Microsoft Research that extracts a knowledge graph from unstructured text, builds commun…	92	36292	maintenance
open-compass/opencompass OpenCompass is a Python-based evaluation platform and toolkit for benchmarking large language models across 100+ datasets, supporting model…	93	7471	active
LargeWorldModel/LWM Large World Model (LWM) is a family of open-source 7B-parameter multimodal autoregressive transformer models trained on long videos and boo…	26	7425	active
datajuicer/data-juicer Data-Juicer is a Python library and data processing system for cleaning, deduplicating, synthesizing, and analyzing data for foundation mod…	94	7132	active
zai-org/GLM-4 Official repository for the GLM-4 series of open-weight, multilingual (primarily Chinese/English) multimodal chat language models from Z.ai…	64	7069	active
Bruce Bruce is an open-source (AGPL-3.0) ESP32 firmware packed with offensive-security and Red Team tools such as WiFi attacks, Evil Portal, ward…	88	6946	active
PaddlePaddle/models PaddlePaddle's officially maintained industry-grade model repository containing 600+ models across computer vision, NLP, speech, recommenda…	23	6931	active
postgresml/postgresml PostgresML is a PostgreSQL extension that brings machine learning and AI inference directly into the database, with GPU acceleration and pg…	32	6823	active
facebookresearch/fairseq Fairseq is a PyTorch-based sequence modeling toolkit from Facebook AI Research for training custom models for translation, summarization, l…	10	32211	maintenance
OLMo olmOCR is a Python library that converts PDFs and image-based documents into clean, readable plain text or Markdown using a visual language…	42	6692	active
vynect/venom Venom is a high-performance Node.js/TypeScript framework for automating WhatsApp through WhatsApp Web via Puppeteer, offering a clean API f…	65	6585	active
souzatharsis/podcastfy Podcastfy is an open-source Python package and CLI that transforms multimodal content (websites, PDFs, images, YouTube videos, topics) into…	57	6576	active
haifengl/smile SMILE is a comprehensive, high-performance machine learning framework for the JVM with idiomatic APIs for Java, Scala, and Kotlin. It cover…	100	6423	active
oomol-lab/pdf-craft pdf-craft is a Python library that converts PDF files into Markdown or EPUB, with a focus on scanned books and documents. It uses OCR (loca…	89	6413	active
therealXiaomanChu/ex-skill A Claude Code skill (plugin) that distills an ex-partner into a personalized AI persona. It ingests chat exports (WeChat, QQ), screenshots,…	46	6406	active
joeseesun/qiaomu-anything-to-notebooklm A Claude Code Skill that ingests content from 15+ sources (WeChat articles, web pages, YouTube, PDFs, EPUB, Office docs, audio) and uploads…	69	6347	active
MaiBot MaiBot (MaiSaka) is an open-source, LLM-powered conversational agent designed to behave like a warm, human-like 'digital life form' in QQ g…	84	6338	active
JimmyLv/BibiGPT-v1 BibiGPT is an AI-powered web application that summarizes videos and audio from platforms like Bilibili, YouTube, TikTok, and podcasts, gene…	54	6241	active
ByteDance-Seed/Bagel BAGEL is an open-source unified multimodal foundation model with 7B active parameters (14B total) trained on interleaved multimodal data. I…	52	6191	active
Vale Vale is a fast, cross-platform command-line linter for prose that enforces editorial style guides on documentation. It is markup-aware, par…	98	6182	active
MinishLab/semble Semble is a fast, CPU-only code search library built for coding agents, providing semantic and hybrid search over codebases with ~99% fewer…	79	6114	active
OFA-Sys/Chinese-CLIP Chinese-CLIP is a Chinese version of the CLIP model trained on ~200 million Chinese image-text pairs, built on open_clip. It provides APIs,…	62	6014	active
Livebook Livebook is an open-source web application for writing interactive and collaborative Elixir notebooks, mixing Markdown prose with executabl…	98	5888	active
AidLux (AidLearning) AidLux (originally AidLearning) is an AIoT development platform that runs a native Ubuntu Linux environment with GUI, deep learning tooling…	63	5812	active
SmartSub SmartSub (妙幕) is a free, open-source cross-platform desktop application that provides an end-to-end subtitle and dubbing pipeline: speech-t…	92	5776	active
potpie-ai/potpie Potpie is an open-source context engine that turns a codebase and its development history into a living context graph for AI coding agents.…	87	5733	active
YouDub YouDub WebUI is an open-source AI video localization and dubbing tool that converts YouTube, Bilibili, or local videos into target-language…	95	5704	active
SenseNova A collection of modular Agent Skills for SenseNova models that add end-to-end office capabilities such as slide-deck generation, Excel data…	58	5683	active
zxlie/FeHelper FeHelper is an all-in-one browser extension toolbox for Chrome, Firefox, and Edge (Manifest V3) that bundles 30+ developer utilities such a…	74	5676	active
MiniGPT-4 Official code for MiniGPT-4 and MiniGPT-v2, vision-language models that align a frozen visual encoder with a frozen LLM (Vicuna) via a sing…	30	25605	maintenance
volcengine/MineContext MineContext is an open-source, proactive context-aware AI partner that captures and understands your screen activity to surface relevant in…	61	5534	active
54yyyu/zotero-mcp A Model Context Protocol (MCP) server that connects a Zotero research library to AI assistants like Claude, ChatGPT, Cursor, and Cherry Stu…	88	5420	active
deepseek-ai/DeepSeek-VL2 DeepSeek-VL2 is a series of Mixture-of-Experts vision-language models (Tiny, Small, and 4.5B activated parameters) with inference code and …	22	5376	active
vitali87/code-graph-rag Code-Graph-RAG is a Python CLI tool and MCP server that parses multi-language codebases with Tree-sitter, builds a knowledge graph of code …	86	5258	active
Yuukiy/JavSP JavSP is a Python command-line tool that scrapes adult video (JAV) metadata from multiple websites, aggregates the data, and generates NFO …	23	5173	active
Marker-Inc-Korea/AutoRAG AutoRAG 2.0 is a self-evolving librarian agent that searches local document collections (PDFs, wikis, notes) and curates results into struc…	94	5122	active