Open-source nlp software
1574 open-source libraries, tools and applications tagged nlp, ranked by how closely nlp is their primary purpose, then by adoption and maintenance health. Each entry links to a page with sources, use cases and when to choose or avoid it.
1574 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| pickle-com/glass Glass by Pickle is an open-source Electron desktop app that acts as a 'digital mind extension', seeing your screen and listening in real ti… | 39 | 7602 | active |
| ilyhalight/voice-over-translation A userscript/browser extension that adds AI voice-over translation and subtitles to videos on many websites, powered by Yandex services. It… | 99 | 7570 | active |
| BiliNote BiliNote is an open-source AI video note-taking application that turns video links from Bilibili, YouTube, Douyin, and local files into str… | 81 | 7563 | active |
| lijigang/ljg-skills A curated collection of custom skills (prompt packs) for OpenAI Codex and compatible AI agents, installable via the skills CLI in org-mode … | 60 | 7525 | active |
| soimort/translate-shell Translate Shell is a command-line translator that provides access to Google Translate, Bing Translator, Yandex.Translate, and Apertium from… | 23 | 7514 | stable |
| ChatLab/ChatLab ChatLab is an open-source, local-first desktop application (with an optional CLI) for analyzing chat histories from platforms like WhatsApp… | 78 | 7503 | active |
| TheCraigHewitt/seomachine SEO Machine is a specialized Claude Code workspace of custom commands, AI agents, and Python analysis modules for researching, writing, and… | 57 | 7467 | active |
| MuiseDestiny/zotero-gpt A Zotero plugin that integrates OpenAI GPT models into the Zotero reference manager, letting users ask questions about PDFs, summarize pape… | 73 | 7420 | active |
| fxsjy/jieba Jieba is the most popular Python library for Chinese word segmentation, supporting precise, full, search-engine, and PaddlePaddle-based seg… | 23 | 35195 | maintenance |
| interviewstreet/hiring-agent An open-source AI agent pipeline from HackerRank that extracts structured data from resume PDFs, enriches it with GitHub signals, and produ… | 63 | 7312 | active |
| stanfordnlp/GloVe Stanford's C implementation of the GloVe model for training distributed word representations (word embeddings), plus downloadable pre-train… | 34 | 7230 | stable |
| ymcui/Chinese-LLaMA-Alpaca-2 A project releasing Chinese-adapted LLaMA-2 base models and Alpaca-2 instruction-tuned chat models with an extended Chinese vocabulary, inc… | 51 | 7112 | stable |
| deeppavlov/DeepPavlov DeepPavlov is an open-source Python NLP library built on PyTorch and Hugging Face transformers for developing, training, and deploying stat… | 35 | 6995 | active |
| InterpretML InterpretML is a Python library that unifies machine learning interpretability techniques, letting users train inherently interpretable gla… | 89 | 6961 | active |
| adbar/trafilatura Trafilatura is a Python package and command-line tool for crawling the web and extracting main text, metadata, and comments from raw HTML w… | 94 | 6914 | active |
| zarazhangrui/follow-builders An AI agent skill that tracks top AI builders on X/Twitter, YouTube podcasts, and AI company blogs, then remixes their content into digesti… | 59 | 6828 | active |
| TalAter/annyang annyang is a tiny (2 KB), dependency-free JavaScript library that adds speech recognition and voice commands to websites using the Web Spee… | 72 | 6818 | stable |
| steipete/summarize Summarize is a Node.js CLI and Chrome/Firefox extension that extracts clean text from web pages, PDFs, YouTube videos, podcasts, and audio/… | 84 | 6729 | active |
| goldendict/goldendict GoldenDict is a feature-rich desktop dictionary lookup program that supports many dictionary formats (StarDict, Babylon, Lingvo DSL, Dictd,… | 40 | 6702 | active |
| Beingpax/VoiceInk VoiceInk is a native macOS voice-to-text dictation app that transcribes speech to text almost instantly using local AI models (Parakeet, Wh… | 84 | 6693 | active |
| microsoft/LLMLingua LLMLingua is a Microsoft library for prompt compression that removes non-essential tokens from prompts and KV caches to speed up LLM infere… | 62 | 6687 | active |
| axa-group/nlp.js NLP.js is a natural language processing library for Node.js that provides intent classification, named entity recognition, sentiment analys… | 23 | 6580 | active |
| Argos Translate Argos Translate is an open-source offline neural machine translation library written in Python, built on OpenNMT. It can be used as a Pytho… | 62 | 6532 | active |
| shibing624/pycorrector pycorrector is a Python toolkit for Chinese text error correction, supporting phonetic, visual, and grammar error types with models includi… | 78 | 6528 | active |
| NEKOparapa/AiNiee AiNiee is an AI-powered translation tool focused on automatically translating complex long-form content such as RPG/SLG game text, Epub/TXT… | 93 | 6293 | active |
| itorr/nbnhhsh A userscript and web tool that translates Chinese pinyin initialism abbreviations (like 'yyds' or 'xswl') used on social platforms into rea… | 77 | 6280 | active |
| tyiannak/pyAudioAnalysis pyAudioAnalysis is a Python library for audio analysis covering feature extraction (MFCCs, spectrograms, chromagrams), supervised and unsup… | 44 | 6268 | active |
| PrefectHQ/marvin Marvin is a Python framework for building AI applications with LLMs, offering structured-output utilities (extract, cast, classify, generat… | 85 | 6198 | active |
| HarfBuzz HarfBuzz is a text shaping engine that converts Unicode text into properly positioned glyph output for any writing system, supporting OpenT… | 99 | 6165 | stable |
| YILING0013/AI_NovelGenerator A Python GUI application that uses large language models to generate multi-chapter long-form novels with automatic context continuity, fore… | 62 | 6156 | active |
| houbb/sensitive-word A high-performance Java library for sensitive/prohibited word detection and filtering based on the DFA algorithm, with a built-in 60k+ word… | 52 | 6073 | active |
| FilipePS/Traduzir-paginas-web TWP - Translate Web Pages is a browser extension (WebExtension) that translates web pages in real time using Google, Bing, or Yandex transl… | 93 | 6039 | active |
| epoko77-ai/im-not-ai A Claude Code / Copilot CLI skill (with a hosted web app) that detects and rewrites AI-generated Korean text so it reads like natural human… | 79 | 5958 | active |
| facebookresearch/fastText fastText is a lightweight open-source C++ library (with Python bindings and a CLI) from Facebook Research for efficiently learning word rep… | 10 | 26525 | maintenance |
| nextai-translator/bob-plugin-openai-translator A Bob plugin for macOS that uses OpenAI, Google Gemini, MiniMax, or OpenAI-compatible APIs to translate text, polish wording, and fix gramm… | 93 | 5651 | active |
| Basic Pitch Basic Pitch is a lightweight neural network library from Spotify for automatic music transcription, converting audio recordings of nearly a… | 43 | 5645 | stable |
| maziyarpanahi/openmed OpenMed is a local-first healthcare AI SDK for clinical named-entity recognition and HIPAA PII/PHI de-identification that runs entirely on-… | 84 | 5623 | active |
| 狗头军师 (Goutoujunshi) Goutoujunshi is a Codex Skill (AI agent plugin) that acts as a relationship advisor, first validating the user's emotions, then analyzing r… | 56 | 5619 | active |
| lingodotdev/lingo.dev Lingo.dev is an open-source localization engineering toolkit that turns LLMs into stateful translation APIs, persisting glossaries, brand v… | 88 | 5398 | active |
| pypinyin pypinyin is a Python library (with a companion CLI) that converts Chinese characters (hanzi) to pinyin, supporting polyphonic characters, m… | 64 | 5362 | stable |
| Librum Librum is a free and open-source e-book reader and library management application built with C++, Qt6, and QML. It lets users read e-books,… | 55 | 5319 | active |
| wanasit/chrono Chrono is a natural language date parser library for JavaScript/TypeScript that extracts dates and times from arbitrary text. It handles re… | 95 | 5291 | active |
| HIT-SCIR/ltp LTP (Language Technology Platform) is an open-source neural NLP toolkit for Chinese supporting word segmentation, POS tagging, NER, depende… | 51 | 5265 | active |
| microsoft/SynapseML SynapseML (formerly MMLSpark) is an open-source machine learning library built on Apache Spark that provides simple, composable, distribute… | 84 | 5247 | active |
| katanaml/sparrow Sparrow is an open-source framework for structured data extraction from documents (PDFs, images) using ML, LLMs, and Vision LLMs, with sche… | 92 | 5225 | active |
| grobidOrg/grobid GROBID is a Java machine learning library that extracts, parses, and re-structures raw documents such as PDFs into structured XML/TEI, focu… | 84 | 5176 | active |
| chatopera/Synonyms A Python library for Chinese synonym lookup and semantic similarity computation, built on word vector models for NLP and chatbot use cases.… | 48 | 5107 | active |
| alex alex is a JavaScript-based linter that catches insensitive, inconsiderate writing such as gendered, ableist, or polarizing phrasing in text… | 23 | 5105 | active |
| cjhutto/vaderSentiment VADER is a lexicon and rule-based sentiment analysis library for Python, specifically tuned to sentiments expressed in social media but eff… | 51 | 5077 | stable |
| shibing624/text2vec A Python library that converts text (words, sentences, paragraphs) into vector embeddings, implementing Word2Vec, RankBM25, BERT, Sentence-… | 49 | 4978 | active |
| microsoft/muzic Muzic is a Microsoft Research project providing deep learning models for music understanding and generation, including MusicBERT, SongMASS,… | 62 | 4960 | active |
| 万象拼音 Wanxiang Pinyin is a comprehensive Rime input method configuration ecosystem featuring an AI-optimized Chinese dictionary with tone-annotat… | 87 | 4951 | active |
| conorbronsdon/avoid-ai-writing A portable agent skill that audits and rewrites text to remove AI writing patterns ('AI-isms'). It supports detect-only, rewrite, and edit-… | 82 | 4947 | active |
| libpostal libpostal is a C library for parsing and normalizing street addresses from around the world using statistical NLP and open geo data. It con… | 56 | 4894 | stable |
| danyuchn/asd-ste100-skill A Claude Code skill that rewrites dense, ambiguous English into ASD-STE100 Simplified Technical English, the aerospace controlled-language … | 58 | 4797 | active |
| Chonkie Chonkie is a lightweight Python library for chunking text in RAG pipelines, offering multiple chunking algorithms, embeddings, and integrat… | 82 | 4790 | active |
| SakuraLLM/SakuraLLM SakuraLLM is a series of fine-tuned open large language models for Japanese-to-Chinese translation specialized in light novel and Galgame (… | 58 | 4785 | active |
| Rasa Open Source Rasa Open Source is a Python-based framework for building text and voice conversational agents. It provides NLU, dialogue management, and i… | 62 | 21330 | maintenance |
| zh-lx/pinyin-pro A high-performance Chinese-to-Pinyin conversion library for JavaScript/TypeScript. It converts Chinese characters to pinyin with tones, ini… | 99 | 4742 | active |
| WorldBrain/Memex Memex is a browser extension (Chrome/Firefox) for curating, annotating, highlighting, tagging, and full-text searching web content and PDFs… | 44 | 4722 | active |
| xxnuo/MTranServer MTranServer is an offline machine translation server with very low resource usage and millisecond response times, requiring no GPU. It supp… | 60 | 4711 | active |
| osfans/trime Trime (Tongwen Input Method) is an Android input method editor (IME) built on the open-source RIME input method framework via JNI. It suppo… | 93 | 4705 | active |
| makcedward/nlpaug nlpaug is a Python library for augmenting textual, audio, and spectrogram data to improve machine learning model performance. It provides A… | 100 | 4664 | active |
| promptslab/Promptify Promptify is a Python library that turns LLMs into task-based NLP engines, providing high-level APIs for NER, classification, QA, and custo… | 62 | 4636 | active |
| ThioJoe/YT-Spammer-Purge A Python-based desktop application that scans YouTube comment sections for spam and scam comments using 15 different filtering methods, the… | 36 | 4636 | active |
| MuJing MuJing (幕境) is a free, open-source desktop application for learning English vocabulary through real context from movies, TV shows, and docu… | 54 | 4631 | active |
| amperser/proselint proselint is a command-line linter for English prose that scans text files for style, usage, and clarity issues based on advice from renown… | 68 | 4581 | active |
| kaixindelele/ChatPaper ChatPaper is a Python tool that uses ChatGPT to summarize arXiv papers, translate full PDFs, polish academic writing, and simulate peer rev… | 59 | 19943 | maintenance |
| dedupe Dedupe is a Python library that uses machine learning to perform fuzzy matching, deduplication, and entity resolution on structured data. I… | 44 | 4516 | stable |
| zLanqing/codex-claude-academic-skills A collection of three academic skill packages for Claude Code and Codex covering paper writing, academic Word/PPT document generation, and … | 48 | 4507 | active |
| zjunlp/DeepKE DeepKE is an open-source PyTorch-based knowledge extraction toolkit for knowledge graph construction, supporting named entity recognition, … | 61 | 4484 | active |
| overtrue/pinyin A PHP library that converts Chinese text to pinyin using the mozillazg/pinyin-data dictionary, with accurate handling of polyphonic charact… | 79 | 4462 | stable |
| wooorm/franc franc is a JavaScript library that detects the natural language of text, supporting 82, 186, or 419 languages depending on the package vari… | 23 | 4416 | stable |
| Pot App Pot is a cross‑platform desktop application for instant text translation, OCR, and speech synthesis. It runs on Windows, macOS and Linux us… | 10 | 19418 | maintenance |
| Pot App Pot is a cross-platform desktop application for hotkey-based text translation, screenshot OCR, and text-to-speech, built with Tauri. It sup… | 10 | 19418 | maintenance |
| PocketSphinx PocketSphinx is Carnegie Mellon's lightweight, speaker-independent continuous speech recognition engine, available as a C library, a comman… | 79 | 4350 | active |
| whoiskatrin/sql-translator SQL Translator is a free, open-source web application that converts natural language queries into SQL code and translates SQL back into hum… | 41 | 4328 | active |
| umlx5h/LLPlayer LLPlayer is a Windows media player built for language learning, featuring dual subtitles, AI-generated subtitles via Whisper ASR, real-time… | 76 | 4325 | active |
| facebook/duckling Duckling is a Haskell library that parses natural language text into structured data, extracting entities like dates, times, amounts of mon… | 52 | 4324 | active |
| ymcui/Chinese-LLaMA-Alpaca A project releasing Chinese-adapted LLaMA and instruction-tuned Alpaca large language models with extended Chinese vocabulary, plus pre-tra… | 53 | 18936 | maintenance |
| tmoroney/auto-subs AutoSubs is a local-first desktop application that generates AI subtitles on-device using Whisper, Moonshine, and Parakeet models, with spe… | 96 | 4302 | active |
| ssut/py-googletrans An unofficial free Python library that wraps Google Translate's Ajax API for text translation and language detection. It supports async usa… | 62 | 4284 | active |
| ThilinaRajapakse/simpletransformers Simple Transformers is a Python library built on Hugging Face Transformers that lets users train, fine-tune, and evaluate Transformer model… | 57 | 4256 | active |
| kevin2li/PDF-Guru PDF Guru Anki is a cross-platform desktop and mobile application that combines a comprehensive PDF toolbox with deep Anki integration, conv… | 27 | 4228 | active |
| MaartenGr/KeyBERT KeyBERT is a minimal Python library that extracts keywords and keyphrases from documents using BERT embeddings and cosine similarity. It re… | 64 | 4223 | stable |
| Ziwei Doushu Platform An open-source Zi Wei Dou Shu (Purple Star Astrology) chart calculation engine based on Ni Haixia's Tianji system, written in TypeScript wi… | 61 | 4212 | active |
| echo-loop/Echo-Loop Echo Loop is an open-source Flutter-based English listening and speaking training app that guides learners through a structured listen-to-s… | 81 | 4163 | active |
| Spark NLP Spark NLP is an open-source natural language processing library built natively on Apache Spark, providing scalable NLP annotations and tran… | 98 | 4160 | stable |
| jitwxs/163MusicLyrics A Windows desktop GUI application for fetching and processing song lyrics from NetEase Cloud Music and QQ Music. It supports searching by s… | 68 | 4145 | active |
| hcfyapp/crx-selection-translate Huaci Fanyi (Selection Translate) is a browser extension for Chrome, Edge, and Firefox that translates selected text, full web pages, scree… | 32 | 4140 | active |
| rapidfuzz/RapidFuzz RapidFuzz is a fast fuzzy string matching library for Python and C++ offering many string metrics such as Levenshtein, Jaro-Winkler, and Ha… | 91 | 4138 | stable |
| marcelroed/gigatoken Gigatoken is a Rust-based tokenizer library for language modeling that tokenizes text at GB/s throughput, claiming ~1000x speedups over Hug… | 58 | 4134 | active |
| KKKKhazix/human-writing An agent skill (SKILL.md package) that makes AI-written Chinese prose read like a specific human voice, with rules for fact-checking, parag… | 61 | 4124 | active |
| ericciarla/trendFinder A self-hosted Node.js application that monitors influencer posts on Twitter/X and website changes via Firecrawl, then uses LLMs (Together A… | 22 | 4120 | active |
| apache/tika Apache Tika is a Java toolkit that detects file types and extracts text and metadata from over a thousand file formats (PDF, Office documen… | 77 | 4100 | stable |
| rahulnyk/knowledge_graph A Python/Jupyter Notebook project that converts any text corpus into a knowledge graph by extracting concepts with an LLM and linking co-oc… | 68 | 4087 | active |
| rspeer/python-ftfy ftfy is a Python library that fixes mojibake (encoding mix-ups) and other Unicode text glitches after the fact, recovering original text fr… | 23 | 4065 | stable |
| ginobefun/BestBlogs BestBlogs.dev is an AI-powered personal reading assistant and content curation platform that aggregates articles, podcasts, videos, tweets,… | 64 | 4053 | active |
| yifanfeng97/Hyper-Extract Hyper-Extract is a Python CLI tool that transforms unstructured documents into structured knowledge using LLMs, producing graphs, hypergrap… | 82 | 4051 | active |
| defog-ai/sqlcoder SQLCoder is a family of fine-tuned open-weight LLMs that convert natural language questions into SQL queries, outperforming GPT-4 on text-t… | 29 | 4048 | active |