function: nlp
1557 products, primary matches first, then adoption-weighted; health v2 shown.
| Product | Health v2 | Stars | Maturity |
|---|---|---|---|
| sxei/pinyinjs A small JavaScript library for converting between Chinese characters and pinyin, supporting output with tones, without tones, or as first l… | 32 | 2760 | maintenance |
| paperswithcode/galai galai is the official Python library for loading and running inference with the GALACTICA general-purpose scientific language models from P… | 23 | 2741 | maintenance |
| tdebatty/java-string-similarity A Java library implementing a dozen string similarity and distance algorithms, including Levenshtein, Damerau-Levenshtein, Jaro-Winkler, Lo… | 23 | 2738 | maintenance |
| smalot/pdfparser A standalone PHP library for parsing PDF files and extracting data such as text, metadata, and page content. It supports compressed PDFs an… | 82 | 2724 | maintenance |
| thisandagain/sentiment A Node.js module that performs sentiment analysis on text using the AFINN-165 wordlist and Emoji Sentiment Ranking. It supports custom lang… | 23 | 2678 | maintenance |
| baidu/Familia Familia is a C++ toolkit for industrial topic modeling, providing document topic inference and semantic matching tools along with pretraine… | 23 | 2644 | maintenance |
| blmoistawinde/HarvestText HarvestText is a Python library for Chinese text mining and preprocessing using unsupervised or weakly supervised methods. It integrates do… | 23 | 2628 | maintenance |
| pickhardt/betty Betty is a Ruby-based command line tool that translates plain English phrases into shell commands, acting like Siri for the terminal. It le… | 23 | 2602 | maintenance |
| baidu/AnyQ AnyQ is Baidu's open-source FAQ-based question answering framework with a configurable, plugin-based architecture covering question analysi… | 32 | 2575 | maintenance |
| OFA-Sys/OFA OFA is a unified sequence-to-sequence pretrained model supporting English and Chinese that unifies cross-modality, vision, and language tas… | 32 | 2557 | maintenance |
| dmlc/gluon-nlp GluonNLP is a Python toolkit built on Apache MXNet that provides text data loading, processing tools, pretrained model zoos, and training u… | 10 | 2540 | maintenance |
| shirosaidev/stocksight stocksight is an open-source Python application that analyzes stock market sentiment using Twitter streams and news headlines, storing data… | 23 | 2530 | maintenance |
| SUSI.AI SUSI.AI is an open-source personal assistant platform whose Java server holds the assistant's 'intelligence', answering chat and voice quer… | 10 | 2521 | maintenance |
| luin/readability A Node.js library that extracts clean, readable article content from any web page, based on arc90's readability project. It returns the art… | 32 | 2519 | maintenance |
| filipedeschamps/video-maker An open-source Node.js project that automates video production by chaining robots that fetch content, analyze text with IBM Watson NLU, and… | 32 | 2500 | maintenance |
| wiseman/py-webrtcvad A Python wrapper around Google's WebRTC Voice Activity Detector, classifying short frames of 16-bit mono PCM audio as speech or non-speech.… | 32 | 2496 | maintenance |
| saffsd/langid.py langid.py is a standalone language identification tool that classifies text into one of 97 pre-trained languages. It works as a Python libr… | 32 | 2462 | maintenance |
| mattpocock/ts-error-translator A VSCode extension by Matt Pocock that translates cryptic TypeScript compiler errors into plain English explanations. It helps developers u… | 23 | 2455 | maintenance |
| alephdata/aleph Aleph is a self-hosted platform for indexing, searching, and browsing large volumes of documents (PDF, Word, HTML) and structured data (CSV… | 70 | 2420 | maintenance |
| CyberZHG/keras-bert A Keras implementation of BERT that can load official Google pre-trained checkpoints for feature extraction and prediction. It includes a t… | 10 | 2419 | maintenance |
| asyml/texar Texar is a modularized Python toolkit for machine learning, especially natural language processing and text generation, built on TensorFlow… | 65 | 2389 | maintenance |
| BrikerMan/Kashgari Kashgari is a Keras/TensorFlow 2-based NLP transfer learning framework for building text labeling (NER, PoS) and text classification models… | 23 | 2381 | maintenance |
| google-research/electra ELECTRA is a research library from Google for self-supervised pre-training of transformer text encoders using a discriminator-based objecti… | 10 | 2367 | maintenance |
| aboSamoor/polyglot Polyglot is a Python natural language processing toolkit designed for massive multilingual applications, offering language detection, token… | 32 | 2361 | maintenance |
| salesforce/decaNLP decaNLP is a PyTorch research framework and benchmark for the Natural Language Decathlon, a multitask NLP challenge spanning ten tasks from… | 10 | 2337 | maintenance |
| Determined22/zh-NER-TF A simple character-based BiLSTM-CRF sequence labeling model for Chinese Named Entity Recognition built with TensorFlow 1.x. It recognizes P… | 32 | 2333 | maintenance |
| lucasjinreal/weibo_terminater A Python-based web scraper that crawls Weibo (Sina's microblog platform) to collect user posts, comments, followers, and conversation pairs… | 32 | 2317 | maintenance |
| approximatelabs/sketch Sketch is an AI code-writing assistant for pandas users that understands the context of your dataframe content to generate relevant suggest… | 32 | 2284 | maintenance |
| jianfch/stable-ts A Python library that modifies OpenAI's Whisper to produce more reliable timestamps, adding transcription, forced alignment, and audio inde… | 10 | 2281 | maintenance |
| rsennrich/subword-nmt A Python library and CLI toolset for unsupervised word segmentation into subword units, best known for byte pair encoding (BPE) used in neu… | 23 | 2274 | maintenance |
| crownpku/Information-Extraction-Chinese A collection of deep learning models for Chinese information extraction, including named entity recognition with IDCNN or biLSTM+CRF and re… | 32 | 2264 | maintenance |
| TigerResearch/TigerBot TigerBot is a multi-language, multi-task large language model project from TigerResearch, providing pretrained and chat-tuned model weights… | 29 | 2259 | maintenance |
| namisan/mt-dnn A PyTorch library implementing Multi-Task Deep Neural Networks (MT-DNN) for natural language understanding, based on Microsoft research pap… | 32 | 2257 | maintenance |
| chartbeat-labs/textacy textacy is a Python NLP library built on spaCy that handles tasks before and after spaCy's core pipeline, such as text cleaning, informatio… | 23 | 2239 | maintenance |
| microsoft/DeBERTa Official implementation of DeBERTa and DeBERTa V3, transformer-based language models with disentangled attention and decoding-enhanced BERT… | 23 | 2239 | maintenance |
| lonePatient/BERT-NER-Pytorch A PyTorch library for Chinese Named Entity Recognition using BERT-based models with Softmax, CRF, and Span decoding heads. It also supports… | 32 | 2235 | maintenance |
| Turing-Project/AntiFraudChatBot A prompt-based Chinese conversational AI framework that connects a fine-tuned large language model (YUAN-1.0) to WeChat via the wechaty fra… | 22 | 2220 | maintenance |
| ProsusAI/finBERT FinBERT is a pre-trained BERT language model further trained on financial text and fine-tuned for financial sentiment classification. It is… | 32 | 2217 | maintenance |
| plurals/pluralize A small JavaScript library that pluralizes or singularizes English words based on a count, using an ordered list of predefined rules. It su… | 23 | 2213 | maintenance |
| galaxykate/tracery Tracery is a JavaScript story-grammar generation library that expands grammar objects into generative text. You define rules with symbols a… | 32 | 2208 | maintenance |
| epfLLM/meditron Meditron is a suite of open-source medical large language models (7B and 70B) adapted from Llama-2 via continued pretraining on a curated m… | 27 | 2208 | maintenance |
| allenai/longformer Longformer is a pretrained transformer model family (including the LongformerEncoderDecoder/LED variant) that processes long documents up t… | 23 | 2205 | maintenance |
| google-research/uda Google Research's reference implementation of Unsupervised Data Augmentation (UDA), a semi-supervised learning method that uses advanced da… | 10 | 2205 | maintenance |
| dmis-lab/biobert BioBERT is a pre-trained biomedical language representation model (based on BERT) with code for fine-tuning it on biomedical text mining ta… | 32 | 2204 | maintenance |
| alibaba/EasyNLP EasyNLP is a comprehensive PyTorch-based NLP toolkit from Alibaba that provides training, inference, and deployment for pre-trained languag… | 23 | 2184 | maintenance |
| symfony/inflector A Symfony component that converts English words between their singular and plural forms. It has been deprecated since Symfony 5.1 in favor … | 10 | 2172 | maintenance |
| ageitgey/node-unfluff A Node.js library and CLI tool that automatically extracts the main body content and metadata (title, author, date, images, tags, links) fr… | 32 | 2158 | maintenance |
| songyouwei/ABSA-PyTorch PyTorch implementations of aspect-based sentiment analysis (ABSA) models, including attention-based and BERT-based approaches for aspect-te… | 10 | 2114 | maintenance |
| facebookresearch/SentEval SentEval is a Python library from Facebook Research for evaluating the quality of sentence embeddings via a suite of downstream transfer ta… | 10 | 2110 | maintenance |
| observerss/textfilter A small Python library implementing several sensitive-word filtering algorithms (including DFA) bundled with a ~10k-word sensitive word lis… | 32 | 2108 | maintenance |
| asappresearch/sru SRU is a PyTorch library implementing the Simple Recurrent Unit, a highly parallelizable RNN that runs 10-16x faster than cuDNN LSTM with c… | 23 | 2106 | maintenance |
| jalammar/ecco Ecco is a Python library for exploring and explaining Transformer-based NLP language models through interactive visualizations inside Jupyt… | 23 | 2102 | maintenance |
| thunlp/THULAC-Python THULAC is a Chinese lexical analysis toolkit from Tsinghua University's NLP lab that performs Chinese word segmentation and part-of-speech … | 32 | 2085 | maintenance |
| THUDM/P-tuning-v2 P-tuning v2 is a Python implementation of deep prompt tuning, applying trainable continuous prompts at every transformer layer so prompt tu… | 32 | 2078 | maintenance |
| UniversalDataTool/universal-data-tool Universal Data Tool is a web and desktop application for collaboratively annotating images, text, audio, and documents, supporting tasks li… | 28 | 2072 | maintenance |
| koth/kcws A deep learning Chinese word segmentation toolkit implemented in C++ with TensorFlow, supporting BiLSTM+CRF and IDCNN+CRF models, plus part… | 23 | 2069 | maintenance |
| weixsong/elasticlunr.js Elasticlunr.js is a lightweight full-text search engine library written in JavaScript, forked from Lunr.js with added flexibility. It suppo… | 32 | 2066 | maintenance |
| marcotcr/checklist CheckList is a Python library for behavioral testing of NLP models, implementing the ACL 2020 paper 'Beyond Accuracy: Behavioral Testing of… | 32 | 2050 | maintenance |
| amazon-science/auto-cot Official implementation of Auto-CoT (ICLR 2023), a method that automatically constructs chain-of-thought demonstrations for large language … | 32 | 2046 | maintenance |
| alibaba/AliceMind AliceMind is Alibaba's collection of pre-trained encoder-decoder language models and related NLP techniques, including StructBERT, PALM, VE… | 23 | 2041 | maintenance |
| xlang-ai/instructor-embedding INSTRUCTOR is an instruction-finetuned text embedding model and Python library that generates task-tailored embeddings by simply providing … | 32 | 2023 | maintenance |
| baidu/Senta Senta is Baidu's open-source sentiment analysis system built on the SKEP (Sentiment Knowledge Enhanced Pre-training) model. It provides pre… | 32 | 2015 | maintenance |
| hila-chefer/Transformer-Explainability Official PyTorch implementation of the CVPR 2021 paper 'Transformer Interpretability Beyond Attention Visualization', providing relevance-b… | 32 | 2014 | maintenance |
| salesforce/awd-lstm-lm A PyTorch toolkit for training LSTM and QRNN language models, implementing Salesforce Research's AWD-LSTM papers. It supports word-level an… | 10 | 1989 | maintenance |
| HazyResearch/deepdive DeepDive is a Stanford-developed system for extracting structured data from unstructured sources and building knowledge bases using distant… | 23 | 1979 | maintenance |
| MojoJolo/textteaser TextTeaser is an automatic text summarization algorithm written in Scala that combines natural language processing and machine learning to … | 32 | 1967 | maintenance |
| guillaumegenthial/sequence_tagging A TensorFlow implementation of a Bi-LSTM + CRF model with character embeddings for named entity recognition and sequence tagging. It trains… | 32 | 1952 | maintenance |
| ysc/QuestionAnsweringSystem A Java implementation of an open-domain question answering system inspired by IBM Watson, which analyzes questions and returns ranked candi… | 32 | 1946 | maintenance |
| psal/anonymouth Anonymouth is a Java-based desktop application that helps users anonymize documents by detecting and suggesting edits to stylometric patter… | 32 | 1943 | maintenance |
| julius-speech/julius Julius is an open-source large vocabulary continuous speech recognition (LVCSR) decoder written in C, based on word N-gram language models … | 35 | 1933 | maintenance |
| google/sling SLING is a natural language frame semantics parser that annotates text with frame semantic graph representations using bi-directional LSTMs… | 10 | 1930 | maintenance |
| Tencent/NeuralNLP-NeuralClassifier NeuralClassifier is a PyTorch-based open-source toolkit for neural text classification, with a focus on hierarchical multi-label classifica… | 56 | 1922 | maintenance |
| PandaOCR PandaOCR is a free Windows desktop OCR tool that captures screen regions and recognizes text using many cloud OCR engines (Sogou, Tencent, … | 80 | 1918 | maintenance |
| appvision-ai/fast-bert Fast-Bert is a Python deep learning library for training and deploying BERT, RoBERTa, and XLNet based models for NLP tasks, starting with m… | 23 | 1917 | maintenance |
| Tiiiger/bert_score BERTScore is a PyTorch implementation of the BERTScore automatic evaluation metric for text generation, which scores generated text against… | 23 | 1916 | maintenance |
| Mimino666/langdetect A Python port of Google's language-detection library that identifies the language of text, supporting 55 languages via ISO 639-1 codes. It … | 27 | 1901 | maintenance |
| jiesutd/NCRFpp NCRF++ is a PyTorch-based toolkit for neural sequence labeling tasks such as NER, POS tagging, and word segmentation. Model architectures c… | 32 | 1899 | maintenance |
| mourner/bullshit.js Bullshit.js is a JavaScript bookmarklet that translates corporate marketing jargon into plain, human-readable text on any web page. It runs… | 51 | 1898 | maintenance |
| microsoft/BlingFire Bling Fire is a fast finite state machine and regular expression manipulation library from Microsoft, primarily used for high-performance n… | 23 | 1890 | maintenance |
| scrapy/scrapely Scrapely is a pure-Python library for extracting structured data from HTML pages. It learns a parser from example pages annotated with the … | 32 | 1883 | maintenance |
| nlplab/brat brat is a web-based collaborative text annotation tool for creating text-bound and relational annotations, originally built for NLP and Bio… | 32 | 1879 | maintenance |
| salesforce/ctrl CTRL is a 1.63 billion-parameter conditional Transformer language model from Salesforce that generates text controllable via control codes … | 10 | 1879 | maintenance |
| clue-ai/ChatYuan ChatYuan is an open-source bilingual (Chinese and English) dialogue large language model in ChatGPT style, with a lightweight variant runna… | 31 | 1863 | maintenance |
| ANYbotics/elevation_mapping A ROS package for robot-centric elevation mapping of rough terrain, built for mobile and legged robots equipped with pose estimation and di… | 32 | 1857 | maintenance |
| nlpodyssey/spago Spago is a self-contained machine learning and NLP library written in pure Go, featuring an asynchronous computation graph with automatic d… | 29 | 1850 | maintenance |
| minimaxir/aitextgen aitextgen is a Python library for training and generating text with GPT-2 and GPT Neo models, built on PyTorch, Hugging Face Transformers, … | 23 | 1838 | maintenance |
| anthropics/jacobian-lens A Python library implementing the Jacobian lens, an interpretability technique that linearly transports residual-stream activations at any … | 56 | 1836 | maintenance |
| huichen/sego sego is a Go library for Chinese word segmentation using a double-array trie dictionary and a shortest-path-plus-dynamic-programming algori… | 32 | 1826 | maintenance |
| ysc/word A Java distributed Chinese word segmentation library offering multiple dictionary-based segmentation algorithms with ngram-based disambigua… | 32 | 1818 | maintenance |
| WASasquatch/was-node-suite-comfyui An extensive custom node suite for ComfyUI with over 210 nodes covering image processing, masking, text processing, animation, and AI-assis… | 41 | 1816 | maintenance |
| maoruibin/TranslateApp An Android app called GuDong Translate that provides instant 'copy-to-translate' functionality: it monitors the clipboard and shows transla… | 10 | 1814 | maintenance |
| yongzhuo/Keras-TextClassification A Keras-based library for Chinese text classification supporting long/short text, multi-label classification, and sentence pair similarity.… | 23 | 1808 | maintenance |
| Trusted-AI/AIX360 AI Explainability 360 is an open-source Python library from IBM Research offering a comprehensive set of algorithms for interpreting and ex… | 66 | 1796 | maintenance |
| DQinYuan/chinese_province_city_area_mapper A Python library (pip package 'cpca') that extracts province, city, and district names from simplified Chinese address strings and maps the… | 32 | 1796 | maintenance |
| bazingagin/npc_gzip A Python library and research codebase implementing the parameter-free 'kNN-gzip' text classification method from the ACL 2023 paper, which… | 20 | 1780 | maintenance |
| ttengwang/Caption-Anything Caption-Anything combines Segment Anything image segmentation, visual captioning, and ChatGPT to generate tailored captions for any object … | 30 | 1777 | maintenance |
| impira/docquery DocQuery is a Python library and CLI tool that uses large language models to answer questions about semi-structured and unstructured docume… | 32 | 1775 | maintenance |
| salesforce/ALBEF Official PyTorch implementation of ALBEF, a vision-and-language pre-training method that aligns image and text representations before fusin… | 10 | 1755 | maintenance |
| deepset-ai/FARM FARM is a Python framework for fine-tuning and evaluating transformer-based language models for NLP tasks, with a focus on question answeri… | 10 | 1752 | maintenance |
| dav/word2vec The original Google word2vec tool, hosted on GitHub with community patches for Mac OS X compilation and memory fixes. It efficiently trains… | 32 | 1741 | maintenance |