aboSamoor/polyglot

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

2361 stars · 338 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Polyglot is a Python natural language processing toolkit designed for massive multilingual applications, offering language detection, tokenization, named entity recognition, and other text pipelines across many languages. It is distributed on PyPI under the GPLv3 license.

Use cases

• detect the language of a text snippet
• tokenize text in dozens of languages
• extract named entities from multilingual documents
• run NLP pipelines on non-English corpora
• transliterate text between scripts
• count syllables and analyze morphology in multiple languages

When to choose

• you need NLP support for many languages in one library
• you want lightweight language detection without heavy models
• you need multilingual tokenization or NER in Python

When to avoid

• you need state-of-the-art accuracy on a single language
• you want actively developed tooling with frequent updates
• you need a permissive license (it is GPLv3)
• you prefer transformer-based NLP pipelines

Facets

library · maturity maintenance

nlp parser machine-learning python cross-platform multilingual language-detection tokenization named-entity-recognition morphology text-processing natural-language-processing localization

Member repositories

For agents

markdown · JSON · MCP: product_card(name="aboSamoor/polyglot")