hermitdave/FrequencyWords resource

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1535 stars · 601 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A repository of preprocessed word frequency lists for many languages, generated from OpenSubtitles corpora, plus the C# generator code. Each list maps words to occurrence counts (e.g. en_50k.txt).

Use cases

• get a frequency word list for a language
• build an autocomplete or predictive keyboard
• rank vocabulary words by commonness for language learning
• filter or prioritize tokens in NLP preprocessing
• generate word clouds weighted by real usage

When to choose

• you need ready-made frequency data for many languages
• you want simple word-count lists without heavy NLP tooling
• you need corpus-derived word rankings for input methods or education apps

When to avoid

• you need part-of-speech tags, lemmas, or rich linguistic annotations
• you need up-to-date corpora or domain-specific frequency data
• you need sentence-level or contextual language data

Facets

dataset · maturity maintenance

nlp data-generation data-science cross-platform word-frequency-lists opensubtitles corpus text-processing csharp natural-language-processing localization

Member repositories

For agents

markdown · JSON · MCP: product_card(name="hermitdave/FrequencyWords")