tatuylonen/wiktextract

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1251 stars · 115 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A Python package and CLI tool that parses Wiktionary XML dump files and extracts structured dictionary data (glosses, translations, pronunciations, inflections) into JSONL format. It expands templates and Lua macros for high extraction quality across many languages.

Use cases

• extract structured dictionary data from Wiktionary dumps
• build machine translation dictionaries
• get word senses and inflections for NLP
• download multilingual word data as JSONL
• parse wikitext and expand Lua templates from Wiktionary
• create pronunciation and translation datasets for many languages

When to choose

• you need high-quality structured Wiktionary data with expanded templates and Lua macros
• you want multilingual dictionary data for NLP, machine translation, or language generation
• you need inflection tables, translations, and pronunciations in machine-readable JSONL

When to avoid

• you only need a simple word list without rich linguistic detail
• you cannot run long extractions (hours to days) and pre-built data from kaikki.org suffices
• you need a dictionary API rather than offline dump processing

Facets

library · maturity active

parser nlp data-generation etl machine-learning python cli cross-platform wiktionary wikitext dictionary-data jsonl lua-templates linguistics corpus-extraction natural-language-processing dictionaries data-engineering

Member repositories

For agents

markdown · JSON · MCP: product_card(name="tatuylonen/wiktextract")