# tatuylonen/wiktextract

Wiktionary dump file parser and multilingual data extractor

Repository: https://github.com/tatuylonen/wiktextract
Canonical: https://ross.abutalabs.com/products/wiktextract
Language: Python
License: NOASSERTION
License Family: other
Topics: wiktionary, wiktionary-parser, multilingual, dictionary, extractor, parser, scribunto, lua, wikitext, templates
Last push: 2026-08-12T08:56:58+00:00

## Health v2 (maintenance only)
Score: 76/100 (v2, computed 2026-09-02T17:46:02.011165+00:00)
- activity 97, release rhythm 35, longevity 100
- inputs: {"age_days": 2865, "days_push": 21, "days_rel": null, "gap_med": null, "n_releases_24m": 0}
- flags: no_releases, no_license
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 1251, forks 115 (observed 2026-08-28T04:04:08.433222+00:00)

## What it is
A Python package and CLI tool that parses Wiktionary XML dump files and extracts structured dictionary data (glosses, translations, pronunciations, inflections) into JSONL format. It expands templates and Lua macros for high extraction quality across many languages.

## Use cases
- extract structured dictionary data from Wiktionary dumps
- build machine translation dictionaries
- get word senses and inflections for NLP
- download multilingual word data as JSONL
- parse wikitext and expand Lua templates from Wiktionary
- create pronunciation and translation datasets for many languages

## When to choose
- you need high-quality structured Wiktionary data with expanded templates and Lua macros
- you want multilingual dictionary data for NLP, machine translation, or language generation
- you need inflection tables, translations, and pronunciations in machine-readable JSONL

## When to avoid
- you only need a simple word list without rich linguistic detail
- you cannot run long extractions (hours to days) and pre-built data from kaikki.org suffices
- you need a dictionary API rather than offline dump processing

## Facets
- artifact type: library
- maturity: active
- function: parser, nlp, data-generation, etl
- domain: machine-learning
- platform: python, cli, cross-platform
- tags: wiktionary, wikitext, dictionary-data, jsonl, lua-templates, linguistics, corpus-extraction, natural-language-processing, dictionaries, data-engineering

## Member repositories
- tatuylonen/wiktextract (main) score 76

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:04:08.433222+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-30T05:07:41.946575+00:00, confidence not recorded.
  - readme: https://github.com/tatuylonen/wiktextract (fetched 2026-08-28T04:04:08.433222+00:00, sha 7b34d1552dd7)
  - registry_pypi: https://pypi.org/pypi/wiktextract/json (fetched 2026-08-29T12:18:39.003723+00:00, sha eb47f99c7525)
- Data as of 2026-08-30T08:39:29.467469+00:00.