rspeer/python-ftfy

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

4060 stars · 127 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

ftfy is a Python library that fixes mojibake (encoding mix-ups) and other Unicode text glitches after the fact, recovering original text from mis-decoded UTF-8. It also provides a command-line interface for fixing text files.

Use cases

• fix mojibake in scraped text
• clean up garbled unicode characters in a dataset
• repair text that was decoded with the wrong encoding
• fix broken utf-8 strings in python
• clean text before training a language model
• undo double-encoded unicode

When to choose

• you have text with visible mojibake like '✔' or 'é' that needs repair
• you're cleaning web-scraped or user-submitted text for NLP pipelines
• you want a well-tested, heuristic-based fixer rather than writing encoding hacks yourself

When to avoid

• you need general encoding detection for unknown files rather than fixing known mojibake
• you need to normalize or transliterate text rather than repair encoding errors
• you're not working in Python and can't use the CLI

Facets

library · maturity stable

nlp parser developer-tools developer-tools text-editors python cli cross-platform unicode mojibake text-cleaning encoding-fixes data-cleaning natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="rspeer/python-ftfy")