segment-any-text/wtpsplit

Health v2 · maintenance only

Adoption not part of the score

1333 stars · 84 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

wtpsplit is a Python toolkit for segmenting text into sentences or other semantic units using the SaT and WtP deep learning models. It provides robust, punctuation-agnostic sentence segmentation across 85 languages with GPU, TPU, and ONNX inference support.

Use cases

• split text into sentences without relying on punctuation
• segment multilingual text into sentences across 85 languages
• preprocess text for NLP pipelines like translation or RAG chunking
• adapt sentence segmentation to a specific domain or writing style
• run fast sentence segmentation on GPU or with ONNX

When to choose

• you need robust sentence segmentation on unpunctuated or noisy text
• you work with many languages and need one universal segmenter
• you need semantic paragraph or section splitting for document chunking
• you want state-of-the-art segmentation performance with GPU/ONNX acceleration

When to avoid

• you only need simple period-based splitting for clean English text and want zero dependencies
• you cannot run a neural model due to compute or latency constraints
• you need tokenization or full parsing rather than sentence segmentation

Facets

library · maturity active

nlp machine-learning parser machine-learning deep-learning python cross-platform sentence-segmentation sentence-boundary-detection pretrained-models onnx multilingual transformers natural-language-processing gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="segment-any-text/wtpsplit")