hightman/scws

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

1681 stars · 347 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

SCWS (Simple Chinese Word Segmentation) is a dictionary-based mechanical Chinese word segmentation engine written in pure C, with no external dependencies, supporting GBK and UTF-8 encodings. It ships as a C library (libscws), a command-line tool, and a PHP extension for fast tokenization of Chinese text.

Use cases

• segment Chinese text into words for search indexing
• extract keywords from Chinese documents in PHP
• tokenize Chinese text from the command line
• build a small Chinese full-text search engine
• split Chinese strings into words for NLP preprocessing
• embed a lightweight C segmentation library into an application

When to choose

• you need fast, dependency-free Chinese word segmentation in C or PHP
• you are building a small search engine or keyword extractor for Chinese text
• you want a mature, lightweight tokenizer without heavy ML dependencies

When to avoid

• you need state-of-the-art accuracy on complex modern Chinese text
• you want a pure PHP solution without compiling C extensions
• you need segmentation for languages other than Chinese

Facets

library · maturity maintenance

nlp search-engine parser cli developer-tools windows php cpp c cli chinese-word-segmentation text-segmentation php-extension dictionary-based keyword-extraction full-text-search natural-language-processing search linux macos

Member repositories

For agents

markdown · JSON · MCP: product_card(name="hightman/scws")