go-ego/gse

Health v2 · maintenance only

Adoption not part of the score

2844 stars · 233 forks observed · 2026-10-15

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

gse is a Go library for efficient multilingual text segmentation and NLP, implementing jieba-style word segmentation with HMM/Viterbi support. It supports English, Chinese (simplified and traditional), and Japanese, with integrations for Elasticsearch and Bleve.

Use cases

• segment Chinese text into words in Go
• tokenize mixed English and Chinese text for search indexing
• add Chinese word segmentation to Elasticsearch
• perform POS tagging on Chinese text
• cut Japanese text into words
• use HMM Viterbi to segment text without a dictionary
• run a JSON RPC segmentation service

When to choose

• you need fast Chinese/Japanese/English word segmentation in a Go program
• you want jieba-like segmentation without leaving the Go ecosystem
• you need custom dictionaries, POS tagging, or stop-word trimming
• you're building full-text search with Elasticsearch or Bleve over CJK text

When to avoid

• you need full-featured NLP like mature named entity recognition or parsing (still in progress)
• your stack is Python and you can use jieba directly
• you need deep-learning-based tokenization or multilingual transformer models

Facets

library · maturity active

nlp parser search-engine developer-tools go cross-platform text-segmentation chinese jieba hmm trie tokenization word-segmentation japanese elasticsearch bleve natural-language-processing search

Member repositories

For agents

markdown · JSON · MCP: product_card(name="go-ego/gse")