# go-ego/gse

Go efficient multilingual NLP and text segmentation; support English, Chinese, Japanese and others.

Repository: https://github.com/go-ego/gse
Canonical: https://ross.abutalabs.com/products/gse
Language: Go
License: Apache-2.0
License Family: permissive
Topics: go, segment, nlp, gse, hmm, jieba, hmm-viterbi-algorithm, trie, chinese, english, japanese
Last push: 2026-06-10T19:54:00+00:00

## Health v2 (maintenance only)
Score: 80/100 (v2, computed 2026-09-03T02:20:16.233290+00:00)
- activity 86, release rhythm 62, longevity 100
- inputs: {"age_days": 3358, "days_push": 84, "days_rel": 174, "gap_med": 48.0, "n_releases_24m": 3}
- flags: none
- formula: round(0.45*activity + 0.35*rhythm + 0.20*longevity); archived -> min(score, 10)

## Adoption (not part of the score)
Stars 2841, forks 232 (observed 2026-08-28T04:07:24.756132+00:00)

## What it is
gse is a Go library for efficient multilingual text segmentation and NLP, implementing jieba-style word segmentation with HMM/Viterbi support. It supports English, Chinese (simplified and traditional), and Japanese, with integrations for Elasticsearch and Bleve.

## Use cases
- segment Chinese text into words in Go
- tokenize mixed English and Chinese text for search indexing
- add Chinese word segmentation to Elasticsearch
- perform POS tagging on Chinese text
- cut Japanese text into words
- use HMM Viterbi to segment text without a dictionary
- run a JSON RPC segmentation service

## When to choose
- you need fast Chinese/Japanese/English word segmentation in a Go program
- you want jieba-like segmentation without leaving the Go ecosystem
- you need custom dictionaries, POS tagging, or stop-word trimming
- you're building full-text search with Elasticsearch or Bleve over CJK text

## When to avoid
- you need full-featured NLP like mature named entity recognition or parsing (still in progress)
- your stack is Python and you can use jieba directly
- you need deep-learning-based tokenization or multilingual transformer models

## Facets
- artifact type: library
- maturity: active
- function: nlp, parser, search-engine
- domain: developer-tools
- platform: go, cross-platform
- tags: text-segmentation, chinese, jieba, hmm, trie, tokenization, word-segmentation, japanese, elasticsearch, bleve, natural-language-processing, search

## Member repositories
- go-ego/gse (main) score 80

## Provenance
- Observed fields: from GitHub, fetched 2026-08-28T04:07:24.756132+00:00.
- Health v2: computed from the inputs above; adoption is never an input.
- Inferred fields (summary, facets, guidance): AI-extracted, prompt v1, taxonomy v1, on 2026-08-29T18:48:32.712661+00:00, confidence not recorded.
  - readme: https://github.com/go-ego/gse (fetched 2026-08-28T04:07:24.756132+00:00, sha 421bd13fc857)
- Data as of 2026-08-30T08:39:29.467469+00:00.
