BytedanceSpeech/seed-tts-eval resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1595 stars · 147 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

An objective evaluation test set and metric scripts from ByteDance's seed-TTS project for benchmarking zero-shot text-to-speech and voice conversion. It includes English and Mandarin test samples plus code for computing word error rate (WER) and speaker similarity (SIM).

Use cases

• evaluate zero-shot TTS models on English and Mandarin
• compute WER for synthesized speech with Whisper and Paraformer
• measure speaker similarity of generated audio with WavLM embeddings
• benchmark voice conversion quality
• compare TTS systems on hard-case Mandarin samples

When to choose

• you need a standard objective benchmark for zero-shot TTS or VC models
• you want reproducible WER and SIM evaluation scripts
• you are evaluating multilingual (EN/ZH) speech generation

When to avoid

• you want the seed-TTS model itself, which is not released
• you need perceptual or MOS-style subjective evaluation
• you need languages other than English and Mandarin

Facets

dataset · maturity stable

speech-recognition benchmarking audio-processing speech-processing machine-learning artificial-intelligence python cli tts-evaluation zero-shot-tts voice-conversion wer speaker-similarity test-set

Member repositories

For agents

markdown · JSON · MCP: product_card(name="BytedanceSpeech/seed-tts-eval")