microsoft/SpeechT5

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1449 stars · 135 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Microsoft's unified-modal speech-text pre-training framework implementing SpeechT5 and related models (SpeechLM, SpeechUT, VALL-E X, WavLLM) for speech recognition, synthesis, and translation. It provides research code, pretrained models, and HuggingFace integration for spoken language processing tasks.

Use cases

• convert text to speech with a pretrained tts model
• transcribe speech to text with asr
• translate speech directly to another language
• clone a voice across languages
• pretrain speech and text models jointly
• run speecht5 models from huggingface

When to choose

• you need research-grade pretrained models for ASR, TTS, or speech translation
• you want to reproduce or build on Microsoft's speech-text pre-training papers
• you want HuggingFace-compatible SpeechT5 checkpoints

When to avoid

• you need a production-ready, well-supported TTS/ASR product
• you want simple inference without GPU resources or research setup
• you need actively maintained code with frequent updates

Facets

library · maturity maintenance

speech-recognition tts machine-learning deep-learning transformers speech-processing machine-learning artificial-intelligence python speech-text-pretraining speech-synthesis speech-translation asr research-code huggingface natural-language-processing linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/SpeechT5")