WhisperSpeech/WhisperSpeech

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

4639 stars · 275 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

WhisperSpeech is an open-source text-to-speech system built by inverting OpenAI's Whisper model, aiming to be 'Stable Diffusion for speech'. It supports voice cloning, multilingual synthesis, and runs faster than real time on consumer GPUs, with all code and training data properly licensed for commercial use.

Use cases

• generate speech from text with an open-source model
• clone a voice from a short audio sample
• synthesize multilingual or code-switching sentences
• run fast TTS locally on a consumer GPU
• build a commercially safe TTS product without licensing risk
• fine-tune or hack a speech synthesis pipeline

When to choose

• you need open-source, commercially usable TTS with permissive licenses
• you want voice cloning and multilingual support
• you have a GPU and want faster-than-real-time local synthesis
• you want a hackable research-friendly speech model

When to avoid

• you need production TTS with many polished prebuilt voices out of the box
• you have no GPU and need low-latency CPU inference
• you need broad language coverage today (English is the main current release)

Facets

library · maturity active

tts machine-learning deep-learning audio-processing speech-processing artificial-intelligence deep-learning python cross-platform speech-synthesis voice-cloning pytorch whisper open-source-models audio-generation audio gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="WhisperSpeech/WhisperSpeech")