0nutation/SpeechGPT

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1401 stars · 97 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

SpeechGPT is a series of speech large language models that can perceive and generate speech, supporting cross-modal instruction following and speech dialogue. It includes SpeechGPT and SpeechGPT-Gen, along with related components like SpeechTokenizer and the SpeechInstruct dataset.

Use cases

• build a voice chatbot that listens and speaks
• transcribe speech to text with an LLM
• generate natural-sounding speech from text
• research multimodal speech language models
• run speech-to-speech conversation experiments

When to choose

• you need an open speech LLM for research on cross-modal conversation
• you want both speech understanding and generation in one model
• you need a speech tokenizer for speech language model pipelines

When to avoid

• you need a production-grade low-latency voice assistant
• you only need simple ASR or TTS without LLM integration
• you lack GPU resources for large model inference

Facets

library · maturity active

speech-recognition tts llm-inference machine-learning chatbot speech-processing large-language-models artificial-intelligence python speech-llm multimodal speech-generation research speech-tokenizer natural-language-processing gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="0nutation/SpeechGPT")