Ksuriuri/index-tts-vllm

Health v2 · maintenance only

Adoption not part of the score

1235 stars · 174 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A reimplementation of IndexTTS's GPT model inference using vLLM, providing significantly faster text-to-speech generation with a web UI and FastAPI-based API server. It supports Index-TTS v1, v1.5, and v2 model weights with OpenAI-compatible API options.

Use cases

• run index-tts with faster inference using vllm
• self-host a text-to-speech api server
• serve tts with high concurrency on a single gpu
• deploy indextts2 with a webui
• speed up gpt-based tts decoding
• expose openai-compatible speech synthesis endpoint

When to choose

• you want much lower RTF and higher concurrency for IndexTTS on an NVIDIA GPU
• you need a self-hosted TTS service with REST or OpenAI-compatible APIs
• you want a ready webui and prepackaged model weights for easy deployment

When to avoid

• you don't have a CUDA-capable NVIDIA GPU
• you need non-IndexTTS TTS models
• you need fully parallel non-GPT pipeline stages - s2mel inference is still serial and slow

Facets

application · maturity active

tts llm-inference http-server gpu-computing speech-processing artificial-intelligence large-language-models python vllm text-to-speech indextts inference-acceleration fastapi voice-cloning webui gpu linux docker

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Ksuriuri/index-tts-vllm")