andimarafioti/faster-qwen3-tts

Health v2 · maintenance only

Adoption not part of the score

1372 stars · 195 forks observed · 2026-10-07

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A Python library for real-time text-to-speech inference with Qwen3-TTS using manual CUDA graph capture, requiring no Flash Attention, vLLM, or Triton. It supports both streaming and non-streaming generation, with an experimental GGML backend via qwentts.cpp.

Use cases

• generate speech from text in real time on an NVIDIA GPU
• stream TTS audio with low latency
• run Qwen3-TTS without vLLM or Triton
• design voices with an instruct prompt like 'warm, confident narrator'
• run TTS with a quantized GGML backend
• deploy text-to-speech on T4 or Blackwell GPUs

When to choose

• you need fast, real-time Qwen3-TTS inference on NVIDIA hardware
• you want streaming TTS without heavyweight inference stacks
• you want a simple pip-installable TTS library with CLI support

When to avoid

• you have no NVIDIA GPU or an old CUDA driver
• you need CPU-only or non-NVIDIA inference (except experimental GGML)
• you need a production-hardened, long-term-stable TTS solution

Facets

library · maturity active

tts llm-inference audio-processing speech-processing machine-learning python cli text-to-speech cuda-graphs qwen3 streaming real-time nvidia-gpu audio linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="andimarafioti/faster-qwen3-tts")