soniqo/speech-swift

Health v2 · maintenance only

Adoption not part of the score

1161 stars · 158 forks observed · 2026-09-03

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

An open-source Swift toolkit for on-device speech AI on Apple Silicon, providing ASR, TTS, speech-to-speech, VAD, and speaker diarization via MLX (Metal GPU) and CoreML (Neural Engine). It ships as a Swift package with modular components, plus a Homebrew CLI and an OpenAI-compatible HTTP/WebSocket server, all running fully offline.

Use cases

• transcribe audio to text locally on a Mac
• generate speech from text on-device
• build a privacy-preserving voice agent with VAD, STT, LLM, and TTS
• run speaker diarization on meeting recordings
• clone a voice and synthesize speech offline
• add dictation to an iOS app without cloud APIs
• serve local speech AI through an OpenAI-compatible realtime endpoint

When to choose

• you need fully offline, private speech AI on Apple Silicon Macs or iOS
• you want a native Swift async/await API instead of C++ bridges
• you need low-latency realtime transcription or full-duplex speech-to-speech
• you want to avoid cloud API costs and per-minute pricing

When to avoid

• you need to run on non-Apple hardware (Android/Windows/Linux support is via separate SDKs, not this Swift package)
• you target macOS below 15 or iOS below 18
• you need MLX-based models on iOS, which are macOS-only
• your project is not in the Swift/Apple ecosystem

Facets

library · maturity active

speech-recognition tts audio-processing machine-learning llm-inference cli http-server websocket speech-processing machine-learning artificial-intelligence apple-ecosystem mobile-development developer-tools cli on-device apple-silicon mlx coreml voice-activity-detection speaker-diarization voice-cloning offline-inference voice-agents speech-to-speech openai-compatible-api macos ios swift apple-ecosystem

Member repositories

For agents

markdown · JSON · MCP: product_card(name="soniqo/speech-swift")