magenta/magenta-realtime

Health v2 · maintenance only

Adoption not part of the score

1739 stars · 192 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Magenta RealTime 2 (MRT2) is an open-weights model for real-time, interactive music generation controllable via text, MIDI, and audio. It ships with a Python inference library (JAX/MLX), a C++ streaming inference engine for Apple Silicon, and example apps including a DAW plugin.

Use cases

• generate music in real time on a MacBook
• build an AI musical instrument controlled by MIDI
• run live music generation inside a DAW
• stream audio faster than playback on Apple Silicon
• run offline music generation on an NVIDIA GPU
• clone sounds and blend styles interactively
• embed a live music model into custom music software

When to choose

• you need low-latency, interactive music generation rather than offline track generation
• you are on Apple Silicon and want on-device inference
• you want open weights you can fine-tune or embed in your own apps
• you want a DAW plugin or standalone app for live performance

When to avoid

• you need real-time streaming on non-Apple hardware (only offline inference is supported there)
• you want text-to-song generation of finished tracks rather than live performance
• you need supervised fine-tuning today (planned but not yet supported)

Facets

library · maturity active

machine-learning audio-processing llm-inference sdk machine-learning developer-tools python cpp music-generation real-time-audio open-weights jax mlx audio-plugin daw generative-music apple-silicon streaming-inference audio real-time macos gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="magenta/magenta-realtime")