magenta/ddsp

Health v2 · maintenance only

Adoption not part of the score

3344 stars · 381 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-29, confidence not recorded

DDSP is a Python library of differentiable digital signal processing components (synthesizers, filters, waveshapers) that can be embedded in deep learning models, particularly as output layers for audio generation. It is developed by Google's Magenta team and powers audio synthesis tasks like timbre transfer and self-supervised pitch detection.

Use cases

• generate audio from neural network outputs
• convert my voice into a violin with timbre transfer
• train an autoencoder model on audio files
• detect pitch in audio in a self-supervised way
• use interpretable DSP elements as differentiable output layers
• synthesize realistic instrument sounds with neural control

When to choose

• you need differentiable DSP components inside a TensorFlow deep learning audio model
• you want interpretable audio generation rather than a black-box neural vocoder
• you are doing music or audio research like timbre transfer or pitch detection

When to avoid

• you need a general-purpose non-differentiable DSP toolkit for production audio processing
• you work in PyTorch or another framework without adaptation effort
• you need real-time low-latency audio synthesis in a DAW or plugin

Facets

library · maturity active

audio-processing machine-learning deep-learning llm-training machine-learning deep-learning artificial-intelligence python cross-platform dsp audio-synthesis music timbre-transfer tensorflow neural-audio synthesizers pitch-detection audio

Member repositories

For agents

markdown · JSON · MCP: product_card(name="magenta/ddsp")