YuanGongND/ast

Health v2 · maintenance only

Flags: no_releases

Adoption not part of the score

1472 stars · 244 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

Official PyTorch implementation of the Audio Spectrogram Transformer (AST) from the Interspeech 2021 paper, which applies a Vision Transformer to audio spectrograms for audio classification. Includes pretrained models and recipes for AudioSet, ESC-50, and Speech Commands datasets.

Use cases

• classify audio clips with a transformer model
• fine-tune a pretrained audio classification model on my own dataset
• run keyword spotting on speech commands
• evaluate on ESC-50 environmental sound classification
• extract audio representations for downstream tasks
• visualize transformer attention over audio spectrograms

When to choose

• you need a strong, well-cited transformer baseline for audio classification
• you want pretrained AudioSet models for transfer learning
• you need reproducible recipes for ESC-50, Speech Commands, or AudioSet

When to avoid

• you need real-time or low-latency audio inference on edge devices
• you want speech recognition or transcription rather than classification
• you need actively maintained code with frequent updates

Facets

library · maturity maintenance

machine-learning audio-processing deep-learning machine-learning deep-learning speech-processing python audio-classification transformer pytorch audio-spectrogram keyword-spotting pretrained-models research-code audio gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="YuanGongND/ast")