Separius/awesome-fast-attention resource

Health v2 · maintenance only

Flags: no_releases archived

Adoption not part of the score

1024 stars · 106 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A curated awesome-list of efficient attention modules for transformer models, cataloguing papers, implementations, computational complexity, and autoregressive support. It serves as a reference index linking to projects like Reformer, Longformer, Linformer, and other linear-complexity attention variants.

Use cases

• find efficient attention implementations for long sequences
• compare complexity of transformer attention variants
• research alternatives to standard self-attention
• find longformer or linformer style implementations
• survey efficient attention papers for a literature review
• pick an attention module for a transformer project

When to choose

• you need a quick index of efficient attention papers and their code
• you are researching sub-quadratic attention mechanisms
• you want to compare computational complexity across attention variants

When to avoid

• you need a maintained, production-ready attention library
• you need up-to-date coverage of recent attention research (list last updated 2021)
• you want runnable code rather than links to other repositories

Facets

learning-resource · maturity maintenance

machine-learning developer-tools deep-learning machine-learning python awesome-list attention transformer efficient-attention self-attention long-context curated-list natural-language-processing

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Separius/awesome-fast-attention")