apple/ml-ane-transformers

Health v2 · maintenance only

Flags: no_license

Adoption not part of the score

2736 stars · 93 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A reference PyTorch implementation of the Transformer architecture optimized for Apple's Neural Engine (ANE), including optimized Hugging Face model classes like DistilBERT. It enables deployment of Transformer models on Apple devices (A14+/M1+) with significantly improved latency and memory efficiency via Core ML conversion.

Use cases

• deploy transformers on apple neural engine
• speed up distilbert inference on iphone
• reduce memory usage of transformer models on apple devices
• convert huggingface models to core ml
• optimize on-device nlp inference for ios

When to choose

• deploying transformer models on Apple A14+/M1+ devices
• needing faster and lower-memory on-device inference via Core ML
• optimizing Hugging Face models like DistilBERT for ANE

When to avoid

• targeting non-Apple hardware or GPUs
• training models rather than deploying them
• needing actively updated support for the latest model architectures

Facets

library · maturity maintenance

machine-learning deep-learning llm-inference machine-learning deep-learning apple-ecosystem python apple-neural-engine coreml transformer-optimization pytorch on-device-inference macos ios

Member repositories

For agents

markdown · JSON · MCP: product_card(name="apple/ml-ane-transformers")