microsoft/Cream

Health v2 · maintenance only

Adoption not part of the score

1839 stars · 244 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of Microsoft research projects on neural architecture search (NAS) and efficient Vision Transformers, including AutoFormer, TinyViT, EfficientViT, MiniViT, TinyCLIP, and iRPE. It provides reference implementations, pretrained models, and training code for architecture search and ViT compression techniques.

Use cases

• search for efficient vision transformer architectures
• compress vision transformers with knowledge distillation
• train small ViT models with distillation pretraining
• improve relative position encoding in vision transformers
• distill CLIP models into tiny multimodal encoders
• run one-shot neural architecture search for image models

When to choose

• you need reference implementations of published NAS or efficient ViT papers
• you want pretrained tiny/efficient vision transformer checkpoints
• you are researching architecture search or ViT compression

When to avoid

• you need a production-ready model training framework
• you want a maintained general-purpose deep learning library
• you need non-vision or non-transformer NAS tasks

Facets

library · maturity maintenance

machine-learning deep-learning machine-learning computer-vision deep-learning python nas vision-transformer automl knowledge-distillation model-compression research-code gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="microsoft/Cream")