libffcv/ffcv

Health v2 · maintenance only

Adoption not part of the score

2993 stars · 181 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

FFCV is a fast data loading system for PyTorch that dramatically increases data throughput in model training by replacing standard data loaders with an optimized binary format and asynchronous pipeline. It enables training models like ImageNet in minutes on a single GPU with drop-in loader replacement.

Use cases

• speed up pytorch model training data loading
• train imagenet fast on one gpu
• convert dataset to fast binary format for training
• replace torchvision dataloader with faster alternative
• accelerate image augmentation pipeline on gpu
• train cifar-10 in under a minute
• reduce cloud cost of model training

When to choose

• training vision models where data loading is the bottleneck
• large image datasets with repeated training epochs
• cost-sensitive GPU training on a single machine

When to avoid

• non-image or streaming datasets with complex formats
• Windows or macOS-first workflows (Linux is best supported)
• projects needing frequent dataset mutation after conversion

Facets

library · maturity maintenance

machine-learning data-science etl image-processing machine-learning computer-vision deep-learning python cross-platform pytorch data-loading dataloader image-decoding training-acceleration gpu-training data-engineering linux gpu

Member repositories

For agents

markdown · JSON · MCP: product_card(name="libffcv/ffcv")