Lyken17/Efficient-PyTorch resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1103 stars · 136 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of best practices and example code for efficiently training large datasets like ImageNet with PyTorch. It demonstrates techniques such as packing small JPEGs into LMDB to eliminate disk I/O bottlenecks, achieving ~730 images/second training ResNet-50.

Use cases

• speed up pytorch training on large image datasets
• avoid disk io bottleneck when training imagenet
• convert image folders to lmdb for faster data loading
• benchmark pytorch resnet-50 training throughput
• learn best practices for efficient pytorch data pipelines

When to choose

• you train large-scale image classification models in PyTorch and hit data loading bottlenecks
• you want reference code for LMDB-based data pipelines and mixed-precision training tips

When to avoid

• you need a maintained library with an API rather than example code
• your project uses TensorFlow, JAX, or non-image modalities
• you need a permissively licensed dependency, since the repo has no license

Facets

learning-resource · maturity maintenance

machine-learning benchmarking etl deep-learning machine-learning developer-tools python pytorch training-pipeline data-loading lmdb performance-optimization imagenet best-practices data-engineering gpu linux

Member repositories

For agents

markdown · JSON · MCP: product_card(name="Lyken17/Efficient-PyTorch")