davidtvs/pytorch-lr-finder

Health v2 · maintenance only

Adoption not part of the score

1008 stars · 122 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A PyTorch library implementing the learning rate range test from Leslie Smith's cyclical learning rates paper, including the fastai-tweaked variant. It sweeps learning rates during a pre-training run and plots loss versus learning rate to help pick an optimal learning rate.

Use cases

• find the optimal learning rate for training a PyTorch model
• run a learning rate range test before training
• determine start and end learning rates for cyclical learning rate schedules
• plot loss vs learning rate to pick a good static LR
• tune hyperparameters for neural network training

When to choose

• you train PyTorch models and want a principled way to pick a learning rate
• you use cyclical learning rates and need boundary values
• you want a lightweight pip-installable LR finder with optional mixed-precision support

When to avoid

• you use TensorFlow, JAX, or other non-PyTorch frameworks
• you need full hyperparameter search beyond learning rate
• you want an automatic tuner rather than a diagnostic plot

Facets

library · maturity active

machine-learning benchmarking developer-tools deep-learning machine-learning developer-tools python cross-platform pytorch learning-rate-finder lr-range-test hyperparameter-tuning training

Member repositories

For agents

markdown · JSON · MCP: product_card(name="davidtvs/pytorch-lr-finder")