cyclical-learning-rate

Here are 5 public repositories matching this topic...

Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks" https://arxiv.org/abs/1506.01186 for PyTorch framework

scheduler clr optimizer pytorch restarts triangular adamw cosine-annealing cyclical-learning-rate adamw-optimizer

Super-convergence implementation on TensorFlow Slim

SGLD and cSGLD as a PyTorch Optimizer

python pytorch cyclical-learning-rate sgld pytorch-optimizers csgld

Experiments on the paper Super-Convergence

Provide a collection of flexible learning rate schedulers for PyTorch with presets, warmup wrappers, and research-based implementations.

To associate your repository with the cyclical-learning-rate topic, visit your repo's landing page and select "manage topics."