Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks" https://arxiv.org/abs/1506.01186 for PyTorch framework
scheduler
clr
optimizer
pytorch
restarts
triangular
adamw
cosine-annealing
cyclical-learning-rate
adamw-optimizer
-
Updated
Jul 14, 2019 - Python