Learning-Rate-Dropout
Pytorch implementation of Learning Rate Dropout.
Paper Link: https://arxiv.org/pdf/1912.00144.pdf
Train ResNet-34 for Cifar10:
run:
python main.py --model=resnet --optim=adam_lrd --lr=0.001 --LRD_p=0.5
python main.py --model=resnet --optim=adam --lr=0.001
python main.py --model=resnet --optim=sgd_lrd --lr=0.1 --LRD_p=0.5
python main.py --model=resnet --optim=sgd --lr=0.1
python main.py --model=resnet --optim=rmsprop_lrd --lr=0.001 --LRD_p=0.5
python main.py --model=resnet --optim=rmsprop --lr=0.001
After training, run "plot.py" to show the learning curves.
19 Jan 25, 2022
123 Dec 30, 2022
13 Oct 12, 2022
53 Nov 15, 2022
1 Jan 13, 2022
65 Dec 20, 2022
87 Nov 22, 2022
26 Nov 30, 2022
1 Nov 10, 2021
5 Sep 23, 2022
8 Dec 07, 2022
95 Dec 29, 2022
27 Dec 23, 2022
4.6k Jan 09, 2023
5 Dec 26, 2022
1 Dec 13, 2021
181 Dec 21, 2022
155 Oct 27, 2022
36 Dec 29, 2022
49 Dec 11, 2022