search

juntang-zhuang / Adabelief-Optimizer

Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"
BSD 2-Clause "Simplified" License
1.05k stars 108 forks source link

MSVAG #47

Closed densechen closed 3 years ago

densechen commented 3 years ago

https://github.com/juntang-zhuang/Adabelief-Optimizer/blob/b0e455142594ab618d3a7cda6857b02950736c7a/PyTorch_Experiments/classification_cifar10/optimizers/MSVAG.py#L103

Should this be bias_correction2 in all MSVAG?

juntang-zhuang commented 3 years ago

Thanks for pointing out, you are correct