search

juntang-zhuang / Adabelief-Optimizer

Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"
BSD 2-Clause "Simplified" License
1.04k stars 108 forks source link

Debug prints in ranger-adabelief #4

Closed iiSeymour closed 3 years ago

iiSeymour commented 3 years ago

Hey @juntang-zhuang

I'm just trying out the optimisers and noticed that ranger-adabelief has a couple of debug prints in.

juntang-zhuang commented 3 years ago

Thanks a lot. That part is directly copied from ranger so I did not carefully check that. Will remove it in the update.

iiSeymour commented 3 years ago

Found a couple more in AdaBelief when using {weight_decouple, fixed_decay, rectify, amsgrad}.

JulienMaille commented 3 years ago

It would be nice to have an option to remove the Please check your arguments message

juntang-zhuang commented 3 years ago

@JulienMaille Thanks for suggestion. We'll add it in the next release.