-
This new NeurIPS 2020 optimizer looks interesting: https://www.reddit.com/r/MachineLearning/comments/jc1fp2/r_neurips_2020_spotlight_adabelief_optimizer/
The code is already pip installable, so and…
-
Hi,
There is an obvious question, i think it would be nice to address it in the final presentation, paper, etc.
In the "A quick look at the algorithm",
The "belief" part of Adabelief comes from …
-
Hi @juntang-zhuang , super excited to try the new improvements.
I saw that you did not updated the ranger version. Do you plan to add the improvements there too?
-
Hi~
https://github.com/juntang-zhuang/Adabelief-Optimizer/issues/18#issue-729329117
Since I asked you question last time, I've done a series of experiments. I think both methods of determining the …
-
When I tried the optimizer with tensorflow cycle GAN, it takes lot of time to complete one step. Is it a problem regarding the use of gpu or framework, or with the optimizer itself?
Thanks in Advan…
-
Hi
I have a question.
In "A quick look at the algorithm" in README.md, eps is added to shat_t.
But in the code, eps is added to s_t(exp_avg_var) instead of shat_t.
Also only the code for py…
-
Ich bin mir nicht sicher was genau das Problem ist aber ich vermute es liegt an editdistance und python-levenshtein. Ich habe sie schon separat mit `conda install -c conda-forge editdistance` und `con…
-
Hello,
congratulations on being accepted to NeurIPS and thank you for sharing the code.
I'm enjoying playing with this code.
I found that the arXiv paper has been updated from v1 to v2.
In v2,…
-
Hi just a question is this optimizer compatible with Mixed precision training or AMP. I tried to use in in combination with lucidrains' lightweight-gan implementation which uses the PyTorch version of…
-
How about a Matlab test case?
I tried to implement a Matlab version of AdaBelief and compare it with SGD with momentum at
https://github.com/pcwhy/AdaBelief-Matlab
I found that sometimes AdaBelie…
pcwhy updated
4 years ago