search

BaderLab / saber

Saber is a deep-learning based tool for information extraction in the biomedical domain. Pull requests are welcome! Note: this is a work in progress. Many things are broken, and the codebase is not stable.
https://baderlab.github.io/saber/
MIT License
102 stars 17 forks source link

Try Yogi Optimizer #106

Closed JohnGiorgi closed 5 years ago

JohnGiorgi commented 5 years ago

A new optimizer, Yogi was introduced at NIPS. Authors claim better performance than existing adaptive gradient methods (e.g. RMSProp, Adam, Adadelta).

This has already been implemented in keras-contrib here.

This would be an extremely quick thing to try. If it improves performance we could swap it in for Nadam.