search

Luolc / AdaBound

An optimizer that trains as fast as Adam and as good as SGD.
https://www.luolc.com/publications/adabound/
Apache License 2.0
2.9k stars 330 forks source link

keras version #5

Open fayeshine opened 5 years ago

fayeshine commented 5 years ago

could you please implement a keras version

CyberZHG commented 5 years ago

I've implemented a Keras version which could produce similar results to the official optimizer.

titu1994 commented 5 years ago

There's a keras implementation here - https://github.com/titu1994/keras-adabound

It also provides weights for ResNet 34 on CIFAR. Note, final acc isn't the same as paper because I didn't apply random crop data augmentation (which Keras doesn't support in its ImageDataGenerator).