Open Jack29913 opened 3 years ago
https://github.com/facebookresearch/madgrad
It looks better than SGD and ADAM. I wonder if it can be implemented to DFL
is it better than Adabelief?
It has been released 4-5 days ago, I haven't seen a direct comparison yet.
https://github.com/facebookresearch/madgrad
It looks better than SGD and ADAM. I wonder if it can be implemented to DFL