iperov / DeepFaceLab

DeepFaceLab is the leading software for creating deepfakes.
GNU General Public License v3.0
16.31k stars 8 forks source link

New optimization method from Facebook #5304

Open Jack29913 opened 3 years ago

Jack29913 commented 3 years ago

https://github.com/facebookresearch/madgrad

It looks better than SGD and ADAM. I wonder if it can be implemented to DFL

iperov commented 3 years ago

is it better than Adabelief?

Jack29913 commented 3 years ago

It has been released 4-5 days ago, I haven't seen a direct comparison yet.