search

IAHispano / Applio

A simple, high-quality voice conversion tool focused on ease of use and performance
https://applio.org
MIT License
1.82k stars 293 forks source link

DiffGrad Optimizer #737

Closed Bebra777228 closed 2 months ago

Bebra777228 commented 2 months ago

What do you think about the DiffGrad optimizer? Do you think it is better than AdamW?

I heard that it can be a couple of percent more efficient, but I couldn't find it in popular forks.

AznamirWoW commented 2 months ago

What do you think about the DiffGrad optimizer? Do you think it is better than AdamW?

I heard that it can be a couple of percent more efficient, but I couldn't find it in popular forks.

while it works as a drop-in replacement, it does not seem to provide much benefit. Granted I only tried it with 100 epochs and 4 min audio.

Perhaps with some tweaking it may, but good luck with that.