search

dribnet / pixray

neural image generation
Other
402 stars 53 forks source link

learning_rate has changed #17

Closed summerstay closed 3 years ago

summerstay commented 3 years ago

I was using a colab notebook where I set the learning_rate. But some time in the last month or so the learning rate I had before is now much too small. How has learning_rate changed?

dribnet commented 3 years ago

About a month ago the learning rate and default optimiser was updated when learning_rate_drops was added. I can look up the old settings and we can see if they were working better for you. Both learning rate and optimiser can be overridden with settings.

summerstay commented 3 years ago

Thanks, that makes sense.

dribnet commented 3 years ago

Let me know if you'd like some help dredging up what the old settings were or if you find yourself using a different rate or optimizer as I'm interested in tweaking these settings to something that works well in most cases.