search

Lornatang / SRGAN-PyTorch

A simple and complete implementation of super-resolution paper.
Apache License 2.0
410 stars 105 forks source link

The amp #70

Closed Jihnjockey closed 1 year ago

Jihnjockey commented 1 year ago

image image Why do you delete the amp related funcions? Don't you need automatic mixing precision anymore？

Lornatang commented 1 year ago

No， there is a problem of disappearing weights

Jihnjockey commented 1 year ago

Can you elaborate on it？I don‘t understand the "disappearing weights". Thank you very much.

Lornatang commented 1 year ago

Maybe vanishing gradient problem