search

junyanz / CycleGAN

Software that can generate photos from paintings, turn horses into zebras, perform style transfer, and more.
Other
12.23k stars 1.93k forks source link

Sigmoid for lsgan #70

Closed fanpengustc closed 6 years ago

fanpengustc commented 6 years ago

Why sigmoid is not used in Discriminator for lsgan, if that has some special meaning？

junyanz commented 6 years ago

Sigmoid activation is removed in the LSGAN. Otherwise, there might be vanishing gradient issue. See this post for more details.

fanpengustc commented 6 years ago

Thanks for your answer! But in the post, I did not find the sigmoid activation is removed!

junyanz commented 6 years ago

You can find details in the 'LSGAN implementation in Pytorch' section. There is a comment saying # No sigmoid.

fanpengustc commented 6 years ago

Thanks!