search

hanzhanggit / StackGAN-v2

MIT License
842 stars 190 forks source link

GLU instead of ReLU #4

Open cfunk1210 opened 6 years ago

cfunk1210 commented 6 years ago

Why are you using gated linear units (GLU) instead of the ReLU mentioned in the paper?

Also, why did you define your own GLU instead of using the built-in one? Was there a reason or was it just not implemented yet when you wrote this?

Thanks in advance.

hanzhanggit commented 6 years ago

Yes. It is because that GLU was not implemented when we tried to utilize it.

jppgks commented 6 years ago

@hanzhanggit And what about the choice of GLU over ReLU?