Why not use Dense layer during encoding?

pbaylies / stylegan-encoder

StyleGAN Encoder - converts real images to latent space

Other

740 stars 182 forks source link

Why not use Dense layer during encoding? #34

Closed gsygsy96 closed 4 years ago

gsygsy96 commented 4 years ago

Hi @pbaylies, I'm consufed the reason you don't use Dense layer after Tree Connect, because generally speaking, we won't add ReLU/ELU after the last layer.

pbaylies commented 4 years ago

Hi @mehameha998 - I'm specifically avoiding dense layers here because of the number of weights involved -- (18*512)^2 is a lot of numbers!