liaohaofu / adn

ADN: Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction
Other
164 stars 39 forks source link

why use the layernorm in decoder's upscale module? #11

Closed brisyramshere closed 4 years ago

liaohaofu commented 4 years ago

Hi, for the decoder's structure we mostly follow the MUNIT paper which uses LayerNorm to decouple the dependency of batch sizes in BatchNorm layers. With BathNorm, the performance usually drops during inference when the batch size is smaller.