search

megvii-research / NAFNet

The state-of-the-art image restoration model without nonlinear activation functions.
Other
2.08k stars 256 forks source link

Layer Normalization from pytorch #148

Open edmBernard opened 4 weeks ago

edmBernard commented 4 weeks ago

I see that you implement yourself the layer normalization instead of using the LayerNorm available in Pytorch https://pytorch.org/docs/stable/generated/torch.nn.LayerNorm.html

Is there a reason to not use the one from Pytorch ?

Thanks