some question about init_weights

whai362 / PVT

Official implementation of PVT series

Apache License 2.0

1.71k stars 245 forks source link

some question about init_weights #70

Open Yangr116 opened 3 years ago

Yangr116 commented 3 years ago

Hello, thanks for your best work!

I would like to know why you use the function "_init_weights" in all class, including 'MLP, Attention'? Maybe, one init_weights function is enough in the 'class PyramidVisionTransformerV2(nn.Module)'.

Is it will get a better initialization?