search

whai362 / PVT

Official implementation of PVT series
Apache License 2.0
1.74k stars 246 forks source link

some question about init_weights #70

Open Yangr116 opened 3 years ago

Yangr116 commented 3 years ago

Hello, thanks for your best work!

I would like to know why you use the function "_init_weights" in all class, including 'MLP, Attention'? Maybe, one init_weights function is enough in the 'class PyramidVisionTransformerV2(nn.Module)'.

Is it will get a better initialization?