search

HuangJunJie2017 / BEVDet

Code base of the BEVDet series .
Apache License 2.0
1.45k stars 266 forks source link

Question about SyncBNHook #277

Closed woxihuanjiangguo closed 1 year ago

woxihuanjiangguo commented 1 year ago

Thanks for your consistent updates on this repo. I notice that in the update for occ task, there is a SyncBNHook implemented for models with STBase as their backbones. It is described that SyncBNHook can prevent loss divergency. Is there a connection between divergent loss and normal BatchNorm2D? I wonder if you can share with us your opinions on this conversion.

HuangJunJie2017 commented 1 year ago

@woxihuanjiangguo Just empirical setting…… BN is used in both BEVEncoder and Head. The batch size in training STBase is too small to obtain stable statistics.

woxihuanjiangguo commented 1 year ago

i see. thank you anyway.