search

XiaLiPKU / EMANet

The code for Expectation-Maximization Attention Networks for Semantic Segmentation (ICCV'2019 Oral)
https://xialipku.github.io/publication/expectation-maximization-attention-networks-for-semantic-segmentation/
GNU General Public License v3.0
680 stars 130 forks source link

About the BN!!! #43

Open zyxu1996 opened 4 years ago

zyxu1996 commented 4 years ago

I add other block to replace EMAU, but get some warning. I guess it's bn_lib you used not suitable for my block.

`2020-07-30 20:05:26,727 - INFO - step: 1 loss: 2.429 lr: 0.009

WARNING batched routines are designed for small sizes. It might be better to use the Native/Hybrid classical routines if you want good performance.

========================================================================================= WARNING batched routines are designed for small sizes. It might be better to use the Native/Hybrid classical routines if you want good performance.

========================================================================================= WARNING batched routines are designed for small sizes. It might be better to use the Native/Hybrid classical routines if you want good performance.

========================================================================================= WARNING batched routines are designed for small sizes. It might be better to use the Native/Hybrid classical routines if you want good performance.

2020-07-30 20:05:29,586 - INFO - step: 2 loss: 2.398 lr: 0.009`

XiaLiPKU commented 4 years ago

Yeap, the BN used in my repo is not the best choice. As we may have no plan to update it, I suggest you replace it with Pytorch's official version of SyncBN