calculate BN on multi GPUs?

chenyilun95 / tf-cpn

Cascaded Pyramid Network for Multi-Person Pose Estimation (CVPR 2018)

MIT License

793 stars 197 forks source link

calculate BN on multi GPUs? #28

Closed FightForCS closed 6 years ago

FightForCS commented 6 years ago

Hi, thanks for your great work. I have a question on BN calculation. In your code, BN is only calculated on a single GPU. What if I want calculate BN on multi GPUs to make the normalization step more accurate? Since it may help network converge better. Thanks.

chenyilun95 commented 6 years ago

BN is important. I think it should work better. But I don't have a good implementation of multi-gpu BN in tensorflow.

FightForCS commented 6 years ago

Thx