search

fyu / drn

Dilated Residual Networks
https://www.vis.xyz/pub/drn
BSD 3-Clause "New" or "Revised" License
1.1k stars 219 forks source link

sync-bn efficiency? #25

Open hszhao opened 6 years ago

hszhao commented 6 years ago

Hi, thanks for your work on sync-bn. 1.I want to know the efficiency comparison between un-sync bn and your implementation of sync-bn?

  1. Btw, has anyone meet program stuck (I meet this at some iterations when 2 gpus are used and at the beginning if 4 gpus are adopted)?