search

facebookresearch / video-nonlocal-net

Non-local Neural Networks for Video Classification
Other
1.97k stars 325 forks source link

Nonlocal block initialization #38

Open zhujiagang opened 6 years ago

zhujiagang commented 6 years ago

As said in your paper, the nonlocal block is initialized as zero weights, while with its shortcut connection, it will not influence the original network. But in your implementation, nonlocal block is initialized just the same as normal conv, as shown in code __C.NONLOCAL.USE_ZERO_INIT_CONV = False __C.NONLOCAL.CONV_INIT_STD = 0.01 Is there any difference in performance between these two implementations?

raywzy commented 5 years ago

@zhujiagang Hi, have you figured out the reason?

zhujiagang commented 5 years ago

@raywzy No, I just skip it.