search

dmlc / gluon-cv

Gluon CV Toolkit
http://gluon-cv.mxnet.io
Apache License 2.0
5.82k stars 1.21k forks source link

Have you ever tested last_gamma in ResidualBlockV2? #568

Closed PistonY closed 5 years ago

PistonY commented 5 years ago

I found you implement last_gamma in ResidualBlockV2,so I tested it with AttentionNet,but not work for me? And I didn't find any ResidualBlockV2 script in Gluon-CV model_zoo training with last_gamma,Have you ever tested it?

hetong007 commented 5 years ago

Can you specify what does "not work" mean? It breaks your accuracy, or just not helpful? It is expected to be helpful when you are training with large batches.

We haven't tested it on ResNetv2 since it is not used as the backbone for other models in GluonCV yet.

PistonY commented 5 years ago

Ok,when I using it in ResNetV2 block with last gamma ,It’s only got 90% acc finally.So I’m now training just ResNetV2 not AttentionNet.I opened an issue for I don’t know my implement is right or other issus caused the problem, and if you tested it you may give me some advice.