Problem of Replacement of "BatchNorm" to "GroupNorm"

Res2Net / Res2Net-PretrainedModels

(ImageNet pretrained models) The official pytorch implemention of the TPAMI paper "Res2Net: A New Multi-scale Backbone Architecture"

https://mmcheng.net/res2net/

1.07k stars 215 forks source link

Problem of Replacement of "BatchNorm" to "GroupNorm" #74

Open CinKKKyo opened 1 year ago

CinKKKyo commented 1 year ago

Hi, Dr. Gao, I have a question about model modification. Due to my work setting, I could only set batch_size=1, so I am going to modify the BatchNorm to GroupNorm. Based on the original code, I just changed BatchNorm to GroupNorm directly and set the group=8, actually, it doesn't work, do you have any advice for this replacement?