errors happened with optimizer

microsoft / DynamicHead

MIT License

624 stars 60 forks source link

errors happened with optimizer #22

Open XiaoyuWant opened 2 years ago

XiaoyuWant commented 2 years ago

I have tried 2 different configs with diferent backbones, but all occurs exception of one thing, that is weight_decay is NoneType in optimizer SGD and ADAMW. It seems the configs of WEIGHT_DECAY is not imported correctly?

hejinsome commented 2 years ago

the same problem

drigoni commented 2 years ago

The problem is due to the missing parameter: WEIGHT_DECAY_BIAS. To fix it, I added that parameter in the config file with the same value as WEIGHT DECAY.