Question regarding the config files

lihong2303 / AGM

[ICCV2023] The repo for "Boosting Multi-modal Model Performance with Adaptive Gradient Modulation".

MIT License

24 stars 4 forks source link

Question regarding the config files #3

Open kkontras opened 1 year ago

kkontras commented 1 year ago

Hi,

This is not an issue but just a question. I wanted to understand if the config to reproduce the results are there, specifically I am questioning for CREMA-D the alpha=1.0, the end_epoch=20 for the modulating and what would the grad_norm_clip=0 mean?

About the grad_norm_clip, I didnt find any usage in the files, do you still clip all your gradients despite that?

Thanks once again!

lihong2303 commented 1 year ago

AGM used parameters for CREMA-D are alpha=1.5, end_epoch=1500. It is a continuous process of modulation.