GeWu-Lab / OGM-GE_CVPR2022

The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
MIT License
218 stars 18 forks source link

Have you try OGM on image-text datasets? #18

Open popo1518 opened 1 year ago

popo1518 commented 1 year ago

Have you try OGM on image-text datasets? Maybe that's more popular datasets.

echo0409 commented 1 year ago

Hi,

Thanks for your question. We pay more attention to audio-visual modalities and did not conduct OGM on image-text datasets in the current version. But it is quite worth having a try.