search

GeWu-Lab / OGM-GE_CVPR2022

The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
MIT License
236 stars 18 forks source link

about “imbalance phenomenon” #17

Open Wbojiao opened 2 years ago

Wbojiao commented 2 years ago

论文中的不平衡现象（imbalance phenomenon）在实验过程中的表现是否就是Audio Acc， Visual Acc的数值差异

echo0409 commented 2 years ago

Hi,

Thanks for your question. In the experiment, we use the uni-modal performance to evaluate the quality of uni-modal encoder, and you are right.