pliang279 / MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
MIT License
462 stars 68 forks source link

Question about relative robustness #31

Open mishimario opened 1 year ago

mishimario commented 1 year ago

Hi I have a question about relative robustness. There is a function of "relative_robustness_helper" in eval_scripts/robustness.py. It may be my misunderstanding, but that function is correct? I think it's necessary to compare with 'LF' result, but it doesn't do it. (I checked the paper and there is some explanation about it but I think it's not same to code)