search

pliang279 / MultiBench

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
MIT License
478 stars 68 forks source link

Error while testing with avmnist_simple_late_fusion. #5

Closed mrbeann closed 2 years ago

mrbeann commented 2 years ago

Firstly, thank you for this great repo. I try to run examples/multimedia/avmnist_simple_late_fusion.py. The training procedure is all right. But while it runs into the test, it gets the following error.

single_test(encoder, head, test_dataloaders_all[list(test_dataloaders_all.keys())[0]][0], auprc, modalnum, task, criterion)
AttributeError: 'DataLoader' object has no attribute 'keys'

I guess this is due to refactoring do not complete? How can I fix this? Thanks!

lvyiwei1 commented 2 years ago

Thanks for informing us this error! This is indeed due to incomplete refactoring and we are very sorry about that. I have pushed a fix. The code should work now.

mrbeann commented 2 years ago

Thank you for the quick fix. I can run it now. But it seems the robust test is removed. What if I want to use the robust test?