om-ai-lab / VL-CheckList

Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations. [EMNLP 2022]
126 stars 4 forks source link

Running test with other models #7

Closed alfassy closed 1 year ago

alfassy commented 2 years ago

Hi! Thank you for publishing this great work. I was able to run test with your Vilt model, is it possible to run test with other models such TCL and the rest? their checkpoints are different so it's not clear to me if the code should support it or not. Thank you and have a great week, Amit

kyusonglee commented 1 year ago

I'm glad to hear you were able to test the ViLT model successfully. Regarding testing other models, such as TCL, you can use the "albef example" provided in the code. This should allow you to run TCL.