Closed sramshetty closed 2 years ago
Hi, this error is due to the image_size being different from the image_size of your loaded model. You can check the README for details
Hi,
Yeah I was able to get inference working on by correcting my model initialization, thank you though. However, I do have a question regarding the fine tuning of the model. Was the fine-tuning done with the image-hypothesis pair or was the given caption also used? I know in OFA they concatenate the caption and hypothesis but it doesn't look like that is done here, is that correct? I may be misunderstanding but hopefully my question is still clear. Thank you!
Hello, the captions should NOT be used in visual entailment. Here is a table from the CoCa paper.
Awesome, thank you for the prompt response.
Hi,
Thank you for the great work and the fine-tuned models, but I just wanted to ask how I should go about running inference with the fine-tuned model. Currently, I run into this error in my notebook:
I wonder if this is due to how I configure the model or not, is there a specific way I should create the config for inference? Thank you in advance.