search

Yushi-Hu / tifa

TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
https://tifa-benchmark.github.io/
Apache License 2.0
138 stars 9 forks source link

what's mplug-large #7

Open gaotaogaotao opened 3 months ago

gaotaogaotao commented 3 months ago

image Hello, when I used the script you provided to test, "loading mplug-large" was displayed, but it failed. What is mplug-large? Is there another way I can solve this problem?

FruitPigFoot commented 3 months ago

https://github.com/X-PLUG/mPLUG?tab=readme-ov-file if it's the model issue, i think you can download the model from that github manually. what's the error code you got

gaotaogaotao commented 3 months ago

https://github.com/X-PLUG/mPLUG?tab=readme-ov-file if it's the model issue, i think you can download the model from that github manually. what's the error code you got The reason for the error is that the model cannot be downloaded. The link you provided shows that there are no models. Is this related to this？

FruitPigFoot commented 3 months ago

image https://github.com/X-PLUG/mPLUG go visit the github and download it manually. But i have a feeling that your issue is about gpu or some kind of memory issue since you mentioned that error occurred while loading. Unless you post logs, i can't really figure it out

gaotaogaotao commented 3 months ago

image https://github.com/X-PLUG/mPLUG go visit the github and download it manually. But i have a feeling that your issue is about gpu or some kind of memory issue since you mentioned that error occurred while loading. Unless you post logs, i can't really figure it out

Thank you so much, thank you for your help

gaotaogaotao commented 3 months ago

image https://github.com/X-PLUG/mPLUG go visit the github and download it manually. But i have a feeling that your issue is about gpu or some kind of memory issue since you mentioned that error occurred while loading. Unless you post logs, i can't really figure it out

The reason for the error is that I am unable to download 'MPLUG Large', as I am unable to download the model due to network issues. So I tried to download the model and put it in the corresponding folder, but I don't know how to configure the name and location of the model?

FruitPigFoot commented 3 months ago

bro... those tifa codes are installed at my desktop which i don't have access to right now. I'll take a look tomorrow

gaotaogaotao commented 3 months ago

bro... those tifa codes are installed at my desktop which i don't have access to right now. I'll take a look tomorrow Thank you very much for your help！

gaotaogaotao commented 3 months ago

bro... those tifa codes are installed at my desktop which i don't have access to right now. I'll take a look tomorrow

Thank you for sharing

FruitPigFoot commented 3 months ago

i checked. I'm on ubuntu so i'll describe on this os. let's say your user name is gaotao. The place for mplug will : /home/gaotao/.cache/modelscope/hub/damo/mplug_visual-question-answering_coco_large_en/ and in this folder, you'll have something like image

since tifa code uses modelscope, i suggest you remove the git cloned tifa and install it again. That would be easier instead of manually downloading and fixing the model loading codes also.

gaotaogaotao commented 3 months ago

i checked. I'm on ubuntu so i'll describe on this os. let's say your user name is gaotao. The place for mplug will : /home/gaotao/.cache/modelscope/hub/damo/mplug_visual-question-answering_coco_large_en/ and in this folder, you'll have something like image

since tifa code uses modelscope, i suggest you remove the git cloned tifa and install it again. That would be easier instead of manually downloading and fixing the model loading codes also.

thank you