tsb0601 / MMVP

260 stars 7 forks source link

How to evaluate the DFN model? #4

Closed DesertsP closed 5 months ago

DesertsP commented 6 months ago

Where the weights and codes can be found?

tsb0601 commented 5 months ago

Hi,

The weight for DFN can be found in huggingface (for example, https://huggingface.co/apple/DFN2B-CLIP-ViT-L-14). Please use adapt from evaluate_vlm.py to evaluate DFN and other models. We'll also add a script that includes downloading the models weight.