search

yonatanbitton / wysiwyr

Apache License 2.0
32 stars 0 forks source link

blip2_pretrain_flant5xl_highres.yaml missing. #8

Open nicholscrawford opened 1 year ago

nicholscrawford commented 1 year ago

Hi, I'm trying to replicate the VNLI results. When running itm_vqa_blip2_train.py it's expecting a model config file for blip2, which isn't included in the repository. Is that available somewhere?

FileNotFoundError: [Errno 2] No such file or directory: 
'/home/nicholscrawfordtaylor/code/wysiwyr/blip2_pretrain_flant5xl_highres.yaml'
yonatanbitton commented 1 year ago

Thanks for your interest. We do plan to publish the training dataset soon, and this way you can reproduce the VNLI training with BLIP2 or any more updated VLM available.

Updated the BLIP2 fine-tuning instructions here (including the YAML file reference you mentioned): https://github.com/yonatanbitton/wysiwyr/blob/main/README.md#reproducing-results-for-the-end-to-end-vnli-method