search

dino-chiio / blip-vqa-finetune

This is implementation of finetuning BLIP model for Visual Question Answering
42 stars 6 forks source link

How to fine-tune blip2 for vqa task? #5

Open WildLight opened 4 months ago

WildLight commented 4 months ago

hi, thank you for your open source. But this code can't use for blip2. Do you have the code for the blip2 version?

dino-chiio commented 4 months ago

Thanks for your attention to this code. I have not yet implemented the base code for the BLIP2 version. I think they use the same backbone and you can modify your own code when considering the details of the BLIP2 structure.

WildLight commented 4 months ago

Thanks for your attention to this code. I have not yet implemented the base code for the BLIP2 version. I think they use the same backbone and you can modify your own code when considering the details of the BLIP2 structure.

thank you