yonatanbitton / wysiwyr

Apache License 2.0
32 stars 0 forks source link

Computing VQ2 Score #2

Open avshalomman opened 1 year ago

avshalomman commented 1 year ago

Hi and thanks for the great work :) I'm trying to run the VQ2 pipeline, and can't find the code for calculating the "yes" score in BLIP-2 VQA, the code only gets the text output without getting the logits.

Are you planning on releasing this?

Thanks!

yonatanbitton commented 1 year ago

Hi, yes it's a limitation of the BLIP2 variant, we plan to work on data release & the end-to-end model, but it will take time. We will update. Thanks.