search

ExplainableML / Vision_by_Language

[ICLR 2024] Official repository for "Vision-by-Language for Training-Free Compositional Image Retrieval"
MIT License
37 stars 2 forks source link

Prompt argument in BLIP generate function does not exist. #5

Closed antreashp closed 1 month ago

antreashp commented 1 month ago

In the generation of captions, specifically in the function generate_predictions, you input a dictionary in the blip model. This dictionary has keys of 'image' and 'prompt' where for the prompt value you input the prompts.blip_prompt. There is not a prompt argument in the lavis library for the generate function. When you exclude the prompt key and value from the generate function you get the same caption as output. Am I missing something? Thank you in advance =]

antreashp commented 1 month ago

I am sorry for the inconvenience, I realized you were using BLIP-2 and also I had a typo, instead of 'prompt' i had 'promt'.