search

rabiulcste / vqazero

visual question answering prompting recipes for large vision-language models
https://rabiul.me/vqazero/
22 stars 2 forks source link

Question about Inference time #1

Closed qyx1121 closed 7 months ago

qyx1121 commented 1 year ago

Hi, I wonder if this code can only support single gpu for inference at the moment? Feeling a bit slow, I spent an hour testing on okvqa's test set in zero-shot setting.

rabiulcste commented 1 year ago

Thanks for raising the issue. Current postprocessing heavily slowing it down. I am working on a fix asap.