search

haotian-liu / LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
https://llava.hliu.cc
Apache License 2.0
19.61k stars 2.16k forks source link

[Question] How to batch inference? #1473

Open catssci opened 5 months ago

catssci commented 5 months ago

Question

Hi, I've been extracting information about images using inference examples for some time now, can you tell me how to do batch inference and example code.

Thank you.

zsxm1998 commented 4 months ago

I have the same question

dreamlychina commented 2 weeks ago

I have the same question