search

magic-research / PLLaVA

Official repository for the paper PLLaVA
496 stars 31 forks source link

Does it support batch inference #16

Open QiaoZhennn opened 2 months ago

QiaoZhennn commented 2 months ago

Wonder does it support batch inference? I read the code of eval. Seems each time it only eval on one video.

ermu2001 commented 2 months ago

No, currently it doesn't support batch inference. The repo currently only evaluate a single sample on each GPU upon each iteration.

For batch inference we might plan to set up accelerate for evaluation next.

QiaoZhennn commented 1 month ago

Check again to see if the batch inference is supported?

markus583 commented 32 minutes ago

+1