search

magic-research / PLLaVA

Official repository for the paper PLLaVA
568 stars 37 forks source link

Eval Results. #73

Closed liguopeng0923 closed 2 months ago

liguopeng0923 commented 3 months ago

Hi,

I reproduced successfully your results on qabench and mvbench. But the results are not normal on vcgbench with pllava-7b.

image
liguopeng0923 commented 2 months ago

I solve it by changing the different chatgpt API.

hulianyuyy commented 1 month ago

When i test the model on the MVBench benchmark, i encounter the error "error decoding DATAS/MVBench/video/ssv2_video/166583.webm". Have you encoutered the same error and knowd how to solve it? Thanks!

Li-Jinsong commented 1 month ago

When i test the model on the MVBench benchmark, i encounter the error "error decoding DATAS/MVBench/video/ssv2_video/166583.webm". Have you encoutered the same error and knowd how to solve it? Thanks!

Did u solve it? i encounter the same error.😭

hulianyuyy commented 1 month ago

When i test the model on the MVBench benchmark, i encounter the error "error decoding DATAS/MVBench/video/ssv2_video/166583.webm". Have you encoutered the same error and knowd how to solve it? Thanks!

Did u solve it? i encounter the same error.😭

You may set num_threads=1 in the VideoReader.

Li-Jinsong commented 1 month ago

When i test the model on the MVBench benchmark, i encounter the error "error decoding DATAS/MVBench/video/ssv2_video/166583.webm". Have you encoutered the same error and knowd how to solve it? Thanks!

Did u solve it? i encounter the same error.😭

You may set num_threads=1 1 in the VideoReader.

This works for me, thx so much!

Lexarymade commented 3 weeks ago

i still facing error decoding DATAS/MVBench/video/ssv2_video/140639.webm problem after setting num_threads=1 1😭