patrick-tssn / VideoHallucer

VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
https://videohallucer.github.io
MIT License
22 stars 0 forks source link

Can you add the results about ShareGPT4Video-8B on VideoHallucer benchmark? #2

Closed xiaoachen98 closed 4 months ago

xiaoachen98 commented 4 months ago

Thanks for your awesome work of building a solid benchmark for video hallucinations. I wonder if you could add the results of ShareGPT4Video-8B on your benchmark. We provide the inference code here, very easy to follow. Many thanks!

patrick-tssn commented 4 months ago

Thank you for your work. I have updated your models to our benchmark. For further evaluation, you are encouraged to make a PR or submit your results to me (flagwyx@gmail.com).

xiaoachen98 commented 4 months ago

Thank you for your work. I have updated your models to our benchmark. For further evaluation, you are encouraged to make a PR or submit your results to me (flagwyx@gmail.com).

Thanks for your reply! It seems like we should make some efforts to alleviate hallucinations for ShareGPT4Video-8B~