search

rese1f / MovieChat

[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
https://rese1f.github.io/MovieChat/
BSD 3-Clause "New" or "Revised" License
531 stars 41 forks source link

Evaluations without human blind evaluation #78

Open ADiko1997 opened 2 months ago

ADiko1997 commented 2 months ago

Hi, have you evaluated the model using only GPT3.5/Claude without HBR? This is important for the research community to compare against your work.

Espere-1119-Song commented 2 months ago

Sure, you can refer to Table K10 and Table K11 in the Appendix of our paper

ADiko1997 commented 2 months ago

Thank you very much for your reply. Best regards

On Tue, 3 Sept 2024, 17:46 EnxinSong, @.***> wrote:

Sure, you can refer to Table K10 and Table K11 in the Appendix of our paper

— Reply to this email directly, view it on GitHub https://github.com/rese1f/MovieChat/issues/78#issuecomment-2326719292, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL3UZJAO3MQBGOPP7BE7ODDZUXDT7AVCNFSM6AAAAABNRVNPWKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRWG4YTSMRZGI . You are receiving this because you authored the thread.Message ID: @.***>

lan-lw commented 1 week ago

Hi can you provide the moviechat+ model using GPT3.5/Claude without HBR ? I didn't find the results in moviechat+ paper.