search

LLaVA-VL / LLaVA-NeXT

Apache License 2.0
2.29k stars 154 forks source link

Data to evaluate Video Detailed Description. #38

Open Hon-Wong opened 3 months ago

Hon-Wong commented 3 months ago

Hi,

I'm deeply inspired by your great work!

Could you please provide some information on the data used to evaluate the detailed captioning ability of the model (not the evaluation script, but the videos and annotations)?

I really appreciate any help you can provide.

ZhangYuanhan-AI commented 3 months ago

Please refer to this branch: https://github.com/LLaVA-VL/LLaVA-NeXT/tree/video_inference

Hon-Wong commented 3 months ago

Please refer to this branch: https://github.com/LLaVA-VL/LLaVA-NeXT/tree/video_inference

Thanks for your reply!

However, the link you provided seems like a private one, as I have no access to it. It reports: "AADSTS90072: User account 'xxx@gmail.com' from identity provider 'live.com' does not exist in tenant 'Mohamed Bin Zayed University of Artificial Intelligence' and cannot access the application '00000003-0000-0ff1-ce00-000000000000'(Office 365 SharePoint Online) in that tenant. The account needs to be added as an external user in the tenant first."

Could you please provide a public URL link instead?

ZhangYuanhan-AI commented 3 months ago

Please try this: https://mbzuaiac-my.sharepoint.com/personal/hanoona_bangalath_mbzuai_ac_ae/_layouts/15/onedrive.aspx?id=%2Fpersonal%2Fhanoona%5Fbangalath%5Fmbzuai%5Fac%5Fae%2FDocuments%2FVideo%2DChatGPT%2FData%5FCode%5FModel%5FRelease%2FQuantitative%5FEvaluation%2Fbenchamarking%2FTest%5FHuman%5FAnnotated%5FCaptions%2Ezip&parent=%2Fpersonal%2Fhanoona%5Fbangalath%5Fmbzuai%5Fac%5Fae%2FDocuments%2FVideo%2DChatGPT%2FData%5FCode%5FModel%5FRelease%2FQuantitative%5FEvaluation%2Fbenchamarking&ga=1

JaronTHU commented 3 months ago

Please try this: https://mbzuaiac-my.sharepoint.com/personal/hanoona_bangalath_mbzuai_ac_ae/_layouts/15/onedrive.aspx?id=%2Fpersonal%2Fhanoona%5Fbangalath%5Fmbzuai%5Fac%5Fae%2FDocuments%2FVideo%2DChatGPT%2FData%5FCode%5FModel%5FRelease%2FQuantitative%5FEvaluation%2Fbenchamarking%2FTest%5FHuman%5FAnnotated%5FCaptions%2Ezip&parent=%2Fpersonal%2Fhanoona%5Fbangalath%5Fmbzuai%5Fac%5Fae%2FDocuments%2FVideo%2DChatGPT%2FData%5FCode%5FModel%5FRelease%2FQuantitative%5FEvaluation%2Fbenchamarking&ga=1

I guess this link is still private. After clicking this link, I am redirected to the login webpage

1
linxid commented 2 months ago

I have no access to it also, can you provide public url.

ZhangYuanhan-AI commented 2 months ago

I have uploaded the dataset at: https://huggingface.co/datasets/lmms-lab/VideoDetailCaption.