search

mbzuai-oryx / Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
https://mbzuai-oryx.github.io/Video-ChatGPT
Creative Commons Attribution 4.0 International
1.23k stars 108 forks source link

Video frame timestamp #58

Closed nahidalam closed 1 year ago

nahidalam commented 1 year ago

Is it possible to get the video frame timestamp in your approach? I do not see you are extracting time info while dataset creation so I am guessing no.

Please suggest.

mmaaz60 commented 1 year ago

Hi @nahidalam,

Unfortunately, the model did not use or generate timestamps. Thank You.