OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
https://vchat.opengvlab.com/
MIT License
2.85k stars 230 forks source link

How to implement VideoChat2_text #170

Closed qtli closed 3 weeks ago

qtli commented 2 months ago

Thanks for your high-quality work. Could you please provide the blank video or the code you utilized to generate the ablation model VideoChat2_text? Thanks very much!

Andy1621 commented 1 month ago

Hi! For VideoChat2_text, we simply input a video tensor of 0, like torch.zeros_like(video_emb).