search

Ino-Ichan / GIT-LLM

17 stars 2 forks source link

Video Captioning #2

Open zhouliang-yu opened 10 months ago

zhouliang-yu commented 10 months ago

Hey @Ino-Ichan Thx so much for your work! does GIT-LLM support video as input as original GIT2?

Ino-Ichan commented 10 months ago

Hi @zhouliang-yu , GIT-LLM can deal with video inputs, but you need to create custom video dataset. So, would you please check out our new library heron? We will plan to support video inputs soon. (You still need to create a custom dataset for video now.)