search

Ino-Ichan / GIT-LLM

21 stars 2 forks source link

Video Captioning #2

Open zhouliang-yu opened 1 year ago

zhouliang-yu commented 1 year ago

Hey @Ino-Ichan Thx so much for your work! does GIT-LLM support video as input as original GIT2?

Ino-Ichan commented 1 year ago

Hi @zhouliang-yu , GIT-LLM can deal with video inputs, but you need to create custom video dataset. So, would you please check out our new library heron? We will plan to support video inputs soon. (You still need to create a custom dataset for video now.)