search

ShareGPT4Omni / ShareGPT4Video

[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
https://sharegpt4video.github.io/
1.25k stars 44 forks source link

Finetuning #41

Open spidercatfly opened 1 month ago

spidercatfly commented 1 month ago

Hi, team!

This is an excellent work in providing very fine-grained descriptions in my experiments, and thank you for open sourcing it!

If I want to do some fine-tuning on these two models to support structured output, how should I do? Do you have plans to add a fine-tuning framework?

By the way, can you give the difference between these two models in terms of task performance, such as speed and granularity?

Thanks for your kind help!

spidercatfly commented 1 month ago

@zehuichen123 @xiaoachen98 @Wiselnn570 @Li-Jinsong Thanks for your help!