search

jy0205 / LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
Other
438 stars 22 forks source link

Motion Vectors Dataloading #13

Closed PardoAlejo closed 3 months ago

PardoAlejo commented 5 months ago

Hi,

Thank you for sharing this remarkable work. I noticed that there are currently no plans to release the training code. Nonetheless, I was wondering if it might be possible for you to provide a simplified version of your data loader. Specifically, a version that includes the extraction of keyframes and motion vectors would be incredibly helpful. It's understandable if the complete training data loader cannot be shared; a minimal working example would be greatly appreciated.

Thank you for considering this request!

jy0205 commented 5 months ago

The data loader code will be released in the next few weeks. By the way, we use this tool: https://github.com/LukasBommes/mv-extractor to extract motion vectors.