facebookresearch / HierVL

[CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
Other
43 stars 3 forks source link

Demo Notebook #2

Open Tejas-Haritsa-vk opened 1 year ago

Tejas-Haritsa-vk commented 1 year ago

Hi thanks for the great work, very inspiring.

I wanted to test the model on some custom datasets, Is there any notebooks that you can share with me to achieve the same? Any help would be greatly appreciated.

thechargedneutron commented 1 year ago

Thanks for your interest in this work. You can create a custom notebook yourself using the dataloader, model file and released checkpoints. I don't have the bandwidth to work on this now but if you having troubles creating such a notebook, I will be happy to help. Let me know if you face any difficulties. If you are able to make a minimal reproducible example notebook, feel free to open a pull request and I will add that here. Thanks!

Tejas-Haritsa-vk commented 11 months ago

Hi, Sorry for the long delay was modifying and implementing this for my work. I'm creating a demo notebook and need some help. Can you please create a small sample Howto100m dataset 1-2 videos and share them with me so that I can use that to run the notebook and submit the pull request? Thanks in advance!

thechargedneutron commented 11 months ago

Sorry for the late reply! You can download YouTube videos in HowTo100M using yt-dlp tool. Downloading directly would be easier than releasing the videos with this codebase due to license issues. If you need any help in downloading HowTo100M videos from YouTube, feel free to ask here.