search

rsomani95 / video-classification

Exploring and understanding existing open-source video-classification tools and models
1 stars 1 forks source link

This repo's target #1

Open Namzakku opened 3 years ago

Namzakku commented 3 years ago

Hi! Just curious to ask what is your attempt of creating this repo? Are you trying to detect camera movement in movie shots?

rsomani95 commented 3 years ago

Hello! This repo was just me getting my hands dirty with 3d CNNs and data loading for the same. It's quite dated, and I've no plans on updating it for now

I'd love to tackle detecting camera movement in movie shots at some point.

Namzakku commented 3 years ago

Would love to hear if you made any new progress with the camera movement! I have followed the "AI for filmmaking" blog and really loved it! I mainly work in video production and have been into AI Engineering recently, and learned a lot from your work. I'm also trying to build the camera movement dataset, too lol. Look forward to seeing new things from you! Btw, Happy new year! Cheers!

rsomani95 commented 3 years ago

Thanks @Namzakku! I'm glad you found it useful. What kind of work do you do exactly? I'd be curious to hear how you're building out that dataset.

Happy new year :)

Namzakku commented 3 years ago

I work as an camera operator and (mainly) editor in a video production company and recently got into machine learning. I was looking for some inspiration from people attempting to put ML into cinema world and got to see your blog! It was really inspiring! I saw that you mentioned Camera movement in the blog, which motivates me to make some attempt with video classification lately (but still no luck haha). The dataset I'm building is collecting some cinema shots (and nice video stocks) over the internet and categorized into 6 different movement classes (Pan, Tilt, Pedestal, Dolly, Truck, Zoom). Each clip is around 1 second to 10 seconds. It is my first time building a video dataset and it is still in progress (1700 clips at the moment). If you have any interest let me know, I could share it with you when I'm done with the dataset! Any advices for building dataset is welcome!

rsomani95 commented 3 years ago

@Namzakku exciting to hear you've started building it out! Video classification is a touch more complicated than images and also a much less mature space -- there's many ways to approach it from a modelling perspective, and introducing the time aspect to the data opens up a door of considerations.

I'd love to chat more, discuss some ideas regarding building the dataset. Please reach out to me at rsomani95@gmail.com and we can schedule something :)