joonson / syncnet_python

Out of time: automated lip sync in the wild
MIT License
652 stars 146 forks source link

Input preprocessing for SyncNet #47

Open rohana96 opened 2 years ago

rohana96 commented 2 years ago

Thanks for the fantastic work with SyncNet and for releasing its code!

I am currently using SyncNet (https://github.com/joonson/syncnet_python) for the evaluation of a project that I have been working on. I had a couple of questions on it and would be grateful if you could answer them:

  1. Do I need to preprocess the input video to SyncNet (outside of the preprocessing that sync net does internally)?

  2. Would you be able to share an example of what an input frame looks like to the SyncNet network (i.e. after all the preprocessing)?