eeskimez / emotalkingface

The code for the paper "Speech Driven Talking Face Generation from a Single Image and an Emotion Condition"
MIT License
161 stars 29 forks source link

How to train gan for face movements without caring about emotions #13

Open gaelix98 opened 1 year ago

gaelix98 commented 1 year ago

Hi everyone, is there anyway to train this model to work on lips movement without caring about emotions? I'm trying to use my dataset but it does not have emotion labels. I was wondering if there was anyway to replicate the lips movement from a video to an image without having to label the emotions for every video since they are video taken from youtube and in different languages.