search

lelechen63 / Talking-head-Generation-with-Rhythmic-Head-Motion

Other
197 stars 28 forks source link

How is the target frame determined #9

Open tangyibo123 opened 3 years ago

tangyibo123 commented 3 years ago

@lelechen63 @rainingDesert Thank you very much for your project,I saw the last part of the paper，“the controllable results. The videos in upper part are manipulated with target facial expressions while keep the head motion unchanged. We show the target facial expression in the first row. The videos in lower part are manipulated with target head motion while keep the facial expression unchanged.” image But when I tested, I only input the audio and a series of pre-processing results related to the original video. How is the target frame determined?

rainingDesert commented 3 years ago

@lelechen63 @rainingDesert Thank you very much for your project,I saw the last part of the paper，“the controllable results. The videos in upper part are manipulated with target facial expressions while keep the head motion unchanged. We show the target facial expression in the first row. The videos in lower part are manipulated with target head motion while keep the facial expression unchanged.” image But when I tested, I only input the audio and a series of pre-processing results related to the original video. How is the target frame determined?

The head motion of target frame is determined by the head motion of original video. The facial expression is determined by landmarks synthesized according to audio, which belongs to the target and contains related information.