search

foivospar / NED

PyTorch implementation for NED (CVPR 2022). It can be used to manipulate the facial emotions of actors in videos based on emotion labels or reference styles.
https://openaccess.thecvf.com/content/CVPR2022/html/Papantoniou_Neural_Emotion_Director_Speech-Preserving_Semantic_Control_of_Facial_Expressions_in_CVPR_2022_paper.html
MIT License
154 stars 26 forks source link

About training a new neural face renderer of a new actor and the results. #4

Open joyce7709 opened 1 year ago

joyce7709 commented 1 year ago

Hello, I used a new actor video and I trained a new neural face renderer, but the mouth of the generated mp4 video is blurred and cannot be overlapped with the original. Is this related to the video I used of Asians or something wrong with my testing or models? In addition, could you give me your email? I can't open the email link in github and I want to contact you to apply the training/test videos used in the experiments, thanks a lot.

foivospar commented 1 year ago

Hi, If the blurred mouth appears on specific target emotions it may be that the training video is not long enough, or has not enough expression variability to properly fine-tune the model on. Otherwise, you could check whether the 3D reconstruction for the training video has failed by looking at the nmfc or shape images (although this rarely happens). For accessing the videos, please use phoebus1998p@gmail.com.