Closed iamchenxin-coder closed 3 years ago
Sorry, I do not understand your question. What mask are you talking about? what is the picture 1?
Hello @prajwalkr, because my computer can't upload pictures with too much memory, I will reduce the image of the generated video and send it to you for a look. This picture is generated by wav2lip + Gan, but there is a layer of mask on it, which makes the whole video unclear,Especially when the size of the input image is large, the resolution of the generated video is higher, and the mask is more obvious. I especially want to know how to remove the mask.
The documents of the project are in operation inference.py:
Finally, I found this code in the function datagen, which can adjust the color level of the facial mask in the generated video. I don't know how to adjust img_masked value to get an invisible video effect,help tell me how to adjust here. The code of the red box in the following picture is added by myself. I want to see the effect of modifying this value.
The generated video frame is shown in the figure below:
We concatenate a reference frame (from any random time step) and the GT frame with the lower half masked (during training). This is to provide the model with the target head pose information without leaking the lip shape (GT frame contains the GT lip shape). During inference at any time step, we concatenate the lower half masked frame with itself. This is the masking step you find in this line. I think the face detection failed for this particular example. Probably the face was detected above the real face, and the lower half mask meant that the forehead region was masked out.
Hello, I use this model to input the video generated by picture 1. I feel that there is a layer of mask on it, which is not clear. What's the matter? How can I remove it?sorry,the video can't be uploaded