soumik-kanad / diff2lip

Other
322 stars 38 forks source link

Result Video blurry #13

Closed wfengchen closed 9 months ago

wfengchen commented 10 months ago

I have encountered some issues. I input a video in 1080p resolution. After processing, the output is also in 1080p, but the video is very blurry and doesn't achieve a high-quality result. How can I adjust this? Please assist me. Thank you.

INPUT LIKE: 1 1

OUTPUT LIKE: 1 2

soumik-kanad commented 9 months ago

If I had to guess, I would say this is happening because the generate script uses ffmpeg to extract the frame (here) and consequently might compress the images. This was done to make sure that the frames saved on the disk don't occupy too much space. You can probably update this code to be able to save the frames at full quality.

Even with that there might be degradation in results in this case because the model is not trained with HD data and resizes the face to 128x128, so HD focused faces might have blurry results.