OpenTalker / video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
https://opentalker.github.io/video-retalking/
Apache License 2.0
6.14k stars 908 forks source link

output resolution problem #9

Open labels168 opened 1 year ago

labels168 commented 1 year ago

This is a great open source, but there is a gap between the resolution of the output and the original video, the resolution of the output is low, and there are jagged, is there a way to deal with it, thank you very much!

indianajson commented 1 year ago

I would also be interested in a way to improve the output resolution when the system has the necessary RAM + GPU power to do so. There does not appear to be any information about this in the documentation.

kunncheng commented 1 year ago

You can try to use GFPGAN/GPEN again or other super-resolution/face restoration methods to enhance the generated video. It's worth noting that GFPGAN will have a slightly change on identity.

fjesikfjdskl commented 1 year ago

When I used GPEN to enhance the face, problems such as facial mosaics appeared in the result of synthesis. Have you ever had such problems

AIhasArrived commented 8 months ago

I would also be interested in a way to improve the output resolution when the system has the necessary RAM + GPU power to do so. There does not appear to be any information about this in the documentation.

Hello @indianajson did you notice this tech used all the RAM and very few of GPU?? image

Do you know how to solve this?

mahnoorfawad commented 6 months ago

You can try to use GFPGAN/GPEN again or other super-resolution/face restoration methods to enhance the generated video. It's worth noting that GFPGAN will have a slightly change on identity.

how to use the super-resolution sr_model on colab, it doesnt download the RealESR model or make a srmodel directory