numz / sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111
Apache License 2.0
1.23k stars 163 forks source link

Errors on code #19

Closed Zakabaka closed 1 year ago

Zakabaka commented 1 year ago

I update the extension change the video and audio (mp4 and mp3 files) But the program load something for a 10 mon and then gaves me an errors. See attached file CVould you please advice what is the problem and how to get rid of it. Screenshot 2023-08-13 121001

numz commented 1 year ago

Hi,

I apologize for the inconvenience. As indicated in the logs, it appears there's a frame in your video where a face couldn't be detected. You can locate this problematic frame at "extensions\sd-wav2lip-uhq\scripts\wav2lip\temp\faulty_frame.jpg". To resolve this error, you can edit your video using your preferred video editor to either remove this frame or adjust it to ensure a face can be detected.

Please let me know if this process resolve your issue. Regards

Zakabaka commented 1 year ago

in video there are some transitions, so the person talks a bit then there is a transition to the next topic of conversation and the transition is like a dark screen for less than a second. May that be an issue? does the video whoul have a static scene/background with no transitions or scene changes?

numz commented 1 year ago

The challenge is that every frame needs to have a face, otherwise, it will cause an error. To circumvent this, you should segment your video into separate parts and arrange audio for each segment using a video editing software.

I close this issue because it's not one, you have to prepare stuff before send it to wav2lip. Regards