ShmuelRonen / ComfyUI_wav2lip

A custom node for ComfyUI that allows you to perform lip-syncing on videos using the Wav2Lip model. It takes an input video and an audio file and generates a lip-synced output video.
53 stars 10 forks source link

EOF error when executing wav2lip #23

Closed lalliexe closed 2 weeks ago

lalliexe commented 3 weeks ago

Hi everyone, when the process of the workflow in comfyUI arrives at the wav2lip node, I get this error:


Error occurred when executing Wav2Lip:

unexpected EOF, expected 8549702 more bytes. The file might be corrupted.

File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\wav2lip.py", line 103, in todo out_imglist = wav2lip(in_img_list, temp_audio_path, face_detect_batch, mode, model_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lipnode.py", line 162, in wav2lip for i, (img_batch, mel_batch, frames, coords) in enumerate(tqdm(gen, File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\tqdm\std.py", line 1181, in iter for obj in iterable: File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 65, in datagen face_det_results = face_detect(frames, face_detect_batch) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\wav2lip_node.py", line 20, in face_detect detector = face_detection.FaceAlignment(face_detection.LandmarksType._2D, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\face_detection\api.py", line 60, in init self.face_detector = sfd.FaceDetector(device=device, verbose=verbose) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\face_detection\detection\sfd\sfd_detector.py", line 22, in init model_weights = load_url(models_urls['s3fd']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\hub.py", line 770, in load_state_dict_from_url return torch.load(cached_file, map_location=map_location, weights_only=weights_only) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 1040, in load return _legacy_load(opened_file, map_location, pickle_module, pickle_load_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\akira\Desktop\new_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 1276, in _legacy_load typed_storage._untyped_storage._set_from_file(

I tried so many thing to resolve but without success; anyone is experiencing the same error or can indicate me what to do ? thanks in advance

Cal-DCosta commented 3 weeks ago

Issues with Wav2Lip Node for ComfyUI all attempts to install fail. Screenshot 2024-06-11 093217

ShmuelRonen commented 3 weeks ago

Send here the all CMD log of ComfyUI in .text file

Cal-DCosta commented 3 weeks ago

comfy_logs.txt

ShmuelRonen commented 3 weeks ago

Model wav2lip_gan.pth not found in D:\AI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_wav2lip\Wav2Lip\checkpoints

Please download the wav2lip_gan.pth model and put it in the right folder

Cal-DCosta commented 3 weeks ago

Thanks for getting back, I have done what was suggested but the node still does not install and using the example json comes up as not installed node.

lalliexe commented 3 weeks ago

Hi there, i attach the cmd log in txt here: EOFerror.txt

Hope you can help me , thanks in advance !

ShmuelRonen commented 3 weeks ago

The model file wav2lip_gan.pth may be corrupted or improperly downloaded.