failed to load file with cv

[Rvage0815]

while the files are save to the comfyui temp folder, the source image and the target image, also a video file for some reason, there are several error messages in the command prompt. everything required is installed as far as i know, i followed your instruction but i dont get this to work. please help me to figure this out :) the complete process is listed below. i used a single image but tried it with a video file too.

video h265-mp4 {'enhancer': 'gfpgan_1.4', 'faceswap_model': 'inswapper_128', 'frame_enhancer': 'ultra_sharp_x4', 'face_detector_model': 'retinaface', 'reference_face_index': 0, 'face_mask_padding_left': 0, 'face_mask_padding_right': 0, 'face_mask_padding_bottom': 0, 'face_mask_padding_top': 0, 'device': 'cpu', 'frame_rate': 1.0, 'loop_count': 0, 'filename_prefix': 'deepfuze', 'pingpong': False, 'save_output': True, 'source_images': ['879', 0], 'target_images': ['883', 0], 'format': 'video/h265-mp4', 'pix_fmt': 'yuv420p10le', 'crf': 22, 'save_metadata': ['save_metadata', 'BOOLEAN', {'default': True}]} D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite\videohelpersuite..\video_formats\h265-mp4.json pix_fmt crf save_metadata ['python', './run.py', '--frame-processors', 'face_swapper', '-s', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze00007.png', '-t', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze_00007.mp4', '--face-detector-model', 'retinaface', '-o', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4', '--face-swapper-model', 'inswapper_128', '--reference-face-position', '0', '--face-mask-padding', '0', '0', '0', '0', '--headless'] Traceback (most recent call last): File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\run.py", line 10, in core.cli() File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\core.py", line 112, in cli run(program) File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\core.py", line 227, in run conditional_process() File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\core.py", line 265, in conditional_process conditional_append_reference_faces() File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\core.py", line 284, in conditional_append_reference_faces abstract_reference_frame = frame_processor_module.get_reference_frame(source_face, reference_face, reference_frame) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\processors\frame\modules\face_swapper.py", line 311, in get_reference_frame return swap_face(source_face, target_face, temp_vision_frame) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\processors\frame\modules\face_swapper.py", line 241, in swap_face crop_vision_frame = apply_swap(source_face, crop_vision_frame) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\processors\frame\modules\face_swapper.py", line 252, in apply_swap frame_processor = get_frame_processor() ^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze.\deepfuze\processors\frame\modules\face_swapper.py", line 105, in get_frame_processor FRAME_PROCESSOR = onnxruntime.InferenceSession(model_path, providers = apply_execution_provider_options(deepfuze.globals.execution_device_id, deepfuze.globals.execution_providers)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 419, in init self._create_inference_session(providers, provider_options, disabled_optimizers) File "D:\AI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 472, in _create_inference_session sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ onnxruntime.capi.onnxruntime_pybind11_state.InvalidProtobuf: [ONNXRuntimeError] : 7 : INVALID_PROTOBUF : Load model from D:\AI\ComfyUI_windows_portable\ComfyUI\models\deepfuze\inswapper_128.onnx failed:Protobuf parsing failed. ['python', './run.py', '--frame-processors', 'face_enhancer', '--face-enhancer-model', 'gfpgan_1.4', '-t', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4', '-o', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4', '--headless'] [DEEPFUZE.PROCESSORS.FRAME.MODULES.FACE_ENHANCER] Select a image or video for target path! ['python', './run.py', '--frame-processors', 'frame_enhancer', '--frame-enhancer-model', 'ultra_sharp_x4', '-t', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4', '-o', 'D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4', '--headless'] [DEEPFUZE.PROCESSORS.FRAME.MODULES.FRAME_ENHANCER] Select a image or video for target path! None None !!! Exception during processing!!! D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4 could not be loaded with cv. Traceback (most recent call last): File "D:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\nodes.py", line 1018, in faceswampgenerate return load_video_cv(faceswap_filename,0,'Disabled',512,512,0,0,1) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\nodes.py", line 543, in load_video_cv (width, height, fps, duration, total_frames, target_frame_time) = next(gen) ^^^^^^^^^ File "D:\AI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\nodes.py", line 462, in cv_frame_generator raise ValueError(f"{video} could not be loaded with cv.") ValueError: D:\AI\ComfyUI_windows_portable\ComfyUI\output\deepfuze\faceswap_1719183553317289.mp4 could not be loaded with cv.

Prompt executed in 25.19 seconds

[Rvage0815]

looks like the ONNXRuntimeError] : 7 : INVALID_PROTOBUF is the problem but everything is updated and the requirements are installed too, maybe a wrong version?

[Rvage0815]

found the mistake. first i uninstalled onnx-runtime-gpu:

• python_embeded\python.exe -m pip uninstall onnxruntime-gpu

reinstalled it:

• python_embeded\python.exe -m pip install onnxruntime-gpu

after that a missing DLL was reported:

• found a Fix here ^^

I was able to find a copy of the missing zlib DLL in the NVIDIA Nsight directory: C:\Program Files\NVIDIA Corporation\Nsight Systems 2022.4.2\host-windows-x64\zlib.dll

I copied and renamed it to: C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\bin\zlibwapi.dll

now it works :P