williamyang1991 / Rerender_A_Video

[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation
https://www.mmlab-ntu.com/project/rerender/
Other
2.96k stars 202 forks source link

no find 0002.bin,how can I get it #32

Open lmpeng12 opened 1 year ago

lmpeng12 commented 1 year ago

Hello, I have encountered the same problem and cannot find the relevant bin file. My Ebsynth is running normally. I can find the output images in out_1 folder, and there are also npy files in tmp. How can I modify it?? python video_blend.py result/pexels-koolshooters-7322716 --beg 1 --end 101 --itv 10 --key keys --output result/pexels-koolshooters-7322716/blend.mp4 --fps 25.0 --n_proc 4 -ps /home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] ebsynth: 113.05732083320618 Traceback (most recent call last): File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 330, in main(args) File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 268, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 199, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/ai-tets/wangzijian/image_generator/Rerender_A_Video-main/video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result/pexels-koolshooters-7322716/out_1/0002.bin' Traceback (most recent call last): File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/routes.py", line 437, in run_predict output = await app.get_blocks().process_api( File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/blocks.py", line 1355, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/blocks.py", line 1289, in postprocess_data prediction_value = block.postprocess(prediction_value) File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/video.py", line 249, in postprocess processed_files = (self._format_video(y), None) File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/video.py", line 313, in _format_video video = self.make_temp_copy_if_needed(video) File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/base.py", line 223, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "/home/ai-tets/miniconda3/envs/lmp_1/lib/python3.10/site-packages/gradio/components/base.py", line 187, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result/pexels-koolshooters-7322716/blend.mp4'

williamyang1991 commented 1 year ago

https://github.com/williamyang1991/Rerender_A_Video/issues/18#issuecomment-1723977359

Your path /home/ai-tets/ contains - You can change it to /home/ai_tets/

curlysasha commented 1 year ago

same problem

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] Global seed set to 96470270 Data shape for DDIM sampling is (1, 4, 112, 64), eta 0.0 Running DDIM Sampling with 20 timesteps DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] python video_blend.py result/test111 --beg 1 --end 31 --itv 10 --key keys --output result/test111/blend.mp4 --fps 30.0 --n_proc 4 -ps /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] [ WARN:0@3.201] global loadsave.cpp:248 findDecoder imread('result/test111/out_21/0022.jpg'): can't open/read file: check file path/integrity Process Process-3: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.309] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity Process Process-1: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, *self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.482] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0012.jpg'): can't open/read file: check file path/integrity Process Process-2: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(self._args, self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 3.9767417907714844 [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0010.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0010.jpg'): can't open/read file: check file path/integrity Traceback (most recent call last): File "/home/sd/Rerender_A_Video/video_blend.py", line 318, in main(args) File "/home/sd/Rerender_A_Video/video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/sd/Rerender_A_Video/video_blend.py", line 198, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/sd/Rerender_A_Video/video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/out_1/0002.bin' Traceback (most recent call last): File "/home/sd/.local/lib/python3.10/site-packages/gradio/queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/blend.mp4'

curlysasha commented 1 year ago

switched to windows, first time was ok second video:

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████| 20/20 [00:10<00:00, 1.95it/s] python video_blend.py result\input2 --beg 1 --end 281 --itv 10 --key keys --output result\input2\blend.mp4 --fps 30.0 --n_proc 4 -ps C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature (2 * (dim_t // 2) / self.num_pos_feats) C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature * (2 (dim_t // 2) / self.num_pos_feats) C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature (2 * (dim_t // 2) / self.num_pos_feats) C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature (2 (dim_t // 2) / self.num_pos_feats) C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] Process Process-3: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(self._args, self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 76, in process_one_sequence flow_calc.get_flow(i1, i2, flow_seq[j]) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context return func(*args, kwargs) File "C:\Rerender_A_Video\flow\flow_utils.py", line 182, in get_flow np.save(save_path, flow_np) File "<__array_function__ internals>", line 180, in save File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\npyio.py", line 502, in save format.write_array(fid, arr, allow_pickle=allow_pickle, File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\format.py", line 689, in write_array array.tofile(fp) OSError: 917504 requested and 0 written Process Process-4: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, *self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' Process Process-2: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(self._args, self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' Process Process-1: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, **self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 47.178515911102295 Traceback (most recent call last): File "video_blend.py", line 318, in main(args) File "video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "video_blend.py", line 199, in process_seq dist2s.append(load_error(bin_b, img_shape)) File "video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\out_11\0010.bin' Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\blend.mp4'

curlysasha commented 1 year ago

first video was 2 seconds second 9 seconds

maybe length is a problem?

lmpeng12 commented 1 year ago

switched to windows, first time was ok second video:

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████| 20/20 [00:10<00:00, 1.95it/s] python video_blend.py result\input2 --beg 1 --end 281 --itv 10 --key keys --output result\input2\blend.mp4 --fps 30.0 --n_proc 4 -ps C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature (2 * (dim_t // 2) / self.num_pos_feats) C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature * (2 (dim_t // 2) / self.num_pos_feats) C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature (2 * (dim_t // 2) / self.num_pos_feats) C:\Rerender_A_Video\deps/gmflow\gmflow\position.py:39: UserWarning: floordiv is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). dim_t = self.temperature (2 (dim_t // 2) / self.num_pos_feats) C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\functional.py:478: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at C:\cb\pytorch_1000000000000\work\aten\src\ATen\native\TensorShape.cpp:2895.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] Process Process-3: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(self._args, self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 76, in process_one_sequence flow_calc.get_flow(i1, i2, flow_seq[j]) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context return func(*args, kwargs) File "C:\Rerender_A_Video\flow\flow_utils.py", line 182, in get_flow np.save(save_path, flow_np) File "<array_function internals>", line 180, in save File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\npyio.py", line 502, in save format.write_array(fid, arr, allow_pickle=allow_pickle, File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\numpy\lib\format.py", line 689, in write_array array.tofile(fp) OSError: 917504 requested and 0 written Process Process-4: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, *self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' Process Process-2: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(self._args, self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' Process Process-1: Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 315, in _bootstrap self.run() File "C:\ProgramData\anaconda3\envs\rerender\lib\multiprocessing\process.py", line 108, in run self._target(*self._args, **self._kwargs) File "C:\Rerender_A_Video\video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "C:\Rerender_A_Video\video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "C:\Rerender_A_Video\blender\guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "C:\Rerender_A_Video\flow\flow_utils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 47.178515911102295 Traceback (most recent call last): File "video_blend.py", line 318, in main(args) File "video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "video_blend.py", line 199, in process_seq dist2s.append(load_error(bin_b, img_shape)) File "video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\out_11\0010.bin' Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "C:\ProgramData\anaconda3\envs\rerender\lib\site-packages\gradio\components\base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result\input2\blend.mp4'

Can you find the file 'result\input2\out_1\0002.bin'?I can't find this file.

williamyang1991 commented 1 year ago

first video was 2 seconds second 9 seconds

maybe length is a problem?

Is it in your case, some images are generated but somes are not, rather than missing all images? If so, Ebsynth fails on some sub Processes. I'm not sure the exact reason. But when the workload is heavy or GPU is nearly out of usage, we observed similar cases occasionally. Since we are not the developer of Ebsynth, we don't know how to fix Ebsynth.

likewise, if you find 0012 missing, you can run:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 11 --end 21 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

And finally merge all results together into a single video.

curlysasha commented 1 year ago

first video was 2 seconds second 9 seconds maybe length is a problem?

Is it in your case, some images are generated but somes are not, rather than missing all images? If so, Ebsynth fails on some sub Processes. I'm not sure the exact reason. But when the workload is heavy or GPU is nearly out of usage, we observed similar cases occasionally. Since we are not the developer of Ebsynth, we don't know how to fix Ebsynth.

  • I think one solution is to use less multiprogress, like setting --n_proc 2 or --n_proc 1 or using smaller image resolution.
  • Another naive solution is to manually run Ebsynth on the interval where images are missing. For example, if you find 0002 missing, you can run:
python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 1 --end 11 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

likewise, if you find 0012 missing, you can run:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 11 --end 21 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

And finally merge all results together into a single video.

Thank you, if I'm change input video resolution will it help?

I have 4090 and 5950x, input video was 1080x1920

williamyang1991 commented 1 year ago

Thank you, if I'm change input video resolution will it help?

I have 4090 and 5950x, input video was 1080x1920

Maybe, you can try. Our method will crop the frame and resize its short side to Frame Resolution (default 512). You can lower the Frame Resolution or crop your video into a more square shape

Laidawang commented 1 year ago

@williamyang1991 i found in /deps/gmflow/gmflow/utils.py line21, The length and width of the input video must be at least a multiple of 16. when i change 1920 1080 to 1936 1088 and it works

williamyang1991 commented 1 year ago

@Laidawang In our code, we have the code to preprocess the input video to ensure its length and width to be a multiple of 64. I think your 1920 * 1080 will be preprocessed to 896 * 512, so there should be no problem with gmflow?

https://github.com/williamyang1991/Rerender_A_Video/blob/b2dd9704117ab80d6c386e37314ba8fd252a7f64/webUI.py#L645-L649

https://github.com/williamyang1991/Rerender_A_Video/blob/b2dd9704117ab80d6c386e37314ba8fd252a7f64/src/video_util.py#L80-L81

Laidawang commented 1 year ago

@Laidawang In our code, we have the code to preprocess the input video to ensure its length and width to be a multiple of 64. I think your 1920 1080 will be preprocessed to 896 512, so there should be no problem with gmflow?

https://github.com/williamyang1991/Rerender_A_Video/blob/b2dd9704117ab80d6c386e37314ba8fd252a7f64/webUI.py#L645-L649

https://github.com/williamyang1991/Rerender_A_Video/blob/b2dd9704117ab80d6c386e37314ba8fd252a7f64/src/video_util.py#L80-L81

yes, i think this happens when just use video_blend.py.

williamyang1991 commented 1 year ago

@Laidawang Oh, I understand. We will solve it.

SingleZombie commented 1 year ago

@Laidawang Hi, thanks for the bug report. GMFlow offers a padder to ensure the sidelength of image is valid. Could you try to change the 8 to 16 in the following line and input 1920 * 1080 video again? If it works, we will update the codes. https://github.com/williamyang1991/Rerender_A_Video/blob/b2dd9704117ab80d6c386e37314ba8fd252a7f64/flow/flow_utils.py#L170

lmpeng12 commented 1 year ago

第一个视频时长 2 秒,第二个视频时长 9 秒 也许长度是一个问题?

在您的情况下,是否生成了一些图像,但有些图像没有生成,而不是丢失所有图像?如果是这样,Ebsynth 在某些子进程上会失败。 我不确定确切的原因。但当工作量很大或者GPU几乎用完时,我们偶尔会观察到类似的情况。由于我们不是 Ebsynth 的开发者,因此我们不知道如何修复 Ebsynth。

  • 我认为一种解决方案是使用较少的多重进度,例如设置--n_proc 2--n_proc 1或使用较小的图像分辨率。
  • 另一个简单的解决方案是在图像丢失的时间间隔手动运行 Ebsynth。例如,如果您发现 0002 丢失,您可以运行:
python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 1 --end 11 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

同样,如果您发现 0012 丢失,您可以运行:

python video_blend.py videos/pexels-antoni-shkraba-8048492-540x960-25fps --beg 11 --end 21 --itv 10 --key keys --output videos/pexels-antoni-shkraba-8048492-540x960-25fps/blend.mp4 --fps 25.0 --n_proc 1 -ps

最后将所有结果合并到一个视频中。

OK, thanks for your help, I can run it now.

zhaoxin111 commented 1 year ago

same problem

DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] Global seed set to 96470270 Data shape for DDIM sampling is (1, 4, 112, 64), eta 0.0 Running DDIM Sampling with 20 timesteps DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] python video_blend.py result/test111 --beg 1 --end 31 --itv 10 --key keys --output result/test111/blend.mp4 --fps 30.0 --n_proc 4 -ps /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] [ WARN:0@3.201] global loadsave.cpp:248 findDecoder imread('result/test111/out_21/0022.jpg'): can't open/read file: check file path/integrity Process Process-3: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.309] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity Process Process-1: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, *self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.482] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0012.jpg'): can't open/read file: check file path/integrity Process Process-2: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(self._args, self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 3.9767417907714844 [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0010.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0010.jpg'): can't open/read file: check file path/integrity Traceback (most recent call last): File "/home/sd/Rerender_A_Video/video_blend.py", line 318, in main(args) File "/home/sd/Rerender_A_Video/video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/sd/Rerender_A_Video/video_blend.py", line 198, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/sd/Rerender_A_Video/video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/out_1/0002.bin' Traceback (most recent call last): File "/home/sd/.local/lib/python3.10/site-packages/gradio/queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/blend.mp4'

I encountered the same problem, how did you solve it?

lmpeng12 commented 1 year ago

same problem DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] Global seed set to 96470270 Data shape for DDIM sampling is (1, 4, 112, 64), eta 0.0 Running DDIM Sampling with 20 timesteps DDIM Sampler: 100%|████████████████████████████████████████████████████████████████████████| 20/20 [00:11<00:00, 1.75it/s] python video_blend.py result/test111 --beg 1 --end 31 --itv 10 --key keys --output result/test111/blend.mp4 --fps 30.0 --n_proc 4 -ps /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /home/sd/.local/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] [ WARN:0@3.201] global loadsave.cpp:248 findDecoder imread('result/test111/out_21/0022.jpg'): can't open/read file: check file path/integrity Process Process-3: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.309] global loadsave.cpp:248 findDecoder imread('result/test111/out_1/0002.jpg'): can't open/read file: check file path/integrity Process Process-1: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(*self._args, *self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' [ WARN:0@3.482] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0012.jpg'): can't open/read file: check file path/integrity Process Process-2: Traceback (most recent call last): File "/usr/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap self.run() File "/usr/lib/python3.10/multiprocessing/process.py", line 108, in run self._target(self._args, self._kwargs) File "/home/sd/Rerender_A_Video/video_blend.py", line 109, in process_sequences process_one_sequence(i, video_sequence) File "/home/sd/Rerender_A_Video/video_blend.py", line 96, in process_one_sequence cmd += ' ' + g.get_cmd(j, w) File "/home/sd/Rerender_A_Video/blender/guide.py", line 100, in get_cmd warped_img = flow_calc.warp(prev_img, self.flows[i - 1], File "/home/sd/Rerender_A_Video/flow/flowutils.py", line 188, in warp if len(img.shape) == 2: AttributeError: 'NoneType' object has no attribute 'shape' ebsynth: 3.9767417907714844 [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.330] global loadsave.cpp:248 findDecoder imread('result/test111/out1/0010.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0002.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0003.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0004.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0005.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0006.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0007.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0008.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out11/0009.jpg'): can't open/read file: check file path/integrity [ WARN:0@5.338] global loadsave.cpp:248 findDecoder imread('result/test111/out_11/0010.jpg'): can't open/read file: check file path/integrity Traceback (most recent call last): File "/home/sd/Rerender_A_Video/video_blend.py", line 318, in main(args) File "/home/sd/Rerender_A_Video/video_blend.py", line 267, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/sd/Rerender_A_Video/video_blend.py", line 198, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/sd/Rerender_A_Video/video_blend.py", line 159, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/out_1/0002.bin' Traceback (most recent call last): File "/home/sd/.local/lib/python3.10/site-packages/gradio/queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1440, in process_api data = self.postprocess_data(fn_index, result["prediction"], state) File "/home/sd/.local/lib/python3.10/site-packages/gradio/blocks.py", line 1341, in postprocess_data prediction_value = block.postprocess(prediction_value) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 281, in postprocess processed_files = (self._format_video(y), None) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/video.py", line 355, in _format_video video = self.make_temp_copy_if_needed(video) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 226, in make_temp_copy_if_needed temp_dir = self.hash_file(file_path) File "/home/sd/.local/lib/python3.10/site-packages/gradio/components/base.py", line 190, in hash_file with open(file_path, "rb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'result/test111/blend.mp4'

I encountered the same problem, how did you solve it?

Hello, I suggest you download ebsynth from this website https://github.com/SingleZombie/ebsynth .Then, run the sh/bat to build the ebsynth file in ./deps/ebsynth. Maybe, you can try.

343195246 commented 9 months ago

Please move the ebsynth.exe file and the ebsynth.dll file to . \\\deps\\\\\\ebsynth\\\\bin\\\ path.