search

williamyang1991 / FRESCO

[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation
https://www.mmlab-ntu.com/project/fresco/
Other
734 stars 71 forks source link

can not find target file while executing process_seq(video_sequence, i, blend_histogram, blend_gradient) in video_blend.py #37

Closed yellowfish82 closed 8 months ago

yellowfish82 commented 8 months ago

After I configured parameter "run_ebsynth" as True to generate video occurred the following error

I am wondering is the files were not generated or is just given the wrong target file path ？

And why the target file is not there (and there are no *.bin files generated in output directory): ./output/boxer-punching-towards-camera/out_0/0001.jpg ./output/boxer-punching-towards-camera/out_2/0001.jpg image

is there something wrong in code or the related file is not generated correctly?

image

image

yellowfish82 commented 8 months ago

I changed this function as follow, and do not throw not find jpg exception, but still can not find xxx.bin files image

the following is the error log image

williamyang1991 commented 8 months ago

Turn on the log by setting OPEN_EBSYNTH_LOG = True And check whether you give the execute permission of ebsynth

https://github.com/williamyang1991/FRESCO/issues/33#issuecomment-2019774640

yellowfish82 commented 8 months ago

After I turned on the OPEN_EBSYNTH_LOG = True, and polished the log as below. But it is still got the can not find xxxx.bin file log. What's wrong ?

image

I gave the ./src/ebsynth/deps/ebsynth/bin/ebsynth auth to execute image

williamyang1991 commented 8 months ago

Is this full log?

yellowfish82 commented 8 months ago

The following is the full log

(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO# python run_fresco.py config/config_boxer.yaml

loading configuration... batch_size: 8 cond_scale: 0.7 controlnet_type: depth end_opt_step: 15 file_path: ./data/boxer-punching-towards-camera.mp4 gmflow_path: ./model/gmflow_sintel-0c07dcb3.pth max_process: 4 maxinterv: 2 mininterv: 2 num_inference_steps: 20 num_warmup_steps: 5 prompt: An African American boxer wearing black boxing gloves punches towards the camera, cartoon style run_ebsynth: True save_path: ./output/boxer-punching-towards-camera/ sd_path: stablediffusionapi/flat-2d-animerge seed: 0 sod_path: ./model/epoch_resnet.pth use_controlnet: True use_freeu: False use_salinecy: True

==================================================================================================== creating models... create optical flow estimation model successfully! create saliency detection model successfully! /opt/conda/envs/diffusers/lib/python3.10/site-packages/timm/models/_factory.py:117: UserWarning: Mapping deprecated model name vit_base_resnet50_384 to current vit_base_r50_s16_384.orig_in21k_ft_in1k. model = create_fn( create controlnet model-depth successfully! unet/diffusion_pytorch_model.safetensors not found Loading pipeline components...: 0%| | 0/7 [00:00<?, ?it/s]/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/_utils.py:831: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() return self.fget.get(instance, owner)() Loading pipeline components...: 29%|███████████████████████████████████▋ | 2/7 [00:00<00:02, 2.22it/s]/opt/conda/envs/diffusers/lib/python3.10/site-packages/transformers/models/clip/feature_extraction_clip.py:28: FutureWarning: The class CLIPFeatureExtractor is deprecated and will be removed in version 5 of Transformers. Please use CLIPImageProcessor instead. warnings.warn( Loading pipeline components...: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [00:03<00:00, 1.80it/s] create diffusion model stablediffusionapi/flat-2d-animerge successfully!

==================================================================================================== key frame selection for "./data/boxer-punching-towards-camera.mp4"... processing 3 batches: keyframe indexes [[0, 2, 4, 6, 8, 10, 12, 14], [16, 18, 20, 22, 24], [26, 28, 30]]

==================================================================================================== video to video translation... processing batch [1/3] with 8 frames /opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:47<00:00, 3.15s/it] processing batch [2/3] with 5 frames 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:43<00:00, 2.89s/it] processing batch [3/3] with 3 frames 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:30<00:00, 2.01s/it]

==================================================================================================== translating full video with:

python video_blend.py ./output/boxer-punching-towards-camera/ --key keys --key_ind 0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30  --output ./output/boxer-punching-towards-camera/blend.mp4 --fps 10 --n_proc 4 -ps

/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined] /opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.) return _VF.meshgrid(tensors, kwargs) # type: ignore[attr-defined]

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0000.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0000.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0001.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_0/edge_0000.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_0/edge_0001.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_0/temporal_0000.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_0/temporal_0001.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_0/pos_0000.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_0/pos_0001.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_2/0002.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0002.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0002.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0001.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/edge_0002.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/edge_0001.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/temporal_0002.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/temporal_0001.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/pos_0002.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/pos_0001.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_0/0000.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0008.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0008.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0009.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/edge_0008.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/edge_0009.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/temporal_0008.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/temporal_0009.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/pos_0008.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/pos_0009.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_10/0010.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0002.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0002.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0003.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/edge_0002.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/edge_0003.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/temporal_0002.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/temporal_0003.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/pos_0002.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_2/pos_0003.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_4/0004.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0024.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0024.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0025.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/edge_0024.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/edge_0025.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/temporal_0024.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/temporal_0025.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/pos_0024.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/pos_0025.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_26/0026.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0016.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0016.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0017.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/edge_0016.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/edge_0017.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/temporal_0016.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/temporal_0017.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/pos_0016.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/pos_0017.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_18/0018.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0004.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0004.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0003.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/edge_0004.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/edge_0003.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/temporal_0004.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/temporal_0003.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/pos_0004.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/pos_0003.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_2/0002.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0010.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0010.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0009.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/edge_0010.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/edge_0009.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/temporal_0010.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/temporal_0009.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/pos_0010.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/pos_0009.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_8/0008.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0004.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0004.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0005.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/edge_0004.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/edge_0005.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/temporal_0004.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/temporal_0005.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/pos_0004.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_4/pos_0005.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_6/0006.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0026.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0026.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0025.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/edge_0026.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/edge_0025.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/temporal_0026.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/temporal_0025.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/pos_0026.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/pos_0025.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_24/0024.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0018.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0018.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0017.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/edge_0018.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/edge_0017.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/temporal_0018.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/temporal_0017.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/pos_0018.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/pos_0017.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_16/0016.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0006.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0006.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0005.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/edge_0006.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/edge_0005.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/temporal_0006.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/temporal_0005.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/pos_0006.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/pos_0005.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_4/0004.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0026.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0026.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0027.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/edge_0026.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/edge_0027.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/temporal_0026.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/temporal_0027.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/pos_0026.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_26/pos_0027.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_28/0028.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0010.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0010.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0011.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/edge_0010.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/edge_0011.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/temporal_0010.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/temporal_0011.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/pos_0010.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_10/pos_0011.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_12/0012.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0006.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0006.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0007.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/edge_0006.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/edge_0007.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/temporal_0006.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/temporal_0007.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/pos_0006.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_6/pos_0007.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_8/0008.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0028.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0028.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0027.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/edge_0028.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/edge_0027.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/temporal_0028.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/temporal_0027.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/pos_0028.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/pos_0027.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_26/0026.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0018.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0018.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0019.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/edge_0018.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/edge_0019.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/temporal_0018.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/temporal_0019.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/pos_0018.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_18/pos_0019.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_20/0020.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0012.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0012.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0011.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/edge_0012.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/edge_0011.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/temporal_0012.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/temporal_0011.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/pos_0012.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/pos_0011.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_10/0010.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0028.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0028.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0029.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/edge_0028.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/edge_0029.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/temporal_0028.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/temporal_0029.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/pos_0028.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_28/pos_0029.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_30/0030.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0008.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0008.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0007.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/edge_0008.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/edge_0007.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/temporal_0008.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/temporal_0007.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/pos_0008.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_8/pos_0007.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_6/0006.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0030.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0030.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0029.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_30/edge_0030.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_30/edge_0029.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_30/temporal_0030.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_30/temporal_0029.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_30/pos_0030.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_30/pos_0029.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_28/0028.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0012.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0012.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0013.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/edge_0012.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/edge_0013.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/temporal_0012.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/temporal_0013.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/pos_0012.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_12/pos_0013.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_14/0014.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0020.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0020.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0019.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/edge_0020.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/edge_0019.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/temporal_0020.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/temporal_0019.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/pos_0020.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/pos_0019.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_18/0018.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0014.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0014.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0013.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/edge_0014.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/edge_0013.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/temporal_0014.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/temporal_0013.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/pos_0014.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/pos_0013.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_12/0012.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0020.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0020.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0021.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/edge_0020.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/edge_0021.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/temporal_0020.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/temporal_0021.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/pos_0020.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_20/pos_0021.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_22/0022.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0014.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0014.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0015.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/edge_0014.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/edge_0015.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/temporal_0014.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/temporal_0015.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/pos_0014.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_14/pos_0015.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_16/0016.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0022.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0022.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0021.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/edge_0022.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/edge_0021.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/temporal_0022.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/temporal_0021.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/pos_0022.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/pos_0021.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_20/0020.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0016.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0016.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0015.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/edge_0016.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/edge_0015.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/temporal_0016.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/temporal_0015.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/pos_0016.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_16/pos_0015.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_14/0014.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0022.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0022.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0023.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/edge_0022.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/edge_0023.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/temporal_0022.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/temporal_0023.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/pos_0022.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_22/pos_0023.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_24/0024.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ cmd: ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/keys/0024.png -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0024.png /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/video/0023.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/edge_0024.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/edge_0023.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/temporal_0024.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/temporal_0023.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/pos_0024.jpg /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/tmp/out_24/pos_0023.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/boxer-punching-towards-camera/out_22/0022.jpg -searchvoteiters 12 -patchmatchiters 6 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

ebsynth: 234.69033813476562

oas: 
 ['./output/boxer-punching-towards-camera/out_0/0000.jpg', './output/boxer-punching-towards-camera/out_2/0002.jpg'] 
obs: 
 ['./output/boxer-punching-towards-camera/out_2/0002.jpg', './output/boxer-punching-towards-camera/out_0/0000.jpg'] 
binas: 
 ['./output/boxer-punching-towards-camera/out_0/0000.bin', './output/boxer-punching-towards-camera/out_2/0002.bin'] 
binbs: 
 ['./output/boxer-punching-towards-camera/out_2/0002.bin', './output/boxer-punching-towards-camera/out_0/0000.bin']

Traceback (most recent call last): File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 317, in main(args) File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 277, in main process_seq(video_sequence, i, blend_histogram, blend_gradient) File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 209, in process_seq dist1s.append(load_error(bin_a, img_shape)) File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 161, in load_error with open(bin_path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: './output/boxer-punching-towards-camera/out_2/0002.bin'

==================================================================================================== Done (diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO# (diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO#

williamyang1991 commented 8 months ago

@SingleZombie Do you have any idea?

yellowfish82 commented 8 months ago

And do you think this modification is needs?

this helped me resolve can not find jpg image issues as follow:

image

image

williamyang1991 commented 8 months ago

Can you successfully run config_carturn.yaml via the unedited code?

williamyang1991 commented 8 months ago

Are there any images generated in ./output/car-turn/blend/? What does the path ./output/car-turn/ look like

yellowfish82 commented 8 months ago

sorry, forgot to modify the yaml config file, I am running again now

yellowfish82 commented 8 months ago

the same error, can not find xxx.bin file and since I used not modified code, so can not find xxx.jpg are there too


(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO# rm -rf output/car-turn/
(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO# python run_fresco.py config/config_carturn.yaml 
====================================================================================================
loading configuration...
batch_size: 8
cond_scale: 0.7
controlnet_type: hed
end_opt_step: 15
file_path: ./data/car-turn.mp4
gmflow_path: ./model/gmflow_sintel-0c07dcb3.pth
max_process: 4
maxinterv: 5
mininterv: 5
num_inference_steps: 20
num_warmup_steps: 5
prompt: a red car turns in the winter
run_ebsynth: True
save_path: ./output/car-turn/
sd_path: SG161222/Realistic_Vision_V2.0
seed: 0
sod_path: ./model/epoch_resnet.pth
use_controlnet: True
use_freeu: False
use_salinecy: True

====================================================================================================
creating models...
create optical flow estimation model successfully!
create saliency detection model successfully!
create controlnet model-hed successfully!
safety_checker/model.safetensors not found
Loading pipeline components...:   0%|                                                                                                                                     | 0/7 [00:00<?, ?it/s]/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/_utils.py:831: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
  return self.fget.__get__(instance, owner)()
Loading pipeline components...: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [00:03<00:00,  1.76it/s]
create diffusion model SG161222/Realistic_Vision_V2.0 successfully!

====================================================================================================
key frame selection for "./data/car-turn.mp4"...
processing 3 batches:
keyframe indexes [[0, 5, 10, 15, 20, 25, 30, 35], [40, 45, 50, 55, 60], [65, 70, 75]]

====================================================================================================
video to video translation...
processing batch [1/3] with 8 frames
/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:44<00:00,  2.99s/it]
processing batch [2/3] with 5 frames
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:40<00:00,  2.73s/it]
processing batch [3/3] with 3 frames
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 15/15 [00:30<00:00,  2.03s/it]

====================================================================================================
translating full video with:

python video_blend.py ./output/car-turn/ --key keys --key_ind 0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 --output ./output/car-turn/blend.mp4 --fps 10 --n_proc 4 -ps

/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]
/opt/conda/envs/diffusers/lib/python3.10/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3526.)
  return _VF.meshgrid(tensors, **kwargs)  # type: ignore[attr-defined]

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 
cmd:
 ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/car-turn/keys/0000.png -guide /home/admin/workspace/ai/FRESCO/output/car-turn/video/0000.png /home/admin/workspace/ai/FRESCO/output/car-turn/video/0001.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_0/edge_0000.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_0/edge_0001.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_0/temporal_0000.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_0/temporal_0001.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_0/pos_0000.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_0/pos_0001.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/car-turn/out_0/0001.jpg -searchvoteiters 12 -patchmatchiters 6
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

[ WARN:0@4.741] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_0/0001.jpg'): can't open/read file: check file path/integrity
Process Process-1:
Traceback (most recent call last):
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 111, in process_sequences
    process_one_sequence(i, video_sequence)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 98, in process_one_sequence
    cmd += ' ' + g.get_cmd(j, w)
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/blender/guide.py", line 96, in get_cmd
    warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/flow/flow_utils.py", line 230, in warp
    if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 
cmd:
 ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/car-turn/keys/0020.png -guide /home/admin/workspace/ai/FRESCO/output/car-turn/video/0020.png /home/admin/workspace/ai/FRESCO/output/car-turn/video/0021.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_20/edge_0020.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_20/edge_0021.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_20/temporal_0020.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_20/temporal_0021.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_20/pos_0020.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_20/pos_0021.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/car-turn/out_20/0021.jpg -searchvoteiters 12 -patchmatchiters 6
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

[ WARN:0@7.952] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_20/0021.jpg'): can't open/read file: check file path/integrity
Process Process-2:
Traceback (most recent call last):
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 111, in process_sequences
    process_one_sequence(i, video_sequence)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 98, in process_one_sequence
    cmd += ' ' + g.get_cmd(j, w)
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/blender/guide.py", line 96, in get_cmd
    warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/flow/flow_utils.py", line 230, in warp
    if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 
cmd:
 ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/car-turn/keys/0040.png -guide /home/admin/workspace/ai/FRESCO/output/car-turn/video/0040.png /home/admin/workspace/ai/FRESCO/output/car-turn/video/0041.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_40/edge_0040.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_40/edge_0041.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_40/temporal_0040.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_40/temporal_0041.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_40/pos_0040.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_40/pos_0041.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/car-turn/out_40/0041.jpg -searchvoteiters 12 -patchmatchiters 6
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

[ WARN:0@16.393] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_40/0041.jpg'): can't open/read file: check file path/integrity
Process Process-3:
Traceback (most recent call last):
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 111, in process_sequences
    process_one_sequence(i, video_sequence)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 98, in process_one_sequence
    cmd += ' ' + g.get_cmd(j, w)
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/blender/guide.py", line 96, in get_cmd
    warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/flow/flow_utils.py", line 230, in warp
    if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 
cmd:
 ./src/ebsynth/deps/ebsynth/bin/ebsynth -style /home/admin/workspace/ai/FRESCO/output/car-turn/keys/0060.png -guide /home/admin/workspace/ai/FRESCO/output/car-turn/video/0060.png /home/admin/workspace/ai/FRESCO/output/car-turn/video/0061.png -weight 6 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_60/edge_0060.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_60/edge_0061.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_60/temporal_0060.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_60/temporal_0061.jpg -weight 0.5 -guide /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_60/pos_0060.jpg /home/admin/workspace/ai/FRESCO/output/car-turn/tmp/out_60/pos_0061.jpg -weight 2 -output /home/admin/workspace/ai/FRESCO/output/car-turn/out_60/0061.jpg -searchvoteiters 12 -patchmatchiters 6
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

[ WARN:0@31.702] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_60/0061.jpg'): can't open/read file: check file path/integrity
Process Process-4:
Traceback (most recent call last):
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/opt/conda/envs/diffusers/lib/python3.10/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 111, in process_sequences
    process_one_sequence(i, video_sequence)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 98, in process_one_sequence
    cmd += ' ' + g.get_cmd(j, w)
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/blender/guide.py", line 96, in get_cmd
    warped_img = flow_calc.warp(prev_img, self.flows[i - 1],
  File "/home/admin/workspace/ai/FRESCO/./src/ebsynth/flow/flow_utils.py", line 230, in warp
    if len(img.shape) == 2:
AttributeError: 'NoneType' object has no attribute 'shape'
ebsynth: 32.5006959438324

~~~~~~~~~~~~~~~~~ 
oas: 
 ['./output/car-turn/out_0/0000.jpg', './output/car-turn/out_0/0001.jpg', './output/car-turn/out_0/0002.jpg', './output/car-turn/out_0/0003.jpg', './output/car-turn/out_0/0004.jpg'] 
obs: 
 ['./output/car-turn/out_5/0005.jpg', './output/car-turn/out_5/0004.jpg', './output/car-turn/out_5/0003.jpg', './output/car-turn/out_5/0002.jpg', './output/car-turn/out_5/0001.jpg'] 
binas: 
 ['./output/car-turn/out_0/0000.bin', './output/car-turn/out_0/0001.bin', './output/car-turn/out_0/0002.bin', './output/car-turn/out_0/0003.bin', './output/car-turn/out_0/0004.bin'] 
binbs: 
 ['./output/car-turn/out_5/0005.bin', './output/car-turn/out_5/0004.bin', './output/car-turn/out_5/0003.bin', './output/car-turn/out_5/0002.bin', './output/car-turn/out_5/0001.bin']
~~~~~~~~~~~~~~~~~

[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_0/0001.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_0/0002.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_0/0003.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_0/0004.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_5/0005.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_5/0001.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_5/0002.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_5/0003.jpg'): can't open/read file: check file path/integrity
[ WARN:0@34.537] global loadsave.cpp:248 findDecoder imread_('./output/car-turn/out_5/0004.jpg'): can't open/read file: check file path/integrity
Traceback (most recent call last):
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 317, in <module>
    main(args)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 277, in main
    process_seq(video_sequence, i, blend_histogram, blend_gradient)
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 209, in process_seq
    dist1s.append(load_error(bin_a, img_shape))
  File "/home/admin/workspace/ai/FRESCO/video_blend.py", line 161, in load_error
    with open(bin_path, 'rb') as fp:
FileNotFoundError: [Errno 2] No such file or directory: './output/car-turn/out_0/0001.bin'

====================================================================================================
Done
(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO#
yellowfish82 commented 8 months ago

the following is output directory things


(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO/output/car-turn# pwd
/home/admin/workspace/ai/FRESCO/output/car-turn
(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO/output/car-turn# tree .
.
├── blend
├── keys
│   ├── 0000.png
│   ├── 0005.png
│   ├── 0010.png
│   ├── 0015.png
│   ├── 0020.png
│   ├── 0025.png
│   ├── 0030.png
│   ├── 0035.png
│   ├── 0040.png
│   ├── 0045.png
│   ├── 0050.png
│   ├── 0055.png
│   ├── 0060.png
│   ├── 0065.png
│   ├── 0070.png
│   └── 0075.png
├── out_0
│   └── 0000.jpg
├── out_10
├── out_15
├── out_20
│   └── 0020.jpg
├── out_25
├── out_30
├── out_35
├── out_40
│   └── 0040.jpg
├── out_45
├── out_5
├── out_50
├── out_55
├── out_60
│   └── 0060.jpg
├── out_65
├── out_70
├── out_75
├── tmp
│   ├── flow_f_0000.npy
│   ├── flow_f_0000.png
│   ├── flow_f_0001.npy
│   ├── flow_f_0001.png
│   ├── flow_f_0002.npy
│   ├── flow_f_0002.png
│   ├── flow_f_0003.npy
│   ├── flow_f_0003.png
│   ├── flow_f_0020.npy
│   ├── flow_f_0020.png
│   ├── flow_f_0021.npy
│   ├── flow_f_0021.png
│   ├── flow_f_0022.npy
│   ├── flow_f_0022.png
│   ├── flow_f_0023.npy
│   ├── flow_f_0023.png
│   ├── flow_f_0040.npy
│   ├── flow_f_0040.png
│   ├── flow_f_0041.npy
│   ├── flow_f_0041.png
│   ├── flow_f_0042.npy
│   ├── flow_f_0042.png
│   ├── flow_f_0043.npy
│   ├── flow_f_0043.png
│   ├── flow_f_0060.npy
│   ├── flow_f_0060.png
│   ├── flow_f_0061.npy
│   ├── flow_f_0061.png
│   ├── flow_f_0062.npy
│   ├── flow_f_0062.png
│   ├── flow_f_0063.npy
│   ├── flow_f_0063.png
│   ├── out_0
│   │   ├── edge_0000.jpg
│   │   ├── edge_0001.jpg
│   │   ├── edge_0002.jpg
│   │   ├── edge_0003.jpg
│   │   ├── edge_0004.jpg
│   │   ├── pos_0000.jpg
│   │   ├── pos_0001.jpg
│   │   ├── pos_0002.jpg
│   │   ├── pos_0003.jpg
│   │   ├── pos_0004.jpg
│   │   ├── temporal_0000.jpg
│   │   └── temporal_0001.jpg
│   ├── out_10
│   ├── out_15
│   ├── out_20
│   │   ├── edge_0020.jpg
│   │   ├── edge_0021.jpg
│   │   ├── edge_0022.jpg
│   │   ├── edge_0023.jpg
│   │   ├── edge_0024.jpg
│   │   ├── pos_0020.jpg
│   │   ├── pos_0021.jpg
│   │   ├── pos_0022.jpg
│   │   ├── pos_0023.jpg
│   │   ├── pos_0024.jpg
│   │   ├── temporal_0020.jpg
│   │   └── temporal_0021.jpg
│   ├── out_25
│   ├── out_30
│   ├── out_35
│   ├── out_40
│   │   ├── edge_0040.jpg
│   │   ├── edge_0041.jpg
│   │   ├── edge_0042.jpg
│   │   ├── edge_0043.jpg
│   │   ├── edge_0044.jpg
│   │   ├── pos_0040.jpg
│   │   ├── pos_0041.jpg
│   │   ├── pos_0042.jpg
│   │   ├── pos_0043.jpg
│   │   ├── pos_0044.jpg
│   │   ├── temporal_0040.jpg
│   │   └── temporal_0041.jpg
│   ├── out_45
│   ├── out_5
│   ├── out_50
│   ├── out_55
│   ├── out_60
│   │   ├── edge_0060.jpg
│   │   ├── edge_0061.jpg
│   │   ├── edge_0062.jpg
│   │   ├── edge_0063.jpg
│   │   ├── edge_0064.jpg
│   │   ├── pos_0060.jpg
│   │   ├── pos_0061.jpg
│   │   ├── pos_0062.jpg
│   │   ├── pos_0063.jpg
│   │   ├── pos_0064.jpg
│   │   ├── temporal_0060.jpg
│   │   └── temporal_0061.jpg
│   ├── out_65
│   ├── out_70
│   └── out_75
└── video
    ├── 0000.png
    ├── 0001.png
    ├── 0002.png
    ├── 0003.png
    ├── 0004.png
    ├── 0005.png
    ├── 0006.png
    ├── 0007.png
    ├── 0008.png
    ├── 0009.png
    ├── 0010.png
    ├── 0011.png
    ├── 0012.png
    ├── 0013.png
    ├── 0014.png
    ├── 0015.png
    ├── 0016.png
    ├── 0017.png
    ├── 0018.png
    ├── 0019.png
    ├── 0020.png
    ├── 0021.png
    ├── 0022.png
    ├── 0023.png
    ├── 0024.png
    ├── 0025.png
    ├── 0026.png
    ├── 0027.png
    ├── 0028.png
    ├── 0029.png
    ├── 0030.png
    ├── 0031.png
    ├── 0032.png
    ├── 0033.png
    ├── 0034.png
    ├── 0035.png
    ├── 0036.png
    ├── 0037.png
    ├── 0038.png
    ├── 0039.png
    ├── 0040.png
    ├── 0041.png
    ├── 0042.png
    ├── 0043.png
    ├── 0044.png
    ├── 0045.png
    ├── 0046.png
    ├── 0047.png
    ├── 0048.png
    ├── 0049.png
    ├── 0050.png
    ├── 0051.png
    ├── 0052.png
    ├── 0053.png
    ├── 0054.png
    ├── 0055.png
    ├── 0056.png
    ├── 0057.png
    ├── 0058.png
    ├── 0059.png
    ├── 0060.png
    ├── 0061.png
    ├── 0062.png
    ├── 0063.png
    ├── 0064.png
    ├── 0065.png
    ├── 0066.png
    ├── 0067.png
    ├── 0068.png
    ├── 0069.png
    ├── 0070.png
    ├── 0071.png
    ├── 0072.png
    ├── 0073.png
    ├── 0074.png
    └── 0075.png

36 directories, 176 files
(diffusers) root@dsw-348389-b6d8bbb65-mw2gl:/home/admin/workspace/ai/FRESCO/output/car-turn#
G-force78 commented 8 months ago

when running install.py did you add chmod command to allow access to ebsynth? Not sure why this hasn't been added to the repo yet..

yellowfish82 commented 8 months ago

I already changed the ebsynth mod as below. but is still occurr the error above. what is more I should do?

image

williamyang1991 commented 8 months ago

The log seems to show no error information than that the images are not found. I think one possible problem is that the ebsynth does not properlly run, thus 0061.png is not found, (all other modules like the optical flow work well since temporal_0061.jpg, pos_0061.jpg, 61_edge.png, flow_f_0061.npy are all generated)

Maybe you can try to rebuild ebsynth? https://github.com/williamyang1991/Rerender_A_Video/issues/38#issuecomment-1730735138

yellowfish82 commented 8 months ago

actually I am curious about for your experience, if all the things go right, the image and bin files will be generated successfully in the target directory or is a bug about indicated a wrong path to load wrong images?

for the reason why the log said:


[ WARN:0@220.145] global loadsave.cpp:248 findDecoder imread_('./output/boxer-punching-towards-camera/out_0/0001.jpg'): can't open/read file: check file path/integrity
[ WARN:0@220.149] global loadsave.cpp:248 findDecoder imread_('./output/boxer-punching-towards-camera/out_2/0001.jpg'): can't open/read file: check file path/integrity

and/or

FileNotFoundError: [Errno 2] No such file or directory: './output/boxer-punching-towards-camera/out_0/0001.bin'
williamyang1991 commented 8 months ago

Yes, if all the things go right, the image and bin files will be generated successfully in the target directory. And after the video is generated, all these intermediate files will be removed automatically.

For your case, 0001.bin and 0001.jpg is the intermediate files of ebsynth. So I suppose there is some wrong with your ebsynth.

yellowfish82 commented 8 months ago

is there a way to check whether the ebsynth is installed correct or not?

williamyang1991 commented 8 months ago

If it is installed, then 0001.bin and 0001.jpg will be successfully generated. Otherwise, it is not corerectly installed.

yellowfish82 commented 8 months ago

重新安装ebsynth后成功了

williamyang1991 commented 8 months ago

Congrat! The problem is indeed due to the incorrect installation.