TMElyralab / MuseV

MuseV: Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising
Other
2.26k stars 240 forks source link

Report error #50

Open DatanIMU opened 4 months ago

DatanIMU commented 4 months ago

ou 无标题 ![Uploading 无标题.jpg…]() t_videos.shape (1, 3, 12, 448, 256) G:\BaiduNetdiskDownload\MuseV-240404\MuseV\scripts\gradio\results\vm2v_m=majicmixRealv6Fp16_rm=musev_referencenet_c=cluslkee5000148un6078qfr1_w=256_h=448_t=12_n=1_vn=10_w=0.001_w=0.5_s=2918172_n=dwpose_body_hand_s=0.8_g=7.5_vs=1.0_vg=3.5_p=1ec06_V2_r=clu_ip=clu_f=no.mp4: No such file or directory Traceback (most recent call last): File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio_ffmpeg_io.py", line 630, in write_frames p.stdin.write(bb) BrokenPipeError: [Errno 32] Broken pipe

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\blocks.py", line 1437, in process_api result = await self.call_function( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\blocks.py", line 1109, in call_function prediction = await anyio.to_thread.run_sync( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\anyio\to_thread.py", line 56, in run_sync return await get_async_backend().run_sync_in_worker_thread( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread return await future File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\anyio_backends_asyncio.py", line 851, in run result = context.run(func, args) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\utils.py", line 641, in wrapper response = f(args, *kwargs) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\utils.py", line 641, in wrapper response = f(args, kwargs) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV\scripts\gradio\gradio_video2video.py", line 1013, in online_v2v_inference save_videos_grid_with_opencv( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV\musev\utils\util.py", line 230, in save_videos_grid_with_opencv imageio.mimsave(path, outputs, params) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\v2.py", line 495, in mimwrite return file.write(ims, is_batch=True, **kwargs) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\core\legacy_plugin_wrapper.py", line 253, in write writer.append_data(image, metadata) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\core\format.py", line 590, in append_data return self._append_data(im, total_meta) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\plugins\ffmpeg.py", line 600, in _append_data self._write_gen.send(im) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio_ffmpeg_io.py", line 637, in write_frames raise IOError(msg) OSError: [Errno 32] Broken pipe

FFMPEG COMMAND: G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio_ffmpeg\binaries\ffmpeg-win64-v4.2.2.exe -y -f rawvideo -vcodec rawvideo -s 256x448 -pix_fmt rgb24 -r 6.00 -i - -an -vcodec libx264 -pix_fmt yuv420p -crf 5 -v warning G:\BaiduNetdiskDownload\MuseV-240404\MuseV\scripts\gradio\results\vm2v_m=majicmixRealv6Fp16_rm=musev_referencenet_c=cluslkee5000148un6078qfr1_w=256_h=448_t=12_n=1_vn=10_w=0.001_w=0.5_s=2918172_n=dwpose_body_hand_s=0.8_g=7.5_vs=1.0_vg=3.5_p=1ec06_V2_r=clu_ip=clu_f=no.mp4

FFMPEG STDERR OUTPUT:

i_test_data {'name': 'cluslpl9j000248unfxzvkihc', 'prompt': '(masterpiece, best quality, highres:1)', 'video_path': 'C:\Users\Mocopi\AppData\Local\Temp\gradio\6353fca934d3b8c613a99a607046f336f601fddf\111.mp4', 'condition_images': './t2v_input_image\cluslpl9j000248unfxzvkihc.jpg', 'refer_image': './t2v_input_image\cluslpl9j000248unfxzvkihc.jpg', 'ipadapter_image': './t2v_input_image\cluslpl9j000248unfxzvkihc.jpg', 'height': -1.0, 'width': -1.0, 'img_length_ratio': 1.0} majicmixRealv6Fp16 {'condition_images': './t2v_input_image\cluslpl9j000248unfxzvkihc.jpg', 'height': -1.0, 'img_length_ratio': 1.0, 'ipadapter_image': './t2v_input_image\cluslpl9j000248unfxzvkihc.jpg', 'name': 'cluslpl9j000248unfxzvkihc', 'prompt': '(masterpiece, best quality, highres:1)', 'prompt_hash': '1ec06', 'refer_image': './t2v_input_image\cluslpl9j000248unfxzvkihc.jpg', 'video_path': 'C:\Users\Mocopi\AppData\Local\Temp\gradio\6353fca934d3b8c613a99a607046f336f601fddf\111.mp4', 'width': -1.0} test_data_height=448 test_data_width=256 2024-04-10 00:33:56,352- py.warnings:109- WARNING- G:\BaiduNetdiskDownload\MuseV-240404\MuseV\diffusers\src\diffusers\configuration_utils.py:135: FutureWarning: Accessing config attribute vae_scale_factor directly via 'VaeImageProcessor' object attribute is deprecated. Please access 'vae_scale_factor' over 'VaeImageProcessor's config object instead, e.g. 'scheduler.config.vae_scale_factor'. deprecate("direct config name access", "1.0.0", deprecation_message, standard_warn=False)

2024-04-10 00:33:56,689- py.warnings:109- WARNING- G:\BaiduNetdiskDownload\MuseV-240404\MuseV\musev\models\unet_3d_condition.py:910: FutureWarning: Accessing config attribute temporal_transformer directly via 'UNet3DConditionModel' object attribute is deprecated. Please access 'temporal_transformer' over 'UNet3DConditionModel's config object instead, e.g. 'unet.config.temporal_transformer'. if self.temporal_transformer is not None:

2024-04-10 00:33:56,689- py.warnings:109- WARNING- G:\BaiduNetdiskDownload\MuseV-240404\MuseV\musev\models\unet_3d_condition.py:931: FutureWarning: Accessing config attribute temporal_transformer directly via 'UNet3DConditionModel' object attribute is deprecated. Please access 'temporal_transformer' over 'UNet3DConditionModel's config object instead, e.g. 'unet.config.temporal_transformer'. if self.temporal_transformer is not None:

2024-04-10 00:35:39,240- py.warnings:109- WARNING- G:\BaiduNetdiskDownload\MuseV-240404\MuseV\diffusers\src\diffusers\pipelines\controlnet\pipeline_controlnet_img2img.py:485: FutureWarning: The decode_latents method is deprecated and will be removed in 1.0.0. Please use VaeImageProcessor.postprocess(...) instead deprecate("decode_latents", "1.0.0", deprecation_message, standard_warn=False)

out_videos.shape (1, 3, 12, 448, 256) G:\BaiduNetdiskDownload\MuseV-240404\MuseV\scripts\gradio\results\vm2v_m=majicmixRealv6Fp16_rm=musev_referencenet_c=cluslpl9j000248unfxzvkihc_w=256_h=448_t=12_n=1_vn=10_w=0.001_w=0.5_s=13436546_n=dwpose_body_hand_s=0.8_g=7.5_vs=1.0_vg=3.5_p=1ec06_V2_r=clu_ip=clu_f=no.mp4: No such file or directory Traceback (most recent call last): File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio_ffmpeg_io.py", line 630, in write_frames p.stdin.write(bb) BrokenPipeError: [Errno 32] Broken pipe

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\queueing.py", line 388, in call_prediction output = await route_utils.call_process_api( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\route_utils.py", line 219, in call_process_api output = await app.get_blocks().process_api( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\blocks.py", line 1437, in process_api result = await self.call_function( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\blocks.py", line 1109, in call_function prediction = await anyio.to_thread.run_sync( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\anyio\to_thread.py", line 56, in run_sync return await get_async_backend().run_sync_in_worker_thread( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread return await future File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\anyio_backends_asyncio.py", line 851, in run result = context.run(func, args) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\utils.py", line 641, in wrapper response = f(args, *kwargs) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\gradio\utils.py", line 641, in wrapper response = f(args, kwargs) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV\scripts\gradio\gradio_video2video.py", line 1013, in online_v2v_inference save_videos_grid_with_opencv( File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV\musev\utils\util.py", line 230, in save_videos_grid_with_opencv imageio.mimsave(path, outputs, params) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\v2.py", line 495, in mimwrite return file.write(ims, is_batch=True, **kwargs) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\core\legacy_plugin_wrapper.py", line 253, in write writer.append_data(image, metadata) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\core\format.py", line 590, in append_data return self._append_data(im, total_meta) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio\plugins\ffmpeg.py", line 600, in _append_data self._write_gen.send(im) File "G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio_ffmpeg_io.py", line 637, in write_frames raise IOError(msg) OSError: [Errno 32] Broken pipe

FFMPEG COMMAND: G:\BaiduNetdiskDownload\MuseV-240404\MuseV.glut\lib\site-packages\imageio_ffmpeg\binaries\ffmpeg-win64-v4.2.2.exe -y -f rawvideo -vcodec rawvideo -s 256x448 -pix_fmt rgb24 -r 6.00 -i - -an -vcodec libx264 -pix_fmt yuv420p -crf 5 -v warning G:\BaiduNetdiskDownload\MuseV-240404\MuseV\scripts\gradio\results\vm2v_m=majicmixRealv6Fp16_rm=musev_referencenet_c=cluslpl9j000248unfxzvkihc_w=256_h=448_t=12_n=1_vn=10_w=0.001_w=0.5_s=13436546_n=dwpose_body_hand_s=0.8_g=7.5_vs=1.0_vg=3.5_p=1ec06_V2_r=clu_ip=clu_f=no.mp4

FFMPEG STDERR OUTPUT:

xzqjack commented 4 months ago

@DatanIMU hi, this error is same as #36. We are updating new services and expect to resolve this issue. We will let you know later.

xzqjack commented 4 months ago

@DatanIMU Your download video is broken?

DatanIMU commented 4 months ago

I searched for an image online and asked them to directly capture a part of our project's openpose video demo, so that the openpose in the first frame is roughly consistent with the pose in the image

raochinmay6 commented 2 months ago

can anyone help me to download this into my PC I'm not good at coding