search

TimoBolkart / voca

This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.
https://voca.is.tue.mpg.de/en
1.14k stars 271 forks source link

"video.mp4" only has speech but no images ? #107

Open wsywsywsywsywsy979 opened 1 year ago

wsywsywsywsywsy979 commented 1 year ago

hi , after I running run_voca.py( using the command"python run_voca.py --tf_model_fname './model/gstep_52280.model' --ds_fname './ds_graph/output_graph.pb' --audio_fname './audio/test_sentence.wav' --template_fname './template/FLAME_sample.ply' --condition_idx 3 --out_path './animation_output'" and "python run_voca.py --tf_model_fname './model/gstep_52280.model' --ds_fname './ds_graph/output_graph.pb' --audio_fname './audio/test_sentence.wav' --template_fname './template/FLAME_sample.ply' --condition_idx 3 --uv_template_fname './template/texture_mesh.obj' --texture_img_fname './template/texture_mesh.png' --out_path './animation_output_textured'")， both generates "video.mp4"， but when I check this video, only speech have no image in it.

mhxlearn commented 1 year ago

Download the MP4 file and open it on Windows

wsywsywsywsywsy979 commented 1 year ago

Download the MP4 file and open it on Windows

Thanks for comments. But That is what I did , because I runned the codes with docker in server, which I can't play the video directly. So I must download it to windows to play.

mhxlearn commented 1 year ago

Download the MP4 file and open it on Windows

Thanks for comments. But That is what I did , because I runned the codes with docker in server, which I can't play the video directly. So I must download it to windows to play.

I had the same problem. It starts with sound and no picture on Windows as well. Could you try switching the video player？If not, I don't know why.

wsywsywsywsywsy979 commented 1 year ago

Download the MP4 file and open it on Windows

Thanks for comments. But That is what I did , because I runned the codes with docker in server, which I can't play the video directly. So I must download it to windows to play.

I had the same problem. It starts with sound and no picture on Windows as well. Could you try switching the video player？If not, I don't know why.

I maybe find the reason is that pyrender couldn't make an effect in docker, so the every frame in video is be setted with full black color, what I do now is setting the "visualize" to false and downloading the all obj files to windows, I find the obj files is correct , but I still can''t find a available render method to use this file generate a video. I try to use bpy library, but Its installation is too diffcult to implement, So I'm still finding another method.