setarehc / diffusion-motion-inbetweening

The official implementation of Flexible Motion In-betweening with Diffusion Models, SIGGRAPH 2024
https://setarehc.github.io/CondMDI/
Other
120 stars 9 forks source link

Motion Synthesis Error #15

Open HellOInDec opened 3 months ago

HellOInDec commented 3 months ago

created 1 samples saving results file to [save/results/condmdi_uncond/samples_000500000_seed10_a_person_is_running/results.npy] saving visualizations to [save/results/condmdi_uncond/samples_000500000_seed10_a_person_is_running]... ["a person is running" (00) | Rep #00 | -> sample00_rep00.mp4] MovieWriter stderr: [h264_nvenc @ 0x55ea1c81e380] OpenEncodeSessionEx failed: unsupported device (2) [h264_nvenc @ 0x55ea1c81e380] No NVENC capable devices found

icedwater commented 2 months ago

Hi HellOInDec,

I could open the MP4 generated from a conditional synthesis.

Edit: for unconditional, I run into this error:

Traceback (most recent call last):
  File "/home/iced/anaconda3/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/home/iced/anaconda3/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/home/iced/projects/CondMDI/sample/synthesize.py", line 20, in <module>
    from data_loaders.amass.utils.utils import batch_to_dict, dict_to_batch
  File "/home/iced/projects/CondMDI/data_loaders/amass/utils/utils.py", line 6, in <module>
    from human_body_prior.tools.omni_tools import copy2cpu as c2c
ModuleNotFoundError: No module named 'human_body_prior'

Have you resolved your issue? Maybe it is an issue with MovieWriter on your end?

setarehc commented 2 months ago

You're getting this error because you're missing human_body-prior package which is only required when dealing with the amass dataset. Since the current version of the code doesn't provide the amass models, I've gone ahead and commented out the lines related to sampling from the amass model in sample/synthesize.py. Please try pulling the new script and re-running the code.

icedwater commented 2 months ago

Thank you for your update, @setarehc! I've pulled the new code into my repo and sample/synthesize.py works fine now.