search

zkf1997 / DIMOS

code release of paper "DIMOS: Synthesizing Diverse Human Motions in 3D Indoor Scenes"
https://zkf1997.github.io/DIMOS/
Apache License 2.0
79 stars 3 forks source link

Slow vis #3

Open shamangary opened 1 year ago

shamangary commented 1 year ago

Hello, great project.

I tried to run the vis for locomotion but it has been running for a very long time for pyrender. I wonder how long do you normally run it and is there a way to speed up.

Thanks in advance!

zkf1997 commented 1 year ago

Hi,

The pyrender visualization script is slow because we need to update human body meshes at each frame via SMPLX model inference and update the body mesh node in pyrender. This can lead to low fps especially when visualizing multiple sequences at the same time. With my local workstation, it works OK for visualizing up to 8 sequences at the same time.

If the visualization is too slow for you, you may first try to visualize only 1 sequence at a time (check args.seq_path and args.max_vis). The SMPLX inference part could be precomputed to accelerate but the pyrender part can still be a bottleneck.

Another alternative visualization solution is to import the motion results into Blender for real-time visualization. I uploaded the blender script to import the result files here. Before running this script, you need to first install Blender and the SMPLX add-on. The primitive loading may take some time. After finishing loading, the results can be viewed in real time in Blender. Note that you also need to load the scenes in blender, and visualizing too many sequences at the same time can also lead to low fps.