facebookresearch / frankmocap

A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator
Other
2.12k stars 373 forks source link

why pyrender and pytorch3d cpu render so slow #188

Open lucasjinreal opened 2 years ago

lucasjinreal commented 2 years ago

pytorch3d need about 40ms to render, while I switch to Sim3DR it only need 4ms

penincillin commented 2 years ago

Yeah, it might happen. Glad that you find a faster renderer.

lucasjinreal commented 2 years ago

@penincillin Will u consider using Sim3DR? I now successfully replaced with it, now on CPU render only need 4ms.

I tried Open3D, pyrender, pytorch3D, all need at least 30-40ms. Very weird.

Now, I can run frankmocap body model on CPU realtime! (including rendering time), the pose model inference on Onnxruntime faster than Pytorch cpu

penincillin commented 2 years ago

@jinfagang That sounds great! Would you mind making a pull request to include the updates you mentioned (Sim3DR, Onnxruntime, etc.)?

lucasjinreal commented 2 years ago

@penincillin Sure, but my modification is too messy. I will send a PR with minimal modification on change render with pip install realrender as an option. It's python package for Sim3DR.

penincillin commented 2 years ago

@jinfagang That sounds great. Looking forward to your PR!