wyhuai / PhysHOI

Official code release for the paper "PhysHOI: Physics-Based Imitation of Dynamic Human-Object Interaction"
Other
167 stars 7 forks source link

Issues with Rebound and Backspin Using Pre-trained Model #9

Open zhanglbthu opened 1 month ago

zhanglbthu commented 1 month ago

Hello, When I use the trained model to reproduce the rebound and backspin action, something goes wrong, like the following:

https://github.com/wyhuai/PhysHOI/assets/101646108/f5dfc2bb-5997-4554-a5a4-364fc0a10de3

https://github.com/wyhuai/PhysHOI/assets/101646108/ef8cb6f4-50f2-4a1e-8e6c-07323e91a61e

Has this happened to any of you, please? Thank you for your reply.

zhanglbthu commented 1 month ago

Btw, the trained model was downloaded from the official.

wyhuai commented 1 month ago

Btw, the trained model was downloaded from the official.

Hi, these issue happens in this code version. There are mainly two reasons: (1) the reference data is not accurate, especially the "rebound" data; (2) the current code uses the first frame to initialize the env. In our follow-up work, using accurate HOI data and applying random frame initialization can significantly improve imitation performance.