dulucas / siMLPe

A Simple Baseline for Human Motion Prediction
MIT License
127 stars 19 forks source link

How to use the preditction model in real video? #19

Closed Ninialover closed 3 weeks ago

Ninialover commented 1 month ago

Hello! I would like to use this model to predict my walking motion.If I want to complete the above task, do I need to convert the joint data in the video into other data formats (ex. h36m).Then how can I convert 3d joint data to h36m data. Thanks.

dulucas commented 3 weeks ago

Maybe you can train a motion prediction model with AMASS data, then detect your motion in the video using a 3D human pose model, and feed the captured motion to the trained motion prediction model to forecast your motion?