c-he / NeMF

[NeurIPS 2022] Official implementation of "NeMF: Neural Motion Fields for Kinematic Animation"
MIT License
155 stars 9 forks source link

Can NeMF be used for generating physically plaussible and smooth motion sequence from coarse predicted motion sequence #14

Open ChangjianLi opened 1 year ago

c-he commented 1 year ago

That sounds like a motion in-betweening task, and we've shown some results on it. However, since NeMF is a kinematics model, it is not guaranteed to produce physically-correct results, and artifacts such as foot skating are inevitable. To remedy these artifacts, you probably need to introduce some physics energy terms in the optimization, or probably you can correct NeMF results with some reinforcement learning works in physics-based character control (e.g., https://ye-yuan.com/rfc/)