search

enesduran / HMP

Other
40 stars 3 forks source link

Motion Prior for the Left Hand #1

Closed zhangy76 closed 7 months ago

zhangy76 commented 7 months ago

Hi,

Thank you for sharing the great work! May I ask how to handle left hand motion? Are we supposed to train the motion prior using left hand pose data?

Thanks, Yufei

enesduran commented 7 months ago

Hey, glad to hear your words.

It is not necessary to train on the left hand motion actually. What you can do is to flip the output of the motion prior model so that it becomes left hand. For an axis angle output you can multiply with [1, -1, -1] to flip hands

This trick allows us to leverage the left hand in the dataset in training actually. In data processing we flipped left hands to get more data.

zhangy76 commented 7 months ago

Thank you for the prompt reply! Got it. So, we utilize both the left and right hand data to train the hand motion prior (we also have more data by doing this). During testing, the prior model can work for both cases by flipping the input when needed.

Yufei

enesduran commented 7 months ago

Exactly. Just flip the hand when encoding (if left) and then flip the output back.

zhangy76 commented 7 months ago

Got it. Thanks.