jnnan / trumans_utils

Repository of TRUMANS
83 stars 3 forks source link

Action Label #7

Open yw0208 opened 4 weeks ago

yw0208 commented 4 weeks ago

Hi, great work! There are some questions about action labels. According to my understanding, action labels should be an important input of your generative model. But there is no such input in your demo code. BTW, I noticed there is a dir named "Action" in the TRUMANS dataset, but I don't know what it means and how to use it. Could you explain how action labels work in the generative model? And how do you define and use it? Thank you!

jnnan commented 2 days ago

We add the training code which takes the action labels (action_labels.npy) as input. The dir named "Action" is the language annotation of the motions in TRUMANS dataset. The txt file name is the motion segment name. Each line of file indicates one interaction clip, with the start frame, end frame and motion description.