neu-vi / OmniControl

OmniControl: Control Any Joint at Any Time for Human Motion Generation, ICLR 2024
https://neu-vi.github.io/omnicontrol/
MIT License
235 stars 15 forks source link

Why not use rotation data for control #18

Open lunarlabour opened 2 months ago

lunarlabour commented 2 months ago

Hi, I have two questions about the rotation data in the genearted dataframe:

  1. You only utilize the relative xyz (ric data) in the generation and motion recovery. Is the rotation just redundant data for network training assistance? Have you tried using rotation data for control guidance?

  2. Did you evaluate the quality of the rot data in the generated results? The FID measures it, but not directly. Have you tried recovering motion from the rotation data and assessing control error and visual performance?

ymingxie commented 2 months ago

Thanks for your interest in our work.

  1. Yes the rotation part is just for network training. In the control guidance, we only use relative xyz. We didn't try to use rotation data. Probably it works as well.
  2. No. When converting to human joints from the redundant representation (263), we always use relative xyz.