PeizhuoLi / ganimator

A motion generation model learned from a single example [SIGGRAPH 2022]
Other
379 stars 46 forks source link

Trouble understanding the skeleton operator #9

Open fire opened 2 years ago

fire commented 2 years ago

Hi, I'm having trouble understanding the pooling operator. Posting for others to recreate.

My goal to see if it's possible to describe each frame of the animation in tabular (spreadsheet) input format so I can compute it as a ludwig compute. https://ludwig-ai.github.io/ludwig-docs/0.5/

My goal is to identify per bone the pooled limb and the specific bone classification without using text processing.

image

  1. Given a t-pose skeletal.
  2. May also be a series of animation frames.
  3. May be corrected so that global bone pose forward points up roll correction and must not be all rotation identity.
  4. There's a pooled skeleton
  5. The pooled skeleton bone hips stores global position and rotation as the root motion bone
  6. Offset for the bones in each pooled limb is stored in some way?
  7. Each original bone's rotation is stored?
  8. There's a graph representation connecting each bone to an edge
  9. The representation should store one frame's worth of data.

References

This training input data solves for the bone classification using text processing. https://github.com/V-Sekai-fire/ML_avatar_wellness/blob/main/ml/train.tsv