search

paulstarke / PhaseBetweener

Creating animation sequences between sparse key frames using motion phase features.
183 stars 25 forks source link

How to train PAE and extract Phases from it? #14

Open dj-kefir-siorbacz opened 1 year ago

dj-kefir-siorbacz commented 1 year ago

I've watched the video on how to train it (https://www.youtube.com/watch?v=3ASGrxNDd0k) and downloaded the Untiy project (https://github.com/sebastianstarke/AI4Animation/tree/master/AI4Animation/SIGGRAPH_2022/Unity), but I have following doubts/issues:

  1. Is the BVH import functionality the same as in the PhaseBetweener?
  2. How to create a scene with motion editor for a Biped model (ex. LaFAN model)?
  3. There is no Biped pipeline in this project: image
  4. Provided I get the following output data: image what should I do with them? Do I need to follow the video step by step until the end in order to train the GNN? But is this GNN the same as in the PhaseBetweener? Or can I somehow copy them to PhaseBetweener Unity project as Phase parameters? But then how do I convert them to the following format required by PhaseBetweener: image ?
dj-kefir-siorbacz commented 1 year ago

@pauzii in case you missed it :)