search

sebastianstarke / AI4Animation

Bringing Characters to Life with Computer Brains in Unity
7.83k stars 1.05k forks source link

How to apply deepphase to music-dance generation? #103

Closed youngstu closed 1 year ago

youngstu commented 1 year ago

How to apply deepphase to music to dance generation? And how to combine deepphase with FACT and Bailando. Could you provide some demo code.

Very Thanks.

youngstu commented 1 year ago

How to encode a single frame without time range using deepphase in autoregressive decoder module?

sebastianstarke commented 1 year ago

For generating music features, this has been addressed here: https://github.com/sebastianstarke/AI4Animation/issues/97 For training the PAE decoder, the time range is needed to reconstruct the latent space from the learned phase parameters.

starryforest-ymxk commented 4 months ago

I just did some work on this. If you still have this question, you can find it here : DeepPhase-DanceGeneration Hope it help you. :) @youngstu