google-research / mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.
Apache License 2.0
497 stars 85 forks source link

Is there some relation between audio input and motion input? Could you please provide some inference code for other custom audio inputs? #31

Open sunshangyu opened 2 years ago

liruilong940607 commented 2 years ago

Hi We are currently not support that in the code base. But it should be that hard to modify the code.

Please to refer to the preprocessing code on how to extract audio features and create the test file:

https://github.com/google-research/mint/blob/main/tools/preprocessing.py