google-research / mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.
Apache License 2.0
497 stars 85 forks source link

BeatAlign #17

Closed YIN95 closed 2 years ago

YIN95 commented 2 years ago

Hi Ruilong,

I was wondering whether the kinematic beats are computed based on the whole body joints? I cannot find these codes.

wang-zm18 commented 2 years ago

@YIN95 Hello, Wenjie, did you find the corresponding code?

kotomiDu commented 2 years ago

@YIN95 @wang-zm18 @liruilong940607 I have same question, where does the kinetic velocity come from?

liruilong940607 commented 2 years ago

Hi, please refer to the code here for beat metric calculation:

https://github.com/liruilong940607/mint/blob/main/tools/calculate_beat_scores.py

Sorry that I forgot to merge updates from my personal branch to this official repo. I just created a merge request but would need to wait for my collaborators to approve it.