search

YoungSeng / FreeTalker

Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness (ICASSP 2024)
https://youngseng.github.io/FreeTalker/
62 stars 9 forks source link

How to handle converting smplx to h5 files？ #3

Closed yangdaowu closed 6 months ago

yangdaowu commented 6 months ago

Hello, I currently have an SMPLX file and I would like to convert it to an H5 file. Should I first convert it to BVH and then convert it according to the method you provided？

YoungSeng commented 6 months ago

No, our work converts the BVH of the BEAT dataset to smplx without reversing it; you can generate h5 files directly from the smplx format.

yangdaowu commented 6 months ago

Is it okay to skip Audio2Gesture directly and run Prepare features? May I know the file format after converting BVH to SMPLX? I will follow your converted file format. Thank you very much

YoungSeng commented 6 months ago

I think you can try both, or just read the well understood code and see if there's a specific part that's problematic

yangdaowu commented 6 months ago

Okay, I'll give it a try. Thank you for your answer