how can i get the 3d-landmark xxx.npy of my own input audio file?

KylinYee / R2-Talker-code

R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning

MIT License

71 stars 4 forks source link

how can i get the 3d-landmark xxx.npy of my own input audio file? #1

Open lokvke opened 6 months ago

KylinYee commented 6 months ago

Thank you for your interest in this project, if you want to get a landmark for custom data, you need to train a postnet related to the character video through the code of Geneface and the postnet can convert the audio into the corresponding landmark. I am also gradually adding the postnet to the R2-Talker project, and I hope it will be convenient for everyone to use in the future.

Oyiyi commented 5 months ago

Same request here, thank you!