Applied to a 3D model of the human body as a whole

Doubiiu / CodeTalker

[CVPR 2023] CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior

MIT License

531 stars 58 forks source link

Applied to a 3D model of the human body as a whole #6

Closed LihaoshengQAZ closed 1 year ago

LihaoshengQAZ commented 1 year ago

First of all, thank the author for opening up the code. I am currently confused about this output video. I would like to apply it to a 3D model of the human body as a whole. What method should I use to apply it? Can you provide an answer?

Doubiiu commented 1 year ago

Hi~ Thanks for your interest! Let me rephrase your questions as: Now you have a whole 3D model of the human body and you would like to animate the head (face) according to the audio signal using CodeTalker? If so, the simplest way is to "crop" the head part, and animate it using CodeTalker separately (make sure it is in FLAME or BIWI topology.) I am not sure if this paper could be useful for your case.