search

yunik1004 / SAiD

SAiD: Blendshape-based Audio-Driven Speech Animation with Diffusion
https://yunik1004.github.io/SAiD/
Apache License 2.0
89 stars 17 forks source link

generate blendshapes #2

Open duan348733684 opened 9 months ago

duan348733684 commented 9 months ago

Great work, it seems you've only calculated 32 blendshapes, can your method be used to calculate all 52?

yunik1004 commented 9 months ago

Remained blend shapes are related to the eyes (and the tongue - which does not exist in the typical facial mesh). Unfortunately, the deformation transfer algorithm performs bad when transferring the eye blinks (eyeBlinkLeft, eyeBlinkRight). Therefore, you might need to retouch some of the outputs.

SaltedSlark commented 3 months ago

@yunik1004 hello,when I try to create my custom blendshape_head by Deformation-Transfer , the position of the eyeballs is so wierd, I have no idea about that. image looking for your reply, thank you so much.

hu394854434 commented 1 month ago

@yunik1004 hello,when I try to create my custom blendshape_head by Deformation-Transfer , the position of the eyeballs is so wierd, I have no idea about that. image looking for your reply, thank you so much.

I have the same problem,I think it maybe caused by the optimization

HiouKaoru commented 1 month ago

Hello, I'm trying to create blendshapes by Deformation transfer, but I've realized that I don't really know how to go about generating a correspondence between the source and target triangles While this may be a simple question, can anyone tell me what to do

hu394854434 commented 1 month ago

Just follow the Readme file, the triangle correspondence of source and target mesh is calculated.I guess you have not delete the example data of "Deformation transfer"

HiouKaoru commented 1 month ago

Just follow the Readme file, the triangle correspondence of source and target mesh is calculated.I guess you have not delete the example data of "Deformation transfer"

Thank you for your reply. If you are referring to the data/correspondence_result/face_head_crspd.json' file under the https://github.com/guyafeng/Deformation-Transfer-for-Triangle-Meshes and its example data provided, I have looked at it before. But I still don't understand how I should find the correspondence map between neutral meshes if I want to generate blendshapes by myself. Mostly I don't know how to select the marker vertices so I can't advance. I wonder if you can give me some help. Please forgive my lack of understanding.