Thriliriel / LipSync

6 stars 1 forks source link

Doubt how it works in Blendshapes #1

Open Mecon0710 opened 1 year ago

Mecon0710 commented 1 year ago

I'm using an asset called 1toonteen that has talking animations. I put the Lipsync script in the head, which is where it talks. However, I don't know if I have to remove the speaking animations or if it can work in conjunction with Lipsync. I already tried to remove those animations but Lipsync does not move the lips of the character. Help, I don't know why it doesn't work.

image
Thriliriel commented 1 year ago

Hello!

Do you have the BlendShapes of the toonteen in this HEAD object? I ask because i am not seeing them in the picture =) Also, you need to inform which is the blendshape index (bsIndex) of what you want to move (the mouth, in this case). Usually, those animated characters have a list of blendshapes attached in the game object.

Mecon0710 commented 1 year ago

This is the blendshapes. So the Bs Index is 2?

image
Thriliriel commented 1 year ago

Ooooh, wait, you do not have blendshapes, you have only the materials. The blendshapes would look like something like that:

bs

I see that your seem to also have blendshapes, right between "Quality" and "Bounds". Expand that and try to identify where the mouth (or jaw) is there. Then, inform the index of that bs. If you are unsure, try to expand the BlendShapes and post here, so i can take a look and try to help =)

Mecon0710 commented 1 year ago

Jaja yes, sorry. These are the blendshapes. Which is the index? And seriously thank you very much for helping me

image
Thriliriel commented 1 year ago

It is always hard to tell which one it is, because it will depend on the way the character was built. I would say it is, probably, that "jaw_UP" one, which should be index 16 (because it is the 17th item of the list).

Mecon0710 commented 1 year ago

I don't know because I think 3 blendshapes makes the movement. See

This is lipUP_UP

image

This is lipDOWN_DOWN

image

And this is jaw_UP

image

So I think the three makes the movement. Is it incorrect? Or do you still think I should just put jaw? And the character has an animation to talk, do you know how I can combine it?

Thriliriel commented 1 year ago

Huuum, the one i used has this "Mroph_CW_JawOpen", which is the one i use:

print

You can see that if i change the BS value, she opens/closes her mouth. So, that is the one i use.

Since yours has 3 blendshapes to make the mouth movement, i do not really know which one should be used. Try and error, i guess hehe

What is the talking animation you say? This Lip Sync i have made is separated from other animations so, to combine, you would need to see how the animation itself works =)