emilianavt / VSeeFaceReleases

This is a release repository used for posting releases of VSeeFace
119 stars 6 forks source link

also send eyebrows movement through OSC/VMC sender #31

Open Kalimocho opened 1 year ago

Kalimocho commented 1 year ago

VseeFace use but doesn't send through OSC/VMC shapekeys for eyebrows up and down, i'd love to have that info too on blender. thanks a lot. i wish vseeface will keep having updates, thanks anyway for all the work.

emilianavt2 commented 1 year ago

It should send all values, for which a Blend Shape Clip exists on the model. If the model is lacking the "Brows up" and "Brows down" clips, it won't send them.

Kalimocho commented 1 year ago

Dear Emiliana, thanks a lot for the response. i've tested some models including the default model for vsee face when no avatars are available. Using any of them i don't receive any "Brows up" or "Brows down" shapekeys, maybe im missing something, idk. I've made this very short 9 seconds video for you to watch my testing. thanks! https://www.youtube.com/watch?v=Xb0OAS2AkSo

emilianavt2 commented 1 year ago

The default model as well as VRoid models don't have these blend shape clips, so they do not get sent. Instead, VSeeFace animates the eyebrows of those models by combining the BRW_Angry and BRW_Sorrow blendshapes, or, in the case of Cecil based models like the VSeeFace default model, Oko and Yowa. Those are usually not bound to blend shape clips however, so they cannot be sent over VMC protocol. To receive the "Brows up" and "Brows down" clips, please take a VRM model and manually add those two blend shape clips. It shouldn't even be necessary to assign any blendshapes to the clips.

Kalimocho commented 1 year ago

sorry i've just been trying several times using a model exported from blender using the VRM plugin. despite i've assigned "Brows up" and "Brows down" shape keys, neither of them work on VseeFace, also i don't receive them through VCM. At least using the default model on vseeface i can see the brows moving up and down, Other shapekeys like A E I O U Blink work perfectly. am i missing something? do you have any working example or vrm model operative for sending Brows up/down shapekeys? thanks a lot

emilianavt2 commented 1 year ago

If you import your VRM into Unity using UniVRM, are the Brows up and Brows down blend shape clips registered on the blend shape proxy? Having them only as shapekeys or blendshapes is not enough.

At least using the default model on vseeface i can see the brows moving up and down, Other shapekeys like A E I O U Blink work perfectly. am i missing something

Like I described in my previous post, the eyebrows on that model are moved by using the default Cecil model blendshapes because the Brows up and Brows down blend shape clips are not present. However, blendshapes cannot be sent over VMC protocol, only blend shape clip values.