search

emilianavt / VSeeFaceReleases

This is a release repository used for posting releases of VSeeFace
119 stars 6 forks source link

"Enable eye blinking" in the expression settings doesn't disable Blink_L or Blink_R blend shapes #19

Open SageTheLeafeon opened 2 years ago

SageTheLeafeon commented 2 years ago

The "Enable eye blinking" setting in the expression settings disables the Blink blend shape, but it does not disable the Blink_L or Blink_R blend shapes. This can potentially result in eyes looking strange during certain expressions, including with the default avatar's angry expression. I was able to confirm this by removing the Blink_L and Blink_R blend shapes from my personal avatar and the blinking was successfully able to be disabled. Attached is a screenshot demonstrating the issue. VSeeFaceExpressionBlinkIssue

emilianavt commented 2 years ago

I have just tested it and it works for me when using webcam tracking.

How are you receiving tracking data? TR shows "?", so I guess it's not webcam tracking.

SageTheLeafeon commented 2 years ago

I'm using Waidayo to do the tracking.

emilianavt commented 2 years ago

I'll look into it. You could try using the free version of the VTube Studio app for tracking and see if it works properly with that: https://github.com/DenchiSoft/VTubeStudio/wiki/Sending-data-to-VSeeFace

If the same issue occurs, I wonder if it might be caused by the blendshape translation from perfect sync to regular VRM blendshapes. Does it also happen with a perfect sync capable model like these?

SageTheLeafeon commented 2 years ago

Testing both the perfect sync models with both Waidayo and VTube Studio, the same issue occurs with Waidayo but not with VTube Studio. Strangely, when I tested with my personal model, blinking didn't seem to work at all, so I suspect VTube Studio was sending data for a blendshape my model doesn't have.

emilianavt commented 2 years ago

The "Blink" blendshape is used when the "link eye blinks" option is enabled, otherwise "Blink_L" and "Blink_R" are enabled. With Waidayo, blendshapes are applied as they are received and depend on the model loaded in Waidayo, while with the iPhone tracking options, most tracking related settings within VSeeFace are respected and perfect sync blendshapes get converted to regular VRM blendshapes as needed when no perfect sync ones are found on the model. If "link eye blinks" is disabled, VSeeFace probably converted the perfect sync blendshapes to the two separate blendshapes which were removed.

Either way, it seems the the expression based blendshape filtering does not work properly with VMC protocol received data, so that's something I'll look into.

SageTheLeafeon commented 2 years ago

I'll look further into getting my model working with VTube Studio. Thank you so much!