search

dfgHiatus / QuestPro4Neos

Meta Quest Pro eye and face tracking for NeosVR
MIT License
9 stars 8 forks source link

Few expressions don't work via a launch method on ALXR. #2

Open ScarsTRF opened 1 year ago

ScarsTRF commented 1 year ago

The method I'm currently running is by running the ALXR app with --no-alvr-server --no-bindings args using Link/AirLink

All these above are what I have for now, I will post anything else in the future~

dfgHiatus commented 1 year ago

Thanks for the heads up! I'll have a look at these

Geenz commented 1 year ago

I've got this one - yeah I'm aware. I'm pretty sure the left and right look is some weird additional coordinate space issue. The grinning - I'm still tweaking the facial blendshapes.

hazre commented 1 year ago

Hey has there been any updates on this? I can't seem to get it to work at all with Link + ALXR (--no-alvr-server --no-bindings)

ScarsTRF commented 1 year ago

Hey has there been any updates on this? I can't seem to get it to work at all with Link + ALXR (--no-alvr-server --no-bindings)

Nope, was told there was gonna be a update a few times, but nothing yet.

hazre commented 1 year ago

~Hey has there been any updates on this? I can't seem to get it to work at all with Link + ALXR (--no-alvr-server --no-bindings)~

~I'm not sure about the extra expressions~ but I managed to get it work. I thought I have to run VRCFT with it for the mod to work but that's unnecessary and that's why it wasn't working for me.

cc @ScarsTRF

hazre commented 1 year ago

Okay now I see the issues of looking Left and right not working currently :/

I wonder if this is ALXR issue or with the mod. Because VRCFT works fine, so I wonder if they correct in VRCFT afterwards or if it's a issue with the mod instead.

I probably going to unpack the eye data and correct it, then feed it back into eye bone / blendshapes as a workaround if there isn't any other better options. Alternatively get around the mod completely and use a OSC to Websocket bridge and use the VRCFT fork instead, since that seems to be working.

Geenz commented 1 year ago

Just a heads up on this one, I've noticed there's a bunch of small things that don't work as well as they could. I'm going to be doing some deeper testing with a few face tracked avatars against my VPE now that the mod is in a generally stable state.

hazre commented 1 year ago

Just a heads up on this one, I've noticed there's a bunch of small things that don't work as well as they could. I'm going to be doing some deeper testing with a few face tracked avatars against my VPE now that the mod is in a generally stable state.

Good stuff.

Alternatively get around the mod completely and use a OSC to Websocket bridge and use the VRCFT fork instead, since that seems to be working.

I ended up going this route since VRCFT people already figured out a universal face tracking api, it works with Quest Pro as well as other face tracking solutions.

It's janky and not really meant for public use but it works. https://github.com/hazre/VRCFaceTracking-NeosVR