search

vircadia / vircadia-native-core

Vircadia open source agent-based metaverse ecosystem.
https://vircadia.com/
Other
531 stars 174 forks source link

Support for Vive pro facial tracking? #1430

Closed samuk closed 1 year ago

samuk commented 2 years ago

Is there any support planned for Vive Pro lip tracker? https://www.vive.com/uk/accessory/facial-tracker/

ksuprynowicz commented 2 years ago

No idea, but I'm working on face/eye/finger tracking support using single webcam and MediaPipe library. It won't require a VR heaset at all.

samuk commented 2 years ago

Nice, is that using https://www.unrealengine.com/en-US/digital-humans or a different technology?

ksuprynowicz commented 2 years ago

No, I'm not using any proprietary tech. It will use just MediaPipe and regular avatars with some extra shape keys. Later lip and face rigging can be added for more advanced expressions.

stale[bot] commented 2 years ago

Hello! Is this still an issue?

stale[bot] commented 1 year ago

Hello! Is this still an issue?