search

Kariaro / VRigUnity

VRM hand tracking using mediapipe
https://discord.com/invite/Enaup9TJPd
MIT License
163 stars 32 forks source link

[Bug]: Finger tracking constantly lost #93

Open Toiongo opened 11 months ago

Toiongo commented 11 months ago

OS

Windows

App Version

0.5.0

Description

There's an issue with tracking of fingers being constantly lost or not picked up straight away, while tracking of wrists (and everything else) is working fine. Happens when using this program in conjunction with vSeeFace. Changing settings doesn't seem to fix the problem.

VOD Showing the issue: https://www.youtube.com/live/1pHrDu1hecI?si=I3io7epS-T0PYhCN

Logs

No response

Kariaro commented 11 months ago

Could you provide a timestamp that shows the issues?

You are probably talking about the problems at the end of the stream?

There are some ways to reduce stutter by lowering the resolution: https://github.com/Kariaro/VRigUnity/wiki/Optimizing

Camera angle, lighting and how close your hands are to the camera can change the accuracy of the tracking.

I’m not working on this app currently but please tell me if the link above doesn’t fix your issues :)

Toiongo commented 11 months ago

There's one at the very start of the video, 0:37 to be precise: https://www.youtube.com/live/1pHrDu1hecI?si=k58XSfsTNNjxKqoR&t=37

Shows the issue perfectly and a similar situation occurs all throughout.

Toiongo commented 11 months ago

I had antialiasing disabled, hidden the model / UI, didn't use virtual camera and had camera resolution of 640x360 (30hz) during that stream.

Toiongo commented 11 months ago

It was also running on Ryzen 7 CPU with Nvidia Geforce GTX 1660 TI graphic card. Webcam was Logitech HD Pro C920 with good light conditions. Using a paid competitor software to do the same hand / finger tracking through webcam (webcammotioncapture) worked fine.

Toiongo commented 11 months ago

It's a shame to hear this software is no longer worked upon, as it's the best available free solution for this type of tracking that I could find.

Kariaro commented 11 months ago

It’s a lot of code to maintain for multiple systems :3

There might be an earlier version of this app with less features that works better but I don’t think I could help you with this problem currently :(

Hope your streams goes well!

Kariaro commented 11 months ago

When I have time I might make some changes and look at all the previously reported bugs including this one 👍