Yellow-Dog-Man / Resonite-Issues

Issue repository for Resonite.
https://resonite.com
132 stars 2 forks source link

Weird hand offset when on Pico 4 #2221

Open ThemovieaYT opened 3 months ago

ThemovieaYT commented 3 months ago

Describe the bug?

I am using a Pico 4 headset, running Resonite on a Windows 11 machine using SteamVR. Currently, the bug that I am experiencing is that Resonite puts the hand position in a weird offset, right in front of my Pico controller. This is a Resonite only issue as games like VRChat does not have this issue and so does SteamVR. I also heard from the Discord server that 2 Quest 3 users had experienced similar issues. Here is a visual representation of the issue I am having: image0

To Reproduce

Use Pico 4 headset and run the latest beta of PICO 4 streaming assistant (or maybe try the stable global release, see what happens. If the issue is not appearing in the stable streaming assistant version, please let me know!). Run SteamVR, and then run resonite.

Expected behavior

Expected Resonite to accurately place the hand in the same position and rotation as the controllers.

Screenshots

No response

Resonite Version Number

2024.5.31.202

What Platforms does this occur on?

Windows

What headset if any do you use?

PICO 4

Log Files

No log files provided.

Additional Context

No response

Reporters

No response

Chundelac commented 3 months ago

Hey, I am using the Pico 4 with PICO Connect as well. Version 10.0.25 Beta of the connect but on windows 10 and I do not have the same issue. The hand was always pretty much in the correct place but what you are showing on the drawing is a pretty large offset.

Does this issue occur in a specific avatar or all avatars?

Benwager12 commented 3 months ago

I am using a Quest 2, but the issue occurs for me when I am using Virtual Desktop's vive emulation.

ThemovieaYT commented 3 months ago

Hey, I am using the Pico 4 with PICO Connect as well. Version 10.0.25 Beta of the connect but on windows 10 and I do not have the same issue.

The hand was always pretty much in the correct place but what you are showing on the drawing is a pretty large offset.

Does this issue occur in a specific avatar or all avatars?

@Chundelac It might be fixed when Resonite updated. Cause when I played in that specific version, the problem occurred with EVERY avatar (With the same version of Pico Streaming that you have).

I will test it when I can and let you know.

Chundelac commented 3 months ago

Hey, I am using the Pico 4 with PICO Connect as well. Version 10.0.25 Beta of the connect but on windows 10 and I do not have the same issue.

The hand was always pretty much in the correct place but what you are showing on the drawing is a pretty large offset.

Does this issue occur in a specific avatar or all avatars?

@Chundelac It might be fixed when Resonite updated. Cause when I played in that specific version, the problem occurred with EVERY avatar (With the same version of Pico Streaming that you have).

I will test it when I can and let you know.

It could be however I have been using the pico 4 with pico connect for a long time and never had this issue. If you manage to replicate it we can try to find out what exactly caused this

Shuisho10 commented 3 months ago

I tested it out too and had this same issue with Streaming Assistant and PICO Connect. It isn't avatar specific, the offset persists even on the Resonite's Default Avatar on the Essential's folder. The offset seems to be a position thing more than a rotation (although there could be an issue with the rotation too not sure), the hand is at the fingertips of the controller's position, so when you rotate the controller, the rotation feels wierd because of how far away the hand is, making it hard to point at things.

ThemovieaYT commented 3 months ago

@Chundelac It might be fixed when Resonite updated. Cause when I played in that specific version, the problem occurred with EVERY avatar (With the same version of Pico Streaming that you have). I will test it when I can and let you know.

It could be however I have been using the pico 4 with pico connect for a long time and never had this issue. If you manage to replicate it we can try to find out what exactly caused this

@Chundelac I updated Resonite, still the same problem. FYI, my PICO Connect settings has not been changed for a long time.

shiftyscales commented 2 months ago

@ThemovieaYT @Shuisho10 - Do the avatar's fingers move at all in response to any button presses/inputs? My initial thoughts on reading this is that the controller type might not have skeletal input being passed through properly from SteamVR to Resonite- this could result in the behaviour observed.

Chundelac commented 2 months ago

@ThemovieaYT @Shuisho10 - Do the avatar's fingers move at all in response to any button presses/inputs? My initial thoughts on reading this is that the controller type might not have skeletal input being passed through properly from SteamVR to Resonite- this could result in the behaviour observed.

The fingers do move on both touching and pressing buttons so skeletal input does work.

It is for one the binding being limited to just "menu" binding that serves as both context menu and dash with no way to separate them.

For two we are limited to the standard controller flux node for input which doesn't have touch events at all and also only menu button even tho we have same button layout as the touch controller.

shiftyscales commented 2 months ago

@Chundelac - you had already stated above that your hand is properly positioned- so we would need to find out whatever variables are different between your setup and others who are experiencing this issue.

Pico controllers are not natively supported on Resonite as of now- so Resonite makes use of it as a "Standard Controller"- hence why you only have a single menu button. That is expected behaviour.

ko-tengu commented 2 months ago

I triggered this on accident trying to cause a second bug so I don't think it's just a Pico problem, and I have a (bad) screenshot showing the amount of offset. My hands also stopped providing hand poses, but did still have the two button correct Quest bindings. image

BUFU - 2024.6.11.74 - 2024-06-15 01_53_42.log

Shuisho10 commented 2 months ago

Do the avatar's fingers move at all in response to any button presses/inputs? My initial thoughts on reading this is that the controller type might not have skeletal input being passed through properly from SteamVR to Resonite- this could result in the behaviour observed.

Can confirm that whis could be the issue. The hand doesn't react with the trigger and the grip button.

ko-tengu commented 2 months ago

I can update that after the most recent round of updates to SteamVR and SteamLink on the Quest 2, I can trigger this at will by disconnecting the headset for a minute and reconnecting. This suggests it's probably actually the same root issue as https://github.com/Yellow-Dog-Man/Resonite-Issues/issues/927

shiftyscales commented 2 months ago

@ko-tengu I think the issue you are highlighting #927 is separate from what @Shuisho10 has reported above.

It seems that in their case- SteamVR skeletal input data is not being properly passed to Resonite for some reason- which is a separate issue we need to isolate.

@Shuisho10 @ThemovieaYT - how does your setup differ to @Chundelac's? It seems for some reason- whatever specific settings / software you are using is not properly passing skeletal input data from SteamVR to Resonite which is causing this issue.

Krzeszny commented 1 month ago

Same issue, menu buttons don't work, hands don't respond to trigger/grip... but only in Resonite. Setup: Windows 10 PICO Connect 10.1.5 over USB SteamVR 2.6.2

image

Pug189 commented 1 month ago

I have been having this same issue, all buttons still respond but my hands are extended forward from where they should be and the hand poser no longer responds to controller inputs. Persists after restarting the headset and only seems to fix itself by restarting SteamVR

My setup: Windows 11 Quest 2 over Steam Link SteamVR 2.6.2