chernyadev / bigym

Demo-Driven Mobile Bi-Manual Manipulation Benchmark.
https://chernyadev.github.io/bigym/
Apache License 2.0
76 stars 9 forks source link

Inquiry About VR Setup #18

Closed jkewang closed 3 days ago

jkewang commented 2 weeks ago

I followed the instructions in the VR_Readme to configure the Valve Index 1.0 but encountered the following issues:

First, I want to confirm, should I start SteamVR directly from Steam, or should I run it from another command line? Regardless of the method, it seems due to permission issues, SteamVR cannot detect the VR device information. Therefore, I started a new command line and executed

sudo -E $HOME/.steam/debian-installation/steamapps/common/SteamVR/bin/vrmonitor.sh. 

This indeed allowed SteamVR to start and read the VR device information, and also configure OpenXR. However, Steam then reported an error

"vrclient shared lib not found 102"

and on the Python side, there was also an error with OpenXR failing to start, showing

xr.exception.RuntimeFailureError: The runtime failed to handle the function in an unexpected way that is not covered by another error result.

Therefore, I would appreciate a more detailed description of the order and method for starting SteamVR. Also, I am currently using SteamVR version 2.7.4; may I ask which version of SteamVR you are using?

I look forward to your response.

jkewang commented 2 weeks ago

After some debugging, I confirmed that the issue was caused by USB access permissions. Once I fixed the correct permissions, I was indeed able to record the demo, although there seem to be some minor bugs still.

For more related information, please refer to: https://github.com/ValveSoftware/SteamVR-for-Linux/issues/428 Add the file https://github.com/ValveSoftware/steam-devices/blob/master/60-steam-vr.rules to /etc/udev/rules.d out of the docker and restart the systemctl will solve it.

Meanwhile, I noticed that the "Display VR View" tab in SteamVR shows a completely black VR view while the view in headset is normal, and I would like to confirm if this is normal?