magcius / noclip.website

A digital museum of video game levels
https://noclip.website/
Other
3.23k stars 250 forks source link

VR mode shows black screen both on Oculus quest and Cardboard #490

Open eggnot opened 2 years ago

eggnot commented 2 years ago

Both Oculus and smartphone showing black screen entering VR. There is no option "XR sandbox..." on current chrome version on both as well

magcius commented 2 years ago

Yeah, the VR support is currently broken. Unfortunately, I do not have a headset or a way to test it myself. Last I checked, it worked fine on the XR emulation extension.

jrupinski commented 2 years ago

Tested on Oculus Quest 2 64 GB model, both on a local server and on the noclip.website. The VR Option is there and it works in compatible browsers (both Firefox Reality and built-in Oculus browser) - but on every tested browser the scenery seems to be broken while rendering on certain titles, both while using VR and non-VR view of the website, so it seems it's a per-title problem. I only tested a handful, here are the results:

Doesn't work properly:

What renders as intended (no issues detected on multiple maps):

XR emulation (via Chrome extension) renders all the maps fine though, the issue only occurs on the physical device.

magcius commented 2 years ago

Unless someone is able to debug the actual device, I can't really contribute here. I am happy to assist someone who wants to understand how the VR mode is architected, but given that it works on the WebXR emulation extension, I do not think I am doing anything majorly wrong here...

magcius commented 2 years ago

Thanks to some community members, I identified one potential issue fixed in 8c36ec1ffa81c61dc56bf7df9a3c1dbb4cc5654d.

jrupinski commented 2 years ago

This seems to fix the issue with VR mode on PC based on community reports.

Standalone VR headsets still seem to have rendering issues in some specific games. Fixing this would probably require going through each of the games to find the problematic ones, and comparing (maybe replacing?) code with one that renders correctly (like Super Mario 64 DS).

Resources for someone with a Quest 2 headset and willing to try and fix this:

A video to illustrate the problem:

https://user-images.githubusercontent.com/9074800/162080727-99ef1324-cb22-4c5d-b485-ca903ad5b193.mp4

chandler05 commented 1 year ago

I've got an HTC Vive Index and I've noticed some of the maps (Both Mario Galaxies, Wii Sports, Wind Waker, and more) render strangely to where two very different images render in both eyes and cause the maps to not show up properly.

Here's some videos to show:

Funcitoning Map (Okami): https://github.com/magcius/noclip.website/assets/66492208/387b40e6-aa59-40a8-a4bc-e424a694b5fa

Broken Map (Super Mario Galaxy): https://github.com/magcius/noclip.website/assets/66492208/09af9ab8-621b-474b-ad85-1308d809b8a2

magcius commented 1 year ago

I tried using the WebXR API Emulator extension, and the render looked correct to me... I do not have a personal device to test with.

image

maximxlss commented 11 months ago

My take:

I have no experience working with low-level graphics, so I don't think I can figure it out, but I'll continue my research.

maximxlss commented 11 months ago

What doesn't work (black textures):

What does work: