Left and Right eye Occlusion view in Unity

[ga28299]

Hi there, Thank you for creating this plugin. I want to get the left and right eye view in the game view in unity. How do I do that? Currently I select the GaussianSplattingVR scene then add the Gaussia Splatting Camera script using add component > add the render and depth material parameters to get the one camera view of the splats.

[Peamon]

In the GaussianSplattingVR scene you already have a camera. Just plug you XR device press play and change the Game view render mode in unity for "Occlusion Mesh".

The option is above statistic panel in this image : https://github.com/clarte53/GaussianSplattingVRViewerUnity/blob/master/performance_vr.png

[ga28299]

Hey thanks for the quick reply. Is there any way I can get the occluded view without connecting a XR device? Also my inspector after selecting the GaussianSplattingVR scene looks different from the one in the images shared. Here is how it looks:

[Peamon]

No you cannot have this view without a headset connected.

Your screen looks ok, it start like this, then you can check the 'point_cloud.ply' button to load the file but if you don't have a headset connected you will not see the gaussian splatting.

If you want to see something start with the GaussianSplattingCam scene that is a scene without headset.

[seblanc]

I'm facing the same issue, I would like to load by default a *.ply file, and make sure it is placed at the right location. Otherwise, I always end up with the wrong position/rotation of my gaussian splat.

Is there a way to display it in the scene inspector?

[Peamon]

You cannot display it in the inspector but you can deactivate "isXR" on GaussianSplattingCamera Script attached to the camera and press Play without headset connected. With this you can see the gaussian in the game view, move it in inspector and copy paste the transform.

[seblanc]

Thanks for your advice Peamon. In GaussianSplattingCamera.cs, isXr is already equal to false: 10: public bool isXr = false; I tested the game with isXr = false and with true, without any VR headset connected, but no Gaussian Splat is visible in the "Game" view. Am I doing something wrong?

[Peamon]

First if you don't have done that, you have to download and copy "defaultmodel.bytes" file see Starting in the README.md

Then you need to check that "defaultmodel.bytes" is correctly referenced :

Then you have to uncheck the "isXR" on main camera :

Then you have to press Play and check the "defaultmodel.ply" checkbox (in red) and then move the object (in blue)

[Peamon]

To Load your own "ply" file when the application start you just have to add a new GameObject and put the script GaussianSplattingModel on it, like this :

[seblanc]

This is awesome, it works like a charm. Although the quality is much lower than my original splat file when visualized in other viewers, is there a way to improve the quality?

[Peamon]

check the "tex factor" parameter on GaussianSplattingCamera Script put it to 1