xverse-engine / XV3DGS-UEPlugin

A Unreal Engine 5 (UE5) based plugin aiming to provide real-time visulization, management, editing, and scalable hybrid rendering of Guassian Splatting model.
Apache License 2.0
573 stars 74 forks source link

Lower resolution than expected. #6

Open Aleix0 opened 11 months ago

Aleix0 commented 11 months ago

The resolution of the Gaussian Splatting capture is lower than expected.

Steps to reproduce the behavior:

  1. I have downloaded the plugin for UE5.2 and directly placed the 'XV3dGS' folder into the 'Plugins' folder.
  2. After enabling the plugin, the button to import appeared, and I used it to import the .ply file.
  3. I imported a .ply with 30,000 points. imagen
  4. The resolution of the image is much lower than expected, seems that it's about 1400 instead the 30000 points. imagen imagen

Do you have any suggestions to try to solve this?

Thank you!!

Windows 11
UE 5.2"
lxk121lalala commented 11 months ago

The parameter "pointcloud_image_size" is ambiguous. We will rename it in the next version. Here, it indicates that the number of points in the scene is 1400*1400 = 1,960,000. "From the screenshot, it appears that this phenomenon is caused by the 'spritesize' parameter having too small a value. For now, you can temporarily adjust the 'spritesize' parameter as below. In the next version, we will expose this parameter as a public parameter." image

bellx3 commented 11 months ago

동일한 ply를 사용해서 적용한 결과 이미지입니다. 언리얼에서의 개선의 여부가 있을까요? 위의 이미지는 언리얼 5.3에서 플러그인을 사용해서 캡처한 장면입니다. 아래의 이미지는 SuperSplat에서 캡처한 장면입니다.

image
rpte commented 10 months ago

Hello developers, There already an update in terms of quality improvement? Thanks for this amazing plugin for Unreal Engine

lxk121lalala commented 10 months ago

Hello developers, There already an update in terms of quality improvement? Thanks for this amazing plugin for Unreal Engine

Hello, we cannot reproduce the problem of poor quality. If it is convenient, please provide a test sample.

rpte commented 10 months ago

image Just used the samples from https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/datasets/pretrained/models.zip

lxk121lalala commented 10 months ago

image Just used the samples from https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/datasets/pretrained/models.zip

This behavior is as expected because the original scene contains an excessive number of points, while Niagara in UE (Unreal Engine) supports a maximum of 2 million points for simultaneous rendering. Therefore, our plugin generates LODs automatically to ensure that the scene's simultaneously rendered point count does not exceed 2 million. In our future versions, we will introduce support for dynamically adjusting LODs based on the viewpoint. This will allow for more visible points within the view frustum (but still capped at 2 million).

rpte commented 10 months ago

What if it's made in multiple Niagara assets? so it can pass the limit?

LoneDev6 commented 5 months ago

I think it's related to spherical harmonics loading not being implemented in the plugin.