btsmart / splatt3r

Official repository for Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairs
Other
514 stars 20 forks source link

Point Cloud Rendering failure by "diff_gaussian_rasterization import GaussianRasterizer as Renderer" #30

Open luminousking opened 1 week ago

luminousking commented 1 week ago

Hi, I try to use from diff_gaussian_rasterization import GaussianRasterizer as Renderer to render the predicted .ply file, but I consistently encountered the CUDA issue RuntimeError: CUDA error: an illegal memory access was encountered. After I render the ply into image, the im, cam, gs_data will point to some strange address like this: image I think the correct one after rendering should be like this: image Do you have any sense why this would happen? Thanks!

btsmart commented 3 days ago

Hello @luminousking,

Unfortunately I am not sure what could be causing the illegal memory accesses. In my experiments (and in the README) I used this fork of diff_gaussian_rasterization from pixelSplat: https://github.com/dcharatan/diff-gaussian-rasterization-modified, so you might like to check that it is this version you have installed. I conducted by experiments at 256x256 and 512x512 resolution, so you may also wish to verify that your resolution isn't causing any issues.

In my experiments, I think I also never directly render the .ply files that I create, I think I only use those for exporting and visualizing in interactive viewers. If you are using diff_gaussian_rasterization on data from the .ply files, your pipeline may be a little different to mine.

If you are able to find the issue, please let me know!