How to render results align with the ideal distortion effect based on the distortion parameters k1k2k3k4?

zmliao / Fisheye-GS

3D Gaussian Splatting (3DGS) on fisheye cameras

80 stars 5 forks source link

How to render results align with the ideal distortion effect based on the distortion parameters k1k2k3k4? #14

Open bolunzhangQwQ opened 3 weeks ago

bolunzhangQwQ commented 3 weeks ago

I am using pinhole camera data for training and rendering fisheye images by constructing camera.txt through COLMAP. However, the rendered results do not seem to reflect the distortion parameters (k1, k2, k3, k4), and I am not getting the desired distortion effect. How should I set the parameters or input data to ensure that the rendering results align with the ideal distortion effect based on the distortion parameters?

haofengsiji commented 2 weeks ago

When k1, k2, k3, and k4 are set to 0, the fisheye model degrades to the equidistant model. I attempted the relevant calculations and coding but did not achieve the desired result. Furthermore, I tested this repository with a pinhole model, yet the results remained spherical blurry. Perhaps I made some mistakes during coding. I hope someone can take over and continue the work.