search

inuex35 / 360-gaussian-splatting

This repository contains programs for reconstructing 3D space using OpenSfM and Gaussian Splatting techniques. It allows users to generate point clouds from images captured by a 360-degree camera using OpenSfM, and then train Gaussian Splatting models using the generated point clouds.
Other
102 stars 10 forks source link

Panorama Rendering #14

Closed zhichu99 closed 2 weeks ago

zhichu99 commented 2 weeks ago

Great job!Now I have a gaussian model containing its 3DGS parameters,I have the following three questions: 1.Should I use render_panorama or render_spherical to render a panorama? 2.In render_panorama, the camera is rotated three times, and these four images are concatenated to create a panorama. Should I set both my FOV values to 90 or set FOV_y to 180? 3.If render_spherical can be used for rendering a panorama, how should I set my FOV?

inuex35 commented 2 weeks ago

Yes you can use render panorama for stitching four angles of images. Settting 90 deg and it will render cubemap without top and bottom. Render spherical is for equirectangular image.

zhichu99 commented 2 weeks ago

Thank you for your prompt reply! I would like my rendered panorama to encompass both top and bottom directions, achieving full vertical coverage with a complete 180 degrees of latitude. Could you advise on how I might achieve this?

inuex35 commented 2 weeks ago

You have two options.

  1. render separately You have to add top and bottom here. https://github.com/inuex35/360-gaussian-splatting/blob/c1e5c8b5b071cd5923810f9edc9d429cdbfa74fd/scene/cameras.py#L63-L82 Stitching images here so I can add top and bottom here. https://github.com/inuex35/360-gaussian-splatting/blob/c1e5c8b5b071cd5923810f9edc9d429cdbfa74fd/gaussian_renderer/__init__.py#L163-L169

  2. render equirectangular and convert it to cubemap You can use this kind of tools to convert. https://github.com/blackironj/panorama

zhichu99 commented 2 weeks ago

Thanks！I got another question now,why the stitching order is right,forward,left,backward rather than left,forward,right,backward,are those partial panoramas are flipped?

inuex35 commented 2 weeks ago

Actually i don't use this function for a long time. This may be wrong.

zhichu99 commented 2 weeks ago

Alright,thank you for your detailed explanation.