LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-time 3D Radiance Field Map Rendering. (arXiv:2401.14857v1 [cs.RO]) https://ift.tt/4CMPIVE
We introduce an integrated precise LiDAR, Inertial, and Visual (LIV)
multi-modal sensor fused mapping system that builds on the differentiable
surface splatting to improve the mapping fidelity, quality, and structural
accuracy. Notably, this is also a novel form of tightly coupled map for
LiDAR-visual-inertial sensor fusion.
This system leverages the complementary characteristics of LiDAR and visual
data to capture the geometric structures of large-scale 3D scenes and restore
their visual surface information with high fidelity. The initial poses for
surface Gaussian scenes are obtained using a LiDAR-inertial system with
size-adaptive voxels. Then, we optimized and refined the Gaussians by
visual-derived photometric gradients to optimize the quality and density of
LiDAR measurements.
Our method is compatible with various types of LiDAR, including solid-state
and mechanical LiDAR, supporting both repetitive and non-repetitive scanning
modes. bolstering structure construction through LiDAR and facilitating
real-time generation of photorealistic renderings across diverse LIV datasets.
It showcases notable resilience and versatility in generating real-time
photorealistic scenes potentially for digital twins and virtual reality while
also holding potential applicability in real-time SLAM and robotics domains.
We release our software and hardware and self-collected datasets on
Github\footnote[3]{https://ift.tt/WYeTbXl} to benefit the
community.
LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-time 3D Radiance Field Map Rendering. (arXiv:2401.14857v1 [cs.RO])
https://ift.tt/4CMPIVE
We introduce an integrated precise LiDAR, Inertial, and Visual (LIV) multi-modal sensor fused mapping system that builds on the differentiable surface splatting to improve the mapping fidelity, quality, and structural accuracy. Notably, this is also a novel form of tightly coupled map for LiDAR-visual-inertial sensor fusion.
This system leverages the complementary characteristics of LiDAR and visual data to capture the geometric structures of large-scale 3D scenes and restore their visual surface information with high fidelity. The initial poses for surface Gaussian scenes are obtained using a LiDAR-inertial system with size-adaptive voxels. Then, we optimized and refined the Gaussians by visual-derived photometric gradients to optimize the quality and density of LiDAR measurements.
Our method is compatible with various types of LiDAR, including solid-state and mechanical LiDAR, supporting both repetitive and non-repetitive scanning modes. bolstering structure construction through LiDAR and facilitating real-time generation of photorealistic renderings across diverse LIV datasets. It showcases notable resilience and versatility in generating real-time photorealistic scenes potentially for digital twins and virtual reality while also holding potential applicability in real-time SLAM and robotics domains.
We release our software and hardware and self-collected datasets on Github\footnote[3]{https://ift.tt/WYeTbXl} to benefit the community.
via cs.RO updates on arXiv.org http://arxiv.org/