mapillary / OpenSfM

Open source Structure-from-Motion pipeline
https://www.opensfm.org/
BSD 2-Clause "Simplified" License
3.42k stars 861 forks source link

360 camera feature point coordinate #1033

Closed inuex35 closed 3 weeks ago

inuex35 commented 11 months ago

Hello,

I am currently working on a project involving Gaussian Splatting (GS) with data reconstructed from a 360 camera using OpenSfM. However, I've encountered a challenge: GS primarily supports the COLMAP data format, but not the OpenSfM format.

To address this, I am considering converting the OpenSfM 360 camera data into the COLMAP format. My approach involves splitting the spherical view into a cube map format and then loading it into GS.

In relation to this, I came across a relevant issue on OpenSfM's GitHub: https://github.com/mapillary/OpenSfM/issues/794 It seems that in OpenSfM, the process is executed after creating a perspective view from the 360 camera data. Is this understanding correct?

Additionally, I retrieved the following point coordinate from the SfM feature data: array([4.9925733e-01, 2.3722187e-01, 1.8578832e-01, 3.5989554e+02], dtype=float32),

However, I am uncertain if this coordinate represents the image below or if it has already been converted to a perspective view. image

I would appreciate any insights or suggestions on how to properly convert the data format or verify the coordinates.

Thank you for your time and assistance.