search

facebookarchive / Surround360

Surround360 is Facebook's open source hardware and software for capturing stereoscopic 3D 360 video for VR. The repo contains hardware designs, as well as software for camera control and rendering.
Other
2.17k stars 580 forks source link

Incorrect stitching with synthetic data #229

Closed kevinra closed 7 years ago

kevinra commented 7 years ago

Hi!

I'm trying to use stitching on rendered data but I get weird results. I used 6 side cameras to test monoscopic 360 video .

Equirectangular frame (the result) can be found here, along with camera rig setup and image from each camera: http://imgur.com/a/OcGPZ FYI, when camera_rig.json is created, coordinate system was changed from the one in the link. +z is changed to -z so that the coordinate system is right handed (Unity is left handed). Horizontal field of view is 137 and vertical field of view is 110 with aspect ratio of 16:9.

Calibration seems to be working fine. This is the link to the debug images on the last pass: http://imgur.com/a/E2WJ5 Textual output of calibration process is available here (trimmed the beginning): https://gist.github.com/kevinra/1a4f0da61fd76bf1a3e249e0bc09faa9

Here is the linked to the projected frames: http://imgur.com/a/Iw24h Textual output of running run_all.py is available here: https://gist.github.com/kevinra/8334c18838ff5f1515812efc507c1d3b

Any help would be appreciated!

kevinra commented 7 years ago

The issue was caused by using wrong coordinate system. It's solved now.

For those who view this post later, if the rig is viewed from bird's eyes view (top down view), the x axis is pointing at 12'o clock, y axis is pointing at 9'o clock and z axis is coming up from the group to the zenith.