ProjectSidewalk / sidewalk-cv-2021

4 stars 3 forks source link

Translation from POV to GSV Image Coordinates #51

Open shokiami opened 2 years ago

shokiami commented 2 years ago

Due to faulty translation from POV to GSV Image coordinates, some label positions are slightly off (both images are of "curb ramp" labels): 52235_0 912_0

More information about the issue and our proposed fix can be found here: https://docs.google.com/document/d/1TLCz07VBthmeUFLU6HcYn6Zt4DIzHgzX6jquemegECs/edit?usp=sharing

jonfroehlich commented 2 years ago

Thanks for making this an issue @shokiami. Any progress on this? It will be a huge win once fixed!

shokiami commented 2 years ago

@jonfroehlich Yup! Although, we are currently stuck. As Michael mentioned on the doc, our proposed fix assumes that we are only looking at a portion of the pano. However, since we are looking at the entire panorama, our FOV is 360 degrees, which leads to an infinite focal length... We are figuring it out though! I found a post that seems promising: https://stackoverflow.com/questions/43741885/how-to-convert-spherical-coordinates-to-equirectangular-projection-coordinates