autonomousvision / kitti360Scripts

This repository contains utility scripts for the KITTI-360 dataset.
MIT License
391 stars 64 forks source link

Project 3D bounding boxes on a fisheye image #93

Open wxn01 opened 1 year ago

wxn01 commented 1 year ago

Hi, Thank you for your dataset! In kitti360Viewer.py it is possible to project the 3d bounding boxes onto a perspective image. I would like to know if I change "CameraPerspective" to "CameraFisheye" in kitti360Viewer.py, can I project the 3d bounding boxes onto the fisheye picture? And is the 3d bounding box projected on the fisheye picture also cuboid? Thanks.

AnRanbel commented 1 year ago

Hi, Thank you for your dataset! In kitti360Viewer.py it is possible to project the 3d bounding boxes onto a perspective image. I would like to know if I change "CameraPerspective" to "CameraFisheye" in kitti360Viewer.py, can I project the 3d bounding boxes onto the fisheye picture? And is the 3d bounding box projected on the fisheye picture also cuboid? Thanks.

Have you solved it? I am also looking for 2d bboxof fisheye.

yiyiliao commented 1 year ago

Hi, Thank you for your dataset! In kitti360Viewer.py it is possible to project the 3d bounding boxes onto a perspective image. I would like to know if I change "CameraPerspective" to "CameraFisheye" in kitti360Viewer.py, can I project the 3d bounding boxes onto the fisheye picture? And is the 3d bounding box projected on the fisheye picture also cuboid? Thanks.

It is possible to project the 3D bounding boxes on the fisheye picture, though our kitti360Viewer.py does not support this function yet. The edges of the 3D bounding boxes will not be straight anymore with the fisheye projection. In order to get the correctly projected 3D bounding boxes, it is required to sample points on the edges of the 3D bounding boxes (in addition to the 8 corners) and then project them.

wxn01 commented 1 year ago

Thank you for your reply. So are the 3d bounding boxes provided in the dataset now applicable to fisheye images?