Objectron is a dataset of short, object-centric video clips. In addition, the videos also contain AR session metadata including camera poses, sparse point-clouds and planes. In each video, the camera moves around and above the object and captures it from different views. Each object is annotated with a 3D bounding box. The 3D bounding box describes the object’s position, orientation, and dimensions. The dataset contains about 15K annotated video clips and 4M annotated images in the following categories: bikes, books, bottles, cameras, cereal boxes, chairs, cups, laptops, and shoes
Other
2.24k
stars
263
forks
source link
Question about PLANE_CENTER and PLANE_NORMAL in objectron.schema.features #56
I am now implementing my own Dataset class wrapper for objectron. And I follow the tutorial of Parse Annotations.ipynd and objectron-geometry-tutorial.ipynb to parse the raw annotations.pbdata and geometry.pbdata. When I use the evaluation code in objectron.dataset.eval, I notice that there is a feature named plane which is used to re-scale the predict box. However, I couldn't parse the PLANE_NORMAL infomation from annotations.pbdata or geometry.pbdata.
I wonder how to get PLANE_CENTER and PLANE_NORMAL infomation. Or PLANE_CENTER means the PlaneVector center defined in ARPlaneAnchor in a_r_capture_metadata.proto while PLANE_NORMAL needs to be calculated using other infomation in AR metadata?
Misaka1996
commented
2 years ago
Thanks a lot for this great dataset.
I am now implementing my own
Datasetclass wrapper for objectron. And I follow the tutorial ofParse Annotations.ipyndandobjectron-geometry-tutorial.ipynbto parse the rawannotations.pbdataandgeometry.pbdata. When I use the evaluation code inobjectron.dataset.eval, I notice that there is a feature namedplanewhich is used to re-scale the predict box. However, I couldn't parse thePLANE_NORMALinfomation fromannotations.pbdataorgeometry.pbdata.I wonder how to get
PLANE_CENTERandPLANE_NORMALinfomation. OrPLANE_CENTERmeans thePlaneVector centerdefined inARPlaneAnchorina_r_capture_metadata.protowhilePLANE_NORMALneeds to be calculated using other infomation in AR metadata?Sincerely look forward to your reply.