waymo-research / waymo-open-dataset

Waymo Open Dataset
https://www.waymo.com/open
Other
2.73k stars 617 forks source link

Wrong 2D annotations #341

Open frenky-strasak opened 3 years ago

frenky-strasak commented 3 years ago

Hi, I explore Waymo dataset and it seems to me, there are wrong annotations for pedestrians in some images.

In the first image I do not really understand why the a pedestrian is annotated inside the tree. Is it wrong annotation?

tfrecord file: "validation_0003/segment-15948509588157321530_7187_290_7207_290_with_camera_labels.tfrecord:
image.name=FRONT
image_id: 175

Bbox in the tree: box { center_x: 1509.2543356201513 center_y: 493.77632521797057 width: 87.16017181839737 length: 25.38990296363204 } type: TYPE_PEDESTRIAN id: "ecd501ed-2e28-4d2e-8022-668d1d4def53"

Screenshot from 2021-06-23 11-22-24

In the second image, there are people behind the glass. Why are not they annotated?

tfrecord file: "validation_0002/segment-15224741240438106736_960_000_980_000_with_camera_labels.tfrecord"
image.name=SIDE_LEFT
image_id: 227

Screenshot from 2021-06-23 11-37-32

In the last image, some pedestrians are annotated and some not.

tfrecord file: "validation_0004/segment-1943605865180232897_680_000_700_000_with_camera_labels.tfrecord"
image.name=FRONT_LEFT
image_id: 316

Screenshot from 2021-06-23 11-41-34

Is this an expected annotation error? Or do I miss anything? Thanks!

frenky-strasak commented 3 years ago

@scott-ettinger, @peisun1115 Does anyone know? Thank you

frenky-strasak commented 3 years ago

@xmyqsh @scott-ettinger, @peisun1115 Could you tell me if this is expected error in general? Or did I miss anything?