search

waymo-research / waymo-open-dataset

Waymo Open Dataset
https://www.waymo.com/open
Other
2.66k stars 609 forks source link

The 3d detection test submit is all 0's #220

Open Phoebe-ovo opened 4 years ago

Phoebe-ovo commented 4 years ago

The validation submit is right, and I have drawn the test result by myself, the results are right too. The submit process is same as validation. But my submission is all 0's, can you help me figure the problem. My submission is : https://waymo.com/open/challenges/entry/?timestamp=1598250012718879&challenge=DETECTION_3D&email=zhyovo@gmail.com

peisun1115 commented 4 years ago

Our eval server for test and validation are setup with the same code. Do you think you can manually check your result locally?

You can decode the file you submitted directly and compare. I suspect that there is something wrong with context_name and timestamp.