search

PRBonn / semantic-kitti-api

SemanticKITTI API for visualizing dataset, processing data, and evaluating results.
http://semantic-kitti.org
MIT License
783 stars 187 forks source link

codalab：assert(len(label_names) == len(pred_names)) AssertionError #134

Closed WYRTDCQ closed 1 year ago

WYRTDCQ commented 1 year ago

I Participated in semanticKITTTTI segmentation in codalab https://codalab.lisn.upsaclay.fr/competitions/6280. The result zip file has passed the validation of validate_submission.py in SemanticKITTI API. But when I submit the zip file to codalab, page display error： File "/tmp/codalab/tmpTsCyFj/run/program/evaluate_semantics.py", line 171, in assert(len(label_names) == len(pred_names)) AssertionError This error indicates that the number of labels and the number of predicted results are different, but after testing locally, the number of both is the same. Why would an error be reported when uploading to the codalab？

jbehley commented 1 year ago

Please check that you have completely downloaded all files:

image

It seems like that you are missing at least one file in sequence/13/predictions/. The validate script just checks if there is for every scan in the velodyne folder a corresponding file. Thus, if you are missing files in the velodnye folder of the test sequences it will pass, but still have errors on the Codalab server.

Not that failed attempts don't count towards the limit of 10 submissions on the testset.

WYRTDCQ commented 1 year ago

Thank you very much for your quick answer.