valeoai / WaffleIron

Other
39 stars 6 forks source link

Could you please tell me how to get the results of semantickitti in the test set, thank you! #9

Closed horizonfly99 closed 2 months ago

horizonfly99 commented 2 months ago

Could you please tell me how to get the results of semantickitti in the test set, thank you!

gpuy commented 2 months ago

Dear @horizonfly99,

If your goal is to submit predictions of some models on the test set, you can use the script eval_kitti.py with the flag --phase test. This will save the prediction on disk. You can then zip the result folder and submit it to the benchmark. I let you read here how to validate the zip folder before submission and here about the submission process itself.

If your goal is to reproduce our results on the test set then you will need to retrain a model using both the training and validation splits, and also use test time augmentation to obtain the predictions. We provide the details in our paper and in the readme file on how we obtained these results. If needed, I can try to summarize them again here.

Cheers,

Gilles

horizonfly99 commented 2 months ago

Okay, thank you very much for your help