How to upload Kitti results?

[408550969]

Hi,I have registered my account on Kitti. How do I upload the result? Do we need to upload txt documents containing test results only? How does Kitti measure the speed? How do we distinguish between 2D and 3D object on the Kitti list?

[melfm]

Please refer to KITTI's instructions inside readme.txt file, you can also see instructions when you try to submit : "Submission instructions: For the object detection and orientation estimation as well as 3D object detection and bird's eye view benchmark, all results must be provided in the root directory of a zip file using the format described in the readme.txt"...

KITTI does not measure speed, they trust you are honest enough to provide the correct run-time speed.

[408550969]

Thanks for your advice. I have another question. Do I need to set 'Van' to 'Car' or ignore it when making training sets?

[eypros]

If you want to compare to other methods you should ignore them.

[hoangduyloc]

@melfm
@408550969 @eypros Sorry for bother three of you. I'm really new at submitting to the official KITTI benchmark. I want to evaluate only Bird's Eye View, when I submit this file, I got Zero scores to all, my label format for only BEV method evaluation is the image below. Could anyone clarify for me? Thank you so much!

[hoangduyloc]

I set the default value "The Alpha=0; Height=0; and Y = 0; Trun, Occlu = -1; 2D bounding box I set to (0, 0, 0, 0) (I think my fault is here)." Could you guys tell me where is my fault? And if possible could anyone give me 1 line of example for only BEV evaluation, Thank you!

[wisper181]

hello, I also have doubt about this question? I wanna test my 3D detection results on KITTI How should I set these values? And 2D bounding box values is necessary or not??? Can anyone help? Thx ^_^

[gledsonmelotti]

Hello @hoangduyloc, Did you understand how to submit txt results to evaluate only BEV? If so, could you provide an example? Best regards.

[hoangduyloc]

Hello @hoangduyloc, Did you understand how to submit txt results to evaluate only BEV? If so, could you provide an example? Best regards.

So basically 2D Object Detection Is Always Required, so the score should be at least (2D, BEV). Set Height=0, if you want to evaluate only BEV.

[gledsonmelotti]

Hello @hoangduyloc, Did you understand how to submit txt results to evaluate only BEV? If so, could you provide an example? Best regards.

So basically 2D Object Detection Is Always Required, so the score should be at least (2D, BEV). Set Height=0, if you want to evaluate only BEV.

Hello @hoangduyloc , thank you very much.

[jyunkaichen]

Hi, I tried to submit my 3D object detection results to the Kitti server , but I got an error message like this:

"Thank you for participating in our evaluation! Loading detections... ERROR: Couldn't read: 000000.txt An error occured while processing your results. Please make sure that the data in your zip archive has the right format!"

I just zip all the results into a zip file, the structure of my submission is like:

Results.zip :

• 000000.txt
• 000001.txt ...

• 007517.txt

  Is there any file name restriction or anything that I didn't notice?

Sincerely

[jyunkaichen]

And this is the prediction format of my result. Thanks a lot.

[crjxixixi]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB)

[pengzhenD]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

[hoangduyloc]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

Hi your txt format seem right, for preparing the KITTI submission format. You might zip the txt files only, not the folder include txt files

[pengzhenD]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

Hi your txt format seem right, for preparing the KITTI submission format. You might zip the txt files only, not the folder include txt files

Thank you very much for the tip, my problem has been solved, good luck!

[JunjieWang0528]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

Hi your txt format seem right, for preparing the KITTI submission format. You might zip the txt files only, not the folder include txt files

Thank you very much for the tip, my problem has been solved, good luck!

I also encountered this problem. Can you provide specific instructions on how to do it

[pengzhenD]

You only might zip the Txt files only, not the folder include txt files

[pengzhenD]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

Hi your txt format seem right, for preparing the KITTI submission format. You might zip the txt files only, not the folder include txt files

Thank you very much for the tip, my problem has been solved, good luck!

I also encountered this problem. Can you provide specific instructions on how to do it

You only might zip the txt files only, not the folder include txt files

[IbrahimUWA]

Hello, I have trained my model on 3D KITTI dataset for car detection. I have no idea how to generate prediction results and upload on the server. Help will be really appreciated.

Best regards Ibrahim

[pengzhenD]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

Hi your txt format seem right, for preparing the KITTI submission format. You might zip the txt files only, not the folder include txt files

Thank you very much for the tip, my problem has been solved, good luck!

I also encountered this problem. Can you provide specific instructions on how to do it

You only might zip the txt files only, not the folder include txt files

i have just zip the folder and directly upload one by one to kitti but still got same error do we need to upload one zip file for one class or all together. could you please help me the right way.

You should submit the.txt file of the test results as a.zip file. Don't wrap any nested folders.

[pengzhenD]

Hello, I have trained my model on 3D KITTI dataset for car detection. I have no idea how to generate prediction results and upload on the server. Help will be really appreciated.

Best regards Ibrahim

I'm really sorry for not replying to you in time. You should submit the.txt file of the test results as a.zip file. Don't wrap any nested folders.

[pengzhenD]

And this is the prediction format of my result. Thanks a lot.

I have a same format of prediction , Do you solve the problem ? When I upload my results, The error is :Zip file content is either invalid or too large (>500 MB). Please try again! (accumulated size of files in zip file: 0 MB) Is the problem solved? I'm having the same problem

Hi your txt format seem right, for preparing the KITTI submission format. You might zip the txt files only, not the folder include txt files

Thank you very much for the tip, my problem has been solved, good luck!

I also encountered this problem. Can you provide specific instructions on how to do it

You only might zip the txt files only, not the folder include txt files

i have just zip the folder and directly upload one by one to kitti but still got same error do we need to upload one zip file for one class or all together. could you please help me the right way.

You should submit the.txt file of the test results as a.zip file. Don't wrap any nested folders.

THanks for your quick response as i still did not got what are you talking about i already zip only the txt file you want me to zip the folder not the txt.file. if you could screenshot the file.

Just zip all the.txt files in your car folder and upload them.

[pengzhenD]

@pengzhenD

One quick question we should evaluate on the test set or val set. as it is giving me error as in valset there is no 000000.txt so it is giving me errors.

Maybe you should put all the generated.txt files in a file like res_data, then select all the.txt files in the res_data folder and compress them as name.zip and upload name.zip to kitti. Instead of dividing the detection results into different folders by category. I hope this helps you.

[faziii0]

@all

Does anyone got error like that

Thank you for participating in our evaluation! Loading detections... ERROR: Couldn't read: 007481.txt An error occured while processing your results. Please make sure that the data in your zip archive has the right format!

All the prediction files are only 007480. where am i doing mistakes