search

LucasSloan / waymochallenge

0 stars 1 forks source link

How to use your code with waymo's metric evaluation tools #1

Open b4da opened 4 years ago

b4da commented 4 years ago

Good Day Lucas Sloan!

I am trying to run yolov4 on the waymo dataset, and output the mean average precision score (mAP) using waymo's metric evaulation tools.

I am new to machine learning, and tensorflow. I'm wondering how you created the tensorflow file which extract_waymo_yolo.py reads? I wondering if you converted yolov4 detections to tensorflow files; if so, would you be able to explain how you achieved this?

Lastly, how do you then use the tensorflow output file to get mAP metrics? Did you use the python op's provided by waymo?

I am working with the Swedish research lab REVERE; I have been assigned the task of computing mAP of yolov4 detections on waymo datasets. I appreciate your time taken in creating this repository!

Your help would be appreciated! Thank you!

BR, Adnan

LucasSloan commented 4 years ago

extract_waymo_yolo.py reads the tfrecords that the waymo folks put on cloud storage. You can get access on https://waymo.com/open/

I don’t have my script for converting the yolo output to the waymo proto output anymore, but you can get started with their example:

https://github.com/waymo-research/waymo-open-dataset/blob/master/waymo_open_dataset/metrics/tools/create_prediction_file_example.py

Hope that helps!

On Thu, Sep 10, 2020 at 2:59 PM chubinski notifications@github.com wrote:

Good Day Lucas Sloan!

I am trying to run yolov4 on the waymo dataset, and output the mean average precision score (mAP) using waymo's metric evaulation tools.

I am new to machine learning, and tensorflow. I'm wondering how you created the tensorflow file which extract_waymo_yolo.py reads? Did you convert yolov4 detections to tensorflow files; if so, would you be able to explain how you achieved this?

Lastly, how do you then use the tensorflow output file to get mAP metrics? Did you use the python op's provided by waymo?

I am working with the Swedish research lab REVERE; I have been assigned the task of computing mAP of yolov4 detections on waymo datasets.

I appreciate your time taken in creating this repository!

Your help would be appreciated! Thank you!

BR,

Adnan

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/LucasSloan/waymochallenge/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAAY7KLYDWB4WGC57JFVXPTSFFD4ZANCNFSM4RF6VX3Q .

b4da commented 4 years ago

I hope all is good on your end.

Thank you for your response; the links and explanation does help yes. I'll take another look at that example -- create_prediction_file_example.py.

Have a good week :).