search

OpenDriveLab / UniAD

[CVPR 2023 Best Paper Award] Planning-oriented Autonomous Driving
Apache License 2.0
3.44k stars 382 forks source link

About IDS indicators #107

Open haichen-ber opened 1 year ago

haichen-ber commented 1 year ago

Thanks to the author for the proposed method. I found 'nan' in some categories of IDS indicators during eval. What does this mean? "ids": { "bicycle": NaN, "bus": NaN, "car": 285.0, "motorcycle": NaN, "pedestrian": NaN, "trailer": NaN, "truck": NaN } Looking forward to your guidance.

YTEP-ZHI commented 1 year ago

@haichen-ber Hi, does these values come from evaluation? Could you please specify this problem a little bit? Any log information or screenshot would be helpful.

haichen-ber commented 1 year ago

@haichen-ber Hi, does these values come from evaluation? Could you please specify this problem a little bit? Any log information or screenshot would be helpful.

This evaluation is my own use of some corruption methods of imagenet-c to test the performance of UniAD. If this happens to IDS, does it mean that the identity cannot be determined?