search

RI-SE / smirk

SMIRK is an experimental pedestrian emergency breaking ADAS facilitating research on quality assurance of critical components that rely on machine learning.
GNU General Public License v3.0
16 stars 4 forks source link

Update the 50 m threshold in the performance requirements #10

Closed mrksbrg closed 2 years ago

mrksbrg commented 2 years ago

The 50 m threshold for pedestrian detection and recognition in the performance requirements does not match the ODD. If ego car moves at 70 km/h, a TTC of 4 s means that the pedestrian can be almost 80 m away.

mrksbrg commented 2 years ago

This is related to Issue #8. Since we replaced accuracy with true positive rate in SYS-PER-REQ1, SYS-PER-REQ2 is now redundant. We solve this by specifying requirements on TPR and FNR at different distances. We replace 50 m with 80 m in all cases except in SYS-PER-REQ2 where we keep 50 m. We motivate this by the presence of a driver - the driver is reponsible for braking ego car if a pedestrian shows up, thus we measure FNR closer to the vechicle.

mrksbrg commented 2 years ago

At the same time, align ego car and ego vechicle throughout the SRS.