christianbirchler-org / sdc-testing-competition

🚗💻 Tool Competition: Test Selection for Self-driving Cars in Simulation
https://conf.researchr.org/home/icst-2025
GNU General Public License v3.0
6 stars 8 forks source link

Define Evaluation Metrics #5

Closed ChristianBirchler closed 2 months ago

ChristianBirchler commented 3 months ago

I created https://github.com/christianbirchler-org/sdc-testing-competition/blob/main/evaluation.py containing initial code and proposals for potential evaluation metrics

ChristianBirchler commented 2 months ago

I created an initial definition of metrics. They can still be improved, but for now, it should be sufficient.