search

motional / nuplan-devkit

The devkit of the nuPlan dataset.
https://www.nuplan.org
Other
673 stars 129 forks source link

driving_direction_compliance weight inconsistent #273

Open Fan-Yixuan opened 1 year ago

Fan-Yixuan commented 1 year ago

In the doc, we have driving_direction_compliance in challenges 2&3 weights 5.0

while in the provided code, it's a multiple_metric.

patk-motional commented 1 year ago

Hi @Fan-Yixuan,

Thanks for bringing this up. Can you link to the specific point in the code?

Fan-Yixuan commented 1 year ago

https://github.com/motional/nuplan-devkit/blob/630f9d32a4b23f1b414ba6f4c26b9d4b539dcc62/nuplan/planning/script/config/simulation/metric_aggregator/closed_loop_nonreactive_agents_weighted_average.yaml#L14-L18

https://github.com/motional/nuplan-devkit/blob/630f9d32a4b23f1b414ba6f4c26b9d4b539dcc62/docs/nuplan_metrics_aggeregation.md?plain=1#L39-L48