search

woven-planet / l5kit

L5Kit - https://woven.toyota
https://woven-planet.github.io/l5kit
857 stars 278 forks source link

Evaluation protocol for RL environment #325

Closed theDebugger811 closed 3 years ago

theDebugger811 commented 3 years ago

Adding evaluation protocol for RL environment to measure generalization capabilities.

theDebugger811 commented 3 years ago

@perone, could you let me know what would be ideal to plot on tensorboard for evaluation post the metric and validator compute. Ref: See here

Thanks!

theDebugger811 commented 3 years ago

@perone, logged the results of ValidationCountingAggregator into tensorboard.

theDebugger811 commented 3 years ago

@perone , thanks for the comments. Updated the metric set name.