search

PointsCoder / GPT-Driver

Learning to Drive with GPT
https://pointscoder.github.io/projects/gpt_driver/index.html
224 stars 11 forks source link

Evaluation Code #1

Open haomengz opened 10 months ago

haomengz commented 10 months ago

Hi,

Thanks for the nice work! I am interested in reproducing the results, but the evaluation procedure in the repo is not very clear. It seems that we could not directly use the linked ST-P3 eval code. Could you provide the script or more details on how you conduct the evaluate on NuScenes dataset? Thanks!

abhigoku10 commented 10 months ago

@PointsCoder i am having the same issue here can u point or elaborate the steps to do the evaluation on nuscenes or custom dataset THanks in advance

haomengz commented 10 months ago

For the collision evaluation, ST-P3 is using segmentations for calculation. What segmentation results are you using for the calculation? Did you follow the ST-P3 pipeline, or using the data from UniAD? Thanks!

Gear420 commented 9 months ago

same issue; .pkl cannot be directly applied to the evaluation code of st-p3.

PointsCoder commented 7 months ago

@abhigoku10 @haomengz @Gear420 We have released the code and data for evaluation here.