search

Cc-Hy / CMKD

Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection (ECCV 2022 Oral)
Apache License 2.0
107 stars 9 forks source link

Inconsistent evaluation results #41

Closed charmeleonz closed 1 year ago

charmeleonz commented 1 year ago

Hi,

I ran into inconsistent evaluation results where the automatic eval at the end of training and manual evaluation using test.py give slight different results for the same checkpoint. Sometimes the AP differs by ~1 AP and sometimes < 1 AP. Do you have any idea why?

What I am training and evaluating is a CaDDN model using the provided CaDDN.yaml.

Cc-Hy commented 1 year ago

I've been in some similar situations, but the gap is not as large as yours. Maybe it has something to do with the dataloader and I have made some modification to the dataloader, please try again to see whether this issue still exits.