Jaraxxus-Me / AirDet

Full conference version of AirDet: Few-Shot Detection without Fine-tuning for Autonomous Exploration
https://jaraxxus-me.github.io/ECCV2022_AirDet/
BSD 2-Clause "Simplified" License
70 stars 10 forks source link

In COCO, I Get a very low AP score, how can I fix it? #8

Open sixone-Jiang opened 1 year ago

sixone-Jiang commented 1 year ago

I get less than 3 AP in COCO, but I get the AP that similar to you in VOC; I check my output log find that many object in COCO get 0 AP; how can I fix it?

sixone-Jiang commented 1 year ago

[03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> AP : 0.00 [03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> AP50: 0.00 [03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> AP75: 0.00 [03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> APs : 0.00 [03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> APm : 0.00 [03/13 11:19:10 fewx.evaluation.coco_evaluation]: Evaluation results for Non VOC 60 categories =======> APl : 0.00

Jaraxxus-Me commented 1 year ago

How about the novel classes? The test only counts novel classes

sixone-Jiang commented 1 year ago

In COCO, all novel classes get 0 AP, but in VOC, I can get similar AP like you. May be I split the datasets wrong?

Jaraxxus-Me commented 1 year ago

Could be, you can check the steps in data generation phase

Jaraxxus-Me commented 1 year ago

Also check the ID mapper is correct for the VOC classes in COCO

sixone-Jiang commented 1 year ago

Thanks for your reply! At your reminder, I thought that non_voc60 should get 0AP in the testing stage; After the pre-training model you provided is fine-tuned, the category of nonVoc will not be recognized.

sixone-Jiang commented 1 year ago

image

Q12seven commented 4 months ago

image

May I ask if this result is obtained after fine-tuning? I can't fine-tune the code once it's running