tusen-ai / simpledet

A Simple and Versatile Framework for Object Detection and Instance Recognition
Apache License 2.0
3.08k stars 488 forks source link

fcos' performance is far from the paper #289

Closed DuZzzs closed 4 years ago

DuZzzs commented 4 years ago

The results of my training are far from the official code.

modified:

backbone:resnet_v1b_50
train dataset: coco2017
epoch: 7
device:TITAN RTX

results: test on coco minival2014. my result :  map = 34.7,  inference time: 167 ms/pic official result : map = 37.1,  inference time: 50 ms/pic Is this a problem of implementation or my operation?

huangzehao commented 4 years ago

@kfxw

kfxw commented 4 years ago

@DuZzzs Hi! The speed of inference code is not optimized. Some python custom ops are used and they are the bottlenecks. Only the training speed is guaranteed in this code. As for the accuracy, I used 'coco_train2014 + coco_valminusminival2014' for training. This is the common practice. I remember the mAP fluctuated between around 36.8 to 37.2. You can try this training setting.

DuZzzs commented 4 years ago

@kfxw ok. Thank you very much.