cocodataset / cocoapi

COCO API - Dataset @ http://cocodataset.org/
Other
6.06k stars 3.75k forks source link

What the sigmas means in cocoapi/PythonAPI/pycocotools/cocoeval.py line206 #264

Open xiapengchng opened 5 years ago

xiapengchng commented 5 years ago

I has my own keypoint dataset. Every object has 30 points (not 17). So when I evaluate the detection results. I find the dimension the metrics have something with sigmas ious = np.zeros((len(dts), len(gts))) sigmas = np.array([.26, .25, .25, .35, .35, .79, .79, .72, .72, .62,.62, 1.07, 1.07, .87, .87, .89, .89])/10.0 vars = (sigmas * 2)**2 k = len(sigmas) the position was cocoapi/PythonAPI/pycocotools/cocoeval.py fron line 206

harrisonford commented 5 years ago

I actually find it annoying also that the sigma array is hardcoded (len and values) without any documentation about what is it. I guess this toolbox was made to evaluate a very restricted case of mscoco database which is a shame because with a little improvement it could be generalized.

alex-razor commented 5 years ago

I has my own keypoint dataset. Every object has 30 points (not 17). So when I evaluate the detection results. I find the dimension the metrics have something with sigmas ious = np.zeros((len(dts), len(gts))) sigmas = np.array([.26, .25, .25, .35, .35, .79, .79, .72, .72, .62,.62, 1.07, 1.07, .87, .87, .89, .89])/10.0 vars = (sigmas * 2)**2 k = len(sigmas) the position was cocoapi/PythonAPI/pycocotools/cocoeval.py fron line 206

So what did you do? How did you change sigmas..i am having the same problem here for hand landmark detection..

dreamPoet commented 4 years ago

same problem, any update?

carolchenyx commented 3 years ago

Same problem, any update?

tucachmo2202 commented 3 years ago

Same problem, any update?

alen-smajic commented 2 years ago

Same problem, any update?

buptlj commented 2 years ago

Same problem, any update?

adidier17 commented 2 years ago

I would also like to know how these values are determined.

adidier17 commented 2 years ago

I think issue #399 answers this question.

cucdengjunli commented 1 year ago

same problem