search

MengyangPu / EDTER

EDTER: Edge Detection with Transformer, in CVPR 2022
MIT License
278 stars 35 forks source link

Calculation of AP metric #47

Closed Bedrettin-Cetinkaya closed 1 year ago

Bedrettin-Cetinkaya commented 1 year ago

Hello, When I ran your evaluation matlab script, I got the results: ODS=0.774, OIS=0.789, AP=0.756 using your pre-computed nms images for NYUD-RGB. However, you reported an AP metric of 79.7, there is a considerable difference between these results. When I checked the AP array, I noticed that your results didn't have results for recall value >= 0.9, and you interpolated AP for these missing values. The following figure is taken from your supplementary material, and I show these missing AP values with a black rectangle. image

I wonder if this is how you calculate AP. Thanks.

MengyangPu commented 1 year ago

Please refer to our eval code, thanks~