search

uavis / mlproj

Repo for CMPUT551 course project
GNU General Public License v2.0
1 stars 1 forks source link

Error Metrics #11

Closed MSiam closed 8 years ago

vincentzhang commented 9 years ago

For lesions, we need to implement the following to compare with previous work, as described here: http://www.ia.unc.edu/MSseg/rules.html

Reference scores for the evaluation are following. In the order of voldiff, avgdist, tanerr, truepos, and falsepos, 68.29, 4.85, 75.16, 67.79, 32.20, respectively. The score for voldiff and avgdist is computed as '100 - 10 * measurement / reference', and the score for truepos, and falsepos is computed as 90−15×err−referrrefstd where err is the measurement of an error for each criteria of a submitted segmentation and referr and refstd stands for the average and standard deviation of the measurement of an error among human rater segmentations. The measurement is a computed value from the segmentation and the reference is corresponding reference score.

vincentzhang commented 9 years ago

Metric list and naming correspondence:

  1. F1 score = Dice Similarity Coefficients (in the MS lesion literature)= 2TP/(2TP+FP+FN)
  2. Sensitivity = Recall = Completeness (in the building literature) = TPR(lesion) = TP/(TP+FN)
  3. Precision = Correctness(building) = PPV (lesion)
  4. Jaccard Score
  5. Dice Ratio