DigitalSlideArchive / superpixel-classification

A test cli for classifying superpixels with arbitrary labels
Other
5 stars 2 forks source link

Use ALBench to compute different certainty metrics. #4

Closed manthey closed 1 year ago

manthey commented 1 year ago

This is currently using a branch of ALBench and needs to use a pypi release before we merge.

In addition to the confidence array in the metadata, this add a certainty array based on the ALBench computed certainty. We also save "certainty_info" which is a dict of "type" (the type used for computing certainty), "percentiles", and "cdf". Percentiles and cdf are both computed for a selected set of values. For percentiles, this could show how we are approaching some sort of limit, but since the certainty values aren't on the same range for each certainty type, I'm not sure how we would interpret this. And, the computed cdf values are probably worthless on certainty types where the certainty values aren't in the range [0,1].

manthey commented 1 year ago

@naglepuff This exposes a certainty type option and produces a certainty vector which can be used in place of the confidence vector.

Leengit commented 1 year ago

ALBench Pull Request #48 is now merged.

manthey commented 1 year ago

Thank you @Leengit