search

biigle / core

:large_blue_circle: Application core of BIIGLE
https://biigle.de
GNU General Public License v3.0
12 stars 15 forks source link

Ditch the annotation label confidence #182

Open mzur opened 5 years ago

mzur commented 5 years ago

Nothing uses the annotation label confidence and there is no way to set it in the UI. Also, since I have no hope of ever implementing biigle/core#53, there will be no way to enable/disable the annotation confidence for a project. So we should be able to "clean up" and remove the annotation label confidence everywhere.

mzur commented 5 years ago

References #9.

mzur commented 2 years ago

We don't need the confidence in BIIGLE but the new iFDO standard has it, too. So we should think twice before we remove it.

dlangenk commented 1 year ago

Originally I was against a confidence value for manual annotation (e.g. as a confidence of 67% might be a very subjective measure). But if we don't offer that but introduce the ML confidence in #679 people might misuse the AI confidence values for manual confidence measurements. However, this brings back the question of how we support that in the UI. An option could be to only set this with the API (but then it's more or less useless), or what would be more usable: You create every annotation with a confidence of 1. If you want to change the confidence you can click on the confidence value icon (see #679 mockup) and a slider is displayed. Another option would be to use the alt key and the 1 to 0 keys for confidences 10% to 100% in 10 percentage point steps.

mzur commented 1 year ago

Good points. I like the idea that an annotation gets a default confidence of 1 which can be adjusted later. In addition, if the users enable the feature in their settings, a "confidence dial" is displayed next to the cursor whenever a new annotation is finished. This can be a fancy UI element that allows users to choose a confidence with the mouse very quickly. When the confidence is chosen, the annotation is created.

The "confidence dial" must be quite elaborate so the whole annotation process is not slowed down too much. Maybe a slider that is moved with the mouse movement (without clicks) and the slider handle "snaps" to 10% or 25% intervals. With a click, the confidence is confirmed. If users double-click, they skip the confidence dial and get the default confidence.