Implementation of scoring threshold within the proxy

[jonquet]

We finally decided to implement threshold filtering feature for scored annotations.

Two annotation filtering mechanisms will be done:

• an absolute score threshold i.e., Annotators will only return the annotations above a certain given threshold score value
• a normalized score threshold i.e., Annotators will only return the results corresponding to a normalized value between 0 and 100 that indicates how much of the annotations to keep in proportion to the cumulative score density function. For example, a threshold of 90 will retain only the annotations with a score in the top 10% of the score distribution.

We will add 2 parameters in the API for respectively activate thee features:
score_thrseshold confidence_threshold (this one will take value between 0 and 100)

[jonquet]

We currently already testing this on stage.

[twktheainur]

@jonquet Please test the feature in the stageportal UI, filtering now works properly from the API and the UI

[jonquet]

Tested on stage. On Annotator. Seems ok on both UI and API

The combination of the score is not clear. E.g., if using 3.5 for score threshold and 50 for confidence threshold on the sentence : "Le mélanome apparaît lorsque les cellules productrices de pigment qui donnent la couleur à la peau deviennent cancéreuses. Les symptômes possibles sont une nouvelle excroissance anormale ou le changement d'un grain de beauté existant. Les mélanomes peuvent apparaître à n'importe quel endroit du corps. Le traitement peut inclure la chirurgie, la radiothérapie, les médicaments ou, dans certains cas, la chimiothérapie." with MSHFRE and SNMIFRE. No annoations left.

Not working with NCBO Annotator+ from stage (seems to be a different proxy error).

A noter qu'avec une valeur de 10 pour confidence, une seule annoation de score 3.22 est gardée. Que deviennes les autres qui on le même score ?