search

monarch-initiative / pheval

A framework for empirical evaluation of phenotype matching and prioritisation
https://monarch-initiative.github.io/pheval/
Apache License 2.0
12 stars 1 forks source link

325 alter ranking of results penalising results found at the same rank #326

Closed yaseminbridges closed 5 months ago

yaseminbridges commented 6 months ago

Altered the ranking of the post-processed results so equal ranks are now penalised.

Before:

1,1,3

Now

2,2,3

souzadevinicius commented 5 months ago

Altered the ranking of the post-processed results so equal ranks are now penalised.

Before:

1,1,3

Now

2,2,3

Why equal ranks are penalised?

yaseminbridges commented 5 months ago

Altered the ranking of the post-processed results so equal ranks are now penalised. Before: 1,1,3 Now 2,2,3

Why equal ranks are penalised?

Damian and Jules agreed that this is the better way to rank results. In theory with the current ranking if a tool outputs all genes with the same score and they were all ranked 1 the results would be misleading. If it is penalised we can account for these types of instances.