Benchmark also tests for actual scales of scores

outbrain / outrank

A Python library for efficient feature ranking and selection on sparse data sets.

https://dl.acm.org/doi/10.1145/3604915.3610636

BSD 3-Clause "New" or "Revised" License

19 stars 3 forks source link

Benchmark also tests for actual scales of scores #51

Closed SkBlaz closed 1 year ago

SkBlaz commented 1 year ago

Each ranking henceforth shall be subject to an additional test that also checks whether the scales of obtained scores (not only ranks!) match the expected values. This should detect regressions that skew score distribution, yet preserve the ranking.