search

wiesenfa / challengeR

GNU General Public License v2.0
35 stars 8 forks source link

Reduce visualization in report to top n algorithms #5

Closed niklr closed 4 years ago

niklr commented 5 years ago

Dear @wiesenfa As pointed out in the paper, visualization methods often reach their limit when the number of algorithms are too large. grafik Is it already possible with the current implementation to reduce the visualization to a top list of algorithms displayed in the report (e.g. by specifying a parameter topN=10)? Best regards, Roman Niklaus

wiesenfa commented 5 years ago

No unfortunately not yet. I put it on the feature list as this is very important. Note that running the report as it is now with a reduced number of algorithms will underestimate the uncertainty in the rankings. Please give me some time to implement it (I am at the moment doing everything on my own, so if you want to contribute you are more than welcome).

Best regards, Manuel

JunMa11 commented 4 years ago

Dear @wiesenfa ,

Are there any updates on the new features?

Best regards, Jun

wiesenfa commented 4 years ago

Dear @JunMa11

new update now supports reduction of algorithms in single task case. Though not thoroughly tested yet (and documentation scarce). See change log in readme.

Hope this is useful. Best, Manuel