search

openml / openml-r

R package to interface with OpenML
http://openml.github.io/openml-r/
Other
95 stars 37 forks source link

number of results is not matched in listOMLRunEvaluations #424

Closed BayanIbra closed 5 years ago

BayanIbra commented 5 years ago

number of results of the following query in R does not matched with results from the website?

listOMLRunEvaluations(tag = "botV1", limit=10000)

giuseppec commented 5 years ago

Yeah, this is rather a documentation issue. The limit also refers to the other performance measures. In your example, your data.fame has 477 rows and contains results of 21 performance measures and 477 multiplied by 21 is almost 10000 (which is the limit). This is why we rather suggest to do separate calls for each evaluation measure you are interested in and then merge the results, e.g.

acc = listOMLRunEvaluations(tag = "botV1", limit=10000, evaluation.measure = "predictive_accuracy")
auc = listOMLRunEvaluations(tag = "botV1", limit=10000, evaluation.measure = "area_under_roc_curve")
...

In this case, it is probably better and more intuitive if we return the results in the long-format rather than in the wide-format.