search

openml / openml-r

R package to interface with OpenML
http://openml.github.io/openml-r/
Other
95 stars 37 forks source link

Error when using listOMLRunEvaluations #399

Closed PhilippPro closed 6 years ago

PhilippPro commented 6 years ago

This only happens, when you set limit = NULL

> time = system.time(my_runs <- listOMLRunEvaluations(tag = "botV1", evaluation.measure = "area_under_roc_curve", limit = NULL))
Downloading from 'https://www.openml.org/api/v1/json/evaluation/list/tag/botV1/function/area_under_roc_curve' to '<mem>'.
Fehler in doHTTRCall(method, url = url, query = list(api_key = conf$apikey),  : 
  ERROR (code = <NA>) in server response: <NA>
  Server returned a HTML document!
giuseppec commented 6 years ago

Thx, looks like a server issue. I've reported this here https://github.com/openml/OpenML/issues/498 . Will close this issue, please reopen it, if you still have issues after server issue has been fixed.

You can now also use this https://github.com/openml/openml-r/blob/master/R/chunkOMLlist.R function to automatically get all results:

number.requests = 1000 # (each request gives you 10000 results)
res = chunkOMLlist("listOMLRunEvaluations", tag = "botV1", 
  evaluation.measure = "area_under_roc_curve", 
  chunk.limit = 10000, total.limit = number.requests*10000)

Here you need to use chunk.limit = 10000 as the server would complain anyway if you don't provide a limit and a single listOMLRunEvaluations request has more than 10000 results.