Open Neeratyoy opened 3 years ago
What is the produced error? The fact that no such runs exist on the server points towards a server error rather than an openml-python
error. Can you confirm which end is responsible for the failed upload?
What is the produced error?
OpenMLServerException: https://test.openml.org/api/v1/xml/run/ returned code 216: Error processing output data: illegal combination of evaluation measure attributes (repeat, fold, sample) - Measure(s): usercpu_time_millis_training(0, 0), wall_clock_time_millis_training(0, 0), usercpu_time_millis_testing(0, 0), usercpu_time_millis(0, 0), wall_clock_time_millis_testing(0, 0), wall_clock_time_millis(0, 0), predictive_accuracy(0, 0)
I too think it is a server-side error and posted this issue to confirm the same.
However, I am not sure if the predictions we generate locally are as the server expects since this task type is not something common. The test split contains the full dataset.
@mfeurer
Hey @janvanrijn, any insight on this would be nice!
Description
Certain tasks exist on the OpenML server with invalid or illegal task estimation type that results in empty task estimation parameters.
Steps/Code to Reproduce
Expected results
publish()
should work successfully.Misc. info
The list of task IDs on the production server with the
estimation_procedure
type astestontrainingdata
:The list of task IDs on the test server with the
estimation_procedure
type astestontrainingdata
:On both servers, no run exists for these list of tasks.