search

openml / openml-weka

The OpenmlWeka package
4 stars 3 forks source link

null error on run #15

Open Krulvis opened 5 years ago

Krulvis commented 5 years ago

When running a task in Weka I'm getting the following error:

[10-10-2018 19:39:45] [OK] [Cache] Obtained from cache: task/task_168349.xml
Running experiment: Runs from: 1 to: 10
Datasets:
Custom property iterator: on
Custom property path:
1  org.openml.weka.experiment.TaskResultProducer::splitEvaluator ClassifierSplitEvaluator: weka.classifiers.rules.ZeroR (version 48055541465867954)
Custom property name:classifier
Custom property values:
 1 weka.classifiers.trees.RandomForest RandomForest: No model built yet.
ResultProducer: CrossValidationResultProducer: -X 10 -W org.openml.weka.experiment.OpenmlClassificationSplitEvaluator --: <null Instances>
ResultListener: org.openml.weka.experiment.TaskResultListener@47231b6a

Writing experiment copy
Reading experiment copy
Made experiment copy
CrossValidationResultProducer: setting additional measures for split evaluator
[10-10-2018 19:39:58] [OK] [Cache] Obtained from cache: datadescription/datadescription_41198.xml
[10-10-2018 19:39:58] [OK] [Cache] Obtained from cache: dataset/dataset_41198.ARFF
java.lang.NullPointerException
    org.openml.weka.algorithm.InstancesHelper.getDatasetFromTask(InstancesHelper.java:97)
    org.openml.weka.experiment.TaskResultProducer.setTask(TaskResultProducer.java:117)
    org.openml.weka.experiment.TaskBasedExperiment.nextIteration(TaskBasedExperiment.java:147)
    weka.gui.experiment.RunPanel$ExperimentRunner.run(RunPanel.java:180)

    at org.openml.weka.algorithm.InstancesHelper.getDatasetFromTask(InstancesHelper.java:97)
    at org.openml.weka.experiment.TaskResultProducer.setTask(TaskResultProducer.java:117)
    at org.openml.weka.experiment.TaskBasedExperiment.nextIteration(TaskBasedExperiment.java:147)
    at weka.gui.experiment.RunPanel$ExperimentRunner.run(RunPanel.java:180)
Done...

Weka: 3.8.2 openmlWeka package: 0.9.5

janvanrijn commented 5 years ago

Thanks for reporting this error.

Can you please give some information on which classifier and hyperparameter settings you were using? Also, what is the version of the openml-weka package?

Krulvis commented 5 years ago

Ah excuse me, I edited the issue to be more informative. I ran a RandomForest without changing any of the settings. image

janvanrijn commented 5 years ago

I am a little bit confused by the error. It implies that there is a task 41198, but this one is not present op OpenML: https://www.openml.org/t/41196

janvanrijn commented 5 years ago

My bad, it has to be task 168349. I am encountering the same problem. Will investigate.

Krulvis commented 5 years ago

Any updates on the issue?

janvanrijn commented 5 years ago

Hi @Krulvis , this week I created a new release, it should resolve your problems. Can you please verify this?