search

PGijsbers / automlbenchmark

OpenML AutoML Benchmarking Framework
https://openml.github.io/automlbenchmark
MIT License
0 stars 0 forks source link

gama fails on test #23

Open github-actions[bot] opened 3 months ago

github-actions[bot] commented 3 months ago

During a routine test gama installed successfully but failed to pass the test benchmark.

id task framework constraint fold type result metric mode version params app_version utc duration training_duration predict_duration models_count seed info acc auc balacc logloss mae r2 rmse
0 openml.org/t/3913 kc2 GAMA test 0 binary 0.861472 auc local 23.0.0.post1 nan dev [https://github.com/PGijsbers/automlbenchmark, master, b44409c] 2024-07-31T07:47:57 54.2 53.1 0.002 50 1825077064 nan 0.811321 0.861472 0.545455 0.446884 nan nan nan
1 openml.org/t/59 iris GAMA test 0 multiclass nan neg_logloss local 23.0.0.post1 nan dev [https://github.com/PGijsbers/automlbenchmark, master, b44409c] 2024-07-31T07:50:11 130.9 nan nan nan 1825077064 CalledProcessError: Command '/home/runner/work/automlbenchmark/automlbenchmark/frameworks/GAMA/venv/bin/python -W ignore /home/runner/work/automlbenchmark/automlbenchmark/frameworks/GAMA/exec.py' ret… nan nan nan nan nan nan nan
2 openml.org/t/2295 cholesterol GAMA test 0 regression -46.8179 neg_rmse local 23.0.0.post1 nan dev [https://github.com/PGijsbers/automlbenchmark, master, b44409c] 2024-07-31T07:51:09 54.3 53.2 0.01 50 1825077064 nan nan nan nan nan 35.8412 -0.131436 46.8179

For more information, see the logs: https://github.com/PGijsbers/automlbenchmark/actions/runs/10176187671/

github-actions[bot] commented 2 months ago

During a routine test gama installed successfully but failed to pass the test benchmark.

id task framework constraint fold type result metric mode version params app_version utc duration training_duration predict_duration models_count seed info acc auc balacc logloss mae r2 rmse
0 openml.org/t/3913 kc2 GAMA test 0 binary 0.859307 auc local 23.0.0.post1 nan dev [https://github.com/PGijsbers/automlbenchmark, master, b44409c] 2024-08-14T08:46:57 54.3 53.1 0.003 50 860282086 nan 0.773585 0.859307 0.555195 0.373438 nan nan nan
1 openml.org/t/59 iris GAMA test 0 multiclass nan neg_logloss local 23.0.0.post1 nan dev [https://github.com/PGijsbers/automlbenchmark, master, b44409c] 2024-08-14T08:47:54 54.2 nan nan nan 860282086 NoResultError: Ran out of input nan nan nan nan nan nan nan
2 openml.org/t/2295 cholesterol GAMA test 0 regression -43.3912 neg_rmse local 23.0.0.post1 nan dev [https://github.com/PGijsbers/automlbenchmark, master, b44409c] 2024-08-14T08:48:52 54.4 53.2 0.02 50 860282086 nan nan nan nan nan 33.9383 0.0281286 43.3912

For more information, see the logs: https://github.com/PGijsbers/automlbenchmark/actions/runs/10384369245/