aeon-toolkit / aeon

A toolkit for machine learning from time series
https://aeon-toolkit.org/
BSD 3-Clause "New" or "Revised" License
957 stars 109 forks source link

[BUG] Results loader impossible to load Equal length and No missing values dataset results #1845

Open hadifawaz1999 opened 1 month ago

hadifawaz1999 commented 1 month ago

Describe the bug

using get_estimator_results when setting the datasets list parameter to the univariate list in tsc_datasets to get the 128 UCR results. will always give 112 because in tsc_datasets the dataset names are for example "AllGestureWiimoteX" but in the csv files of the results on tsc.com is "AllGestureWiimoteXEq" for example so cant load them

the dataset list should allign with the bake off csv files

Steps/Code to reproduce the bug

from aeon.benchmarking.results_loaders import get_estimator_results
import pandas as pd
import csv
from aeon.datasets.tsc_datasets import univariate

cls = ["TS-CHIEF","MR-Hydra","InceptionTime","H-InceptionTime","HC2"] 
results=get_estimator_results(estimators=cls, datasets=univariate) 

Expected results

get the 128 datasets

Actual results

getting the 112

Versions

No response

TonyBagnall commented 1 month ago

This on me, will look when I get back

TonyBagnall commented 1 month ago

urghh, this is tedious, so either I change the website results on tsc.com or add some exception clauses in the code in aeon. Any preference @hadifawaz1999 ?

hadifawaz1999 commented 1 month ago

urghh, this is tedious, so either I change the website results on tsc.com or add some exception clauses in the code in aeon. Any preference @hadifawaz1999 ?

I think an easier solution is a code work in aeon, and leave the website as is