test_compliance.py does not work with refactored data structure

prio-data / prediction_competition_2023

Code for generating benchmark models and evaluation scripts for the 2023 VIEWS prediction competition

4 stars 5 forks source link

test_compliance.py does not work with refactored data structure #39

Open kvelleby opened 1 year ago

kvelleby commented 1 year ago

Describe the bug This file has not been updated to assume the refactored data structure, and will fail.

Expected behavior It should read a submission, and give sensible feedback on whether it complies with the submission format, and if the data matches with the test/actuals-data windows.