Testing hellsemble on data

KN-Modelowania-Matematycznego / hellsemble

Implementation of the hellsemble ensembling approach.

2 stars 0 forks source link

Testing hellsemble on data #5

Closed jakub-piw closed 2 days ago

jakub-piw commented 1 month ago

We need to test our implementation on data.

Focus on comparing performance of hellsemble with simple ml models.
Test of implementation - any bugs/issues with code.

The script for data is in bin directory.

DawidPludowski commented 1 month ago

I would suggest the following flow:

analysis/report.py file with a class that takes as an input configuration of the experiment, performs it and gathers all information about the outcome
bin/run_analysis.py file with a script that uses report.py
probably config/experiment_config.yaml with configurations run by run_analysis.py

Ofc if we are thinking about a small framework to make experiments, not ad-hoc .ipynb analysis

DawidPludowski commented 1 month ago

I did sth similar here: https://github.com/DawidPludowski/adaptivee

jedrzejrucinski commented 1 month ago

I'll see what I can do, I'll for sure make sure to have a setup that gathers all the neccessary data, not sure if it will be in the same format as this however