Rewamped evaluation and abstract dataloaders (True forecast purple alien precursor)

prio-data / views_pipeline

VIEWS forecasting pipeline for monthly prediction runs. Includes MLops and QA for all models/ensembles.

Other

3 stars 3 forks source link

Rewamped evaluation and abstract dataloaders (True forecast purple alien precursor) #30

Closed Polichinel closed 4 months ago

Polichinel commented 5 months ago

This spiraled a bit out of control.

The purpose was to finalize the true forecast part of Purple Alien, but to do so, I ended up abstracting a lot of stuff related to data loading/viewer fetching.

This was done bc eval (generation, logging ect.) needs to align with the forecast if we are to trust forecasts.

There is still a bit of mess in purple alien, but we need to merge to get the stuff that is now in common_utils

Forecasting will be the next branch/pr

sarakallis commented 5 months ago

Comments I can't add in the code:

in config_sweep.py, there is a typo in the function name (get_swep_config) that is also being called in other scripts
in execute_model_runs.py, consider changing the hardcoded project name (line 34) to what you defined in the sweep config