search

prio-data / views_pipeline

VIEWS forecasting pipeline for monthly prediction runs. Includes MLops and QA for all models/ensembles.
Other
3 stars 3 forks source link

Use ModelPath to orchestrate #112

Closed xiaolong0728 closed 2 weeks ago

xiaolong0728 commented 2 weeks ago

Sorry for not making several focused branches but there are mainly repetitions and class-based modifications here, so no need to be scared. Details of changes are as below:

  1. ModelPath
    • Replace all set_path except for setup_project path using ModelPath
  2. common_utils
    • Modify scripts in utils_dataloader to help identify models.
    • Move utils_log_file.py and set_partition.py to common utils
  3. ensembles
    • Allow training an ensemble if --train is set.
    • If the single model evaluation or forecasting is missing, ensemble will execute evaluation or forecasting and save outputs to the single model's corresponding folders.
    • Log details of single models under ensemble model in txt file.
  4. common_queryset (just for convenience)
    • One missing common_queryset is added.