ScottishCovidResponse / SCRCIssueTracking

Central issue tracking repository for all repos in the consortium
6 stars 0 forks source link

Design of EERA model outputs to pipeline #748

Open peter-t-fox opened 3 years ago

peter-t-fox commented 3 years ago

Pseudo-code for writing the model outputs to the pipeline in both inference and prediction modes.

write_table("original/inference/2020-08-29_10_11_00", "log", log_table);
for step in 0:nsteps
  write_table("eera_outputs/original/inference/2020-08-29_10_11_00", "steps/step/ends", ends_step_n);
  write_table("eera_outputs/original/inference", "steps/step/simu", simu_step_n);
  write_table("eera_outputs/original/inference", "steps/step/particles", particles_step_n);
ends

write_table("original/prediction/2020-08-29_10_11_00", "log", log_table);
write_table("eera_outputs/original/prediction", "full", full);
write_table("eera_outputs/original/prediction", "simu", simu);
github-actions[bot] commented 3 years ago

Heads up @thibaud-porphyre @peter-t-fox - the "Covid19_EERAModel" label was applied to this issue.

andyb96247 commented 3 years ago

Have implemented code to write to the data pipeline using the above format.

andyb96247 commented 3 years ago

Additional documentation has been added to the README file. The upload process is described, but is likely incomplete as I have not completed a successful upload so far - the files have been placed on the ftp server, but something fails towards the end of the upload script run.