As part of exploring the possibility of AWS event notifications -> AWS lambda function for converting incoming model-output data to parquet format (#52), there is some MVP code for the python-based data transformation function. It's currently in a branch of the hubverse-infrastructure repo.
Work needed for this issue
Move the hubverse-transforms Python module from hubverse-infrastructure to its own repository so that it can be deployed as a Hubverse AWS lambda function or used by non-hubverse-cloud hubs who want to perform transformations to their model-output data.
Definition of done:
[x] The model-output transformation Python module is in a standalone repo in the Infectious-Disease-Modeling-Hubs GitHub organization
[x] The module can be pip installed from the GitHub repo
[x] The module is code checked (linter, types, tests) via CI
[x] The new repository has branch protections that prevent updating main without a PR and require successful checks
[x] The README describes how to set up the project locally
Background
As part of exploring the possibility of AWS event notifications -> AWS lambda function for converting incoming model-output data to parquet format (#52), there is some MVP code for the python-based data transformation function. It's currently in a branch of the hubverse-infrastructure repo.
Work needed for this issue
Move the hubverse-transforms Python module from
hubverse-infrastructureto its own repository so that it can be deployed as a Hubverse AWS lambda function or used by non-hubverse-cloud hubs who want to perform transformations to their model-output data.Definition of done:
Infectious-Disease-Modeling-HubsGitHub organizationmainwithout a PR and require successful checks