To prove the cost effectiveness of a hybrid architecture for scientific computing, we need to be able to minimize costs around egress of data from cloud providers. This requires that we come up with a plan for how to cache data downloaded from AWS locally within the HECC system in order to avoid duplicate downloads on subsequent reuse of the same data.
Description:
To prove the cost effectiveness of a hybrid architecture for scientific computing, we need to be able to minimize costs around egress of data from cloud providers. This requires that we come up with a plan for how to cache data downloaded from AWS locally within the HECC system in order to avoid duplicate downloads on subsequent reuse of the same data.
Acceptance Criteria: