Volumetric 1G-1T 1k to 1m compressed files for ext upload testing - Githubissues

ised-isde-canada / cbmdsp-cp-sp-overall-architecture

1 stars 1 forks source link

Volumetric 1G-1T 1k to 1m compressed files for ext upload testing #37

Open obriensystems opened 3 years ago

obriensystems commented 3 years ago

Evolving volumetric test data (all public EC radar/sat/vaisala images for now)

public counsel/client testing data in S3 - us-east-1 for use by EC2....(on/off region, on/off aws) -- 1.4g / 12K files https://upload-weather-lightning.s3.amazonaws.com/radar_lightning-ATL.tgz -- 3.5g / 11K files (under 5) https://upload-weather-lightning.s3.amazonaws.com/radar_lightning-CLDN.tgz -- 10g (over 5) 51K files https://upload-weather-lightning.s3.amazonaws.com/radar_wcan.tgz -- 253g (300g) 1.01M files https://upload-weather-lightning.s3.amazonaws.com/tgz.zip

https://jira.ised-isde.canada.ca/browse/CBMDSP-44