mlcommons / science

MLCommons Science benchmarking working group
https://mlcommons.org/working-groups/research/science/
Apache License 2.0
12 stars 3 forks source link

Unable to download the data for the cloud mask benchmark #83

Open laibamehnaz opened 1 year ago

laibamehnaz commented 1 year ago

I am using the following commands to download the cloudmask benchmark data. However, the data is not downloaded. I will really appreciate any help. Thank you so much.

mkdir -p data/ssts
mkdir -p data/one-day
pip install awscli
aws s3 --no-sign-request --endpoint-url https://s3.echo.stfc.ac.uk sync s3://sciml-datasets/es/cloud_slstr_ds1/one-day ./data/one-day
aws s3 --no-sign-request --endpoint-url https://s3.echo.stfc.ac.uk sync s3://sciml-datasets/es/cloud_slstr_ds1/ssts ./data/ssts

This is the output that I get:

Screen Shot 2023-06-30 at 6 26 37 PM
laszewsk commented 1 year ago

I created globus endpoint look for "cloudmask" "mlcommons"