Document copying to cloud storage

sgkit-dev / bio2zarr

Convert bioinformatics file formats to Zarr

Apache License 2.0

26 stars 7 forks source link

Document copying to cloud storage #234

Open jeromekelleher opened 4 months ago

jeromekelleher commented 4 months ago

Currently we have no documentation for how to copy final encoded Zarrs to cloud storage. We would love to test this out at scale and document for other users.

jgafnea commented 4 months ago

Hi, if you're using s3 (a guess), the following generally works for copying local files to cloud storage:

# Copy file to cloud storage.
aws s3 cp myfile.ext s3://mybucket

# Copy directory to cloud storage.
aws s3 cp mydir s3://mybucket/ --recursive

Reference