added possibility to copy saved products to S3 storage - Githubissues

MeteoSwiss / pyrad

Python Radar Data Processing

https://meteoswiss.github.io/pyrad/

Other

37 stars 10 forks source link

added possibility to copy saved products to S3 storage #63

Closed wolfidan closed 5 months ago

wolfidan commented 5 months ago

This PR adds two keys in the main config file

s3copypath : URL of a S3 storage service in the format https://bucket.endpoint.domain, if provided will copy all products generated by pyrad to this S3 storage service
s3AccessPolicy : access policy to use for the uploaded files, e.g. private or public-read. If not provided will use the default policy defined at bucket level.

Note that the upload will only work if the environment variables: AWS_KEY (for AWS API key) and AWS_SECRET (for the API secret) are defined.