Create job to push monthly data dumps to AWS open data S3 bucket

griffithlab / civic-client

Web client for CIViC: Clinical Interpretations of Variants in Cancer

MIT License

50 stars 28 forks source link

Create job to push monthly data dumps to AWS open data S3 bucket #1613

Closed malachig closed 3 years ago

malachig commented 3 years ago

We now have a public S3 bucket that is part of the AWS Open Data initiative.

https://s3.console.aws.amazon.com/s3/buckets/civic-aws-opendata?region=us-west-2

I have manually populated it with one month of data dumps. Now we could use an automated task that pushed these files into a named folder each month when the data releases are generated.