search

openclimatefix / metoffice_ec2

Subset Met Office MOGREPS-UK and UKV on AWS EC2
MIT License
11 stars 2 forks source link

Add AWS Infrastructure #19

Closed flowirtz closed 4 years ago

flowirtz commented 4 years ago

This PR adds all relevant AWS infrastructure to run the metoffice_ec2 script. Everything is provided as Terraform files.

infra

We are subscribing to two SNS Topics from the Metoffice, filtering the messages based on a custom filter policy and send the resulting messages to SQS. To consume those messages we then set up a simple ECS Fargate cluster and run our docker image on a small instance in there.

The resulting files are pushed to S3.

Fixes #10, Fixes #9, Fixes #3

flowirtz commented 4 years ago

(ignore the tf check, I already ran it and fixed it, just can't retrigger it without pushing...)