openclimatefix / metoffice_ec2

Subset Met Office MOGREPS-UK and UKV on AWS EC2
MIT License
11 stars 2 forks source link

Check if we can filter incoming messages #14

Closed flowirtz closed 4 years ago

flowirtz commented 4 years ago

Currently we are listening to all messages that are published on the respective SNS Topics. That leads to quite a high amount of messages in SQS, even though message retention is only 90 mins.

We should check whether we can filter our subscription to only let trough relevant messages. See: https://docs.aws.amazon.com/sns/latest/dg/sns-message-filtering.html

flowirtz commented 4 years ago

Done, we now have a filter on the SNS Topic Subscription.