Monitor: Add historical weather

ryandagley / mycologeek-website

A repository for the Mycologeek website. A flask website showcasing home tech projects.

0 stars 0 forks source link

Monitor: Add historical weather #5

Closed ryandagley closed 1 month ago

ryandagley commented 1 month ago

To pull historical weather data, it makes more sense that I make a daily API call and store the data myself.

For the architecture, I'm going to use AWS:

Lambda function to fetch weather data daily
Secrets Manager has my API key
DynamoDB to store the data
CloudWatch alarms (depending on cost) to monitor failures. Not sure if I want to spend that 10 cents per month.

ryandagley commented 1 month ago

Progress so far:

Lambda is deployed and writing a dump to S3 during test.
Lambda pulls API key from Secrets Manager
No DDB yet
No CloudWatch alarms or decision yet

ryandagley commented 1 month ago

Next, I'll need to pull the data from S3 and graph it onto the page

ryandagley commented 1 month ago

Historical weather is now displayed on the page pulling from a single S3 file.

Update the code to pull from the latest file
Schedule the lambda and have it overwrite or add a new file. I'll think about this over my coffee.

ryandagley commented 1 month ago

"worked in local" lol - the historical data is not showing up on the monitor site in prod. Probably will not troubleshoot this today.

ryandagley commented 1 month ago

Historical data is now working. While I thought this was a permissions issue at first, it turns out that app.py was instructing to only pull the 9/7 data. Corrected and it's now working with a daily update.