openclimatefix / analysis-dashboard

This is a Streamlit app for the OCF team that reports database statistics
MIT License
2 stars 6 forks source link

reduce weather forecast page storage #205

Open peterdudfield opened 1 month ago

peterdudfield commented 1 month ago

Currently the weather page downloads lots of data. And causes machien to run out of memory some options

  1. Download less data, put default as 2 timepoints
  2. store data in s3, requires a bit of thinking how we do that, if we can put the cahce data on s3
  3. remove old cached data,
  4. other options?
peterdudfield commented 1 month ago

The current solution is to terminate the ec2 instance, causing another new one to start