search

openclimatefix / nowcasting_forecast

Making live forecasts for the nowcasting project
MIT License
5 stars 2 forks source link

Bug: Forecast takes long time to complete #170

Closed peterdudfield closed 1 year ago

peterdudfield commented 1 year ago

Detailed Description

Forecaster should take around ~ 1 min to complete the run. On 24th October it was taking a lot longer. Note: Database was overloaded, so this has a knock on effect.

Context

Hard to develop on the FE, when database is being very slow PD: killed ECS tasks on 24th October to reset the system This task took 20 mins before being killed

The forecast updates the 'forecast_lvalue_latest' but this can take a while. The code that does the updaing is here

Possible Implementation

TODO

peterdudfield commented 1 year ago

Idea: When getting forecast_value_latest object, only get the objects from at most a day a go. This will help reduce the query time.