Metrics

[peterdudfield]

Detailed Description

Method to calucate

• MAE and RMSE
• Per site and fleet
• Normalized by site capacitor and not. Site capacity is stored here
• per forecast horizon

Context

• great to know how good our forecast is doing
• similar to https://github.com/openclimatefix/nowcasting-metrics

Possible Implementation

1. add new tables to datamodel, similar to here, metrics, mertric_values, and datetime_intervals
2. Make a micro service with an app.py to calculate the following metrics over the last day. This could be a sub fold in this repo
3. For each site, look at MAE and RMSE, normalized by capacity and not, for forecast horizons, 0, 15 mins, 30 mins, 1 hours, 2,4,8, 16, 24, 36 and 48 hours
4. Also do this at a fleet level
5. Add CI tests, that check theses are all made

[peterdudfield]

@simlmx feel free to adjust