[meta] Production

[peterdudfield]

Hi, just wanted to put a few thoughts down for productions and get the discussion going.

• Would be great if there was a script that run inference, perhaps for one timezone. Then wrapping this can be fairly easy. See dataflow -

For build this, can start with a 1 week of GSP and NWP data

• Would be great if we can run this of ocf_datapies, perherps there are some extra pipes to write. Need to also have an easy switch that can load GSP data from database, ( i think there is a pipe for that), I can help there

• Output, Think the easiers is a pandas dataframe with the following columns -- target_datetime_utc -- forecast_kw There there will be seperate function that saves it to the database in the write way

• In this repo? Or should we have a different repo, then other national models could be easier ported in. Negative is we need to pull this code (or copy this) into the new repo

Tasks

• [x] #3
• [x] #8
• [x] https://github.com/openclimatefix/gradboost_pv/issues/5
• [x] https://github.com/openclimatefix/gradboost_pv/issues/6
• [x] https://github.com/openclimatefix/ocf_datapipes/issues/143 and use in script
• [x] #2
• [x] https://github.com/openclimatefix/gradboost_pv/issues/7
• [x] #10
• [x] #9

[peterdudfield]

@thomasarmstrong98 @jacobbieker

[peterdudfield]

@thomasarmstrong98 ive put task in as dicsussed - https://github.com/openclimatefix/ocf_datapipes/issues/143

[peterdudfield]

All tasks done, just bug fixing - keep open until full run on aws of forecast

[peterdudfield]

Just got it working for 30 hours ahead