Define reanalysis table in ENTR warehouse

[ejsimley]

The ENTR warehouse needs a reanalysis data table. These data consist of long-term wind resource variables from reanalysis products (e.g., ERA5, MERRA2) (hourly resolution). At least 20 years of data are required for the long-term correction process in OpenOA. Note that the reanalysis data can be downloaded using the PlanetOS API in OpenOA. However, so we don't have to download the data every time we run OpenOA, a table should be created to store the data in the warehouse.

Proposed columns:

• Timestamp
• Plant ID
• Reanalysis product (ERA5 or MERRA2)
• Eastward wind component (m/s)
• Northward wind component (m/s)
• Air temperature (degrees K)
• Surface pressure (Pa)
• Wind speed (m/s)
• Wind direction (degrees)
• Air density (kg/m3)

To download the data for the first time, there are a couple options.

1. When running OpenOA, we could check if reanalysis data exists in the warehouse. If not, OpenOA could download the data.
2. We could require the reanalysis data to exist in the warehouse before running OpenOA, meaning ENTR would be responsible for downloading the data and populating the table.

[ejsimley]

Notes from 3/28/2022 meeting:

• We decided to include a reanalysis table in the warehouse
• The user will be responsible for downloading reanalysis data as csv files from PlanetOS using the OpenOA toolkit (or another method if they prefer) when importing their operational data to the warehouse rather than when OpenOA is used when analyzing data
• We can write a script to create a warehouse table from the downloaded csv files
• We can provide documentation and an example showing how to download reanalysis data using the OpenOA PlanetOS toolkit

[ejsimley]

Notes from 4/4/2022

• User will download reanalysis files and drop into specific folder. Or automate by looping through plant table and downloading files for all plants
• dbt workflow to add downloaded csv files to seed table
• Eric to send Lewis example python code to download reanalysis data using OpenOA
• For now, we'll create a separate table for each reanalysis product

[lewisarmistead]

https://github.com/entralliance/entr_warehouse/pull/7