bcgov / nr-rfc-climate-obs

Transition of the existiing climate observations data pipeline to enable running off prem
Apache License 2.0
1 stars 0 forks source link

Write Climate Obs directly to the XL SS #44

Open franTarkenton opened 1 year ago

franTarkenton commented 1 year ago

Overview

Idea with this ticket is to move the logic that is currently contained in the xl ss import macro and the R climate_obs app to python, so that we can download the data and write it into the SS all in one go.

Steps

For all the various input data sets:

  1. ASP - Automated Snow Pillows
  2. ECCC - Environment Canada weather stations
  3. ZXS - Vertical temperature profiles
  4. F_WX - BC Wildfire Weather Stations

For each dataset:

  1. iterate over the various stations
  2. Look up the stations name with the column header from the METADATA tab in the xl spreadsheet.
  3. Copy the data for the current data / time into the ALL_DATA sheet.

Missing Data How this is going to work hasn't been finalized at this time