alan-turing-institute / dymechh

repository for the DyME-CHH project

Other

3 stars 0 forks source link

REG Onboarding #23

Closed dingaaling closed 1 year ago

dingaaling commented 2 years ago

Before Onboarding:

[x] Invite to project meetings - Thursdays 12-1PM
[x] Set up kick off meeting - October 4th, 9AM
[x] Ask about interest/expertise --> Python, not as experienced with Azure

Materials:

[x] Intro to REG
[x] Intro to DyME-CHH
[x] Intro to CLIM-RECAL
[x] Intro to SPC
[ ] Scoping out project plan with REG for November 2022 - 3 March 2023

First Task: @RuthBowyer could you add some potential tasks here?

Potential Project Plan: Scaling up Data Processing Pipeline (Document)

[ ] Process for downloading datasets to the Azure fileshare
[ ] Set up auto download so datasets are refreshed at regular intervals
[ ] Set up virtual env with GPUs for processing
[ ] Connect fileshare to virtual env
[ ] Convert R scripts into Python
[ ] Scale up/productionize process to improve efficiency
[ ] Apply processing to UKCP18

REG Request (HPC):

[ ] Single Github repository for SPENSER
[ ] Documentation

REG Toy SPC Problem:

[ ] Take SPC data and plot on web map (data viz) https://github.com/alan-turing-institute/uatk-spc/issues/19

Other:

[ ] SPC projection work
[ ] Dash boarding & data vis

dingaaling commented 2 years ago

Open Questions:

Using R vs. Python or R and Python?
Scaling up data pipeline
SPC projected future data