informatics-lab / precip_rediagnosis

Project to use ML to re-diagnose precipitation fields from ensemble model fields
0 stars 0 forks source link

Create an intake catalog for data #4

Open stevehadd opened 2 years ago

stevehadd commented 2 years ago

create an intake catalog to describe the various stages of data.

stevehadd commented 2 years ago

This could be a good way to make azureML code portable, by having an intake driver for azureml, which just makes use of AzML datasets/datastores. This makes permission much easier (everyone in workspace can see workspace datasets/datastores), but means the code that reads the data will be more prtable if it uses intake as the interface to the data.

This should be a fairly lightweight driver. More info on creating drivers:

lab example