search

informatics-lab / precip_rediagnosis

Project to use ML to re-diagnose precipitation fields from ensemble model fields
0 stars 0 forks source link

Issue with mounting data on GPU cluster #89

Closed hannahbrown7 closed 2 years ago

hannahbrown7 commented 2 years ago

When trying to run hyperdrive on a GPU compute cluster using workaround for issue #84 (mounting dataset then loading data from csv files), I run into error: BFSMountError: Unable to mount blob fuse file system

hannahbrown7 commented 2 years ago

This error does not seem to occur on a CPU cluster

stevehadd commented 2 years ago

Use this notebook for testing loading data and training model: https://github.com/informatics-lab/precip_rediagnosis/blob/fraction_pipeline/fractions_model_pipeline/fraction_model_dev_reduced_bands_azml.ipynb

stevehadd commented 2 years ago

Next step is to check this works on the fractional precip modelling branch with cpu and gpu clusters.