[WIP] This adds a script which converts .nc files to .tif and also re projects them to BNG

[AoifeHughes]

Script needs a little work to make more user-friendly

[review-notebook-app[bot]]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[AoifeHughes]

On my mac this took about 2 seconds per file to convert and project. So, I'm kinda worried I've done something wrong. I'll want to double, triple check everything first. Current plan is to use QGIS to test open the files, or if there's other software people suggest using?

[crangelsmith]

I'm struggling to run the script on my machine. I'll try to fix it and add an environment file. Changing this to WIP for now.

[AoifeHughes]

Hmm strange @crangelsmith, I'll be back on this on Monday, did you get any specific errors or did it just not do anything?

Either way, I'll sort the environment stuff and make sure a minimal example is runnable for this next week.

[AoifeHughes]

I added an environment for conda in: c97f4b3

I run something like this from the root directory of the project.

python scripts/reproject_all.py raw_data output_folder

[crangelsmith]

After a lot of debugging with @AoifeHughes I've finally managed to run this on my laptop and the new environment. Before creating the conda environment I had to:

brew install hdf5 netcdf

Before merging it will be good to have the following:

• [x] Make sure we can create the environment and run the projection on the VM.
• [ ] Benchmark how long it will take to run the projections for an example RCP variable in the VM (e.g /Volumes/vmfileshare/ClimateData/Raw/UKCP2.2/tasmax/?
• [ ] Make a short README (add it to the scripts folder maybe?) with a description of how to create the conda environment and run the python script as described here and the expected running times.

[AoifeHughes]

Confirming steps to have this run and be tested on Azure

• Install anaconda
• install environment file
• Run: python scripts/reproject_all.py {src} {target}

Issues that came up:

• Using an environment file needs to be tweaked, when exporting from osx it doesn't like linux.
  • https://github.com/conda/conda/issues/7311
  • https://stackoverflow.com/a/66315309
• Running out of storage