GeoscienceAustralia / dea-cogger

Convert NetCDFs to Cloud Optimized GeoTIFFs
15 stars 4 forks source link

Distribute mpirun program across multiple nodes and fix openmpi integration issue with dea module #22

Closed santoshamohan closed 5 years ago

santoshamohan commented 5 years ago

Proposed changes

  1. Load openmpi/3.1.2 on top of dea/20181015 to enable mpirun program run across multiple nodes.
  2. Update documentation in README.md to reflect latest changes.
  3. Make number of nodes configurable in converter/cog_conv_app.py file.
  4. Update cog conversion script (converter/mpi_cog_convert.sh) for the latest changes.
  5. In converter/mpi_cog_convert.sh script add a line to create an output directory if it does not exists.