GeoscienceAustralia / dea-orchestration

4 stars 1 forks source link

Fix dea env issues #116

Closed santoshamohan closed 5 years ago

santoshamohan commented 5 years ago

Reason for this pull request

dea/20181015 require updated python conda packages. Also, a fix for dea-env build dependencies issues.

Proposed solutions

  1. raijin_scripts/deploy/build_environment_module.py: Refactor code and update comments within the file
  2. raijin_scripts/deploy/dea-env/environment.yaml: To resolve issues with dea-env build packages, ensure packages are installed using conda instead of pip. If packages are not available within conda distribution packages, go with pip install.
  3. raijin_scripts/deploy/dea-env/environment.yaml: Add new python conda packages: openmpi, qgis, rsgislib
  4. raijin_scripts/deploy/dea-env/modulespec.yaml: Install pip packages during environment packaging
  5. raijin_scripts/deploy/dea-env/pip_install_packages.txt: Add the following packages as part of pip install during dea environment build:
    • celery
    • checksumdir
    • click-datetime
    • DAWG
    • ffmpeg-python
    • hdmedians
    • jinja2
    • meinheld
    • pyDEM
  6. raijin_scripts/deploy/reinstall_miniconda.sh: Remove pip and rsgislib conda install commands
  7. raijin_scripts/deploy/requirements.txt: Delete requirements.txt file