Create base box with vagrant using role 'common'

[akorosov]

The base box searches for insecure key in wrong place https://github.com/mitchellh/vagrant/issues/5186

[akorosov]

Testing showed that base box is not feasible. With all important packages the base box is about 2 GB. Since we are using mostly miniconda - almost no compilation is done by provisioning. So all the provisioning time is spent on download of binaries. That probably sum up to 2GB or even less. Resume: no base box.

All VMs now use miniconda to install python and various libraries. The roles are organized the following way:

• common
  • install system libraries and update
  • install miniconda and update
  • install conda packages (and cache in shared directory)
  • install gdal and dependencies from alevin conda repo
  • install nansat using clone, build, link
• sample_datasets
  • download sample data
  • download MODIS landmask
• develop
  • install openwind
  • install nansen-cloud
  • migrate
  • add sample data to database
• course
  • clone nansat-lectures
  • add jupyter to crontab
• production
  • intentionally left empty (it should be just like develop but with a different version of nansat/nansencloud which is configured in group_vars)
• testintegration
  • run nansat tests
  • run end2end tests
  • run gdalinfo

Correspondingly the groups are configured to have the following roles:

• all:
  • common
• develop
  • sample_datasets
  • develop
• production
  • sample_datasets
  • develop
• course
  • course
• testintegration
  • sample_datasets
  • develop
  • testintegration
  • course

In fact roles are so host specific that should rather be called tasks. Therefore the best would be to get rid of roles and simplify to tasks only. That is not according to the best practices, however our set up is also not quite traditional.

NB! You have to destroy all your machines before git clone

[akorosov]

Yes, by the way, the created directories. I found it very convenient to create the following shared directories:

• /vagrant/shared -> nersc-vagrant/shared
  • this is shared also between virtual machines
  • conda_pkgs: cached conda packages
  • test_data: sample data
• /vagrant/shared/develop_vm -> nesrc-vagrant/shared/develop_vm
  • this is specific for virtual machine
  • nansat
  • nansen-cloud
  • openwind