Advance Use of Containers technology in Cloud environments

[lleinenweber]

Develop and test the implementation of WPS2.0 in the NGA's cloud environment to serve as a wrapper to execute algorithms available in Docker containers.

Tasks

• Investigate how better to use WPS in a Apache Mesos type of environment like that being developed at NGA (using Scale framework and Seed specifications).
• Investigate how the technology and capabilities could support execution of Hootenanny capability
• How to best configure an OGC Service (e.g. WMS or WFS) as an input
• Provide architecture recommendations
• Advance a WPS 2.0 test that can help support testing of workflow containers

Deliverables

Components:

• WPS2.0 service implementation that supports asynchronous execution capabilities deployed as a wrapper for algorithms docker images
• algorithms for testing to be deployed in Docker containers
• Browser Client to interface with WPS and Scale framework to execute jobs in the Scale framework

[NOTE] Use NGA's existing Mesos/Scale environment if such resources can be made available and accessible for development & test;

otherwise:

• Deploy/use of Apache Mesos for resource allocation and sharing on nodes
• Deploy copy of Scale framework for management of automated processing in clustered machines

Engineering Report:

• Advancing WPS support for Cloud Container workflows (document the findings and recommendations resulting from the investigations realized from the deployed deliverables and tasking)

[tomLandry]

Please consider ESGF scenarios. I left high-level info on Federated security idea: https://github.com/opengeospatial/testbed14-ideas/issues/3

[ingosimonis]

We are continuing our "applications in the cloud deployment/execution" work from Testbed-13 in Testbed-14, though no Mesos, Scale, or Seed involved.

[cristianoManuelLopes]

As indicated by Ingo, the T13 EOC thread looked at application/algorithm portability; in T14 work will continue. We also touched on this on the EO Exploitation Platform Hackathon also. ER should come out in May/18.