search

NRCan / geo-deep-learning

Deep learning applied to georeferenced datasets
https://geo-deep-learning.readthedocs.io/en/latest/
MIT License
150 stars 50 forks source link

Container scheduling #144

Closed ymoisan closed 2 years ago

ymoisan commented 4 years ago

Kubernetes (K8S) is the tool of choice to manage container deployments on arbitrary computing infrastructure.

NRCan is currently implementing Rancher as a K8S simplification environment. Rancher allows managing several K8S clusters in a variety of computing settings, including local (private) cloud and all major cloud vendor solutions (AWS, Azure, GCP, OpenStack, etc).

With the new developments in HPC Dorval, namely gpsc3 supporting (Singularity ?) container images and the fact that GPUs are being deployed on gpsc3, a tool to abstract NRCan personnel from the underlying infrastructure (like Rancher) almost becomes a silver bullet.

remtav commented 2 years ago

Rancher will not be used in HPC for now.