Open stevehadd opened 3 years ago
For future training, we should be able to set up a Pangeo like environment using AWS Sagemaker plus Dask Cloud Provider for scaling: https://cloudprovider.dask.org/en/latest/aws.html
This is especially useful is we want to combine it with other AWS services for data such as AWS Athena, RDS or AWS earth datasets, or third party environments e.g. mongoDB, tileDB etc.
For future training, we should be able to set up a Pangeo like environment using AWS Sagemaker plus Dask Cloud Provider for scaling: https://cloudprovider.dask.org/en/latest/aws.html
This is especially useful is we want to combine it with other AWS services for data such as AWS Athena, RDS or AWS earth datasets, or third party environments e.g. mongoDB, tileDB etc.