openforis / sepal

Geographical Data Processing in the Cloud
https://sepal.io/
MIT License
203 stars 45 forks source link

Dask as parallelization backend #262

Open TmtStss opened 1 year ago

TmtStss commented 1 year ago

I use Sepal for data collection through the GEE Python API, data storage, and training of machine learning models. I am looking into dask as parallelization back-end for this work, which is well-established within the ML community. Since dask[complete] is part of the python environment provided within Sepal, I was wondering what is the recommended way to proceed.

At the moment, I am running three terminal windows:

A typical limitation I am facing is accessing the dask Dashboard at 127.0.0.1:38285.