Switch to async cluster for benchmarking

ScalableCytometryImageProcessing / SCIP

Scalable Cytometry Image Processing (SCIP) is an open-source tool that implements an image processing pipeline on top of Dask, a distributed computing framework written in Python. SCIP performs projection, illumination correction, image segmentation and masking, and feature extraction.

https://scalable-cytometry-image-processing.readthedocs.io/en/latest/

GNU General Public License v3.0

7 stars 0 forks source link

Switch to async cluster for benchmarking #36

Closed MaximLippeveld closed 3 years ago

MaximLippeveld commented 3 years ago

Switching to async execution allows us to wait for the cluster to be fully spun up.

MaximLippeveld commented 3 years ago

Running dask async allows for waiting on the cluster, but requires the rest of the application to be written async as well. This is not needed at the moment.