search

clEsperanto / pyclesperanto_prototype

GPU-accelerated bio-image analysis focusing on 3D+t microscopy image data
http://clesperanto.net
BSD 3-Clause "New" or "Revised" License
213 stars 46 forks source link

Dask demo with GPU cluster #297

Closed jackyko1991 closed 1 year ago

jackyko1991 commented 1 year ago

This demo is for the illustration of pyclespranto integration with Dask.

Update the original dask gaussian blur demo with proper documentation and big data handling.

Unlike Dask LocalCUDACluster, pyclespranto GPU memory is not directly handled by Dask. The trick to work around for a heterogeneous dask local cluster.

GPU memory cycle when using Dask is also included to reduce memory overflow on parallel processes.

haesleinhuepf commented 1 year ago

Awesome, big thanks @jackyko1991 !