ratt-ru / pfb-imaging

Preconditioned forward/backward clean algorithm
MIT License
6 stars 5 forks source link

AWS kubernetes integration #58

Closed landmanbester closed 1 year ago

landmanbester commented 1 year ago

It should now be possible to launch workers on dask Kubernetes clusters instantiated through stimela (see eg. here). I have also switched to the numba wavelet implementation by @sjperkins which seems to drop the gil and allow for better parallelisation. By default the wavelet decompositions are parallelised over imaging band using dask and over basis using numba's prange