Improve HedwigZARRImages performance in CZI flow - Githubissues

niaid / image_portal_workflows

Workflows related to project previously referred to as "Hedwig"

BSD 3-Clause "New" or "Revised" License

5 stars 1 forks source link

Improve HedwigZARRImages performance in CZI flow #477

Open blowekamp opened 2 months ago

blowekamp commented 2 months ago

In the generate_czi_imageset subflow, allow the dask array computations in HedwigZARRImage to reuse Prefect's Dask task scheduler with all the workers for the node.

Depends on niaid/tomojs-pytools#108 and #479

Changes

List of changes
Breaking changes
Changes to configurations

This PR doesn't introduce any:

[ ] Binary files
[ ] Temporary files, auto-generated files
[ ] Secret keys
[ ] Local debugging print statements
[ ] Unwanted comments (e.g: # Gets user from environment for code os.environ['user'] )

This PR contains valid:

[ ] tests