cytomining / CytoTable

Transform CellProfiler and DeepProfiler data for processing image-based profiling readouts with Pycytominer and other Cytomining tools.
https://cytomining.github.io/CytoTable/
BSD 3-Clause "New" or "Revised" License
5 stars 5 forks source link

Enable Parsl app concurrency with futures #194

Closed d33bs closed 2 months ago

d33bs commented 2 months ago

Description

This PR addresses an issue with Parsl app evaluation to enable concurrency throughout _to_parquet() and related. It stems from investigation through #192, originally inspired by work towards documenting #176 (after finding no significant differences in Parsl configurations performance). After making these changes mypy was upset about a few type hints, so I updated these as well to ensure pre-commit checks could pass.

Generally, this work focused on following the patterns mentioned under Parsl documentation on using Futures.

Closes #192

What is the nature of your change?

Checklist

Please ensure that all boxes are checked before indicating that a pull request is ready for review.

d33bs commented 2 months ago

Thank you @kenibrewer ! Merging this in.