This PR addresses an issue with Parsl app evaluation to enable concurrency throughout _to_parquet() and related. It stems from investigation through #192, originally inspired by work towards documenting #176 (after finding no significant differences in Parsl configurations performance). After making these changes mypy was upset about a few type hints, so I updated these as well to ensure pre-commit checks could pass.
Description
This PR addresses an issue with Parsl app evaluation to enable concurrency throughout
_to_parquet()
and related. It stems from investigation through #192, originally inspired by work towards documenting #176 (after finding no significant differences in Parsl configurations performance). After making these changesmypy
was upset about a few type hints, so I updated these as well to ensure pre-commit checks could pass.Generally, this work focused on following the patterns mentioned under Parsl documentation on using
Futures
.Closes #192
What is the nature of your change?
Checklist
Please ensure that all boxes are checked before indicating that a pull request is ready for review.