proxystore / taps

Benchmarking suite for distributed/parallel task executors
https://taps.proxystore.dev/
MIT License
9 stars 4 forks source link

Add `wait_for_workers` flag in Dask Distributed config and executor (#131) #144

Closed gpauloski closed 2 months ago

gpauloski commented 2 months ago

Description

Add wait_for_workers flag in Dask Distributed config and executor. This is helpful when the client is connected to a remote scheduler and you want to wait to submit work until the workers are connected to the scheduler.

Fixes

Type of Change

Testing

Added tests for coverage and tested with the cholesky app.

Pull Request Checklist

Please confirm the PR meets the following requirements.