dask / dask-gateway

A multi-tenant server for securely deploying and managing Dask clusters.
https://gateway.dask.org/
BSD 3-Clause "New" or "Revised" License
135 stars 87 forks source link

Decide on `wait_for_workers` implementation in client cluster object #798

Open consideRatio opened 5 months ago

consideRatio commented 5 months ago

Should the dask-gateway client's GatewayCluster class implement wait_for_workers?

Its a question raised without knowing if its relevant or not. I understand it as it would enable the wait_for_workers command to get dask-gateway specific logic, such as asking the dask-gateway server directly about worker startus instead of asking the scheduler - but it could be better to just ask the scheduler directly as we do now -- because it will have the final say if a worker is ready or not anyhow right?

Action points

Context