search

dask / distributed

A distributed task scheduler for Dask
https://distributed.dask.org
BSD 3-Clause "New" or "Revised" License
1.57k stars 717 forks source link

Use HighLevelGraph with Client.map #4282

Open mrocklin opened 3 years ago

mrocklin commented 3 years ago

Map is commonly used. If we can reduce overhead by using a Blockwise layer here, that would be welcome.

cc @madsbk @rjzamora @quasiben

mrocklin commented 3 years ago

This would also make it easier to evaluate the tasks-per-second metric. Map tends to be very simple.