cooperative-computing-lab / cctools

The Cooperative Computing Tools (cctools) enable large scale distributed computations to harness hundreds to thousands of machines from clusters, clouds, and grids.
http://ccl.cse.nd.edu
Other
126 stars 111 forks source link

vine: dask executor incompatible function calls + lazy_transfers=False #3800

Open btovar opened 1 month ago

btovar commented 1 month ago

The function calls return a buffer which is freed when the task goes out of scope. Either we need a way to specify their actual output file, or set lazy_transfers=True when using function calls.