search

dask / distributed

A distributed task scheduler for Dask
https://distributed.dask.org
BSD 3-Clause "New" or "Revised" License
1.58k stars 718 forks source link

Use as_completed and progress together #2423

Open sebhahn opened 5 years ago

sebhahn commented 5 years ago

Is it possible to use as_completed and progress together? Or can I update a progressbar when a new future will be ready/iterated in as_completed?

mrocklin commented 5 years ago

Today the quick answer is "no". The progress bar on the bokeh dashboard would update nicely though. You might consider trying to use that instead?

mrocklin commented 5 years ago

Things could be changed though. I encourage you to look at the source code the Progress or MultiProgress plugins if you're interested in improving things here.

sebhahn commented 5 years ago

Thanks! I'll give it a try.

GenevieveBuckley commented 3 years ago

@sebhahn are you still interested in working on this? Should we keep this issue open to track that, or should it be closed?

k4u5h1k commented 2 years ago

As a workaround for someone looking for this you can use,

from tqdm.notebook import tqdm
for future in tqdm(as_completed(computed_futures), total=len(computed_futures)):
    ...