charmplusplus / charm4py

Parallel Programming with Python and Charm++
https://charm4py.readthedocs.io
Apache License 2.0
290 stars 21 forks source link

Charm.pool.map() and tqdm: obtain a progressbar ? #178

Closed lrnv closed 4 years ago

lrnv commented 4 years ago

Hi,

I did not manage to obtain a progressbar with tqdm on charm.pool.map().

Is there a way this could work ? I even tried instanciating a bunch of charm.pool.Task, and .get() them one by one in a loop, but it did not work.

I run on a cluster, the code takes days and I'd love to be able to see the progress in real time. Did I miss an option somewhere ?

If there is not, maybe you could give me an overview / an idea on how hard it would be to add this possiblity to the current implementation of charm.pool.map, and if I feel like I can, I'll do.

Edit: Cross-posted of stackoverflow there : https://stackoverflow.com/questions/63671000/charm-pool-map-tqdm-obtain-a-progressbar

lrnv commented 4 years ago

Solved in stackoverflow via the use of charm.pool.map_async(multi_futures=True) and charm.iwait().