Use tdqm progress bar to log parmap execution progress

tagbase / tagbase-server

tagbase-server is a data management web service for working with eTUFF and nc-eTAG files.

https://oiip.jpl.nasa.gov/doc/OIIP_Deliverable7.4_TagbasePostgreSQLeTUFF_UserGuide.pdf

Apache License 2.0

7 stars 2 forks source link

Use tdqm progress bar to log parmap execution progress #293

Closed lewismc closed 1 year ago

lewismc commented 1 year ago

Jesus requested that he be able to see progress for an ingestion job. After some investigation, a request from me (see https://github.com/zeehio/parmap/issues/30) and a very kind accommodation, we should now be able to use tqdm to log the progress of parmap.map for processing each and every file. I'm going to implement this now and see what results I get.

lewismc commented 1 year ago

During further research I ended up discovering the tqdm slack contrib module which conveniently facilitates incremental progress bar updates directly in Slack! PR coming up.