BiaPyX / BiaPy

Open source Python library for building bioimage analysis pipelines
https://BiaPyX.github.io
MIT License
114 stars 28 forks source link

Multi thread detection #68

Closed ClementCaporal closed 4 months ago

ClementCaporal commented 4 months ago

Should close #67

I propose to use concurrent.futures.ThreadPoolExecutor along with the already existing cfg.SYSTEM.NUM_WORKERS to speed up the process of detection.

On my setup for 5.88 GB:

@danifranco Can you double check if the new documentation for cfg.SYSTEM.NUM_WORKERS is not too vague now?

danifranco commented 4 months ago

Wow, super useful feature Clement, thanks a lot. SYSTEM.NUM_WORKERS as you changed I think it's good, so don't worry. I'm merging this code now!