visual-layer / fastdup

fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.
Other
1.51k stars 74 forks source link

[Feature Request]: Allow search on multiple work dirs in parallel #309

Closed Tompil3r closed 4 months ago

Tompil3r commented 5 months ago

Feature Name

Multiple searches in parallel

Feature Description

Currently fastdup.init_search(k=k, work_dir=work_dir) makes the given work_dir the active one for search, and so if search on multiple work dirs is needed in parallel (in the same process), it is required to run init_search each time - which might take a significant amount of time.

Contact Information [Optional]

No response

dbickson commented 4 months ago

done in 1.89