search

chansooligans / oagdedupe

Developed for Use by NY Office of the Attorney General: A Python library for scalable entity resolution, using active learning to learn blocking configurations, generate comparison pairs, then clasify matches
https://oagdedupe.readthedocs.io/en/latest/
MIT License
2 stars 1 forks source link

tqdm-style for parallel conjunction search #38

Closed chansooligans closed 2 years ago

chansooligans commented 2 years ago

conjunction search is slowest part and it would be helpful to at least show a progress bar

i've had issues with multiprocessing + tqdm + logging before so will keep that in mind

chansooligans commented 2 years ago

https://stackoverflow.com/questions/41920124/multiprocessing-use-tqdm-to-display-a-progress-bar