arthurpsmith / author-disambiguator

Wikidata service to help create or link author items to published articles
GNU General Public License v3.0
33 stars 8 forks source link

Queuing does not always work #166

Open Daniel-Mietchen opened 2 years ago

Daniel-Mietchen commented 2 years ago

The queuing currently does allow multiple threads to be handled in parallel, but they influence each other, leading to high error rates when more than about two run in parallel. So I suppose it would be good to limit the number of parallel threads or to sort out the queuing otherwise.

With the current setup , finishing a batch often requires multiple restarts and manual check-ins about whether the state of the queue would even allow for a restart.

Daniel-Mietchen commented 2 years ago

Here is a sample screenshot that I had forgotten to attach above Screenshot from 2022-01-28 21-39-06