Closed keegansmith21 closed 1 year ago
Patch coverage: 100.00
% and project coverage change: +0.02
:tada:
Comparison is base (
85bb867
) 95.00% compared to head (7472443
) 95.03%.
:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.
This PR creates a pool for each of the crossref (metadata and event) APIs used by the ONIX workflow. This is necessary because many of the workflows can run at once, each of which will throttle themselves without knowledge of outside tasks.
The pool sizes were chosen based only on my experimentation. The slots that each task take up will be equal to the number of threads used for each process, thereby effectively limiting the total number of active threads across all tasks using the same pool.
Tested locally and appears to work as intended. Although it's difficult because running 5 tasks at once tanks my computer.