#3887 - Limit Parallel Processing

andrewsignori-aot commented 1 week ago

Refactoring methods that rely on OS CPUs as a parallel limit to use the existing processInParallel method.
New options added to the processInParallel to keep the existing features from the methods refactored.
- currentRecord allows progress report (added to satisfy SFAS integration and also used for Fed restrictions now).
- partialResults allow access to lasted awaited promises batch (added to satisfy offering bulk upload).
While doing the review, please try to identify existing code that was just moved vs new code.

Federal Restriction Benchmark

The amount of parallel promises allowed was reduced from 4 to 2. Even though the bulk size of 750 was faster in local tests it was kept as 500 to avoid overloading the DB.

2 parallel promises, 500 bulk inserted records, inserting records time: 2:24.584 (m:ss.mmm)
4 parallel promises, 500 bulk inserted records, inserting records time: 2:25.388 (m:ss.mmm)
2 parallel promises, 250 bulk inserted records, inserting records time: 4:24.722 (m:ss.mmm)
- 2 parallel promises, 750 bulk inserted records, inserting records: 1:51.329 (m:ss.mmm)