chaoss / grimoirelab-elk

GNU General Public License v3.0
58 stars 121 forks source link

Improve load identities process performance #1112

Closed jjmerchante closed 11 months ago

jjmerchante commented 11 months ago

This PR improves the performance of load identities. process by 30-40%. Instead of inserting the identities one by one, now inserts the identities in batches of 100, reducing the number of queries to SortingHat.

coveralls commented 11 months ago

Pull Request Test Coverage Report for Build 5574211402


Files with Coverage Reduction New Missed Lines %
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/enriched/github.py 2 76.53%
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/enriched/enrich.py 3 75.14%
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/elk.py 40 23.27%
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/enriched/sortinghat_gelk.py 47 83.72%
<!-- Total: 92 -->
Totals Coverage Status
Change from base Build 5522283588: -0.02%
Covered Lines: 9363
Relevant Lines: 11294

💛 - Coveralls