chaoss / grimoirelab-elk

GNU General Public License v3.0
58 stars 121 forks source link

Improve performance refreshing identities #1109

Closed jjmerchante closed 1 year ago

jjmerchante commented 1 year ago

This PR improves the process of refreshing identities.

The primary objective is to reduce the number of queries made to SortingHat. The approach involves retrieving individuals along with their identities and profile information, which is then passed on to the refreshing process, that way that information is not retrieved again.

This PR also improves the load identities process. It skips the query for adding recently added identities.

coveralls commented 1 year ago

Pull Request Test Coverage Report for Build 5334214860


Files with Coverage Reduction New Missed Lines %
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/enriched/sortinghat_gelk.py 3 80.78%
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/enriched/git.py 60 72.39%
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/enriched/enrich.py 153 73.53%
/home/runner/work/grimoirelab-elk/grimoirelab-elk/grimoire_elk/elk.py 161 22.67%
<!-- Total: 377 -->
Totals Coverage Status
Change from base Build 5005593305: 0.3%
Covered Lines: 9158
Relevant Lines: 11081

💛 - Coveralls