chaoss / grimoirelab-bestiary

GNU General Public License v3.0
3 stars 9 forks source link

Improve performance in queries when adding repositories from organizations #115

Closed jjmerchante closed 2 years ago

jjmerchante commented 2 years ago

Adding large organizations which has over 2K repositories needs 6K requests (issues, prs and commits).

The idea of this commit is to add the datasets in bulk requests of 100, grouping common data in requests like project_id and datasource type.

Related to https://github.com/chaoss/grimoirelab-bestiary/issues/98