utk-se / CodeAnalytics-distributor

Manages jobs and results for CodeAnalytics, using CodeAnalytics-analyzer
0 stars 0 forks source link

WoC project metadata is inefficient #7

Open robobenklein opened 4 years ago

robobenklein commented 4 years ago

with file type count metadata in a separate collection from the one where the URLs are kept having to search for the projectID in either direction or in either collection causes each repo item being added to take many seconds

we need a new method for determining which GH repos to target first, probably will involve using the higher performance WoC APIs