Paging

[jonenst]

By default, api results are paged with a default page of 30. We could at least use per_page=100 (max allowed). And we should page through the whole result set https://docs.github.com/en/rest/guides/traversing-with-pagination

[jonenst]

You can use the "google" org for testing, it has almost 2k repos as of this date..

[jonenst]

'https://api.github.com/users/google/repos?per_page=100&page=11' works 'https://api.github.com/search/repositories?q=user:google&per_page=100&page=11' fails:

{
  "message": "Only the first 1000 search results are available",
  "documentation_url": "https://docs.github.com/v3/search/"
}

[geofjamg]

Solved by #4

[jonenst]

Using per_page=100 is a short term workaround, let's keep this open until the real fix is done

[jonenst]

also the search api seems to not return forked repos:

$ comm -3 <(curl 'https://api.github.com/search/repositories?q=user:gridsuite&per_page=100' | jq -r '.items[].name'  | sort) <(curl 'https://api.github.com/orgs/gridsuite/repos?per_page=100' | jq -r '.[].name'  | sort)

    broadcast-event
    oidc-mock-server

Both are forks:

 gridsuite / oidc-mock-server Public forked from appvia/mock-oidc-user-server 
 gridsuite / broadcast-event Public forked from geofjamg/broadcast-event