search

r-universe-org / help

Support and bug tracker for R-universe
https://docs.r-universe.dev/
9 stars 2 forks source link

Syncs failing because of new GitHub limits ?? #534

Open jeroen opened 3 days ago

jeroen commented 3 days ago

It looks like GitHub has started blocking git remote ls commands after +/- 5000 calls in a short span.

For now his only affects the CRAN sync it seems: https://github.com/r-universe/cran/actions/runs/12010931924/job/33478835990

jeroen commented 3 days ago

Updated it to do it in batches of max 1000 and then wait for 60 seconds in between. Let's see if that is more stable...

This should only affect cran and bioc universes which are the only ones bigger than 1000.

jeroen commented 3 days ago

I think passing the Authorization header has made github happy: https://github.com/r-universe-org/sync/commit/499bc2099a0d9dcdbc2b618278eb52b466972cfa