search

mntnr / name-your-contributors

Name your GitHub contributors; get commits, issues, and comments
MIT License
73 stars 20 forks source link

Scraping Ettiquette #59

Closed tgetgood closed 6 years ago

tgetgood commented 6 years ago

After some back and forth with support, it seems that we can only make on request at a time. No parallelism. Also no more than 300 requests a minute.

After meeting these constraints, the script is somewhat slower, but does not seem to get blocked.

We can now make requests until the quota runs out without getting banned. It does take a few minutes, but that seems to be unavoidable if we want to play by GitHub's rules.

RichardLitt commented 6 years ago

Conflicts?

tgetgood commented 6 years ago

Rebased.

RichardLitt commented 6 years ago

:tada: This PR is included in version 3.4.0 :tada:

The release is available on:

Your semantic-release bot :package::rocket: