CCSoti / IPython_Observatory

Multi-perspective Discourse Analysis on the use of IPython
0 stars 0 forks source link

Traverse all pages of GitHub Api #13

Open CCSoti opened 9 years ago

CCSoti commented 9 years ago

For now it was traversing only the first page, which by default is giving only 30 results.

Use this: https://developer.github.com/guides/traversing-with-pagination/

CCSoti commented 9 years ago

Rate limit

The Search API has a custom rate limit. For requests using Basic Authentication, OAuth, or client ID and secret, you can make up to 30 requests per minute. For unauthenticated requests, the rate limit allows you to make up to 10 requests per minute.

See the rate limit documentation for details on determining your current rate limit status.

Timeouts and incomplete results

To keep the Search API fast for everyone, we limit how long any individual query can run. For queries that exceed the time limit, the API returns the matches that were already found prior to the timeout, and the response has the incomplete_results property set to true.

Reaching a timeout does not necessarily mean that search results are incomplete. More results might have been found, but also might not.

CCSoti commented 8 years ago

Rate Limiting

For requests using Basic Authentication or OAuth, you can make up to 5,000 requests per hour. For unauthenticated requests, the rate limit allows you to make up to 60 requests per hour. Unauthenticated requests are associated with your IP address, and not the user making requests. Note that the Search API has custom rate limit rules.

CCSoti commented 8 years ago

Only 1000 results allowed. Emailed GitHub for that.