search

hisxo / gitGraber

gitGraber: monitor GitHub to search and find sensitive data in real time for different online services such as: Google, Amazon, Paypal, Github, Mailgun, Facebook, Twitter, Heroku, Stripe...
GNU General Public License v3.0
2k stars 328 forks source link

Rate Limit 403 #36

Open jaikishantulswani opened 3 years ago

jaikishantulswani commented 3 years ago

@rmarot @hisxo Gitgraber throwing 403 even after using 70+ tokens.

baxter2 commented 3 years ago

Are you using tokens generated by the same Github account? If so according to this https://docs.github.com/en/rest/overview/resources-in-the-rest-api#rate-limiting you can only make 5000 request an hour even between all of your OAuth tokens. So perhaps you've gone over that limit?

For API requests using Basic Authentication or OAuth, you can make up to 5,000 requests per hour. Authenticated requests are associated with the authenticated user, regardless of whether Basic Authentication or an OAuth token was used. This means that all OAuth applications authorized by a user share the same quota of 5,000 requests per hour when they authenticate with different tokens owned by the same user.

If you want to make 10000 request an hour, you will have to create another OAuth token from a different Github account then you will be able to increase your rate limit count.

jaikishantulswani commented 3 years ago

@baxter2 Thank you for your quick reply on this, so basically how many accounts should I have to use to run gitgraber in monitor mode?