search

MeltwaterArchive / datasift-connector

A set of components designed to retrieve data from third-party APIs and storage systems, and to pass that data in to a DataSift account.
http://datasift.com/
MIT License
9 stars 5 forks source link

Fetching the RPMs from Github releases is rate limited. #12

Open jamesbloomer opened 9 years ago

jamesbloomer commented 9 years ago

See https://developer.github.com/v3/#rate-limiting This means that the number of vagrant up attempts from a single ip is limited per hour.

Allow passing in an authentication token to the chef recipes to allow an increased limit.

jamesbloomer commented 9 years ago

https://github.com/datasift/datasift-connector/blob/master/chef/cookbooks/datasift-writer/recipes/default.rb#L26

and

https://github.com/datasift/datasift-connector/blob/master/chef/cookbooks/gnip-reader/recipes/default.rb#L26

will need to create a client with a token, see http://octokit.github.io/octokit.rb/#Authentication