Feature/writer back off on 429

MeltwaterArchive / datasift-connector

A set of components designed to retrieve data from third-party APIs and storage systems, and to pass that data in to a DataSift account.

http://datasift.com/

MIT License

9 stars 5 forks source link

Feature/writer back off on 429 #59

Closed AndyJS closed 9 years ago

AndyJS commented 9 years ago

Ingestion endpoint will respond with 429 status code when too many connections are made within a period of time, with respect to user rate limits. Datasift-Writer will now parse headers returned and back-off appropriately.