search

scraperwiki / twitter-follows-tool

Get users who follow or are following a particular user; tool now defunct, though the code is here for reference.
https://blog.scraperwiki.com/2014/08/the-story-of-getting-twitter-data-and-its-missing-middle/
Other
5 stars 7 forks source link

Loop through cursors for lots of followers #5

Closed frabcus closed 11 years ago

frabcus commented 11 years ago

Currently we just get the first one (max 100?)

frabcus commented 11 years ago

This might be slow. Arguably it should do it all in the background.

frabcus commented 11 years ago

Actually, it's 20 by default. Not sure why, as I thought it was underneath calling this, which implies default is 5000: https://dev.twitter.com/docs/api/1/get/followers/ids

Some docs on cursoring in Twitter: https://dev.twitter.com/docs/misc/cursoring

frabcus commented 11 years ago

Zarino expects:

Detect if it is taking a long time, and background itself and say "This going to take a while, come back in an hour".

Status API to set the status as "running" until it has caught up. The dataset tile would say "running now". Possibly with % complete.

zarino commented 11 years ago

I didn't mention a percentage ;-)