Poll account data daily

[bstarling]

Process that will accept a list of users and poll daily. Should save a time stamp and user attributes :

• followers
• bio
• Location
• Profile picture/Banner?

Allows us to see how a profile changes over time, fastest growing profiles etc.

[hadoopjax]

I can help work on this one this week (if anyone wants to join, let's do it!). It's a key part of the whole Twitter analytics piece. Aim for a review-ready PR by COB Friday (20 JAN 2017).

[bstarling]

Since this could be used by any number of teams thoughts on using this as a pilot project for starting to add twitter functionality tocollect-social? See related.

[tdraebing]

Hi, is this issue still open to being worked on? If yes, I would like to contribute :-). I already got a testing-instance of discursive running on my amazon aws account and have some thoughts on how to tackle this in accordance to the already existing code.

• I would use the lookup_users method of tweepy to pull the searched users, given in a text-file, off the REST-API.
• I don't think a stream is needed for this like it is for the tweets.
• To add the timing I would add another crontab-job.
• The data would be stored in a new ElasticSearch-Index for users.
• Create a time stamp by getting the system time at one point and add it to the data.

[hadoopjax]

just left a note in the PR @tdraebing but I'll test locally and get back to you. thanks for the work this is awesome!