search

scraperwiki / twitter-search-tool

ScraperWiki tool to get Tweets matching a search term; tool now defunct, though the code is here for reference.
https://blog.scraperwiki.com/2014/08/the-story-of-getting-twitter-data-and-its-missing-middle/
Other
9 stars 7 forks source link

Retweeted column or not get them #43

Open frabcus opened 10 years ago

frabcus commented 10 years ago

Currently we get "retweeted" tweets. Twitter puts the text in the text column with RT at the front and truncated. Not sure when it does or doesn't find these.

There is a "retweeted" column which I think can be true/false. We could include that. Potentially we could just not save retweeted tweets at all, or maybe detect them and use it as opportunity to update the retweeted count? (see https://github.com/scraperwiki/twitter-search-tool/issues/20)

User report: https://app.intercom.io/apps/63b0c6d4bb5f0867b6e93b0be9b569fb3a7ab1e3/conversations/396296912

frabcus commented 10 years ago

It's all not very well documented. Some sources refer to a "retweeted_status" field: https://dev.twitter.com/discussions/14833

Needs testing / researching. Can't trust the Twitter API docs.

frabcus commented 10 years ago

Some users find it useful to have a separate row for each Tweet, e.g. when doing a promotion, wanting each user separately.

https://app.intercom.io/apps/63b0c6d4bb5f0867b6e93b0be9b569fb3a7ab1e3/conversations/407107347