Just wondering if anyone knows exactly what the deal is with the search & streaming APIs. Twitter docs say that "not all tweets will be shown in the search API" but there is nothing on what this criteria might be. I have read suggestions that if you're searching for mentions of a hashtag you should be able to pick up everything, but nothing concrete.
Otherwise I guess we should parse both and just ignore on insert if already present - best to run them side-by-side in case of any downtime / disconnection from the firehose.
Just wondering if anyone knows exactly what the deal is with the search & streaming APIs. Twitter docs say that "not all tweets will be shown in the search API" but there is nothing on what this criteria might be. I have read suggestions that if you're searching for mentions of a hashtag you should be able to pick up everything, but nothing concrete.
Otherwise I guess we should parse both and just ignore on insert if already present - best to run them side-by-side in case of any downtime / disconnection from the firehose.