search

kaihendry / greptweet

Sane twitter backup and search
https://greptweet.com/
Other
76 stars 10 forks source link

Missing tweets? #35

Closed wolfgang42 closed 10 years ago

wolfgang42 commented 10 years ago

I'm trying to retrieve all tweets for @frcfms (the FIRST robotics field management system) for 2013. I know that it was tweeting March 21-23, 2013, but I can't find any tweets from that range in the archive. (At least some of them should begin with #FRCMABO.) I don't know enough about the Twitter API to diagnose this problem. Any idea what's going on here?

kaihendry commented 10 years ago

curl http://greptweet.com/u/frcfms/frcfms.txt | wc -l says 6464. Since twitter limits us to 2400, perhaps you didn't fetch frequently enough?

Or perhaps twitter failed. Could you try running ... hmm... I need to add some docs how to get https://github.com/kaihendry/Greptweet/blob/master/fetch-tweets.sh running yourself since Twitter changed everything to require API keys.

wolfgang42 commented 10 years ago

There seems to be a massive gap between Feb 12 2013 and Mar 30 2013, where none of the tweets are available. I'm not sure what would cause this, since it retrieved the older tweets just fine.

It just occurred to me as I was writing this: perhaps somebody else ran greptweet on frcfms sometime in Febriary 2013. That would explain the gap, wouldn't it? I was running on the assumption that no one would have ever wanted to search frcfms before, which (now that I think about it) seems like a really horrible assumption.

kaihendry commented 10 years ago

Sorry we are limited to 3200 tweets, not 2400 as I mentioned earlier. I am going to close this as I don't know how to move forward or even if there is a problem really.