Jefferson-Henrique / GetOldTweets-python

A project written in Python to get old tweets, it bypass some limitations of Twitter Official API.
MIT License
1.35k stars 809 forks source link

bound dates suddenly not working #8

Closed tangjienan closed 8 years ago

tangjienan commented 8 years ago

Hello:

i tried the last example today and it does not work anymore.It returned 0 tweets. Everything was fine yesterday so do you know what the problem is?

Thank you

chriskao commented 8 years ago

Experiencing the same issue.

Jefferson-Henrique commented 8 years ago

Humm, it is weird @tangjienan, maybe you get a temporary empty response from twitter, are you still facing this problem? and you @chriskao?

APUnatto commented 8 years ago

Hi, @Jefferson-Henrique . I also have the same problem. The project was working fine the other day and suddenly did not work anymore. I reran the original Main.py several times since yesterday and it always returns an empty response from Twitter. I hope you can fix this issue. Thank you very much.

chriskao commented 8 years ago

It worked again today!

On Mon, May 16, 2016 at 4:13 PM, Jefferson Henrique < notifications@github.com> wrote:

Humm, it is weird @tangjienan https://github.com/tangjienan, maybe you get a temporary empty response from twitter, are you still facing this problem? and you @chriskao https://github.com/chriskao?

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/Jefferson-Henrique/GetOldTweets-python/issues/8#issuecomment-219575996

Stanford University Class of 2014 Symbolic Systems / Human Computer Interaction My Site http://www.yuchunkao.com | Blog http://calligraphydance.wordpress.com/ | LinkedIn http://www.linkedin.com/pub/christina-kao/2a/9b/668 | 650-391-6402

APUnatto commented 8 years ago

@chriskao really? I still could not get it to work. Did you change anything?

chriskao commented 8 years ago

No I didn't, not sure what made it work again.

On Thu, May 19, 2016 at 9:11 PM, APUnatto notifications@github.com wrote:

@chriskao https://github.com/chriskao really? I still could not get it to work. Did you change anything?

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/Jefferson-Henrique/GetOldTweets-python/issues/8#issuecomment-220513076

Stanford University Class of 2014 Symbolic Systems / Human Computer Interaction My Site http://www.yuchunkao.com | Blog http://calligraphydance.wordpress.com/ | LinkedIn http://www.linkedin.com/pub/christina-kao/2a/9b/668 | 650-391-6402

APUnatto commented 8 years ago

@chriskao Did you run the Main.py? Which tool did you use to run it? Thank you.

chriskao commented 8 years ago

I've only been using the command line queries.

On Thu, May 19, 2016 at 9:17 PM, APUnatto notifications@github.com wrote:

Did you run the Main.py? Which tool did you use to run it? Thank you.

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/Jefferson-Henrique/GetOldTweets-python/issues/8#issuecomment-220513604

Stanford University Class of 2014 Symbolic Systems / Human Computer Interaction My Site http://www.yuchunkao.com | Blog http://calligraphydance.wordpress.com/ | LinkedIn http://www.linkedin.com/pub/christina-kao/2a/9b/668 | 650-391-6402

mali23 commented 8 years ago

Hi, Great work, thank you for sharing. But i am having the same problem the code was working till yesterday and now its not returning me anything, whenever i run the command line query it shows something like searching...... Done. Output file generated "output_got.csv"

with no tweets in it. my query is something like. "python Exporter.py --since 2016-01-01 --until 2016-05-20 --querysearch 'MERS-CoV'"

Am i doing something wrong or is it something else?

Thank you

yzhou1161 commented 8 years ago

Hi, I'm experiencing this same problem. It worked perfectly yesterday, but when I ran the same code today, it wouldn't fetch tweets with a set time range. Everything else is fine. What do you think could be the possible reason to this? Thanks! @Jefferson-Henrique

Jefferson-Henrique commented 8 years ago

Hello @mali23 and @bcn1161, did you test it with the last version (the one that logs a message every 100 tweets)? Besides that when you face this problem can you check what Twitter shows after you use Advanced Search? Maybe there it isn't showing good as well. Thanks for your replies, I have discovered some issues because of you all on this thread.

yzhou1161 commented 8 years ago

Hi, thank you for writing this amazing project! I'm using the latest version, and the search I used to test it is query search Obama's tweets between May 10 to May 17, 2016. Twitter's advanced search shows the result right.

On Thu, Jun 9, 2016 at 1:57 PM, Jefferson Henrique <notifications@github.com

wrote:

Hello @mali23 https://github.com/mali23 and @bcn1161 https://github.com/bcn1161, did you test it with the last version (the one that logs a message every 100 tweets)? Besides that when you face this problem can you check what Twitter shows after you use Advanced Search https://twitter.com/search-advanced? Maybe there it isn't showing good as well. Thanks for your replies, I have discovered some issues because of you all on this thread.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Jefferson-Henrique/GetOldTweets-python/issues/8#issuecomment-224975829, or mute the thread https://github.com/notifications/unsubscribe/ANeetjazigY2X1rd81avj98iX3JcGP0pks5qKFP9gaJpZM4IPkEM .

Jefferson-Henrique commented 8 years ago

It really weird, I don't know yet what causes this inconsistent behavior because when I am testing it works hahah

yzhou1161 commented 8 years ago

It's working now! @Jefferson-Henrique I have no idea why...

novikesumaningtyas commented 8 years ago

Hai @Jefferson-Henrique , thanks for your great code, its really help me. But yes, i'm facing the same problems, it worked perfectly when the early time i tried, i got the tweets from 2013, but when I ran the same code with a same set time range today, i got nothin. But if i change the range time from just last week or a few days from now (since : few days ago, until :now), it got me the tweets.

Is there any way twitter know and blocked me to access their old tweets again? or there might be any answer for this?

Hi, just want to give you example using Twitter Advanced Search: This is what i got if i search 'pizza' from 2013-03-06 to 2013-08-15

https://twitter.com/search?q=pizza%20since%3A2013-03-06%20until%3A2013-08-15&src=typd

Meanwhile,this is what i got if use your code :

tweetCriteria = got.manager.TweetCriteria().setQuerySearch('pizza').setSince("2013-03-06").setUntil("2013-08-15").setMaxTweets(5) tweet = got.manager.TweetManager.getTweets(tweetCriteria) print tweet []

i got nothin.

Then again i search for just few days ago : tweetCriteria = got.manager.TweetCriteria().setQuerySearch('pizza').setSince("2016-06-20").setUntil("2016-06-23").setMaxTweets(5) tweet = got.manager.TweetManager.getTweets(tweetCriteria)[4] print tweet.text @Cindy_ Pizza baya

i got the tweets.

so whats happen here? Thanks lot!

Jefferson-Henrique commented 8 years ago

Humm thanks for your reply @novikesumaningtyas, can you test again? there is a new apprach now to handle twitter requests, lets see if this will help you.

novikesumaningtyas commented 8 years ago

Hai @Jefferson-Henrique thanks for your reply and update, yes it works after i pull the new one. Wonderful work!

shadigkh commented 8 years ago

I'm having the same problem. I got 10000 tweets from 2012 yesterday. But, it returns 0 tweets just the morning after.

Jefferson-Henrique commented 8 years ago

Hello @shadigkh, can you get the last version and test it again?

shadigkh commented 8 years ago

Hello @Jefferson-Henrique, sorry for such a dumb question. I don't know much about Git. So, what do you mean by the last version? The "got" package hasn't been updated since 19 days and that's the one I'm using right now. I am using the TweetManager that uses cookielib in it.

Jefferson-Henrique commented 8 years ago

That is ok @shadigkh, please download it again, it is from 19 days ago because I have accepted an old pull request, but in fact I did this yesterday, so this update can help you.

shadigkh commented 8 years ago

Thank you @Jefferson-Henrique for the details. I downloaded and used the new version. But, I don't get any results when I use dates. It works perfectly without the dates though.

novikesumaningtyas commented 8 years ago

hai @shadigkh , just want to share my experience when i used the previous package, i tried to change my internet source, like i always use home wifi then change my internet to another wifi or from mobile phone provider, i can get old tweet again from 2013, idk why maybe it got somthin with ISP

shadigkh commented 8 years ago

Thank you @novikesumaningtyas. As you suggested, I'm using a different ISP now and it's working!

jdhurwitz commented 6 years ago

I'm having this issue too. Is there any way to fix it other than switching to a different ISP? I noticed that it worked on my school campus but not at home...