minimaxir / download-tweets-ai-text-gen

Python script to download public Tweets from a given Twitter account into a format suitable for AI text generation.
MIT License
221 stars 41 forks source link

Error while downloading #11

Open Henry-E opened 4 years ago

Henry-E commented 4 years ago

I was downloading from a couple of different twitter handles and got this error across all of them. Then I restarted the process, running them sequentially instead, and it came up with this. Does this mean that twitter has blocked me somehow? I restarted from a new IP address and it started working again.

Oldest Tweet:   0%|                                                                                                                                                | 0/22741 [00:00<?, ?it/s]
Expecting value: line 1 column 1 (char 0) [x] run.Feed
[!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it!
Expecting value: line 1 column 1 (char 0) [x] run.Feed
[!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it!
Expecting value: line 1 column 1 (char 0) [x] run.Feed
[!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it!
Expecting value: line 1 column 1 (char 0) [x] run.Feed
[!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it!
minimaxir commented 4 years ago

To clarify, this is with twint=2.1.4 correct? This issue happened with more recent versions.

Henry-E commented 4 years ago

Yep, just checked the environment and it has

Name: twint
Version: 2.1.4
sdelgadoc commented 4 years ago

The Issue below is similar to your question, and includes some recommendations on fixing the problem. https://github.com/minimaxir/download-tweets-ai-text-gen/issues/17