search

twintproject / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
MIT License
15.75k stars 2.72k forks source link

[Question]:consistent sleeping for a long time and no response #878

Open LucasAndLevinAndJadon opened 4 years ago

LucasAndLevinAndJadon commented 4 years ago

I need to download tweets from Feburary to March this year for 3000 usernames. I got those below consistently. Do I need to rotate my IP address? Does TWINT has a config option? Thank you.

282it [06:28, 2.02s/it]CRITICAL:root:twint.get:User:'NoneType' object is not subscriptable 283it [06:29, 1.63s/it]CRITICAL:root:twint.get:User:'NoneType' object is not subscriptable CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 8.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 27.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 64.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 125.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 216.0 secs

yunusemrecatalcam commented 4 years ago

You should share command or code snippet that you used.