search

strohne / Facepager

Facepager was made for fetching public available data from YouTube, Twitter and other websites on the basis of APIs and webscraping.
https://github.com/strohne/Facepager/releases
506 stars 198 forks source link

Twitter Stream Disconnecting/Crashing #51

Closed Bawage closed 7 years ago

Bawage commented 7 years ago

Hi, I am trying to collect tweets, but my stream is disconnecting again and again. I am getting the following message in status log: 2017-03-20 15:36:15.476000 Exception: IncompleteRead(0 bytes read, 2 more expected).

Did not change any setting. It was working fine two days ago (last time I used)! Max Tweets that I can get are 300-700.

strohne commented 7 years ago

Which Twitter-module (there are two)? Which settings?

IncompleteRead seems to appear when you fall behind the stream (program/computer too slow for stream). After how many minutes does this occur?

Try to add the parameter stall_warnings=true, see https://dev.twitter.com/streaming/overview/request-parameters#stallwarnings