search

taspinar / twitterscraper

Scrape Twitter for Tweets
MIT License
2.39k stars 579 forks source link

"The existing connection was forcibly closed by the remote host" #263

Closed artcode123 closed 4 years ago

artcode123 commented 4 years ago

Hi, the code worked quite fine until about 1 month ago. Then I noticed that Twitter started limiting the access.

Is it possible that the problem is that the IPs, from the proxy-list used in the code, have been blacklisted? Anyone has a similar issue?

Now I get the following error in the command prompt (the "Connection error" – in italian – says "The existing connection was forcibly closed by the remote host": "Connessione in corso interrotta forzatamente dall'host remoto").

INFO: {'User-Agent': 'Mozilla/5.0 (Windows; U; Windows NT 6.1; x64; fr; rv:1.9.2.13) Gecko/20101203 Firebird/3.6.13'} Traceback (most recent call last): File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 665, in urlopen httplib_response = self._make_request( File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 376, in _make_request self._validate_conn(conn) File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 994, in _validate_conn conn.connect() File "c:\python\lib\site-packages\urllib3\connection.py", line 352, in connect self.sock = ssl_wrapsocket( File "c:\python\lib\site-packages\urllib3\util\ssl.py", line 370, in ssl_wrap_socket return context.wrap_socket(sock, server_hostname=server_hostname) File "c:\python\lib\ssl.py", line 500, in wrap_socket return self.sslsocket_class._create( File "c:\python\lib\ssl.py", line 1040, in _create self.do_handshake() File "c:\python\lib\ssl.py", line 1309, in do_handshake self._sslobj.do_handshake() ConnectionResetError: [WinError 10054] Connessione in corso interrotta forzatamente dall'host remoto

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "c:\python\lib\site-packages\requests\adapters.py", line 439, in send resp = conn.urlopen( File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 719, in urlopen retries = retries.increment( File "c:\python\lib\site-packages\urllib3\util\retry.py", line 400, in increment raise six.reraise(type(error), error, _stacktrace) File "c:\python\lib\site-packages\urllib3\packages\six.py", line 734, in reraise raise value.with_traceback(tb) File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 665, in urlopen httplib_response = self._make_request( File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 376, in _make_request self._validate_conn(conn) File "c:\python\lib\site-packages\urllib3\connectionpool.py", line 994, in _validate_conn conn.connect() File "c:\python\lib\site-packages\urllib3\connection.py", line 352, in connect self.sock = ssl_wrapsocket( File "c:\python\lib\site-packages\urllib3\util\ssl.py", line 370, in ssl_wrap_socket return context.wrap_socket(sock, server_hostname=server_hostname) File "c:\python\lib\ssl.py", line 500, in wrap_socket return self.sslsocket_class._create( File "c:\python\lib\ssl.py", line 1040, in _create self.do_handshake() File "c:\python\lib\ssl.py", line 1309, in do_handshake self._sslobj.do_handshake() urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(10054, "Connessione in corso interrotta forzatamente dall'host remoto", None, 10054, None))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Python\Scripts\twitterscraper-script.py", line 11, in load_entry_point('twitterscraper==1.4.0', 'console_scripts', 'twitterscraper')() File "c:\python\lib\site-packages\pkg_resources__init.py", line 489, in load_entry_point return get_distribution(dist).load_entry_point(group, name) File "c:\python\lib\site-packages\pkg_resources__init.py", line 2852, in load_entry_point return ep.load() File "c:\python\lib\site-packages\pkg_resources__init__.py", line 2443, in load return self.resolve() File "c:\python\lib\site-packages\pkg_resources\init.py", line 2449, in resolve module = import__(self.module_name, fromlist=['name'], level=0) File "c:\python\lib\site-packages\twitterscraper\init__.py", line 13, in from twitterscraper.query import query_tweets File "c:\python\lib\site-packages\twitterscraper\query.py", line 73, in proxies = get_proxies() File "c:\python\lib\site-packages\twitterscraper\query.py", line 43, in get_proxies response = requests.get(PROXY_URL) File "c:\python\lib\site-packages\requests\api.py", line 75, in get return request('get', url, params=params, kwargs) File "c:\python\lib\site-packages\requests\api.py", line 60, in request return session.request(method=method, url=url, kwargs) File "c:\python\lib\site-packages\requests\sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "c:\python\lib\site-packages\requests\sessions.py", line 646, in send r = adapter.send(request, kwargs) File "c:\python\lib\site-packages\requests\adapters.py", line 498, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(10054, "Connessione in corso interrotta forzatamente dall'host remoto", None, 10054, None))

artcode123 commented 4 years ago

Great! The tool has started working again! Thanks!