Occasionally, an attempted download from Twitter times out, especially when attempting to download a particularly large amount of media at a time. This causes the program to fail spectacularly.
Traceback (most recent call last):
File "C:\Python38\lib\site-packages\urllib3\connection.py", line 159, in _new_conn
conn = connection.create_connection(
File "C:\Python38\lib\site-packages\urllib3\util\connection.py", line 84, in create_connection
raise err
File "C:\Python38\lib\site-packages\urllib3\util\connection.py", line 74, in create_connection
sock.connect(sa)
TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Python38\lib\site-packages\urllib3\connectionpool.py", line 670, in urlopen
httplib_response = self._make_request(
File "C:\Python38\lib\site-packages\urllib3\connectionpool.py", line 381, in _make_request
self._validate_conn(conn)
File "C:\Python38\lib\site-packages\urllib3\connectionpool.py", line 978, in _validate_conn
conn.connect()
File "C:\Python38\lib\site-packages\urllib3\connection.py", line 309, in connect
conn = self._new_conn()
File "C:\Python38\lib\site-packages\urllib3\connection.py", line 171, in _new_conn
raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x000001EF7BA90550>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Python38\lib\site-packages\requests\adapters.py", line 439, in send
resp = conn.urlopen(
File "C:\Python38\lib\site-packages\urllib3\connectionpool.py", line 726, in urlopen
retries = retries.increment(
File "C:\Python38\lib\site-packages\urllib3\util\retry.py", line 439, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='pbs.twimg.com', port=443): Max retries exceeded with url: /media/EWUxN-6UMAAbkb6.png:orig (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x000001EF7BA90550>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "twitter_media_downloader.py", line 38, in <module>
download(results, outputDir, False, True)
File "D:\twitter_media_downloader\src\downloader.py", line 43, in download
r = requests.get(url, stream=stream)
File "C:\Python38\lib\site-packages\requests\api.py", line 76, in get
return request('get', url, params=params, **kwargs)
File "C:\Python38\lib\site-packages\requests\api.py", line 61, in request
return session.request(method=method, url=url, **kwargs)
File "C:\Python38\lib\site-packages\requests\sessions.py", line 530, in request
resp = self.send(prep, **send_kwargs)
File "C:\Python38\lib\site-packages\requests\sessions.py", line 643, in send
r = adapter.send(request, **kwargs)
File "C:\Python38\lib\site-packages\requests\adapters.py", line 516, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='pbs.twimg.com', port=443): Max retries exceeded with url: /media/EWUxN-6UMAAbkb6.png:orig (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x000001EF7BA90550>: Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond'))
Ideally, and this is just my opinion of how it should be handled, it should retry a few times, with a delay, and if those retries fail, the script should pause for manual input - with a standard (a)bort (r)etry (f)ail? prompt.
Occasionally, an attempted download from Twitter times out, especially when attempting to download a particularly large amount of media at a time. This causes the program to fail spectacularly.
Ideally, and this is just my opinion of how it should be handled, it should retry a few times, with a delay, and if those retries fail, the script should pause for manual input - with a standard
(a)bort (r)etry (f)ail?prompt.