search

s2t2 / tweet-analysis-2021

research in progress
MIT License
4 stars 4 forks source link

Tweet Recollection #8

Closed s2t2 closed 7 months ago

s2t2 commented 2 years ago

Combines tweets from all datasets into an "analysis_2021" dataset.

Recollects tweets from second round datasets (i.e. "election_2020", "transition_2021", "impeachment_2021", "disinfo_2021"), so we can get the full text, and full URLs... so we can perform news quality analysis and a more complete hashtag and content analyses later

This combined universe of tweets to recollect is around 33M tweets total.

s2t2 commented 2 years ago

Sometimes the collector is running into the following errors. Need to investigate. Right now am just restarting the job on the server when this happens. It would be nice to handle the error and quit / restart the job.

2022-04-11 16:58:25 | SAVING BATCH OF 100 | STATUSES: 60 | URLS: 18
2022-04-11T16:58:26.008695+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-11T16:58:26.008712+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/runpy.py", line 193, in _run_module_as_main
2022-04-11T16:58:26.009084+00:00 app[tweet_recollection.1]: "__main__", mod_spec)
2022-04-11T16:58:26.009093+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/runpy.py", line 85, in _run_code
2022-04-11T16:58:26.009172+00:00 app[tweet_recollection.1]: exec(code, run_globals)
2022-04-11T16:58:26.009180+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 136, in <module>
2022-04-11T16:58:26.009270+00:00 app[tweet_recollection.1]: collector.perform()
2022-04-11T16:58:26.009271+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 36, in perform
2022-04-11T16:58:26.009323+00:00 app[tweet_recollection.1]: self.process_batch(batch_of_ids)
2022-04-11T16:58:26.009325+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 66, in process_batch
2022-04-11T16:58:26.009385+00:00 app[tweet_recollection.1]: for status in self.lookup_statuses(status_ids):
2022-04-11T16:58:26.009387+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 105, in lookup_statuses
2022-04-11T16:58:26.009454+00:00 app[tweet_recollection.1]: tweet_mode="extended"
2022-04-11T16:58:26.009457+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/api.py", line 120, in statuses_lookup
2022-04-11T16:58:26.009532+00:00 app[tweet_recollection.1]: )(list_to_csv(id_), *args, **kwargs)
2022-04-11T16:58:26.009543+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 253, in _call
2022-04-11T16:58:26.009638+00:00 app[tweet_recollection.1]: return method.execute()
2022-04-11T16:58:26.009640+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 234, in execute
2022-04-11T16:58:26.009737+00:00 app[tweet_recollection.1]: raise TweepError(error_msg, resp, api_code=api_error_code)
2022-04-11T16:58:26.009751+00:00 app[tweet_recollection.1]: tweepy.error.TweepError: [{'message': 'Over capacity', 'code': 130}]
2022-04-11T16:58:26.363245+00:00 heroku[tweet_recollection.1]: Process exited with status 1

also this:

2022-04-11T20:19:12.588895+00:00 app[tweet_recollection.1]: 2022-04-11 20:19:12 | SAVING BATCH OF 100 | STATUSES: 56 | URLS: 9
2022-04-11T20:19:13.258034+00:00 app[tweet_recollection.1]: 2022-04-11 20:19:13 | SAVING BATCH OF 100 | STATUSES: 62 | URLS: 8
2022-04-11T20:19:13.435247+00:00 app[tweet_recollection.1]: Rate limit reached. Sleeping for: 225
^C
(tweet-analyzer-env-38)  --->> heroku logs --tail -a tweet-analysis-2021
2022-04-12T03:46:16.381232+00:00 app[tweet_recollection.1]: File "<string>", line 3, in raise_from
2022-04-12T03:46:16.381365+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request
2022-04-12T03:46:16.381507+00:00 app[tweet_recollection.1]: httplib_response = conn.getresponse()
2022-04-12T03:46:16.381509+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 1379, in getresponse
2022-04-12T03:46:16.381877+00:00 app[tweet_recollection.1]: response.begin()
2022-04-12T03:46:16.381885+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 311, in begin
2022-04-12T03:46:16.382021+00:00 app[tweet_recollection.1]: version, status, reason = self._read_status()
2022-04-12T03:46:16.382028+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 272, in _read_status
2022-04-12T03:46:16.382163+00:00 app[tweet_recollection.1]: line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
2022-04-12T03:46:16.382170+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/socket.py", line 586, in readinto
2022-04-12T03:46:16.382359+00:00 app[tweet_recollection.1]: return self._sock.recv_into(b)
2022-04-12T03:46:16.382361+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 1012, in recv_into
2022-04-12T03:46:16.382650+00:00 app[tweet_recollection.1]: return self.read(nbytes, buffer)
2022-04-12T03:46:16.382654+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 874, in read
2022-04-12T03:46:16.382914+00:00 app[tweet_recollection.1]: return self._sslobj.read(len, buffer)
2022-04-12T03:46:16.382921+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 631, in read
2022-04-12T03:46:16.383121+00:00 app[tweet_recollection.1]: v = self._sslobj.read(len, buffer)
2022-04-12T03:46:16.383136+00:00 app[tweet_recollection.1]: ConnectionResetError: [Errno 104] Connection reset by peer
2022-04-12T03:46:16.383137+00:00 app[tweet_recollection.1]: 
2022-04-12T03:46:16.383138+00:00 app[tweet_recollection.1]: During handling of the above exception, another exception occurred:
2022-04-12T03:46:16.383138+00:00 app[tweet_recollection.1]: 
2022-04-12T03:46:16.383147+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-12T03:46:16.383164+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
2022-04-12T03:46:16.383313+00:00 app[tweet_recollection.1]: timeout=timeout
2022-04-12T03:46:16.383320+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 756, in urlopen
2022-04-12T03:46:16.383541+00:00 app[tweet_recollection.1]: method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
2022-04-12T03:46:16.383549+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/util/retry.py", line 531, in increment
2022-04-12T03:46:16.383706+00:00 app[tweet_recollection.1]: raise six.reraise(type(error), error, _stacktrace)
2022-04-12T03:46:16.383713+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/packages/six.py", line 734, in reraise
2022-04-12T03:46:16.383912+00:00 app[tweet_recollection.1]: raise value.with_traceback(tb)
2022-04-12T03:46:16.383919+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen
2022-04-12T03:46:16.384121+00:00 app[tweet_recollection.1]: chunked=chunked,
2022-04-12T03:46:16.384133+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 445, in _make_request
2022-04-12T03:46:16.384312+00:00 app[tweet_recollection.1]: six.raise_from(e, None)
2022-04-12T03:46:16.384320+00:00 app[tweet_recollection.1]: File "<string>", line 3, in raise_from
2022-04-12T03:46:16.384373+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request
2022-04-12T03:46:16.384507+00:00 app[tweet_recollection.1]: httplib_response = conn.getresponse()
2022-04-12T03:46:16.384515+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 1379, in getresponse
2022-04-12T03:46:16.384872+00:00 app[tweet_recollection.1]: response.begin()
2022-04-12T03:46:16.384874+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 311, in begin
2022-04-12T03:46:16.385008+00:00 app[tweet_recollection.1]: version, status, reason = self._read_status()
2022-04-12T03:46:16.385015+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 272, in _read_status
2022-04-12T03:46:16.385141+00:00 app[tweet_recollection.1]: line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
2022-04-12T03:46:16.385148+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/socket.py", line 586, in readinto
2022-04-12T03:46:16.385329+00:00 app[tweet_recollection.1]: return self._sock.recv_into(b)
2022-04-12T03:46:16.385336+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 1012, in recv_into
2022-04-12T03:46:16.385615+00:00 app[tweet_recollection.1]: return self.read(nbytes, buffer)
2022-04-12T03:46:16.385622+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 874, in read
2022-04-12T03:46:16.385875+00:00 app[tweet_recollection.1]: return self._sslobj.read(len, buffer)
2022-04-12T03:46:16.385883+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 631, in read
2022-04-12T03:46:16.386079+00:00 app[tweet_recollection.1]: v = self._sslobj.read(len, buffer)
2022-04-12T03:46:16.386096+00:00 app[tweet_recollection.1]: urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2022-04-12T03:46:16.386098+00:00 app[tweet_recollection.1]: 
2022-04-12T03:46:16.386098+00:00 app[tweet_recollection.1]: During handling of the above exception, another exception occurred:
2022-04-12T03:46:16.386098+00:00 app[tweet_recollection.1]: 
2022-04-12T03:46:16.386106+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-12T03:46:16.386113+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 190, in execute
2022-04-12T03:46:16.386201+00:00 app[tweet_recollection.1]: proxies=self.api.proxy)
2022-04-12T03:46:16.386209+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 542, in request
2022-04-12T03:46:16.386368+00:00 app[tweet_recollection.1]: resp = self.send(prep, **send_kwargs)
2022-04-12T03:46:16.386376+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 655, in send
2022-04-12T03:46:16.386563+00:00 app[tweet_recollection.1]: r = adapter.send(request, **kwargs)
2022-04-12T03:46:16.386570+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/adapters.py", line 498, in send
2022-04-12T03:46:16.386730+00:00 app[tweet_recollection.1]: raise ConnectionError(err, request=request)
2022-04-12T03:46:16.386741+00:00 app[tweet_recollection.1]: requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2022-04-12T03:46:16.386742+00:00 app[tweet_recollection.1]: 
2022-04-12T03:46:16.386742+00:00 app[tweet_recollection.1]: During handling of the above exception, another exception occurred:
2022-04-12T03:46:16.386743+00:00 app[tweet_recollection.1]: 
2022-04-12T03:46:16.386750+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-12T03:46:16.386758+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/runpy.py", line 193, in _run_module_as_main
2022-04-12T03:46:16.386849+00:00 app[tweet_recollection.1]: "__main__", mod_spec)
2022-04-12T03:46:16.386857+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/runpy.py", line 85, in _run_code
2022-04-12T03:46:16.386924+00:00 app[tweet_recollection.1]: exec(code, run_globals)
2022-04-12T03:46:16.386932+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 136, in <module>
2022-04-12T03:46:16.387011+00:00 app[tweet_recollection.1]: collector.perform()
2022-04-12T03:46:16.387018+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 36, in perform
2022-04-12T03:46:16.387073+00:00 app[tweet_recollection.1]: self.process_batch(batch_of_ids)
2022-04-12T03:46:16.387080+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 66, in process_batch
2022-04-12T03:46:16.387139+00:00 app[tweet_recollection.1]: for status in self.lookup_statuses(status_ids):
2022-04-12T03:46:16.387146+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 105, in lookup_statuses
2022-04-12T03:46:16.387211+00:00 app[tweet_recollection.1]: tweet_mode="extended"
2022-04-12T03:46:16.387219+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/api.py", line 120, in statuses_lookup
2022-04-12T03:46:16.387291+00:00 app[tweet_recollection.1]: )(list_to_csv(id_), *args, **kwargs)
2022-04-12T03:46:16.387298+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 253, in _call
2022-04-12T03:46:16.387396+00:00 app[tweet_recollection.1]: return method.execute()
2022-04-12T03:46:16.387403+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 192, in execute
2022-04-12T03:46:16.387513+00:00 app[tweet_recollection.1]: six.reraise(TweepError, TweepError('Failed to send request: %s' % e), sys.exc_info()[2])
2022-04-12T03:46:16.387520+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/six.py", line 702, in reraise
2022-04-12T03:46:16.387718+00:00 app[tweet_recollection.1]: raise value.with_traceback(tb)
2022-04-12T03:46:16.387725+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 190, in execute
2022-04-12T03:46:16.387807+00:00 app[tweet_recollection.1]: proxies=self.api.proxy)
2022-04-12T03:46:16.387814+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 542, in request
2022-04-12T03:46:16.387970+00:00 app[tweet_recollection.1]: resp = self.send(prep, **send_kwargs)
2022-04-12T03:46:16.387983+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 655, in send
2022-04-12T03:46:16.388155+00:00 app[tweet_recollection.1]: r = adapter.send(request, **kwargs)
2022-04-12T03:46:16.388162+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/adapters.py", line 498, in send
2022-04-12T03:46:16.388308+00:00 app[tweet_recollection.1]: raise ConnectionError(err, request=request)
2022-04-12T03:46:16.388320+00:00 app[tweet_recollection.1]: tweepy.error.TweepError: Failed to send request: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2022-04-12T03:46:16.647602+00:00 heroku[tweet_recollection.1]: Process exited with status 1
2022-04-12T03:46:16.741318+00:00 heroku[tweet_recollection.1]: State changed from up to crashed
2022-04-12T22:21:51.245899+00:00 app[tweet_recollection.1]: File "<string>", line 3, in raise_from
2022-04-12T22:21:51.245999+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request
2022-04-12T22:21:51.246216+00:00 app[tweet_recollection.1]: httplib_response = conn.getresponse()
2022-04-12T22:21:51.246226+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 1379, in getresponse
2022-04-12T22:21:51.246661+00:00 app[tweet_recollection.1]: response.begin()
2022-04-12T22:21:51.246669+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 311, in begin
2022-04-12T22:21:51.246885+00:00 app[tweet_recollection.1]: version, status, reason = self._read_status()
2022-04-12T22:21:51.246895+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 272, in _read_status
2022-04-12T22:21:51.247176+00:00 app[tweet_recollection.1]: line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
2022-04-12T22:21:51.247179+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/socket.py", line 586, in readinto
2022-04-12T22:21:51.247536+00:00 app[tweet_recollection.1]: return self._sock.recv_into(b)
2022-04-12T22:21:51.247538+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 1012, in recv_into
2022-04-12T22:21:51.248045+00:00 app[tweet_recollection.1]: return self.read(nbytes, buffer)
2022-04-12T22:21:51.248049+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 874, in read
2022-04-12T22:21:51.248498+00:00 app[tweet_recollection.1]: return self._sslobj.read(len, buffer)
2022-04-12T22:21:51.248503+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 631, in read
2022-04-12T22:21:51.248922+00:00 app[tweet_recollection.1]: v = self._sslobj.read(len, buffer)
2022-04-12T22:21:51.248944+00:00 app[tweet_recollection.1]: ConnectionResetError: [Errno 104] Connection reset by peer
2022-04-12T22:21:51.248953+00:00 app[tweet_recollection.1]: 
2022-04-12T22:21:51.248953+00:00 app[tweet_recollection.1]: During handling of the above exception, another exception occurred:
2022-04-12T22:21:51.248953+00:00 app[tweet_recollection.1]: 
2022-04-12T22:21:51.248963+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-12T22:21:51.248975+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
2022-04-12T22:21:51.249339+00:00 app[tweet_recollection.1]: timeout=timeout
2022-04-12T22:21:51.249339+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 756, in urlopen
2022-04-12T22:21:51.249846+00:00 app[tweet_recollection.1]: method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
2022-04-12T22:21:51.249873+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/util/retry.py", line 531, in increment
2022-04-12T22:21:51.250229+00:00 app[tweet_recollection.1]: raise six.reraise(type(error), error, _stacktrace)
2022-04-12T22:21:51.250293+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/packages/six.py", line 734, in reraise
2022-04-12T22:21:51.250836+00:00 app[tweet_recollection.1]: raise value.with_traceback(tb)
2022-04-12T22:21:51.250848+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen
2022-04-12T22:21:51.251244+00:00 app[tweet_recollection.1]: chunked=chunked,
2022-04-12T22:21:51.251255+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 445, in _make_request
2022-04-12T22:21:51.251468+00:00 app[tweet_recollection.1]: six.raise_from(e, None)
2022-04-12T22:21:51.251479+00:00 app[tweet_recollection.1]: File "<string>", line 3, in raise_from
2022-04-12T22:21:51.251556+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request
2022-04-12T22:21:51.251896+00:00 app[tweet_recollection.1]: httplib_response = conn.getresponse()
2022-04-12T22:21:51.251908+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 1379, in getresponse
2022-04-12T22:21:51.252613+00:00 app[tweet_recollection.1]: response.begin()
2022-04-12T22:21:51.252624+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 311, in begin
2022-04-12T22:21:51.252840+00:00 app[tweet_recollection.1]: version, status, reason = self._read_status()
2022-04-12T22:21:51.252851+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/http/client.py", line 272, in _read_status
2022-04-12T22:21:51.253179+00:00 app[tweet_recollection.1]: line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
2022-04-12T22:21:51.253190+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/socket.py", line 586, in readinto
2022-04-12T22:21:51.253507+00:00 app[tweet_recollection.1]: return self._sock.recv_into(b)
2022-04-12T22:21:51.253517+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 1012, in recv_into
2022-04-12T22:21:51.254215+00:00 app[tweet_recollection.1]: return self.read(nbytes, buffer)
2022-04-12T22:21:51.254226+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 874, in read
2022-04-12T22:21:51.254641+00:00 app[tweet_recollection.1]: return self._sslobj.read(len, buffer)
2022-04-12T22:21:51.254652+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/ssl.py", line 631, in read
2022-04-12T22:21:51.255293+00:00 app[tweet_recollection.1]: v = self._sslobj.read(len, buffer)
2022-04-12T22:21:51.255322+00:00 app[tweet_recollection.1]: urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2022-04-12T22:21:51.255330+00:00 app[tweet_recollection.1]: 
2022-04-12T22:21:51.255330+00:00 app[tweet_recollection.1]: During handling of the above exception, another exception occurred:
2022-04-12T22:21:51.255331+00:00 app[tweet_recollection.1]: 
2022-04-12T22:21:51.255340+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-12T22:21:51.255353+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 190, in execute
2022-04-12T22:21:51.255499+00:00 app[tweet_recollection.1]: proxies=self.api.proxy)
2022-04-12T22:21:51.255510+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 542, in request
2022-04-12T22:21:51.255777+00:00 app[tweet_recollection.1]: resp = self.send(prep, **send_kwargs)
2022-04-12T22:21:51.255786+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 655, in send
2022-04-12T22:21:51.256134+00:00 app[tweet_recollection.1]: r = adapter.send(request, **kwargs)
2022-04-12T22:21:51.256144+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/adapters.py", line 498, in send
2022-04-12T22:21:51.256509+00:00 app[tweet_recollection.1]: raise ConnectionError(err, request=request)
2022-04-12T22:21:51.256533+00:00 app[tweet_recollection.1]: requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2022-04-12T22:21:51.256543+00:00 app[tweet_recollection.1]: 
2022-04-12T22:21:51.256543+00:00 app[tweet_recollection.1]: During handling of the above exception, another exception occurred:
2022-04-12T22:21:51.256543+00:00 app[tweet_recollection.1]: 
2022-04-12T22:21:51.256552+00:00 app[tweet_recollection.1]: Traceback (most recent call last):
2022-04-12T22:21:51.256564+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/runpy.py", line 193, in _run_module_as_main
2022-04-12T22:21:51.256832+00:00 app[tweet_recollection.1]: "__main__", mod_spec)
2022-04-12T22:21:51.256843+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/runpy.py", line 85, in _run_code
2022-04-12T22:21:51.256950+00:00 app[tweet_recollection.1]: exec(code, run_globals)
2022-04-12T22:21:51.256961+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 136, in <module>
2022-04-12T22:21:51.257283+00:00 app[tweet_recollection.1]: collector.perform()
2022-04-12T22:21:51.257333+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 36, in perform
2022-04-12T22:21:51.257425+00:00 app[tweet_recollection.1]: self.process_batch(batch_of_ids)
2022-04-12T22:21:51.257436+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 66, in process_batch
2022-04-12T22:21:51.257645+00:00 app[tweet_recollection.1]: for status in self.lookup_statuses(status_ids):
2022-04-12T22:21:51.257646+00:00 app[tweet_recollection.1]: File "/app/app/tweet_recollection/collector.py", line 105, in lookup_statuses
2022-04-12T22:21:51.257780+00:00 app[tweet_recollection.1]: tweet_mode="extended"
2022-04-12T22:21:51.257783+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/api.py", line 120, in statuses_lookup
2022-04-12T22:21:51.257893+00:00 app[tweet_recollection.1]: )(list_to_csv(id_), *args, **kwargs)
2022-04-12T22:21:51.257904+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 253, in _call
2022-04-12T22:21:51.258060+00:00 app[tweet_recollection.1]: return method.execute()
2022-04-12T22:21:51.258071+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 192, in execute
2022-04-12T22:21:51.258367+00:00 app[tweet_recollection.1]: six.reraise(TweepError, TweepError('Failed to send request: %s' % e), sys.exc_info()[2])
2022-04-12T22:21:51.258380+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/six.py", line 702, in reraise
2022-04-12T22:21:51.258710+00:00 app[tweet_recollection.1]: raise value.with_traceback(tb)
2022-04-12T22:21:51.258721+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/tweepy/binder.py", line 190, in execute
2022-04-12T22:21:51.258958+00:00 app[tweet_recollection.1]: proxies=self.api.proxy)
2022-04-12T22:21:51.258972+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 542, in request
2022-04-12T22:21:51.259231+00:00 app[tweet_recollection.1]: resp = self.send(prep, **send_kwargs)
2022-04-12T22:21:51.259242+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/sessions.py", line 655, in send
2022-04-12T22:21:51.259550+00:00 app[tweet_recollection.1]: r = adapter.send(request, **kwargs)
2022-04-12T22:21:51.259559+00:00 app[tweet_recollection.1]: File "/app/.heroku/python/lib/python3.6/site-packages/requests/adapters.py", line 498, in send
2022-04-12T22:21:51.259940+00:00 app[tweet_recollection.1]: raise ConnectionError(err, request=request)
2022-04-12T22:21:51.259958+00:00 app[tweet_recollection.1]: tweepy.error.TweepError: Failed to send request: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
2022-04-12T22:21:51.561508+00:00 heroku[tweet_recollection.1]: Process exited with status 1
2022-04-12T22:21:51.630933+00:00 heroku[tweet_recollection.1]: State changed from up to crashed
^C