search

volentixlabsinc / venue-server

The backend services for Venue, a community engagement platform for the Volentix community
https://venue.volentix.io
MIT License
6 stars 0 forks source link

MaxRetriesExceededError: Can't retry venue.tasks.scrape_forum_profile[689ddb67-f3c5-4c52-bc0b-0562225ef831] args:('ce1753e4-1529-4fa5-9e7c-730240c6ff7a',) kwargs:{} #266

Open shawnlauzon opened 5 years ago

shawnlauzon commented 5 years ago

View details in Rollbar: https://rollbar.com/vlabs/Venue/items/57/

Traceback (most recent call last):
  File "/code/venue/tasks.py", line 220, in scrape_forum_profile
    raise self.retry(countdown=1)
  File "/usr/local/lib/python3.6/site-packages/celery/app/task.py", line 671, in retry
    self.name, request.id, S.args, S.kwargs))
MaxRetriesExceededError: Can't retry venue.tasks.scrape_forum_profile[0b015c62-0a83-4024-a47b-4f810afa6bf9] args:('b9761756-391c-4865-afda-2ff7d08a913e',) kwargs:{}Traceback (most recent call last):
  File "/code/venue/tasks.py", line 109, in scrape_forum_profile
    test_config=test_scrape_config)
  File "/code/venue/scrapers/bitcointalk.py", line 304, in verify_and_scrape
    test_config=test_config
  File "/code/venue/scrapers/bitcointalk.py", line 91, in get_profile
    self.make_request(profile_url, fallback=fallback, verify=False)
  File "/code/venue/scrapers/bitcointalk.py", line 75, in make_request
    raise ScraperError('HTTP request failed', self.error_info)
ScraperError: ('HTTP request failed', {'message': 'ProxyError(MaxRetryError("HTTPSConnectionPool(host=\'bitcointalk.org\', port=443): Max retries exceeded with url: /index.php?action=profile;u=1821300 (Caused by ProxyError(\'Cannot connect to proxy.\', OSError(\'Tunnel connection failed: 503 Crawlera Server Unavailable\',)))",),)'})Traceback (most recent call last):
  File "/code/venue/scrapers/bitcointalk.py", line 58, in make_request
    verify=verify
  File "/usr/local/lib/python3.6/site-packages/requests/api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 524, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 637, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 510, in send
    raise ProxyError(e, request=request)
ProxyError: HTTPSConnectionPool(host='bitcointalk.org', port=443): Max retries exceeded with url: /index.php?action=profile;u=1821300 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 503 Crawlera Server Unavailable',)))Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 639, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py", line 388, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
MaxRetryError: HTTPSConnectionPool(host='bitcointalk.org', port=443): Max retries exceeded with url: /index.php?action=profile;u=1821300 (Caused by ProxyError('Cannot connect to proxy.', OSError('Tunnel connection failed: 503 Crawlera Server Unavailable',)))Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 595, in urlopen
    self._prepare_proxy(conn)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 816, in _prepare_proxy
    conn.connect()
  File "/usr/local/lib/python3.6/site-packages/urllib3/connection.py", line 294, in connect
    self._tunnel()
  File "/usr/local/lib/python3.6/http/client.py", line 919, in _tunnel
    message.strip()))
OSError: Tunnel connection failed: 503 Crawlera Server Unavailable