search

OpenCTI-Platform / connectors

OpenCTI Connectors
https://www.opencti.io
Apache License 2.0
388 stars 416 forks source link

[AlienVault] Connector Stopped Running - CTI #791

Open ims1337 opened 2 years ago

ims1337 commented 2 years ago

CTI was running good, but after some time, dashboard numbers stopped at some stage (added alien vault for now) upon inquiry I am seeing these logs for Alien Vault

Attached are Logs. Please advise what is going wrong here?


INFO:root:Listing Threat-Actors with filters null.
INFO:root:Connector registered with ID: 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Starting ping alive thread
INFO:root:Starting AlienVault connector...
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-07-18T14:19:38.867000', 'last_run': 1658216814}
INFO:root:Initiate work for 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Running pulse importer (update data: False, guess malware: False, guess cve: False, relationships: True, patterns_indicates: True)...
WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2ae9ada0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2ae9aef0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2ae9b010>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2ae9b160>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2acbc0d0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.10/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.10/socket.py", line 955, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Try again

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1040, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 358, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7fad2acbc370>: Failed to establish a new connection: [Errno -3] Try again

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 785, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='otx.alienvault.com', port=443): Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2acbc370>: Failed to establish a new connection: [Errno -3] Try again'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/opencti-connector-alienvault/main.py", line 8, in <module>
    connector.run()
  File "/opt/opencti-connector-alienvault/alienvault/core.py", line 244, in run
    pulse_import_state = self.pulse_importer.run(current_state, work_id)
  File "/opt/opencti-connector-alienvault/alienvault/importer.py", line 92, in run
    pulses = self._fetch_subscribed_pulses(latest_pulse_datetime)
  File "/opt/opencti-connector-alienvault/alienvault/importer.py", line 152, in _fetch_subscribed_pulses
    pulses = self.client.get_pulses_subscribed(modified_since)
  File "/opt/opencti-connector-alienvault/alienvault/client.py", line 25, in get_pulses_subscribed
    pulse_data = self.otx.getsince(modified_since, limit=limit)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 431, in getsince
    return self.getall(limit=limit, modified_since=timestamp, max_page=max_page, max_items=max_items, iter=False)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 404, in getall
    return self.walkapi(
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 385, in walkapi
    return list(self.walkapi_iter(url, max_page=max_page, max_items=max_items, method=method, body=body))
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 366, in walkapi_iter
    data = self.get(next_page_url)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 178, in get
    response = self.session().get(
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='otx.alienvault.com', port=443): Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fad2acbc370>: Failed to establish a new connection: [Errno -3] Try again'))
Killed
INFO:root:Connector will not run, next run in: 2099 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 2039 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1979 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1919 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1859 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1799 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1739 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1679 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1619 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1559 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1499 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1439 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1379 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1319 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1259 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1199 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1139 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1079 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 1019 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 958 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 898 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 838 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 778 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 718 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 658 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 598 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 538 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 478 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 418 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 358 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 298 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 238 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 178 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-04T08:03:45.071000', 'last_run': 1659623469}
INFO:root:Connector will not run, next run in: 118 seconds
INFO:root:Listing Threat-Actors with filters null.
INFO:root:Connector registered with ID: 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Starting ping alive thread
INFO:root:Starting AlienVault connector...
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-07-18T14:19:38.867000', 'last_run': 1658216814}
INFO:root:Initiate work for 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Running pulse importer (update data: False, guess malware: False, guess cve: False, relationships: True, patterns_indicates: True)...
WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccaac50>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccaa860>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccab1f0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccab2b0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccabca0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.10/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.10/socket.py", line 955, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Try again

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1040, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 358, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f4d6ccabf10>: Failed to establish a new connection: [Errno -3] Try again

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 785, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='otx.alienvault.com', port=443): Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccabf10>: Failed to establish a new connection: [Errno -3] Try again'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/opencti-connector-alienvault/main.py", line 8, in <module>
    connector.run()
  File "/opt/opencti-connector-alienvault/alienvault/core.py", line 244, in run
    pulse_import_state = self.pulse_importer.run(current_state, work_id)
  File "/opt/opencti-connector-alienvault/alienvault/importer.py", line 92, in run
    pulses = self._fetch_subscribed_pulses(latest_pulse_datetime)
  File "/opt/opencti-connector-alienvault/alienvault/importer.py", line 152, in _fetch_subscribed_pulses
    pulses = self.client.get_pulses_subscribed(modified_since)
  File "/opt/opencti-connector-alienvault/alienvault/client.py", line 25, in get_pulses_subscribed
    pulse_data = self.otx.getsince(modified_since, limit=limit)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 431, in getsince
    return self.getall(limit=limit, modified_since=timestamp, max_page=max_page, max_items=max_items, iter=False)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 404, in getall
    return self.walkapi(
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 385, in walkapi
    return list(self.walkapi_iter(url, max_page=max_page, max_items=max_items, method=method, body=body))
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 366, in walkapi_iter
    data = self.get(next_page_url)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 178, in get
    response = self.session().get(
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='otx.alienvault.com', port=443): Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4d6ccabf10>: Failed to establish a new connection: [Errno -3] Try again'))
Killed
INFO:root:State stored, next run in: 1800 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1740 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1680 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1620 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1560 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1500 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1440 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1380 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1320 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1260 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1200 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1140 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1080 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 1020 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 959 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 899 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 839 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 779 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 719 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 659 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 599 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 539 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 479 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 419 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 359 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 299 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 239 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 179 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 119 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Connector will not run, next run in: 59 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660210014}
INFO:root:Initiate work for 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Running pulse importer (update data: False, guess malware: False, guess cve: False, relationships: True, patterns_indicates: True)...
INFO:root:0 pulse(s) since 2022-08-10 08:30:00.663000...
INFO:root:Pulse importer completed (imported: 0, failed: 0, total: 0), latest fetch 2022-08-10 08:30:00.663000
INFO:root:Storing new state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660211815}
INFO:root:Reporting work update_received opencti-work--2164cccc-f2c1-41f3-8275-6c7e045557ca
INFO:root:State stored, next run in: 1800 seconds
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-08-10T08:30:00.663000', 'last_run': 1660211815}
INFO:root:Connector will not run, next run in: 1740 seconds
INFO:root:Listing Threat-Actors with filters null.
INFO:root:Connector registered with ID: 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Starting ping alive thread
INFO:root:Starting AlienVault connector...
INFO:root:Running AlienVault connector...
INFO:root:Loaded state: {'latest_pulse_timestamp': '2022-07-18T14:19:38.867000', 'last_run': 1658216814}
INFO:root:Initiate work for 577b6da1-686c-4a9e-bfc2-e5a3d34bf0d2
INFO:root:Running pulse importer (update data: False, guess malware: False, guess cve: False, relationships: True, patterns_indicates: True)...
WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7730443490>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7730442800>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7730443010>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7730443160>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f77304b80d0>: Failed to establish a new connection: [Errno -3] Try again')': /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.10/site-packages/urllib3/util/connection.py", line 72, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
  File "/usr/local/lib/python3.10/socket.py", line 955, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Try again

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 703, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 386, in _make_request
    self._validate_conn(conn)
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1040, in _validate_conn
    conn.connect()
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 358, in connect
    self.sock = conn = self._new_conn()
  File "/usr/local/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn
    raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f77304b8370>: Failed to establish a new connection: [Errno -3] Try again

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 489, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 813, in urlopen
    return self.urlopen(
  [Previous line repeated 2 more times]
  File "/usr/local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 785, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='otx.alienvault.com', port=443): Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f77304b8370>: Failed to establish a new connection: [Errno -3] Try again'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/opencti-connector-alienvault/main.py", line 8, in <module>
    connector.run()
  File "/opt/opencti-connector-alienvault/alienvault/core.py", line 244, in run
    pulse_import_state = self.pulse_importer.run(current_state, work_id)
  File "/opt/opencti-connector-alienvault/alienvault/importer.py", line 92, in run
    pulses = self._fetch_subscribed_pulses(latest_pulse_datetime)
  File "/opt/opencti-connector-alienvault/alienvault/importer.py", line 152, in _fetch_subscribed_pulses
    pulses = self.client.get_pulses_subscribed(modified_since)
  File "/opt/opencti-connector-alienvault/alienvault/client.py", line 25, in get_pulses_subscribed
    pulse_data = self.otx.getsince(modified_since, limit=limit)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 431, in getsince
    return self.getall(limit=limit, modified_since=timestamp, max_page=max_page, max_items=max_items, iter=False)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 404, in getall
    return self.walkapi(
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 385, in walkapi
    return list(self.walkapi_iter(url, max_page=max_page, max_items=max_items, method=method, body=body))
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 366, in walkapi_iter
    data = self.get(next_page_url)
  File "/usr/local/lib/python3.10/site-packages/OTXv2.py", line 178, in get
    response = self.session().get(
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 600, in get
    return self.request("GET", url, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='otx.alienvault.com', port=443): Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f77304b8370>: Failed to establish a new connection: [Errno -3] Try again'))
Killed
richard-julien commented 2 years ago

Looks like the connector cant manage to connect to the AlienVault API.

Max retries exceeded with url: /api/v1/pulses/subscribed?limit=20&modified_since=2022-07-18T14%3A19%3A38.867000 Failed to establish a new connection: [Errno -3] Try again'

barismutanpicus commented 1 year ago

I am facing a similar problem, any updates on this?