search

OpenCTI-Platform / opencti

Open Cyber Threat Intelligence Platform
https://opencti.io
Other
6.14k stars 908 forks source link

Trying to get OpenCTI up and running with Docker #418

Closed rangerrkm closed 4 years ago

rangerrkm commented 4 years ago

Hello,

I've been tried to get OpenCTI installed via Docker without success.

Host OS: Ubuntu 19.10 RAM: 16GB docker-compose version 1.25.0, build 0a186604

I've updated the the APP_ADMIN and OPENCTI_TOKENS with a generated one .

Here is the output from the above command:

swoods@ubuntu:/OpenCTI/docker$ sudo docker-compose --compatibility up docker_grakn_1 is up-to-date docker_elasticsearch_1 is up-to-date Starting docker_minio_1 ... docker_connector-import-file-stix_1 is up-to-date docker_redis_1 is up-to-date docker_connector-mitre_1 is up-to-date docker_connector-export-file-stix_1 is up-to-date Starting docker_minio_1 ... done docker_opencti_1 is up-to-date docker_worker_1 is up-to-date docker_connector-opencti_1 is up-to-date Attaching to docker_grakn_1, docker_elasticsearch_1, docker_connector-import-file-stix_1, docker_redis_1, docker_connector-mitre_1, docker_connector-export-file-stix_1, docker_rabbitmq_1, docker_minio_1, docker_opencti_1, docker_worker_1, docker_connector-opencti_1 connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | Traceback (most recent call last): connector-import-file-stix_1 | File "import-file-stix.py", line 29, in connector-import-file-stix_1 | connectorImportFileStix = ImportFileStix() connector-import-file-stix_1 | File "import-file-stix.py", line 12, in init connector-import-file-stix_1 | self.helper = OpenCTIConnectorHelper(config) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-import-file-stix_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-import-file-stix_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-import-file-stix_1 | raise ValueError('OpenCTI API seems down') connector-import-file-stix_1 | ValueError: OpenCTI API seems down connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | Traceback (most recent call last): connector-opencti_1 | File "opencti.py", line 88, in connector-opencti_1 | openCTIConnector = OpenCTI() connector-opencti_1 | File "opencti.py", line 15, in init connector-opencti_1 | self.helper = OpenCTIConnectorHelper(config) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-opencti_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-opencti_1 | raise ValueError('OpenCTI API seems down') connector-opencti_1 | ValueError: OpenCTI API seems down connector-opencti_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | Traceback (most recent call last): connector-opencti_1 | File "opencti.py", line 88, in connector-opencti_1 | openCTIConnector = OpenCTI() connector-opencti_1 | File "opencti.py", line 15, in init connector-opencti_1 | self.helper = OpenCTIConnectorHelper(config) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-opencti_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-opencti_1 | raise ValueError('OpenCTI API seems down') connector-opencti_1 | ValueError: OpenCTI API seems down connector-opencti_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | Traceback (most recent call last): connector-opencti_1 | File "opencti.py", line 88, in connector-opencti_1 | openCTIConnector = OpenCTI() connector-opencti_1 | File "opencti.py", line 15, in init connector-opencti_1 | self.helper = OpenCTIConnectorHelper(config) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-opencti_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-opencti_1 | raise ValueError('OpenCTI API seems down') connector-opencti_1 | ValueError: OpenCTI API seems down connector-opencti_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | Traceback (most recent call last): connector-opencti_1 | File "opencti.py", line 88, in connector-opencti_1 | openCTIConnector = OpenCTI() connector-opencti_1 | File "opencti.py", line 15, in init connector-opencti_1 | self.helper = OpenCTIConnectorHelper(config) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init connector-opencti_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token, self.log_level) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 106, in init connector-opencti_1 | raise ValueError('OpenCTI API seems down') connector-opencti_1 | ValueError: OpenCTI API seems down connector-opencti_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | Traceback (most recent call last): connector-opencti_1 | File "opencti.py", line 88, in connector-opencti_1 | openCTIConnector = OpenCTI() connector-opencti_1 | File "opencti.py", line 15, in init connector-opencti_1 | self.helper = OpenCTIConnectorHelper(config) connector-opencti_1 | File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 150, in init grakn_1 | ==================================================================================================== grakn1 | ____ ____ __ _____ grakn_1 | | || \ | || | / /| \ | | | || || _ \ | | grakn_1 | | | ||| | | | | | | || | / / | \ | | | | ||| | | || | | | | | grakn_1 | | | | || / | || || |/ / | | | | | | | | || |_| / | |__ grakn1 | | || || \ | || \ | | | | | | | || _ \ | | grakn_1 | | || || | \ \ | | | || | \ \ | | \ | | || || || || | \ \ | |__ grakn_1 | |____||| _|| |||| \|| \| |____||||| \|| grakn_1 | grakn_1 | THE KNOWLEDGE GRAPH grakn_1 | ==================================================================================================== grakn_1 | Version:1.5.9 grakn_1 | Starting Storage......==================================================================================================== grakn1 | ____ ____ __ _____ grakn_1 | | || \ | || | / /| \ | | | || || _ \ | | grakn_1 | | | ||| | | | | | | || | / / | \ | | | | ||| | | || | | | | | grakn_1 | | | | || / | || || |/ / | | | | | | | | || |_| / | |__ grakn1 | | || || \ | || \ | | | | | | | || _ \ | | grakn_1 | | || || | \ \ | | | || | \ \ | | \ | | || || || || | \ \ | |__ grakn_1 | |____||| _|| |||| \|| \| |____||||| \|| grakn_1 | grakn_1 | THE KNOWLEDGE GRAPH grakn_1 | ==================================================================================================== grakn_1 | Version:1.5.9

What could be the problem with the OpenCTI API seems down.

Thanks,

intelwolf commented 4 years ago

I don't see any logging from your opencti_1 container here. docker_opencti_1 is the container that is taking care of the UI and API. Check the logs of that container to see why it didn't start yet: docker logs docker_opencti_1

matthiasmaes commented 4 years ago

@rangerrkm I'm facing similar issue seems to be linked to GRAKN


====================================================================================================
      ________  _____     _______  __    __  __    __      _______  _______  _____     _______
     |   __   ||   _  \  |   _   ||  |  /  /|  \  |  |    |   _   ||   _   ||   _  \  |   ____|
     |  |  |__||  | |  | |  | |  ||  | /  / |   \ |  |    |  | |__||  | |  ||  | |  | |  |
     |  | ____ |  |_| /  |  |_|  ||  |/  /  |    \|  |    |  |     |  | |  ||  |_| /  |  |____
     |  ||_   ||   _  \  |   _   ||   _  \  |   _    |    |  |  __ |  | |  ||   _  \  |   ____|
     |  |__|  ||  | \  \ |  | |  ||  | \  \ |  | \   |    |  |_|  ||  |_|  ||  | \  \ |  |____
     |________||__|  \__\|__| |__||__|  \__\|__|  \__|    |_______||_______||__|  \__\|_______|

                                         THE KNOWLEDGE GRAPH
====================================================================================================
                                                                                       Version:1.5.9

Starting Storage........SUCCESS
Starting Grakn Core Server......SUCCESS
2020-01-22 10:42:27,297 [main] INFO  grakn.core.server.Grakn - Grakn started in 1.406 s
2020-01-22 10:44:55,070 [transaction-listener-0] ERROR g.c.s.r.SessionService$TransactionListener - Runtime Exception in RPC TransactionListener:
grakn.core.graql.exception.GraqlSemanticException: label 'connector_identifier' not found
2020-01-22 10:44:58,001 [transaction-listener-0] ERROR g.c.s.r.SessionService$TransactionListener - Runtime Exception in RPC TransactionListener:
grakn.core.graql.exception.GraqlSemanticException: `UsageTargetsRule sub rule;` doesn't have an 'isa', a 'sub' or an 'id'
2020-01-22 10:44:58,700 [transaction-listener-0] ERROR g.c.s.r.SessionService$TransactionListener - Runtime Exception in RPC TransactionListener:
grakn.core.graql.exception.GraqlSemanticException: `UserTargetsRule sub rule;` doesn't have an 'isa', a 'sub' or an 'id'
2020-01-22 10:44:59,962 [transaction-listener-0] ERROR g.c.s.r.SessionService$TransactionListener - Runtime Exception in RPC TransactionListener:
grakn.core.graql.exception.GraqlSemanticException: label 'internal_id' not found
2020-01-22 10:45:00,739 [transaction-listener-0] ERROR g.c.s.r.SessionService$TransactionListener - Runtime Exception in RPC TransactionListener:
grakn.core.graql.exception.GraqlSemanticException: label 'stix_id' not found
2020-01-22 10:45:03,806 [transaction-listener-0] ERROR g.c.s.r.SessionService$TransactionListener - Runtime Exception in RPC TransactionListener:
grakn.core.graql.exception.GraqlSemanticException: `UsageIndicatesRule sub rule;` doesn't have an 'isa', a 'sub' or an 'id'
diskurse commented 4 years ago

Similar issue here

└[~/opencti/connectors/cve]> docker logs docker_opencti_1 error: [GRAKN] Seems down error: [API] Bootstrap error > Grakn seems down {"stack":"Error: Grakn seems down\n at graknIsAlive (/opt/opencti/dist/database/grakn.js:278:11)\n at processTicksAndRejections (internal/process/task_queues.js:93:5)"}

SamuelHassine commented 4 years ago

Hello,

In the VM where you are running Grakn 1.6., try to put vm.max_map_count = 1048575 in your sysctl.conf file and run sysctl -p /etc/sysctl.conf. Since the 1.6. branch, Cassandra does not start with default the max_map_count.

We will update the documentation to take this into account.

navhits commented 4 years ago

When starting the containers through the provided docker-compose.yml file. Got the following error.

Console output below:- 

connector-export-file-csv_1   | INFO:root:Listing Threat-Actors with filters null.
connector-export-file-csv_1   | Traceback (most recent call last):
connector-export-file-csv_1   |   File "export-file-csv.py", line 121, in <module>
connector-export-file-csv_1   |     connectorExportFileCsv = ExportFileCsv()
connector-export-file-csv_1   |   File "export-file-csv.py", line 15, in __init__
connector-export-file-csv_1   |     self.helper = OpenCTIConnectorHelper(config)
connector-export-file-csv_1   |   File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 181, in __init__
connector-export-file-csv_1   |     self.opencti_url, self.opencti_token, self.log_level
connector-export-file-csv_1   |   File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 110, in __init__
connector-export-file-csv_1   |     raise ValueError("OpenCTI API seems down")
connector-export-file-csv_1   | ValueError: OpenCTI API seems down
connector-import-file-stix_1  | INFO:root:Listing Threat-Actors with filters null.
connector-import-file-stix_1  | Traceback (most recent call last):
connector-import-file-stix_1  |   File "import-file-stix.py", line 29, in <module>
connector-import-file-stix_1  |     connectorImportFileStix = ImportFileStix()
connector-import-file-stix_1  |   File "import-file-stix.py", line 12, in __init__
connector-import-file-stix_1  |     self.helper = OpenCTIConnectorHelper(config)
connector-import-file-stix_1  |   File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 181, in __init__
connector-import-file-stix_1  |     self.opencti_url, self.opencti_token, self.log_level
connector-import-file-stix_1  |   File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 110, in __init__
connector-import-file-stix_1  |     raise ValueError("OpenCTI API seems down")
connector-import-file-stix_1  | ValueError: OpenCTI API seems down
opencti_connector-export-file-csv_1 exited with code 1
opencti_connector-import-file-stix_1 exited with code 1
connector-mitre_1             | INFO:root:Listing Threat-Actors with filters null.
connector-mitre_1             | Traceback (most recent call last):
connector-mitre_1             |   File "mitre.py", line 88, in <module>
connector-mitre_1             |     mitreConnector = Mitre()
connector-mitre_1             |   File "mitre.py", line 15, in __init__
connector-mitre_1             |     self.helper = OpenCTIConnectorHelper(config)
connector-mitre_1             |   File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 181, in __init__
connector-mitre_1             |     self.opencti_url, self.opencti_token, self.log_level
connector-mitre_1             |   File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 110, in __init__
connector-mitre_1             |     raise ValueError("OpenCTI API seems down")
connector-mitre_1             | ValueError: OpenCTI API seems down
connector-export-file-stix_1  | INFO:root:Listing Threat-Actors with filters null.
connector-export-file-stix_1  | Traceback (most recent call last):
connector-export-file-stix_1  |   File "export-file-stix.py", line 62, in <module>
connector-export-file-stix_1  |     connectorExportFileStix = ExportFileStix()
connector-export-file-stix_1  |   File "export-file-stix.py", line 13, in __init__
connector-export-file-stix_1  |     self.helper = OpenCTIConnectorHelper(config)
connector-export-file-stix_1  |   File "/usr/local/lib/python3.7/site-packages/pycti/connector/opencti_connector_helper.py", line 181, in __init__
connector-export-file-stix_1  |     self.opencti_url, self.opencti_token, self.log_level
connector-export-file-stix_1  |   File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 110, in __init__
connector-export-file-stix_1  |     raise ValueError("OpenCTI API seems down")
connector-export-file-stix_1  | ValueError: OpenCTI API seems down

Tried this method as @SamuelHassine mentioned.

SamuelHassine commented 4 years ago

Please guys can you try with the last version we released yesterday and the vm.max_map_count = 1048575?

navhits commented 4 years ago

Please guys can you try with the last version we released yesterday and the vm.max_map_count = 1048575?

Tried this. Still facing ValueError: OpenCTI API seems down in all workers and connectors.

navhits commented 4 years ago

I have documented in detail, the issues I am facing and the environment where I am trying to run the docker. Details below:-

Step 1: Changed the following values in docker-compose.yml

someuser@host $cat docker-compose.yml| grep -i "admin\|token\|connector_id" | grep -v EMAIL
      - APP__ADMIN__PASSWORD=demo
      - APP__ADMIN__TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - OPENCTI_TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - OPENCTI_TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - CONNECTOR_ID=5f768342-7a85-4e38-9e96-e3e033ebd0b0 # Valid UUDv4
      - OPENCTI_TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - CONNECTOR_ID=5f768342-7a85-4e38-9e96-e3e033ebd0b0 # Valid UUDv4
      - OPENCTI_TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - CONNECTOR_ID=5f768342-7a85-4e38-9e96-e3e033ebd0b0 # Valid UUDv4
      - OPENCTI_TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - CONNECTOR_ID=5f768342-7a85-4e38-9e96-e3e033ebd0b0 # Valid UUDv4
      - OPENCTI_TOKEN=5f768342-7a85-4e38-9e96-e3e033ebd0b0
      - CONNECTOR_ID=5f768342-7a85-4e38-9e96-e3e033ebd0b0 # Valid UUDv4

Step 2: Followed the steps as stated here

Executed the following command in my machine

sysctl -w vm.max_map_count=1048575

Step 3: Run docker-compose . under the context folder where the docker-compose.yml file resides.

Have provided the link to asciicinema video demonstrating the issue.

asciicast

Other Information

i. Docker Version

Docker version 19.03.5, build 633a0ea

ii. Git Commit Head Cloned

commit cd2f8c868c10fd508bdc404b3c0c4e865daeec6e

iii. OS Version

Darwin FWS-CHE-LT-3128.local 18.7.0 Darwin Kernel Version 18.7.0: Thu Jan 23 06:52:12 PST 2020; root:xnu-4903.278.25~1/RELEASE_X86_64 x86_64

Let me know if any further information is required or if I am going wrong anywhere.

graememeyer commented 4 years ago

@NAVHITS it looks like you could be experiencing the same issue as #322 and #458, suggest trying with the test config (docker-compose_test.yml), make these changes or run these sed commands:

sed -i 's/8080/4000/g' docker-compose.yml
sed -i 's/ChangeMeAccess/NewAccess19191919/g' docker-compose.yml
sed -i 's/ChangeMeKey/NewAccessKey19191919/g' docker-compose.yml

And then you have to wait quite a while before the errors stop. The containers all start in the wrong order so they'll keep spitting out errors until the dependencies are resolved. I would leave it for at least 20 minutes and by then the errors should have transitioned to INFO lines indicating that the content is being constructed.

b00lpy commented 4 years ago

Hi, i perfomed the same steps:

Started compose with command: docker-compose --compatibility -f docker-compose.yml up

But it's running since hours and still having the same errors:

image

Other suggests?

navhits commented 4 years ago

Using the docker-compose test file I was able to view the dashboard at the localhost. Also required to run as root. But it leads to a new error with the dashboard. Raised an issue for the same #464

graememeyer commented 4 years ago

@b00lpy did you change the port number for OpenCTI? The default of 8080 doesn't work for sure in that environment. You can change it with this sed command:

sed -i 's/8080/4000/g' docker-compose.yml

b00lpy commented 4 years ago

@graememeyer Yes, I tried for both (test/default) docker-compose files but no one can start...same error.

@NAVHITS No way to get it up, even the test one is giving me something to be happy for.

SamuelHassine commented 4 years ago

Hello Everyone, @graememeyer, @NAVHITS, @BFergerson, @b00lpy,

We improved the docker-compose.yml file as well as the documentation. Could you please try again with the latest version following the documentation: https://opencti-platform.github.io/docs/installation/auto.

An OVA file is available here: https://releases.opencti.io/

navhits commented 4 years ago

@SamuelHassine I believe you are still working on it because I can see that the OVA is still not uploaded. I was not able to test the docker file yet because of screen tty issues with macOS. Once the OVA is made available I will drop down feedback on that. Thanks!

SamuelHassine commented 4 years ago

Hello @NAVHITS, thanks for your reply! The OVA is now available here: https://drive.google.com/open?id=1bvB6RmdQNHMW_3h-88KbAit9GRZlL5Bj :)

mmasood6353 commented 4 years ago

Hello team, below are the errors that keep on popping on the screen after running docker-compose --compatibility up

sood@opencti-inst1:~/cti/docker$ sudo docker-compose --compatibility up Starting docker_minio_1 ... done Starting docker_grakn_1 ... done Recreating docker_connector-export-file-stix_1 ... done Recreating docker_connector-export-file-csv_1 ... done Starting docker_elasticsearch_1 ... done Starting docker_redis_1 ... done Recreating docker_connector-import-file-pdf-observables_1 ... done Starting docker_rabbitmq_1 ... done Recreating docker_connector-import-file-stix_1 ... done Recreating docker_connector-mitre_1 ... done Recreating docker_connector-opencti_1 ... done Recreating docker_opencti_1 ... done Recreating docker_worker_1 ... done Recreating docker_worker_2 ... done Recreating docker_worker_3 ... done Attaching to docker_minio_1, docker_grakn_1, docker_elasticsearch_1, docker_connector-import-file-stix_1, docker_connector-import-file-pdf-observables_1, docker_redis_1, docker_rabbitmq_1, docker_connector-mitre_1, docker_connector-export-file-stix_1, docker_connector-opencti_1, docker_connector-export-file-csv_1, docker_opencti_1, docker_worker_1, docker_worker_2, docker_worker_3 connector-export-file-csv_1 | INFO:root:Listing Threat-Actors with filters null. connector-export-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-pdf-observables_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. connector-mitre_1 | INFO:root:Listing Threat-Actors with filters null. connector-opencti_1 | INFO:root:Listing Threat-Actors with filters null. elasticsearch_1 | OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. grakn_1 | ==================================================================================================== grakn1 | ____ ____ __ _____ grakn_1 | | || \ | || | / /| \ | | | || || _ \ | | grakn_1 | | | ||| | | | | | | || | / / | \ | | | | ||| | | || | | | | | grakn_1 | | | | || / | || || |/ / | | | | | | | | || |_| / | |__ grakn1 | | || || \ | || \ | | | | | | | || _ \ | | grakn_1 | | || || | \ \ | | | || | \ \ | | \ | | || || || || | \ \ | |__ grakn_1 | |____||| _|| |||| \|| \| |____||||| \|| grakn_1 | grakn_1 | THE KNOWLEDGE GRAPH grakn_1 | ==================================================================================================== grakn_1 | Version: 1.6.2 grakn_1 | minio_1 | minio_1 | You are running an older version of MinIO released 1 month ago minio_1 | Update: docker pull minio/minio:RELEASE.2020-04-22T00-11-12Z minio_1 | minio_1 | minio_1 | Endpoint: http://172.18.0.2:9000 http://127.0.0.1:9000 minio_1 | minio_1 | Browser Access: minio_1 | http://172.18.0.2:9000 http://127.0.0.1:9000 minio_1 | minio_1 | Object API (Amazon S3 compatible): minio_1 | Go: https://docs.min.io/docs/golang-client-quickstart-guide minio_1 | Java: https://docs.min.io/docs/java-client-quickstart-guide minio_1 | Python: https://docs.min.io/docs/python-client-quickstart-guide minio_1 | JavaScript: https://docs.min.io/docs/javascript-client-quickstart-guide minio_1 | .NET: https://docs.min.io/docs/dotnet-client-quickstart-guide opencti_1 | yarn run v1.19.1 opencti_1 | $ node --max_old_space_size=8192 build/index.js redis_1 | 1:C 22 Apr 2020 19:00:23.844 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo redis_1 | 1:C 22 Apr 2020 19:00:23.844 # Redis version=5.0.8, bits=64, commit=00000000, modified=0, pid=1, just started redis_1 | 1:C 22 Apr 2020 19:00:23.844 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf redis_1 | 1:M 22 Apr 2020 19:00:23.854 Running mode=standalone, port=6379. redis_1 | 1:M 22 Apr 2020 19:00:23.854 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. redis_1 | 1:M 22 Apr 2020 19:00:23.854 # Server initialized redis_1 | 1:M 22 Apr 2020 19:00:23.856 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled. redis_1 | 1:M 22 Apr 2020 19:00:23.859 DB loaded from disk: 0.003 seconds redis_1 | 1:M 22 Apr 2020 19:00:23.859 * Ready to accept connections worker_1 | INFO:root:Listing Threat-Actors with filters null. worker_1 | Traceback (most recent call last): worker_1 | File "worker.py", line 174, in worker_1 | worker = Worker() worker_1 | File "worker.py", line 120, in init worker_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_1 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_1 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_2 | INFO:root:Listing Threat-Actors with filters null. worker_2 | Traceback (most recent call last): worker_2 | File "worker.py", line 174, in worker_2 | worker = Worker() worker_2 | File "worker.py", line 120, in init worker_2 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_2 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_2 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_2 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_3 | INFO:root:Listing Threat-Actors with filters null. worker_3 | Traceback (most recent call last): worker_3 | File "worker.py", line 174, in worker_3 | worker = Worker() worker_3 | File "worker.py", line 120, in init worker_3 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_3 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_3 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_3 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... connector-import-file-stix_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_1 | INFO:root:Listing Threat-Actors with filters null. worker_1 | Traceback (most recent call last): worker_1 | File "worker.py", line 174, in worker_1 | worker = Worker() worker_1 | File "worker.py", line 120, in init worker_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_1 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_1 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... opencti_1 | {"code":14,"metadata":{"_internal_repr":{},"flags":0},"details":"failed to connect to all addresses","level":"error","message":"[GRAKN] Seems down > 14 UNAVAILABLE: failed to connect to all addresses","stack":"Error: 14 UNAVAILABLE: failed to connect to all addresses\n at Object.exports.createStatusError (/opt/opencti/node_modules/grpc/src/common.js:91:15)\n at Object.onReceiveStatus (/opt/opencti/node_modules/grpc/src/client_interceptors.js:1209:28)\n at InterceptingListener._callNext (/opt/opencti/node_modules/grpc/src/client_interceptors.js:568:42)\n at InterceptingListener.onReceiveStatus (/opt/opencti/node_modules/grpc/src/client_interceptors.js:618:8)\n at callback (/opt/opencti/node_modules/grpc/src/client_interceptors.js:847:24)"} opencti_1 | {"message":"[OPENCTI] GraphQL initialization fail > Error: Grakn seems down\n at /opt/opencti/build/index.js:1:4871\n at processTicksAndRejections (internal/process/task_queues.js:93:5)\n at async /opt/opencti/build/index.js:1:128547\n at async n.b (/opt/opencti/build/index.js:1:128531)\n at async /opt/opencti/build/index.js:1:858301","level":"error"} connector-mitre_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... docker_worker_1 exited with code 1 connector-opencti_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... connector-export-file-stix_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... opencti_1 | error Command failed with exit code 1. opencti_1 | info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command. connector-export-file-csv_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_2 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-pdf-observables_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_2 | Traceback (most recent call last): worker_2 | File "worker.py", line 174, in worker_2 | worker = Worker() worker_2 | File "worker.py", line 120, in init worker_2 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_2 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_2 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_2 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_3 | INFO:root:Listing Threat-Actors with filters null. docker_worker_2 exited with code 1 connector-import-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. worker_3 | Traceback (most recent call last): worker_3 | File "worker.py", line 174, in worker_3 | worker = Worker() worker_3 | File "worker.py", line 120, in init worker_3 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_3 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_3 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_3 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... docker_worker_1 exited with code 1 docker_worker_3 exited with code 1 connector-mitre_1 | INFO:root:Listing Threat-Actors with filters null. worker_2 | INFO:root:Listing Threat-Actors with filters null. worker_2 | Traceback (most recent call last): worker_2 | File "worker.py", line 174, in worker_2 | worker = Worker() worker_2 | File "worker.py", line 120, in init worker_2 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_2 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_2 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_2 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... connector-export-file-csv_1 | INFO:root:Listing Threat-Actors with filters null. docker_worker_2 exited with code 1 connector-export-file-stix_1 | INFO:root:Listing Threat-Actors with filters null. worker_1 | INFO:root:Listing Threat-Actors with filters null. worker_1 | INFO:root:Listing Threat-Actors with filters null. worker_1 | Traceback (most recent call last): worker_1 | File "worker.py", line 174, in worker_1 | worker = Worker() worker_1 | File "worker.py", line 120, in init worker_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_1 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_1 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_1 | Traceback (most recent call last): worker_1 | File "worker.py", line 174, in worker_1 | worker = Worker() worker_1 | File "worker.py", line 120, in init worker_1 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_1 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_1 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_1 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... worker_3 | INFO:root:Listing Threat-Actors with filters null. worker_3 | Traceback (most recent call last): worker_3 | File "worker.py", line 174, in worker_3 | worker = Worker() worker_3 | File "worker.py", line 120, in init worker_3 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_3 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_3 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_3 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... docker_worker_3 exited with code 1 connector-import-file-pdf-observables_1 | INFO:root:Listing Threat-Actors with filters null. connector-import-file-stix_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... docker_connector-import-file-stix_1 exited with code 0 worker_2 | INFO:root:Listing Threat-Actors with filters null. worker_2 | Traceback (most recent call last): worker_2 | File "worker.py", line 174, in worker_2 | worker = Worker() worker_2 | File "worker.py", line 120, in init worker_2 | self.api = OpenCTIApiClient(self.opencti_url, self.opencti_token) worker_2 | File "/usr/local/lib/python3.7/site-packages/pycti/api/opencti_api_client.py", line 111, in init worker_2 | "OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration..." worker_2 | ValueError: OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... docker_worker_2 exited with code 1 elasticsearch_1 | {"type": "server", "timestamp": "2020-04-22T19:00:59,554Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "docker-cluster", "node.name": "311296428d42", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda1)]], net usable_space [14.1gb], net total_space [19.2gb], types [ext4]" } elasticsearch_1 | {"type": "server", "timestamp": "2020-04-22T19:00:59,596Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "docker-cluster", "node.name": "311296428d42", "message": "heap size [1007.3mb], compressed ordinary object pointers [true]" } connector-opencti_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... docker_connector-opencti_1 exited with code 0 opencti_1 | {"code":14,"metadata":{"_internal_repr":{},"flags":0},"details":"failed to connect to all addresses","level":"error","message":"[GRAKN] Seems down > 14 UNAVAILABLE: failed to connect to all addresses","stack":"Error: 14 UNAVAILABLE: failed to connect to all addresses\n at Object.exports.createStatusError (/opt/opencti/node_modules/grpc/src/common.js:91:15)\n at Object.onReceiveStatus (/opt/opencti/node_modules/grpc/src/client_interceptors.js:1209:28)\n at InterceptingListener._callNext (/opt/opencti/node_modules/grpc/src/client_interceptors.js:568:42)\n at InterceptingListener.onReceiveStatus (/opt/opencti/node_modules/grpc/src/client_interceptors.js:618:8)\n at callback (/opt/opencti/node_modules/grpc/src/client_interceptors.js:847:24)"} opencti_1 | {"message":"[OPENCTI] GraphQL initialization fail > Error: Grakn seems down\n at /opt/opencti/build/index.js:1:4871\n at processTicksAndRejections (internal/process/task_queues.js:93:5)\n at async /opt/opencti/build/index.js:1:128547\n at async n.b (/opt/opencti/build/index.js:1:128531)\n at async /opt/opencti/build/index.js:1:858301","level":"error"} opencti_1 | error Command failed with exit code 1. opencti_1 | info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command. connector-mitre_1 | OpenCTI API is not reachable. Waiting for OpenCTI API to start or check your configuration... elasticsearch_1 | {"type": "server", "timestamp": "2020-04-22T19:01:01,300Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "311296428d42", "message": "node name [311296428d42], node ID [5iRHapNrR3KjHDaDLALEvw], cluster name [docker-cluster]" } elasticsearch_1 | {"type": "server", "timestamp": "2020-04-22T19:01:01,301Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "311296428d42", "message": "version[7.6.2], pid[1], build[default/docker/ef48eb35cf30adf4db14086e8aabd07ef6fb113f/2020-03-26T06:34:37.794943Z], OS[Linux/5.0.0-1034-gcp/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/13.0.2/13.0.2+8]" } elasticsearch_1 | {"type": "server", "timestamp": "2020-04-22T19:01:01,302Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "311296428d42", "message": "JVM home [/usr/share/elasticsearch/jdk]" } worker_3 | INFO:root:Listing Threat-Actors with filters null. elasticsearch_1 | {"type": "server", "timestamp": "2020-04-22T19:01:01,302Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "311296428d42", "message": "JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=COMPAT, -Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-8479103069803262585, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" }

rbnor commented 4 years ago

Hello team, below are the errors that keep on popping on the screen after running docker-compose --compatibility up

Im also getting this issue

opencti_1 | yarn run v1.19.1 opencti_1 | $ node --max_old_space_size=8192 build/index.js opencti_1 | {"code":14,"metadata":{"_internal_repr":{},"flags":0},"details":"failed to connect to all addresses","level":"error","message":"[GRAKN] Seems down > 14 UNAVAILABLE: f ailed to connect to all addresses","stack":"Error: 14 UNAVAILABLE: failed to connect to all addresses\n at Object.exports.createStatusError (/opt/opencti/node_modules/grpc/src/common.js:91:15)\n at Objec t.onReceiveStatus (/opt/opencti/node_modules/grpc/src/client_interceptors.js:1209:28)\n at InterceptingListener._callNext (/opt/opencti/node_modules/grpc/src/client_interceptors.js:568:42)\n at Intercept ingListener.onReceiveStatus (/opt/opencti/node_modules/grpc/src/client_interceptors.js:618:8)\n at callback (/opt/opencti/node_modules/grpc/src/client_interceptors.js:847:24)"} opencti_1 | {"message":"[OPENCTI] GraphQL initialization fail > Error: Grakn seems down\n at /opt/opencti/build/index.js:1:4871\n at processTicksAndRejections (internal/pro cess/task_queues.js:93:5)\n at async /opt/opencti/build/index.js:1:128547\n at async n.b (/opt/opencti/build/index.js:1:128531)\n at async /opt/opencti/build/index.js:1:858301","level":"error"} opencti_1 | error Command failed with exit code 1. opencti_1 | info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

However graken is very much running? CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 25fc05a7d57d opencti/worker:3.1.0 "/entrypoint.sh" 3 minutes ago Restarting (1) 1 second ago docker_worker_1 a052007ccb57 opencti/platform:3.1.0 "/entrypoint.sh" 3 minutes ago Up 2 seconds 0.0.0.0:8080->8080/tcp docker_opencti_1 b7aeaae91071 opencti/connector-export-file-csv:3.1.0 "/entrypoint.sh" 3 minutes ago Up 9 seconds docker_connector-export-file-csv_1 37d512d8dc9c graknlabs/grakn:1.6.2 "./grakn-docker.sh" 3 minutes ago Up 18 seconds 0.0.0.0:48555->48555/tcp docker_grakn_1 cacc7fc7a23e opencti/connector-import-file-stix:3.1.0 "/entrypoint.sh" 3 minutes ago Up 10 seconds docker_connector-import-file-stix_1 e1d88f341667 opencti/connector-export-file-stix:3.1.0 "/entrypoint.sh" 3 minutes ago Restarting (0) Less than a second ago docker_connector-export-file-stix_1 a7223d39498d opencti/connector-mitre:3.1.0 "/entrypoint.sh" 3 minutes ago Up 12 seconds docker_connector-mitre_1 9c72211e827d opencti/connector-opencti:3.1.0 "/entrypoint.sh" 3 minutes ago Restarting (0) Less than a second ago docker_connector-opencti_1 eb0d4b536b12 redis:5.0.8 "docker-entrypoint.s…" 3 minutes ago Up 12 seconds 6379/tcp docker_redis_1 55fd0cb4304d rabbitmq:3.7-management "docker-entrypoint.s…" 3 minutes ago Up 19 seconds 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 25672/tc p docker_rabbitmq_1 4b57473368db minio/minio:RELEASE.2020-02-27T00-23-05Z "/usr/bin/docker-ent…" 3 minutes ago Restarting (1) Less than a second ago docker_minio_1 d06cfde080d1 opencti/connector-import-file-pdf-observables:3.1.0 "/entrypoint.sh" 3 minutes ago Up 13 seconds docker_connector-import-file-pdf-observables_1 d3a2356db2d0 docker.elastic.co/elasticsearch/elasticsearch:7.6.2 "/usr/local/bin/dock…" 3 minutes ago Up 16 seconds 9200/tcp, 9300/tcp docker_elasticsearch_1

mmasood6353 commented 4 years ago

The issue is probably with the Grakn storage as it will be down I fixed the issue as follows:

After the docker-compose --compatibility up Once all images were upend running, I ran the following command to restart the grain image

docker restart

after that I saw the docker processes via " docker ps", in a short while it showed workers as up and running and opencti port 4000 appeared

Please try this

rbnor commented 4 years ago

Please try this

I just tried this. However here the platform and the workers continue to restart. Are you sure its all running? because the platform runs for some seconds here but always restarts after a few seconds, while the workers are stuck rebooting waiting for the platform and api probably.

Whats your entrypoint for graken in docker ps? ./grakn-docker.sh ?

rbnor commented 4 years ago

opencti_1 holds about 15 seconds before rebooting

rbnor commented 4 years ago

opencti_1 | {"message":"[OPENCTI] GraphQL initialization fail > Error: getaddrinfo EAI_AGAIN minio\n at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:60:26)","level":"er ror"}

opencti_1 | error Command failed with exit code 1. opencti_1 | info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

mmasood6353 commented 4 years ago

Yeah the entry point is same ./grakn-docker.sh

I stopped all containers and re composed... I again faced the same issue....

Then I again restarted Grakn and waited for like 5 mins and kept on checking "docker ps"

After 5 mins I again restarted the Grakn...... and kept on checking "docker ps" the moment I saw the opencti platform as up with 4000 port I. quickly refreshed my web browser and it logged in.... within few secs all workers were up as well....

uniquean777 commented 1 year ago

Hello @navhits, thanks for your reply! The OVA is now available here: https://drive.google.com/open?id=1bvB6RmdQNHMW_3h-88KbAit9GRZlL5Bj :)

can you please share the OVA link again?