Ubuntu installation stuck at "Waiting for elasticsearch URI to be accessible.."

[C0ubv9]

Describe the problem

New installation on Ubuntu, stuck at this step "[HELK-INSTALLATION-INFO] Waiting for some services to be up .....". Checked helk-logstash log it showed "Waiting for elasticsearch URI to be accessible..".

Provide the output of the following commands

Get operating system and version for linux (except Mac) use:
cat /etc/os-release
for Mac/OSX use:
sw_vers
Get disk space, memory, processor cores, and docker storage
echo -e "\nDocker Space:" && df -h /var/lib/docker; echo -e "\nMemory:" && free -g; echo -e "\nCores:" && getconf _NPROCESSORS_ONLN
Get output of the HELK docker containers:
docker ps --filter "name=helk"

NAME="Ubuntu"
VERSION="18.04.5 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.5 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic

Docker Space:
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda1       458G   21G  414G   5% /

Memory:
              total        used        free      shared  buff/cache   available
Mem:             15           7           1           0           6           7
Swap:             1           0           1

Cores:
4

CONTAINER ID   IMAGE                                                 COMMAND                  CREATED       STATUS        PORTS                                                                                                                                                                                                  NAMES
d967d5dfad90   confluentinc/cp-ksql-cli:5.1.3                        "/bin/sh"                5 hours ago   Up 5 hours                                                                                                                                                                                                           helk-ksql-cli
bacfa5034966   confluentinc/cp-ksql-server:5.1.3                     "/etc/confluent/dock…"   5 hours ago   Up 5 hours    0.0.0.0:8088->8088/tcp                                                                                                                                                                                 helk-ksql-server
27bb784ec9fb   otrf/helk-kafka-broker:2.4.0                          "./kafka-entrypoint.…"   5 hours ago   Up 5 hours    0.0.0.0:9092->9092/tcp                                                                                                                                                                                 helk-kafka-broker
2e91cb668539   otrf/helk-spark-worker:2.4.5                          "./spark-worker-entr…"   5 hours ago   Up 5 hours                                                                                                                                                                                                           helk-spark-worker
1039f0896152   otrf/helk-zookeeper:2.4.0                             "./zookeeper-entrypo…"   5 hours ago   Up 5 hours    2181/tcp, 2888/tcp, 3888/tcp                                                                                                                                                                           helk-zookeeper
913e74f20df2   otrf/helk-spark-master:2.4.5                          "./spark-master-entr…"   5 hours ago   Up 5 hours    7077/tcp, 0.0.0.0:8080->8080/tcp                                                                                                                                                                       helk-spark-master
6ca5b9d1d1a5   docker_helk-jupyter                                   "/opt/jupyter/script…"   5 hours ago   Up 5 hours    8000/tcp, 8888/tcp                                                                                                                                                                                     helk-jupyter
91e176c68938   otrf/helk-nginx:0.3.0                                 "/opt/helk/scripts/n…"   5 hours ago   Up 5 hours    0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp                                                                                                                                                               helk-nginx
d573be23d754   otrf/helk-logstash:7.6.2.1                            "/usr/share/logstash…"   5 hours ago   Up 5 hours    0.0.0.0:3515->3515/tcp, 0.0.0.0:5044->5044/tcp, 0.0.0.0:5514->5514/tcp, 0.0.0.0:5514->5514/udp, 0.0.0.0:8515-8516->8515-8516/tcp, 0.0.0.0:8531->8531/tcp, 0.0.0.0:8515-8516->8515-8516/udp, 9600/tcp   helk-logstash
84727ac3893c   docker.elastic.co/kibana/kibana:7.6.2                 "/usr/share/kibana/s…"   5 hours ago   Up 5 hours    5601/tcp                                                                                                                                                                                               helk-kibana
b0f7fbdb6eec   docker.elastic.co/elasticsearch/elasticsearch:7.6.2   "/usr/share/elastics…"   5 hours ago   Up 1 second   9200/tcp, 9300/tcp  

Provide the HELK installation logs located at /var/log/helk-install.log if you are having install errors

Successfully built 99f852a8f1bb
Successfully tagged docker_helk-jupyter:latest
Pulling helk-spark-master (otrf/helk-spark-master:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-master
Digest: sha256:1c3589bf181e5302153480b38e4e675afd1a29ef5d3fc6e31d9a33a566b95f18
Status: Downloaded newer image for otrf/helk-spark-master:2.4.5
Pulling helk-spark-worker (otrf/helk-spark-worker:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-worker
Digest: sha256:0c3e2f759d6f286dbf740dab6a74740eb1b173d41156d50c3e4a32ea7e5aa74c
Status: Downloaded newer image for otrf/helk-spark-worker:2.4.5
Creating helk-elasticsearch ... done
Creating helk-kibana        ... done
Creating helk-nginx         ... done
Creating helk-logstash      ... done
Creating helk-zookeeper     ... done
Creating helk-jupyter       ... done
Creating helk-spark-master  ... done
Creating helk-spark-worker  ... done
Creating helk-kafka-broker  ... done
Creating helk-ksql-server   ... done
Creating helk-ksql-cli      ... done
root@king-A780L3G:/home/king/HELK/docker# clear

root@king-A780L3G:/home/king/HELK/docker# cat /var/log/helk-install.log 
Hit:1 http://us.archive.ubuntu.com/ubuntu bionic InRelease
Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:4 http://us.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,499 kB]
Get:6 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,835 kB]
Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [888 kB]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [290 kB]
Get:9 http://security.ubuntu.com/ubuntu bionic-security/main amd64 DEP-11 Metadata [48.9 kB]
Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [970 kB]
Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,098 kB]
Get:12 http://us.archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,189 kB]
Get:13 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 DEP-11 Metadata [295 kB]
Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [245 kB]
Get:15 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 DEP-11 Metadata [59.5 kB]
Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 DEP-11 Metadata [2,464 B]
Get:17 http://us.archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,549 kB]
Get:18 http://us.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,700 kB]
Get:19 http://us.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 DEP-11 Metadata [288 kB]
Get:20 http://us.archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 DEP-11 Metadata [2,468 B]
Get:21 http://us.archive.ubuntu.com/ubuntu bionic-backports/universe amd64 DEP-11 Metadata [9,288 B]
Fetched 12.2 MB in 3s (3,859 kB/s)
Reading package lists...

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libapr1 libaprutil1
The following NEW packages will be installed:
  apache2-utils libapr1 libaprutil1
0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded.
Need to get 259 kB of archives.
After this operation, 866 kB of additional disk space will be used.
Get:1 http://us.archive.ubuntu.com/ubuntu bionic/main amd64 libapr1 amd64 1.6.3-2 [90.9 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu bionic/main amd64 libaprutil1 amd64 1.6.1-2 [84.4 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 apache2-utils amd64 2.4.29-1ubuntu4.14 [83.9 kB]
Fetched 259 kB in 0s (707 kB/s)
Selecting previously unselected package libapr1:amd64.
(Reading database ... 189511 files and directories currently installed.)
Preparing to unpack .../libapr1_1.6.3-2_amd64.deb ...
Unpacking libapr1:amd64 (1.6.3-2) ...
Selecting previously unselected package libaprutil1:amd64.
Preparing to unpack .../libaprutil1_1.6.1-2_amd64.deb ...
Unpacking libaprutil1:amd64 (1.6.1-2) ...
Selecting previously unselected package apache2-utils.
Preparing to unpack .../apache2-utils_2.4.29-1ubuntu4.14_amd64.deb ...
Unpacking apache2-utils (2.4.29-1ubuntu4.14) ...
Setting up libapr1:amd64 (1.6.3-2) ...
Setting up libaprutil1:amd64 (1.6.1-2) ...
Setting up apache2-utils (2.4.29-1ubuntu4.14) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
Adding password for user helk

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libcurl4
The following NEW packages will be installed:
  curl libcurl4
0 upgraded, 2 newly installed, 0 to remove and 1 not upgraded.
Need to get 373 kB of archives.
After this operation, 1,038 kB of additional disk space will be used.
Get:1 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 libcurl4 amd64 7.58.0-2ubuntu3.12 [214 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu bionic-updates/main amd64 curl amd64 7.58.0-2ubuntu3.12 [159 kB]
Fetched 373 kB in 0s (1,045 kB/s)
Selecting previously unselected package libcurl4:amd64.
(Reading database ... 189560 files and directories currently installed.)
Preparing to unpack .../libcurl4_7.58.0-2ubuntu3.12_amd64.deb ...
Unpacking libcurl4:amd64 (7.58.0-2ubuntu3.12) ...
Selecting previously unselected package curl.
Preparing to unpack .../curl_7.58.0-2ubuntu3.12_amd64.deb ...
Unpacking curl (7.58.0-2ubuntu3.12) ...
Setting up libcurl4:amd64 (7.58.0-2ubuntu3.12) ...
Setting up curl (7.58.0-2ubuntu3.12) ...
Processing triggers for man-db (2.8.3-2ubuntu0.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1.4) ...
# Executing docker install script, commit: 3d8fe77c2c46c5b7571f94b42793905e5b3e42e4
+ sh -c apt-get update -qq >/dev/null
+ sh -c DEBIAN_FRONTEND=noninteractive apt-get install -y -qq apt-transport-https ca-certificates curl >/dev/null
+ sh -c curl -fsSL "https://download.docker.com/linux/ubuntu/gpg" | apt-key add -qq - >/dev/null
Warning: apt-key output should not be parsed (stdout is not a terminal)
+ sh -c echo "deb [arch=amd64] https://download.docker.com/linux/ubuntu bionic stable" > /etc/apt/sources.list.d/docker.list
+ sh -c apt-get update -qq >/dev/null
+ [ -n  ]
+ sh -c apt-get install -y -qq --no-install-recommends docker-ce >/dev/null
+ sh -c docker version
Client: Docker Engine - Community
 Version:           20.10.2
 API version:       1.41
 Go version:        go1.13.15
 Git commit:        2291f61
 Built:             Mon Dec 28 16:17:32 2020
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.2
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.13.15
  Git commit:       8891c58
  Built:            Mon Dec 28 16:15:09 2020
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.4.3
  GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
 runc:
  Version:          1.0.0-rc92
  GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
If you would like to use Docker as a non-root user, you should now consider
adding your user to the "docker" group with something like:

  sudo usermod -aG docker your-user

Remember that you will have to log out and back in for this to take effect!

WARNING: Adding a user to the "docker" group will grant the ability to run
         containers which can be used to obtain root privileges on the
         docker host.
         Refer to https://docs.docker.com/engine/security/security/#docker-daemon-attack-surface
         for more information.
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   651  100   651    0     0   3898      0 --:--:-- --:--:-- --:--:--  3898
100 11.6M  100 11.6M    0     0  12.9M      0 --:--:-- --:--:-- --:--:-- 31.8M
Creating network "docker_helk" with driver "bridge"
Creating volume "docker_esdata" with local driver
Creating volume "docker_notebooks" with local driver
Pulling helk-elasticsearch (docker.elastic.co/elasticsearch/elasticsearch:7.6.2)...
7.6.2: Pulling from elasticsearch/elasticsearch
Digest: sha256:59342c577e2b7082b819654d119f42514ddf47f0699c8b54dc1f0150250ce7aa
Status: Downloaded newer image for docker.elastic.co/elasticsearch/elasticsearch:7.6.2
Pulling helk-kibana (docker.elastic.co/kibana/kibana:7.6.2)...
7.6.2: Pulling from kibana/kibana
Digest: sha256:e8f3743e404462709663422056db2d5076a7a6bd6024f64aea1599b3014c63be
Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.6.2
Pulling helk-logstash (otrf/helk-logstash:7.6.2.1)...
7.6.2.1: Pulling from otrf/helk-logstash
Digest: sha256:b1135da506f40fc1d5861db7ba844486f3a08a57af3fdb8e301ab487f51a2ac1
Status: Downloaded newer image for otrf/helk-logstash:7.6.2.1
Pulling helk-nginx (otrf/helk-nginx:0.3.0)...
0.3.0: Pulling from otrf/helk-nginx
Digest: sha256:32eb6e39681849dc3bed36cfb95bd39b25f8c66d08965b6855f64eb2ee0668ba
Status: Downloaded newer image for otrf/helk-nginx:0.3.0
Pulling helk-zookeeper (otrf/helk-zookeeper:2.4.0)...
2.4.0: Pulling from otrf/helk-zookeeper
Digest: sha256:d8a7c57c03384f5ce2b6125505c1f8e2a020432de81bde3677fcc8009fc5cfd2
Status: Downloaded newer image for otrf/helk-zookeeper:2.4.0
Pulling helk-kafka-broker (otrf/helk-kafka-broker:2.4.0)...
2.4.0: Pulling from otrf/helk-kafka-broker
Digest: sha256:22b87b2e2c97157471af3db8a19e85c9184fa492fa8cd67cc57617c6abec6dce
Status: Downloaded newer image for otrf/helk-kafka-broker:2.4.0
Pulling helk-ksql-server (confluentinc/cp-ksql-server:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-server
Digest: sha256:063add111cc93b1a0118f88b577e31303045d4cc08eb1d21458429f05cba4b02
Status: Downloaded newer image for confluentinc/cp-ksql-server:5.1.3
Pulling helk-ksql-cli (confluentinc/cp-ksql-cli:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-cli
Digest: sha256:18c0ccb00fbf87679e16e9e0da600548fcb236a2fd173263b09e89b2d3a42cc3
Status: Downloaded newer image for confluentinc/cp-ksql-cli:5.1.3
Building helk-jupyter
Step 1/17 : FROM cyb3rward0g/jupyter-hunter:0.0.9
0.0.9: Pulling from cyb3rward0g/jupyter-hunter
Digest: sha256:2f4addd5a42afd3857bff0593fa969f6d0f08e44aa5942d96e5ccf0b61203fd5
Status: Downloaded newer image for cyb3rward0g/jupyter-hunter:0.0.9
 ---> b06921bea109
Step 2/17 : LABEL maintainer="Roberto Rodriguez @Cyb3rWard0g"
 ---> Running in b3a2c31a269c
Removing intermediate container b3a2c31a269c
 ---> b3dcbbe6b343
Step 3/17 : LABEL description="Dockerfile Notebooks-Forge Jupyter-Hunt Project."
 ---> Running in 599f0a697b29
Removing intermediate container 599f0a697b29
 ---> 2eddf312f803
Step 4/17 : ENV DEBIAN_FRONTEND noninteractive
 ---> Running in fa149d3c9372
Removing intermediate container fa149d3c9372
 ---> 44e2598bf513
Step 5/17 : USER root
 ---> Running in 7239c43828c8
Removing intermediate container 7239c43828c8
 ---> 871e36905028
Step 6/17 : ENV POSTGRESQL_VERSION=42.2.9
 ---> Running in 1f91faa5a4be
Removing intermediate container 1f91faa5a4be
 ---> c21fcf59e2fa
Step 7/17 : RUN mkdir /opt/jupyter/notebooks/datasets     && apt-get update --fix-missing && apt-get install -y --no-install-recommends     postgresql postgresql-contrib     && apt-get -qy clean autoremove     && rm -rf /var/lib/apt/lists/*     && wget https://jdbc.postgresql.org/download/postgresql-${POSTGRESQL_VERSION}.jar -P /opt/jupyter/spark/jars/
 ---> Running in 3f6e3f68a538
Get:1 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:4 http://security.ubuntu.com/ubuntu bionic-security/main Sources [306 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic/universe Sources [11.5 MB]
Get:7 http://security.ubuntu.com/ubuntu bionic-security/multiverse Sources [4361 B]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Sources [15.4 kB]
Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe Sources [340 kB]
Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [278 kB]
Get:11 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [14.9 kB]
Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1376 kB]
Get:13 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1872 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic/main Sources [1063 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic/restricted Sources [5823 B]
Get:16 http://archive.ubuntu.com/ubuntu bionic/multiverse Sources [216 kB]
Get:17 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:19 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe Sources [559 kB]
Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Sources [12.7 kB]
Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Sources [19.8 kB]
Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main Sources [628 kB]
Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2140 kB]
Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2298 kB]
Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [45.6 kB]
Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [304 kB]
Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/universe Sources [5759 B]
Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/main Sources [5823 B]
Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [11.4 kB]
Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [11.3 kB]
Fetched 36.4 MB in 4s (8606 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libicu60 libpq5 libxml2 libxslt1.1 netbase postgresql-10
  postgresql-client-10 postgresql-client-common postgresql-common ssl-cert
  tzdata
Suggested packages:
  postgresql-doc locales-all postgresql-doc-10 libjson-perl openssl-blacklist
Recommended packages:
  sysstat
The following NEW packages will be installed:
  libicu60 libpq5 libxml2 libxslt1.1 netbase postgresql postgresql-10
  postgresql-client-10 postgresql-client-common postgresql-common
  postgresql-contrib ssl-cert tzdata
0 upgraded, 13 newly installed, 0 to remove and 112 not upgraded.
Need to get 14.1 MB of archives.
After this operation, 57.2 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libicu60 amd64 60.2-3ubuntu3.1 [8054 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxml2 amd64 2.9.4+dfsg1-6.1ubuntu1.3 [663 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 netbase all 5.4 [12.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 tzdata all 2020f-0ubuntu0.18.04 [190 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpq5 amd64 10.15-0ubuntu0.18.04.1 [108 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-common all 190ubuntu0.1 [29.6 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-10 amd64 10.15-0ubuntu0.18.04.1 [939 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 ssl-cert all 1.0.39 [17.0 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-common all 190ubuntu0.1 [157 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-10 amd64 10.15-0ubuntu0.18.04.1 [3766 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql all 10+190ubuntu0.1 [5884 B]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-contrib all 10+190ubuntu0.1 [5896 B]
Preconfiguring packages ...
Fetched 14.1 MB in 2s (8442 kB/s)
Selecting previously unselected package libicu60:amd64.
(Reading database ... 13830 files and directories currently installed.)
Preparing to unpack .../00-libicu60_60.2-3ubuntu3.1_amd64.deb ...
Unpacking libicu60:amd64 (60.2-3ubuntu3.1) ...
Selecting previously unselected package libxml2:amd64.
Preparing to unpack .../01-libxml2_2.9.4+dfsg1-6.1ubuntu1.3_amd64.deb ...
Unpacking libxml2:amd64 (2.9.4+dfsg1-6.1ubuntu1.3) ...
Selecting previously unselected package netbase.
Preparing to unpack .../02-netbase_5.4_all.deb ...
Unpacking netbase (5.4) ...
Selecting previously unselected package tzdata.
Preparing to unpack .../03-tzdata_2020f-0ubuntu0.18.04_all.deb ...
Unpacking tzdata (2020f-0ubuntu0.18.04) ...
Selecting previously unselected package libpq5:amd64.
Preparing to unpack .../04-libpq5_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking libpq5:amd64 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package libxslt1.1:amd64.
Preparing to unpack .../05-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ...
Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ...
Selecting previously unselected package postgresql-client-common.
Preparing to unpack .../06-postgresql-client-common_190ubuntu0.1_all.deb ...
Unpacking postgresql-client-common (190ubuntu0.1) ...
Selecting previously unselected package postgresql-client-10.
Preparing to unpack .../07-postgresql-client-10_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking postgresql-client-10 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package ssl-cert.
Preparing to unpack .../08-ssl-cert_1.0.39_all.deb ...
Unpacking ssl-cert (1.0.39) ...
Selecting previously unselected package postgresql-common.
Preparing to unpack .../09-postgresql-common_190ubuntu0.1_all.deb ...
Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common'
Unpacking postgresql-common (190ubuntu0.1) ...
Selecting previously unselected package postgresql-10.
Preparing to unpack .../10-postgresql-10_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking postgresql-10 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package postgresql.
Preparing to unpack .../11-postgresql_10+190ubuntu0.1_all.deb ...
Unpacking postgresql (10+190ubuntu0.1) ...
Selecting previously unselected package postgresql-contrib.
Preparing to unpack .../12-postgresql-contrib_10+190ubuntu0.1_all.deb ...
Unpacking postgresql-contrib (10+190ubuntu0.1) ...
Setting up libicu60:amd64 (60.2-3ubuntu3.1) ...
Setting up tzdata (2020f-0ubuntu0.18.04) ...

Current default time zone: 'Etc/UTC'
Local time is now:      Thu Jan 14 03:28:19 UTC 2021.
Universal Time is now:  Thu Jan 14 03:28:19 UTC 2021.
Run 'dpkg-reconfigure tzdata' if you wish to change it.

Setting up ssl-cert (1.0.39) ...
Setting up libxml2:amd64 (2.9.4+dfsg1-6.1ubuntu1.3) ...
Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ...
Setting up libpq5:amd64 (10.15-0ubuntu0.18.04.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up netbase (5.4) ...
Setting up postgresql-client-common (190ubuntu0.1) ...
Setting up postgresql-common (190ubuntu0.1) ...
Adding user postgres to group ssl-cert

Creating config file /etc/postgresql-common/createcluster.conf with new version
Building PostgreSQL dictionaries from installed myspell/hunspell packages...
Removing obsolete dictionary files:
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up postgresql-client-10 (10.15-0ubuntu0.18.04.1) ...
update-alternatives: using /usr/share/postgresql/10/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode
Setting up postgresql-10 (10.15-0ubuntu0.18.04.1) ...
Creating new PostgreSQL cluster 10/main ...
/usr/lib/postgresql/10/bin/initdb -D /var/lib/postgresql/10/main --auth-local peer --auth-host md5
The files belonging to this database system will be owned by user "postgres".
This user must also own the server process.

The database cluster will be initialized with locale "en_US.UTF-8".
The default database encoding has accordingly been set to "UTF8".
The default text search configuration will be set to "english".

Data page checksums are disabled.

fixing permissions on existing directory /var/lib/postgresql/10/main ... ok
creating subdirectories ... ok
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default timezone ... Etc/UTC
selecting dynamic shared memory implementation ... posix
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

Success. You can now start the database server using:

    /usr/lib/postgresql/10/bin/pg_ctl -D /var/lib/postgresql/10/main -l logfile start

Ver Cluster Port Status Owner    Data directory              Log file
10  main    5432 down   postgres /var/lib/postgresql/10/main /var/log/postgresql/postgresql-10-main.log
update-alternatives: using /usr/share/postgresql/10/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up postgresql (10+190ubuntu0.1) ...
Setting up postgresql-contrib (10+190ubuntu0.1) ...
--2021-01-14 03:29:00--  https://jdbc.postgresql.org/download/postgresql-42.2.9.jar
Resolving jdbc.postgresql.org (jdbc.postgresql.org)... 72.32.157.228, 2001:4800:3e1:1::228
Connecting to jdbc.postgresql.org (jdbc.postgresql.org)|72.32.157.228|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 914037 (893K) [application/java-archive]
Saving to: ‘/opt/jupyter/spark/jars/postgresql-42.2.9.jar’

     0K .......... .......... .......... .......... ..........  5% 7.76M 0s
    50K .......... .......... .......... .......... .......... 11% 6.58M 0s
   100K .......... .......... .......... .......... .......... 16% 18.2M 0s
   150K .......... .......... .......... .......... .......... 22% 7.01M 0s
   200K .......... .......... .......... .......... .......... 28% 33.8M 0s
   250K .......... .......... .......... .......... .......... 33% 33.7M 0s
   300K .......... .......... .......... .......... .......... 39% 20.6M 0s
   350K .......... .......... .......... .......... .......... 44% 16.1M 0s
   400K .......... .......... .......... .......... .......... 50% 41.1M 0s
   450K .......... .......... .......... .......... .......... 56% 25.3M 0s
   500K .......... .......... .......... .......... .......... 61% 40.4M 0s
   550K .......... .......... .......... .......... .......... 67% 40.4M 0s
   600K .......... .......... .......... .......... .......... 72% 41.4M 0s
   650K .......... .......... .......... .......... .......... 78% 46.6M 0s
   700K .......... .......... .......... .......... .......... 84% 50.1M 0s
   750K .......... .......... .......... .......... .......... 89% 40.0M 0s
   800K .......... .......... .......... .......... .......... 95% 51.6M 0s
   850K .......... .......... .......... .......... ..        100% 66.1M=0.04s

2021-01-14 03:29:01 (20.2 MB/s) - ‘/opt/jupyter/spark/jars/postgresql-42.2.9.jar’ saved [914037/914037]

Removing intermediate container 3f6e3f68a538
 ---> a9406f351589
Step 8/17 : COPY notebooks/demos ${JUPYTER_DIR}/notebooks/demos
 ---> 0902e54ab228
Step 9/17 : COPY notebooks/tutorials ${JUPYTER_DIR}/notebooks/tutorials
 ---> cac77892dc1d
Step 10/17 : COPY notebooks/sigma ${JUPYTER_DIR}/notebooks/sigma
 ---> bf7711052112
Step 11/17 : COPY spark/* ${SPARK_HOME}/conf/
 ---> 0986b5ddbba6
Step 12/17 : COPY scripts/* ${JUPYTER_DIR}/scripts/
 ---> 9e4a0c98e87e
Step 13/17 : RUN chown -R ${USER} ${JUPYTER_DIR} ${HOME} ${SPARK_HOME}     && chown ${USER} /run/postgresql
 ---> Running in 8dc35d4f8b29
Removing intermediate container 8dc35d4f8b29
 ---> 17d1890272d5
Step 14/17 : WORKDIR ${HOME}
 ---> Running in c0917496fe11
Removing intermediate container c0917496fe11
 ---> 87ef33e2ca90
Step 15/17 : ENTRYPOINT ["/opt/jupyter/scripts/jupyter-entrypoint.sh"]
 ---> Running in 4063fda015d7
Removing intermediate container 4063fda015d7
 ---> 82d826660af7
Step 16/17 : CMD ["/opt/jupyter/scripts/jupyter-cmd.sh"]
 ---> Running in 8dff571906a7
Removing intermediate container 8dff571906a7
 ---> 11bf01f6a4e2
Step 17/17 : USER ${USER}
 ---> Running in 01a190146823
Removing intermediate container 01a190146823
 ---> 1eb161765804

Successfully built 1eb161765804
Successfully tagged docker_helk-jupyter:latest
Pulling helk-spark-master (otrf/helk-spark-master:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-master
Digest: sha256:1c3589bf181e5302153480b38e4e675afd1a29ef5d3fc6e31d9a33a566b95f18
Status: Downloaded newer image for otrf/helk-spark-master:2.4.5
Pulling helk-spark-worker (otrf/helk-spark-worker:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-worker
Digest: sha256:0c3e2f759d6f286dbf740dab6a74740eb1b173d41156d50c3e4a32ea7e5aa74c
Status: Downloaded newer image for otrf/helk-spark-worker:2.4.5
Creating helk-elasticsearch ... done
Creating helk-kibana        ... done
Creating helk-logstash      ... done
Creating helk-nginx         ... done
Creating helk-jupyter       ... done
Creating helk-zookeeper     ... done
Creating helk-spark-master  ... done
Creating helk-kafka-broker  ... done
Creating helk-spark-worker  ... done
Creating helk-ksql-server   ... done
Creating helk-ksql-cli      ... done
The ADVERTISED_LISTENER variable is not set. Defaulting to a blank string.
Stopping helk-ksql-cli      ... done
Stopping helk-ksql-server   ... done
Stopping helk-spark-worker  ... done
Stopping helk-kafka-broker  ... done
Stopping helk-zookeeper     ... done
Stopping helk-jupyter       ... done
Stopping helk-spark-master  ... done
Stopping helk-logstash      ... done
Stopping helk-nginx         ... done
Stopping helk-kibana        ... done
Stopping helk-elasticsearch ... done
Removing helk-ksql-cli      ... done
Removing helk-ksql-server   ... done
Removing helk-spark-worker  ... done
Removing helk-kafka-broker  ... done
Removing helk-zookeeper     ... done
Removing helk-jupyter       ... done
Removing helk-spark-master  ... done
Removing helk-logstash      ... done
Removing helk-nginx         ... done
Removing helk-kibana        ... done
Removing helk-elasticsearch ... done
Removing network docker_helk
Removing volume docker_esdata
Removing volume docker_notebooks
Removing image docker.elastic.co/elasticsearch/elasticsearch:7.6.2
Removing image docker.elastic.co/kibana/kibana:7.6.2
Removing image otrf/helk-logstash:7.6.2.1
Removing image otrf/helk-nginx:0.3.0
Removing image otrf/helk-zookeeper:2.4.0
Removing image otrf/helk-kafka-broker:2.4.0
Removing image confluentinc/cp-ksql-server:5.1.3
Removing image confluentinc/cp-ksql-cli:5.1.3
Removing image docker_helk-jupyter
Removing image otrf/helk-spark-master:2.4.5
Removing image otrf/helk-spark-worker:2.4.5
Untagged: cyb3rward0g/jupyter-hunter:0.0.9
Untagged: cyb3rward0g/jupyter-hunter@sha256:2f4addd5a42afd3857bff0593fa969f6d0f08e44aa5942d96e5ccf0b61203fd5
Deleted: sha256:b06921bea109c478267d7053779085b700adb1d42ff26724216d66c45f488595
Deleted: sha256:fc691b7cf48b119525fe3eeb16a4a1c603bb773491d44e307b5ae1ab29c867ed
Deleted: sha256:27f14d57032c1a0523f61a5ae8905395cccf1bf55047e59af94c8d51d1a2c92f
Deleted: sha256:7bd1f272f778ffdfe5a18ac57e18fa4f327638406a3c3d4f665eb6f06a599305
Deleted: sha256:64e0af12a44405122ebafd2a6f44d811f152b6cee8455c87bd4ff226b17fd9c2
Deleted: sha256:e3934f9224978038239bc7aefe5e817f227796c2b0b50364bf79e13d3aef5398
Deleted: sha256:e5fe9aeac479024529db696cea32af916f678c1541a6a2b992206d9e6ee6ed9b
Deleted: sha256:2e65bcc79de0991a5048e137002b8ef09058709646024266e0e199cf972d25b5
Deleted: sha256:a2bb858b967a4647fd232a3d00d7b1e15d2659b3c53e30413606bbac09b821ea
Deleted: sha256:eeb3562505d52abd387dbd912b51e493d1de99a9582960548257ce716dde33e9
Deleted: sha256:d2f1d22f3e1f13d54d10abc832eddc3821acde4fbd844eeade255b6a2e926f4f
Deleted: sha256:d03c684c7dd711982dddd1ab0e622440c45d27b5d015020e0aef65be0c2e7c9b
Deleted: sha256:63eed5473967cb9a5a4c98a5b1d2b6013d368bf88836aab99b5c5178c8f2f51f
Deleted: sha256:86267d11f0c14fca869691b9b32bdd610b6ab8d9033d59ee64bdcc2cf0219bce
Deleted: sha256:d9a8b3f912eee0b322b86fa0f6888558a468c384611c71178987b20e3a0ebafc
Deleted: sha256:4e627d1476f22151f05e5214147d6cc6e03ad79a082f01aca6560aa75c7ade3a
Deleted: sha256:757b76a12baba45fcbe76abbdd99723be9d94c12a2ad40354dc49ff5fbe1f5c1
Deleted: sha256:f49017d4d5ce9c0f544c82ed5cbc0672fbcb593be77f954891b22b4d0d4c0a84
Adding password for user helk
Creating network "docker_helk" with driver "bridge"
Creating volume "docker_esdata" with local driver
Creating volume "docker_notebooks" with local driver
Pulling helk-elasticsearch (docker.elastic.co/elasticsearch/elasticsearch:7.6.2)...
7.6.2: Pulling from elasticsearch/elasticsearch
Digest: sha256:59342c577e2b7082b819654d119f42514ddf47f0699c8b54dc1f0150250ce7aa
Status: Downloaded newer image for docker.elastic.co/elasticsearch/elasticsearch:7.6.2
Pulling helk-kibana (docker.elastic.co/kibana/kibana:7.6.2)...
7.6.2: Pulling from kibana/kibana
Digest: sha256:e8f3743e404462709663422056db2d5076a7a6bd6024f64aea1599b3014c63be
Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.6.2
Pulling helk-logstash (otrf/helk-logstash:7.6.2.1)...
7.6.2.1: Pulling from otrf/helk-logstash
Digest: sha256:b1135da506f40fc1d5861db7ba844486f3a08a57af3fdb8e301ab487f51a2ac1
Status: Downloaded newer image for otrf/helk-logstash:7.6.2.1
Pulling helk-nginx (otrf/helk-nginx:0.3.0)...
0.3.0: Pulling from otrf/helk-nginx
Digest: sha256:32eb6e39681849dc3bed36cfb95bd39b25f8c66d08965b6855f64eb2ee0668ba
Status: Downloaded newer image for otrf/helk-nginx:0.3.0
Pulling helk-zookeeper (otrf/helk-zookeeper:2.4.0)...
2.4.0: Pulling from otrf/helk-zookeeper
Digest: sha256:d8a7c57c03384f5ce2b6125505c1f8e2a020432de81bde3677fcc8009fc5cfd2
Status: Downloaded newer image for otrf/helk-zookeeper:2.4.0
Pulling helk-kafka-broker (otrf/helk-kafka-broker:2.4.0)...
2.4.0: Pulling from otrf/helk-kafka-broker
Digest: sha256:22b87b2e2c97157471af3db8a19e85c9184fa492fa8cd67cc57617c6abec6dce
Status: Downloaded newer image for otrf/helk-kafka-broker:2.4.0
Pulling helk-ksql-server (confluentinc/cp-ksql-server:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-server
Digest: sha256:063add111cc93b1a0118f88b577e31303045d4cc08eb1d21458429f05cba4b02
Status: Downloaded newer image for confluentinc/cp-ksql-server:5.1.3
Pulling helk-ksql-cli (confluentinc/cp-ksql-cli:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-cli
Digest: sha256:18c0ccb00fbf87679e16e9e0da600548fcb236a2fd173263b09e89b2d3a42cc3
Status: Downloaded newer image for confluentinc/cp-ksql-cli:5.1.3
Building helk-jupyter
Step 1/17 : FROM cyb3rward0g/jupyter-hunter:0.0.9
0.0.9: Pulling from cyb3rward0g/jupyter-hunter
Digest: sha256:2f4addd5a42afd3857bff0593fa969f6d0f08e44aa5942d96e5ccf0b61203fd5
Status: Downloaded newer image for cyb3rward0g/jupyter-hunter:0.0.9
 ---> b06921bea109
Step 2/17 : LABEL maintainer="Roberto Rodriguez @Cyb3rWard0g"
 ---> Running in 1f11c520e5fc
Removing intermediate container 1f11c520e5fc
 ---> fec984bb6f7b
Step 3/17 : LABEL description="Dockerfile Notebooks-Forge Jupyter-Hunt Project."
 ---> Running in 022a401e3d0d
Removing intermediate container 022a401e3d0d
 ---> b93797b832ac
Step 4/17 : ENV DEBIAN_FRONTEND noninteractive
 ---> Running in b5eb6e34662b
Removing intermediate container b5eb6e34662b
 ---> 3f905aa2611a
Step 5/17 : USER root
 ---> Running in a7dc8cac765d
Removing intermediate container a7dc8cac765d
 ---> 42cc3be10e9c
Step 6/17 : ENV POSTGRESQL_VERSION=42.2.9
 ---> Running in 08c7c8b09634
Removing intermediate container 08c7c8b09634
 ---> cd817b3061d3
Step 7/17 : RUN mkdir /opt/jupyter/notebooks/datasets     && apt-get update --fix-missing && apt-get install -y --no-install-recommends     postgresql postgresql-contrib     && apt-get -qy clean autoremove     && rm -rf /var/lib/apt/lists/*     && wget https://jdbc.postgresql.org/download/postgresql-${POSTGRESQL_VERSION}.jar -P /opt/jupyter/spark/jars/
 ---> Running in 13414549d2fc
Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:3 http://security.ubuntu.com/ubuntu bionic-security/main Sources [306 kB]
Get:4 http://security.ubuntu.com/ubuntu bionic-security/restricted Sources [15.4 kB]
Get:5 http://security.ubuntu.com/ubuntu bionic-security/universe Sources [340 kB]
Get:6 http://security.ubuntu.com/ubuntu bionic-security/multiverse Sources [4361 B]
Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [278 kB]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [14.9 kB]
Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1376 kB]
Get:10 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1872 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic/universe Sources [11.5 MB]
Get:14 http://archive.ubuntu.com/ubuntu bionic/restricted Sources [5823 B]
Get:15 http://archive.ubuntu.com/ubuntu bionic/main Sources [1063 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic/multiverse Sources [216 kB]
Get:17 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:18 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Sources [12.7 kB]
Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/main Sources [628 kB]
Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Sources [19.8 kB]
Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe Sources [559 kB]
Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [45.6 kB]
Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [309 kB]
Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2140 kB]
Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2307 kB]
Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/universe Sources [5759 B]
Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/main Sources [5823 B]
Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [11.4 kB]
Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [11.3 kB]
Fetched 36.4 MB in 4s (8390 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libicu60 libpq5 libxml2 libxslt1.1 netbase postgresql-10
  postgresql-client-10 postgresql-client-common postgresql-common ssl-cert
  tzdata
Suggested packages:
  postgresql-doc locales-all postgresql-doc-10 libjson-perl openssl-blacklist
Recommended packages:
  sysstat
The following NEW packages will be installed:
  libicu60 libpq5 libxml2 libxslt1.1 netbase postgresql postgresql-10
  postgresql-client-10 postgresql-client-common postgresql-common
  postgresql-contrib ssl-cert tzdata
0 upgraded, 13 newly installed, 0 to remove and 112 not upgraded.
Need to get 14.1 MB of archives.
After this operation, 57.2 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libicu60 amd64 60.2-3ubuntu3.1 [8054 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxml2 amd64 2.9.4+dfsg1-6.1ubuntu1.3 [663 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 netbase all 5.4 [12.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 tzdata all 2020f-0ubuntu0.18.04 [190 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpq5 amd64 10.15-0ubuntu0.18.04.1 [108 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-common all 190ubuntu0.1 [29.6 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-10 amd64 10.15-0ubuntu0.18.04.1 [939 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 ssl-cert all 1.0.39 [17.0 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-common all 190ubuntu0.1 [157 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-10 amd64 10.15-0ubuntu0.18.04.1 [3766 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql all 10+190ubuntu0.1 [5884 B]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-contrib all 10+190ubuntu0.1 [5896 B]
Preconfiguring packages ...
Fetched 14.1 MB in 2s (8307 kB/s)
Selecting previously unselected package libicu60:amd64.
(Reading database ... 13830 files and directories currently installed.)
Preparing to unpack .../00-libicu60_60.2-3ubuntu3.1_amd64.deb ...
Unpacking libicu60:amd64 (60.2-3ubuntu3.1) ...
Selecting previously unselected package libxml2:amd64.
Preparing to unpack .../01-libxml2_2.9.4+dfsg1-6.1ubuntu1.3_amd64.deb ...
Unpacking libxml2:amd64 (2.9.4+dfsg1-6.1ubuntu1.3) ...
Selecting previously unselected package netbase.
Preparing to unpack .../02-netbase_5.4_all.deb ...
Unpacking netbase (5.4) ...
Selecting previously unselected package tzdata.
Preparing to unpack .../03-tzdata_2020f-0ubuntu0.18.04_all.deb ...
Unpacking tzdata (2020f-0ubuntu0.18.04) ...
Selecting previously unselected package libpq5:amd64.
Preparing to unpack .../04-libpq5_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking libpq5:amd64 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package libxslt1.1:amd64.
Preparing to unpack .../05-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ...
Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ...
Selecting previously unselected package postgresql-client-common.
Preparing to unpack .../06-postgresql-client-common_190ubuntu0.1_all.deb ...
Unpacking postgresql-client-common (190ubuntu0.1) ...
Selecting previously unselected package postgresql-client-10.
Preparing to unpack .../07-postgresql-client-10_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking postgresql-client-10 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package ssl-cert.
Preparing to unpack .../08-ssl-cert_1.0.39_all.deb ...
Unpacking ssl-cert (1.0.39) ...
Selecting previously unselected package postgresql-common.
Preparing to unpack .../09-postgresql-common_190ubuntu0.1_all.deb ...
Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common'
Unpacking postgresql-common (190ubuntu0.1) ...
Selecting previously unselected package postgresql-10.
Preparing to unpack .../10-postgresql-10_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking postgresql-10 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package postgresql.
Preparing to unpack .../11-postgresql_10+190ubuntu0.1_all.deb ...
Unpacking postgresql (10+190ubuntu0.1) ...
Selecting previously unselected package postgresql-contrib.
Preparing to unpack .../12-postgresql-contrib_10+190ubuntu0.1_all.deb ...
Unpacking postgresql-contrib (10+190ubuntu0.1) ...
Setting up libicu60:amd64 (60.2-3ubuntu3.1) ...
Setting up tzdata (2020f-0ubuntu0.18.04) ...

Current default time zone: 'Etc/UTC'
Local time is now:      Thu Jan 14 15:53:22 UTC 2021.
Universal Time is now:  Thu Jan 14 15:53:22 UTC 2021.
Run 'dpkg-reconfigure tzdata' if you wish to change it.

Setting up ssl-cert (1.0.39) ...
Setting up libxml2:amd64 (2.9.4+dfsg1-6.1ubuntu1.3) ...
Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ...
Setting up libpq5:amd64 (10.15-0ubuntu0.18.04.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up netbase (5.4) ...
Setting up postgresql-client-common (190ubuntu0.1) ...
Setting up postgresql-common (190ubuntu0.1) ...
Adding user postgres to group ssl-cert

Creating config file /etc/postgresql-common/createcluster.conf with new version
Building PostgreSQL dictionaries from installed myspell/hunspell packages...
Removing obsolete dictionary files:
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up postgresql-client-10 (10.15-0ubuntu0.18.04.1) ...
update-alternatives: using /usr/share/postgresql/10/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode
Setting up postgresql-10 (10.15-0ubuntu0.18.04.1) ...
Creating new PostgreSQL cluster 10/main ...
/usr/lib/postgresql/10/bin/initdb -D /var/lib/postgresql/10/main --auth-local peer --auth-host md5
The files belonging to this database system will be owned by user "postgres".
This user must also own the server process.

The database cluster will be initialized with locale "en_US.UTF-8".
The default database encoding has accordingly been set to "UTF8".
The default text search configuration will be set to "english".

Data page checksums are disabled.

fixing permissions on existing directory /var/lib/postgresql/10/main ... ok
creating subdirectories ... ok
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default timezone ... Etc/UTC
selecting dynamic shared memory implementation ... posix
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

Success. You can now start the database server using:

    /usr/lib/postgresql/10/bin/pg_ctl -D /var/lib/postgresql/10/main -l logfile start

Ver Cluster Port Status Owner    Data directory              Log file
10  main    5432 down   postgres /var/lib/postgresql/10/main /var/log/postgresql/postgresql-10-main.log
update-alternatives: using /usr/share/postgresql/10/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up postgresql (10+190ubuntu0.1) ...
Setting up postgresql-contrib (10+190ubuntu0.1) ...
--2021-01-14 15:54:04--  https://jdbc.postgresql.org/download/postgresql-42.2.9.jar
Resolving jdbc.postgresql.org (jdbc.postgresql.org)... 72.32.157.228, 2001:4800:3e1:1::228
Connecting to jdbc.postgresql.org (jdbc.postgresql.org)|72.32.157.228|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 914037 (893K) [application/java-archive]
Saving to: ‘/opt/jupyter/spark/jars/postgresql-42.2.9.jar’

     0K .......... .......... .......... .......... ..........  5% 6.43M 0s
    50K .......... .......... .......... .......... .......... 11% 5.30M 0s
   100K .......... .......... .......... .......... .......... 16% 32.8M 0s
   150K .......... .......... .......... .......... .......... 22% 6.28M 0s
   200K .......... .......... .......... .......... .......... 28% 40.6M 0s
   250K .......... .......... .......... .......... .......... 33% 41.5M 0s
   300K .......... .......... .......... .......... .......... 39% 8.01M 0s
   350K .......... .......... .......... .......... .......... 44% 30.0M 0s
   400K .......... .......... .......... .......... .......... 50% 40.0M 0s
   450K .......... .......... .......... .......... .......... 56% 40.8M 0s
   500K .......... .......... .......... .......... .......... 61% 41.4M 0s
   550K .......... .......... .......... .......... .......... 67% 39.4M 0s
   600K .......... .......... .......... .......... .......... 72% 38.4M 0s
   650K .......... .......... .......... .......... .......... 78% 30.5M 0s
   700K .......... .......... .......... .......... .......... 84% 38.3M 0s
   750K .......... .......... .......... .......... .......... 89% 31.7M 0s
   800K .......... .......... .......... .......... .......... 95% 41.9M 0s
   850K .......... .......... .......... .......... ..        100% 55.9M=0.05s

2021-01-14 15:54:04 (17.9 MB/s) - ‘/opt/jupyter/spark/jars/postgresql-42.2.9.jar’ saved [914037/914037]

Removing intermediate container 13414549d2fc
 ---> 4b052ff9d0cf
Step 8/17 : COPY notebooks/demos ${JUPYTER_DIR}/notebooks/demos
 ---> 9aaf791b8811
Step 9/17 : COPY notebooks/tutorials ${JUPYTER_DIR}/notebooks/tutorials
 ---> e106788d1f2a
Step 10/17 : COPY notebooks/sigma ${JUPYTER_DIR}/notebooks/sigma
 ---> 83431500d540
Step 11/17 : COPY spark/* ${SPARK_HOME}/conf/
 ---> 757929a96e53
Step 12/17 : COPY scripts/* ${JUPYTER_DIR}/scripts/
 ---> c636dcd67262
Step 13/17 : RUN chown -R ${USER} ${JUPYTER_DIR} ${HOME} ${SPARK_HOME}     && chown ${USER} /run/postgresql
 ---> Running in deb1a297363c
Removing intermediate container deb1a297363c
 ---> de77558e2b82
Step 14/17 : WORKDIR ${HOME}
 ---> Running in c78aadb4dc57
Removing intermediate container c78aadb4dc57
 ---> 4a6e5da05a94
Step 15/17 : ENTRYPOINT ["/opt/jupyter/scripts/jupyter-entrypoint.sh"]
 ---> Running in 064836f97152
Removing intermediate container 064836f97152
 ---> d52164fbca05
Step 16/17 : CMD ["/opt/jupyter/scripts/jupyter-cmd.sh"]
 ---> Running in e4ba71ee2a6f
Removing intermediate container e4ba71ee2a6f
 ---> c859a0c27894
Step 17/17 : USER ${USER}
 ---> Running in a4caf477aa3a
Removing intermediate container a4caf477aa3a
 ---> 649b945b17af

Successfully built 649b945b17af
Successfully tagged docker_helk-jupyter:latest
Pulling helk-spark-master (otrf/helk-spark-master:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-master
Digest: sha256:1c3589bf181e5302153480b38e4e675afd1a29ef5d3fc6e31d9a33a566b95f18
Status: Downloaded newer image for otrf/helk-spark-master:2.4.5
Pulling helk-spark-worker (otrf/helk-spark-worker:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-worker
Digest: sha256:0c3e2f759d6f286dbf740dab6a74740eb1b173d41156d50c3e4a32ea7e5aa74c
Status: Downloaded newer image for otrf/helk-spark-worker:2.4.5
Pulling helk-elastalert (otrf/helk-elastalert:latest)...
latest: Pulling from otrf/helk-elastalert
Digest: sha256:689fba01b8b238c7a5a0e41b20f1990318c74c0102c6178189baa28037c5c8a7
Status: Downloaded newer image for otrf/helk-elastalert:latest
Creating helk-elasticsearch ... done
Creating helk-kibana        ... done
Creating helk-nginx         ... done
Creating helk-logstash      ... done
Creating helk-elastalert    ... done
Creating helk-zookeeper     ... done
Creating helk-spark-master  ... done
Creating helk-jupyter       ... done
Creating helk-kafka-broker  ... done
Creating helk-spark-worker  ... done
Creating helk-ksql-server   ... done
Creating helk-ksql-cli      ... done
The ADVERTISED_LISTENER variable is not set. Defaulting to a blank string.
Stopping helk-ksql-cli      ... done
Stopping helk-ksql-server   ... done
Stopping helk-spark-worker  ... done
Stopping helk-kafka-broker  ... done
Stopping helk-jupyter       ... done
Stopping helk-spark-master  ... done
Stopping helk-zookeeper     ... done
Stopping helk-elastalert    ... done
Stopping helk-logstash      ... done
Stopping helk-nginx         ... done
Stopping helk-kibana        ... done
Stopping helk-elasticsearch ... done
Removing helk-ksql-cli      ... done
Removing helk-ksql-server   ... done
Removing helk-spark-worker  ... done
Removing helk-kafka-broker  ... done
Removing helk-jupyter       ... done
Removing helk-spark-master  ... done
Removing helk-zookeeper     ... done
Removing helk-elastalert    ... done
Removing helk-logstash      ... done
Removing helk-nginx         ... done
Removing helk-kibana        ... done
Removing helk-elasticsearch ... done
Removing network docker_helk
Removing volume docker_esdata
Removing volume docker_notebooks
Removing image docker.elastic.co/elasticsearch/elasticsearch:7.6.2
Removing image docker.elastic.co/kibana/kibana:7.6.2
Removing image otrf/helk-logstash:7.6.2.1
Removing image otrf/helk-nginx:0.3.0
Removing image otrf/helk-zookeeper:2.4.0
Removing image otrf/helk-kafka-broker:2.4.0
Removing image confluentinc/cp-ksql-server:5.1.3
Removing image confluentinc/cp-ksql-cli:5.1.3
Removing image docker_helk-jupyter
Removing image otrf/helk-spark-master:2.4.5
Removing image otrf/helk-spark-worker:2.4.5
Removing image otrf/helk-elastalert:latest
Untagged: cyb3rward0g/jupyter-hunter:0.0.9
Untagged: cyb3rward0g/jupyter-hunter@sha256:2f4addd5a42afd3857bff0593fa969f6d0f08e44aa5942d96e5ccf0b61203fd5
Deleted: sha256:b06921bea109c478267d7053779085b700adb1d42ff26724216d66c45f488595
Deleted: sha256:fc691b7cf48b119525fe3eeb16a4a1c603bb773491d44e307b5ae1ab29c867ed
Deleted: sha256:27f14d57032c1a0523f61a5ae8905395cccf1bf55047e59af94c8d51d1a2c92f
Deleted: sha256:7bd1f272f778ffdfe5a18ac57e18fa4f327638406a3c3d4f665eb6f06a599305
Deleted: sha256:64e0af12a44405122ebafd2a6f44d811f152b6cee8455c87bd4ff226b17fd9c2
Deleted: sha256:e3934f9224978038239bc7aefe5e817f227796c2b0b50364bf79e13d3aef5398
Deleted: sha256:e5fe9aeac479024529db696cea32af916f678c1541a6a2b992206d9e6ee6ed9b
Deleted: sha256:2e65bcc79de0991a5048e137002b8ef09058709646024266e0e199cf972d25b5
Deleted: sha256:a2bb858b967a4647fd232a3d00d7b1e15d2659b3c53e30413606bbac09b821ea
Deleted: sha256:eeb3562505d52abd387dbd912b51e493d1de99a9582960548257ce716dde33e9
Deleted: sha256:d2f1d22f3e1f13d54d10abc832eddc3821acde4fbd844eeade255b6a2e926f4f
Deleted: sha256:d03c684c7dd711982dddd1ab0e622440c45d27b5d015020e0aef65be0c2e7c9b
Deleted: sha256:63eed5473967cb9a5a4c98a5b1d2b6013d368bf88836aab99b5c5178c8f2f51f
Deleted: sha256:86267d11f0c14fca869691b9b32bdd610b6ab8d9033d59ee64bdcc2cf0219bce
Deleted: sha256:d9a8b3f912eee0b322b86fa0f6888558a468c384611c71178987b20e3a0ebafc
Deleted: sha256:4e627d1476f22151f05e5214147d6cc6e03ad79a082f01aca6560aa75c7ade3a
Deleted: sha256:757b76a12baba45fcbe76abbdd99723be9d94c12a2ad40354dc49ff5fbe1f5c1
Deleted: sha256:f49017d4d5ce9c0f544c82ed5cbc0672fbcb593be77f954891b22b4d0d4c0a84
Adding password for user helk
Creating network "docker_helk" with driver "bridge"
Creating volume "docker_esdata" with local driver
Creating volume "docker_notebooks" with local driver
Pulling helk-elasticsearch (docker.elastic.co/elasticsearch/elasticsearch:7.6.2)...
7.6.2: Pulling from elasticsearch/elasticsearch
Digest: sha256:59342c577e2b7082b819654d119f42514ddf47f0699c8b54dc1f0150250ce7aa
Status: Downloaded newer image for docker.elastic.co/elasticsearch/elasticsearch:7.6.2
Pulling helk-kibana (docker.elastic.co/kibana/kibana:7.6.2)...
7.6.2: Pulling from kibana/kibana
Digest: sha256:e8f3743e404462709663422056db2d5076a7a6bd6024f64aea1599b3014c63be
Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.6.2
Pulling helk-logstash (otrf/helk-logstash:7.6.2.1)...
7.6.2.1: Pulling from otrf/helk-logstash
Digest: sha256:b1135da506f40fc1d5861db7ba844486f3a08a57af3fdb8e301ab487f51a2ac1
Status: Downloaded newer image for otrf/helk-logstash:7.6.2.1
Pulling helk-nginx (otrf/helk-nginx:0.3.0)...
0.3.0: Pulling from otrf/helk-nginx
Digest: sha256:32eb6e39681849dc3bed36cfb95bd39b25f8c66d08965b6855f64eb2ee0668ba
Status: Downloaded newer image for otrf/helk-nginx:0.3.0
Pulling helk-zookeeper (otrf/helk-zookeeper:2.4.0)...
2.4.0: Pulling from otrf/helk-zookeeper
Digest: sha256:d8a7c57c03384f5ce2b6125505c1f8e2a020432de81bde3677fcc8009fc5cfd2
Status: Downloaded newer image for otrf/helk-zookeeper:2.4.0
Pulling helk-kafka-broker (otrf/helk-kafka-broker:2.4.0)...
2.4.0: Pulling from otrf/helk-kafka-broker
Digest: sha256:22b87b2e2c97157471af3db8a19e85c9184fa492fa8cd67cc57617c6abec6dce
Status: Downloaded newer image for otrf/helk-kafka-broker:2.4.0
Pulling helk-ksql-server (confluentinc/cp-ksql-server:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-server
Digest: sha256:063add111cc93b1a0118f88b577e31303045d4cc08eb1d21458429f05cba4b02
Status: Downloaded newer image for confluentinc/cp-ksql-server:5.1.3
Pulling helk-ksql-cli (confluentinc/cp-ksql-cli:5.1.3)...
5.1.3: Pulling from confluentinc/cp-ksql-cli
Digest: sha256:18c0ccb00fbf87679e16e9e0da600548fcb236a2fd173263b09e89b2d3a42cc3
Status: Downloaded newer image for confluentinc/cp-ksql-cli:5.1.3
Building helk-jupyter
Step 1/17 : FROM cyb3rward0g/jupyter-hunter:0.0.9
0.0.9: Pulling from cyb3rward0g/jupyter-hunter
Digest: sha256:2f4addd5a42afd3857bff0593fa969f6d0f08e44aa5942d96e5ccf0b61203fd5
Status: Downloaded newer image for cyb3rward0g/jupyter-hunter:0.0.9
 ---> b06921bea109
Step 2/17 : LABEL maintainer="Roberto Rodriguez @Cyb3rWard0g"
 ---> Running in bfe2a194f91d
Removing intermediate container bfe2a194f91d
 ---> 828c260b7718
Step 3/17 : LABEL description="Dockerfile Notebooks-Forge Jupyter-Hunt Project."
 ---> Running in 32a838593ffe
Removing intermediate container 32a838593ffe
 ---> 3ca36cadafb9
Step 4/17 : ENV DEBIAN_FRONTEND noninteractive
 ---> Running in b97e7a749253
Removing intermediate container b97e7a749253
 ---> 7ed859adaf9d
Step 5/17 : USER root
 ---> Running in 28e378621478
Removing intermediate container 28e378621478
 ---> 04c98ff68ddd
Step 6/17 : ENV POSTGRESQL_VERSION=42.2.9
 ---> Running in fd0fc9ccaeab
Removing intermediate container fd0fc9ccaeab
 ---> 81a7cc6c5e4a
Step 7/17 : RUN mkdir /opt/jupyter/notebooks/datasets     && apt-get update --fix-missing && apt-get install -y --no-install-recommends     postgresql postgresql-contrib     && apt-get -qy clean autoremove     && rm -rf /var/lib/apt/lists/*     && wget https://jdbc.postgresql.org/download/postgresql-${POSTGRESQL_VERSION}.jar -P /opt/jupyter/spark/jars/
 ---> Running in 2583c249b7df
Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic InRelease [242 kB]
Get:3 http://security.ubuntu.com/ubuntu bionic-security/main Sources [306 kB]
Get:4 http://security.ubuntu.com/ubuntu bionic-security/restricted Sources [15.4 kB]
Get:5 http://security.ubuntu.com/ubuntu bionic-security/multiverse Sources [4361 B]
Get:6 http://security.ubuntu.com/ubuntu bionic-security/universe Sources [340 kB]
Get:7 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [14.9 kB]
Get:8 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1872 kB]
Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [278 kB]
Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1376 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic/restricted Sources [5823 B]
Get:14 http://archive.ubuntu.com/ubuntu bionic/main Sources [1063 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic/multiverse Sources [216 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic/universe Sources [11.5 MB]
Get:17 http://archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [186 kB]
Get:18 http://archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [13.5 kB]
Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1344 kB]
Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [11.3 MB]
Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe Sources [559 kB]
Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Sources [19.8 kB]
Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/main Sources [628 kB]
Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Sources [12.7 kB]
Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [2140 kB]
Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [309 kB]
Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [2307 kB]
Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [45.6 kB]
Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/main Sources [5823 B]
Get:30 http://archive.ubuntu.com/ubuntu bionic-backports/universe Sources [5759 B]
Get:31 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [11.4 kB]
Get:32 http://archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [11.3 kB]
Fetched 36.4 MB in 4s (8480 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
  libicu60 libpq5 libxml2 libxslt1.1 netbase postgresql-10
  postgresql-client-10 postgresql-client-common postgresql-common ssl-cert
  tzdata
Suggested packages:
  postgresql-doc locales-all postgresql-doc-10 libjson-perl openssl-blacklist
Recommended packages:
  sysstat
The following NEW packages will be installed:
  libicu60 libpq5 libxml2 libxslt1.1 netbase postgresql postgresql-10
  postgresql-client-10 postgresql-client-common postgresql-common
  postgresql-contrib ssl-cert tzdata
0 upgraded, 13 newly installed, 0 to remove and 112 not upgraded.
Need to get 14.1 MB of archives.
After this operation, 57.2 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libicu60 amd64 60.2-3ubuntu3.1 [8054 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxml2 amd64 2.9.4+dfsg1-6.1ubuntu1.3 [663 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 netbase all 5.4 [12.7 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 tzdata all 2020f-0ubuntu0.18.04 [190 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpq5 amd64 10.15-0ubuntu0.18.04.1 [108 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-common all 190ubuntu0.1 [29.6 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-client-10 amd64 10.15-0ubuntu0.18.04.1 [939 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 ssl-cert all 1.0.39 [17.0 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-common all 190ubuntu0.1 [157 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-10 amd64 10.15-0ubuntu0.18.04.1 [3766 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql all 10+190ubuntu0.1 [5884 B]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 postgresql-contrib all 10+190ubuntu0.1 [5896 B]
Preconfiguring packages ...
Fetched 14.1 MB in 2s (7543 kB/s)
Selecting previously unselected package libicu60:amd64.
(Reading database ... 13830 files and directories currently installed.)
Preparing to unpack .../00-libicu60_60.2-3ubuntu3.1_amd64.deb ...
Unpacking libicu60:amd64 (60.2-3ubuntu3.1) ...
Selecting previously unselected package libxml2:amd64.
Preparing to unpack .../01-libxml2_2.9.4+dfsg1-6.1ubuntu1.3_amd64.deb ...
Unpacking libxml2:amd64 (2.9.4+dfsg1-6.1ubuntu1.3) ...
Selecting previously unselected package netbase.
Preparing to unpack .../02-netbase_5.4_all.deb ...
Unpacking netbase (5.4) ...
Selecting previously unselected package tzdata.
Preparing to unpack .../03-tzdata_2020f-0ubuntu0.18.04_all.deb ...
Unpacking tzdata (2020f-0ubuntu0.18.04) ...
Selecting previously unselected package libpq5:amd64.
Preparing to unpack .../04-libpq5_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking libpq5:amd64 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package libxslt1.1:amd64.
Preparing to unpack .../05-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ...
Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ...
Selecting previously unselected package postgresql-client-common.
Preparing to unpack .../06-postgresql-client-common_190ubuntu0.1_all.deb ...
Unpacking postgresql-client-common (190ubuntu0.1) ...
Selecting previously unselected package postgresql-client-10.
Preparing to unpack .../07-postgresql-client-10_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking postgresql-client-10 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package ssl-cert.
Preparing to unpack .../08-ssl-cert_1.0.39_all.deb ...
Unpacking ssl-cert (1.0.39) ...
Selecting previously unselected package postgresql-common.
Preparing to unpack .../09-postgresql-common_190ubuntu0.1_all.deb ...
Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common'
Unpacking postgresql-common (190ubuntu0.1) ...
Selecting previously unselected package postgresql-10.
Preparing to unpack .../10-postgresql-10_10.15-0ubuntu0.18.04.1_amd64.deb ...
Unpacking postgresql-10 (10.15-0ubuntu0.18.04.1) ...
Selecting previously unselected package postgresql.
Preparing to unpack .../11-postgresql_10+190ubuntu0.1_all.deb ...
Unpacking postgresql (10+190ubuntu0.1) ...
Selecting previously unselected package postgresql-contrib.
Preparing to unpack .../12-postgresql-contrib_10+190ubuntu0.1_all.deb ...
Unpacking postgresql-contrib (10+190ubuntu0.1) ...
Setting up libicu60:amd64 (60.2-3ubuntu3.1) ...
Setting up tzdata (2020f-0ubuntu0.18.04) ...

Current default time zone: 'Etc/UTC'
Local time is now:      Thu Jan 14 17:05:36 UTC 2021.
Universal Time is now:  Thu Jan 14 17:05:36 UTC 2021.
Run 'dpkg-reconfigure tzdata' if you wish to change it.

Setting up ssl-cert (1.0.39) ...
Setting up libxml2:amd64 (2.9.4+dfsg1-6.1ubuntu1.3) ...
Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ...
Setting up libpq5:amd64 (10.15-0ubuntu0.18.04.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
Setting up netbase (5.4) ...
Setting up postgresql-client-common (190ubuntu0.1) ...
Setting up postgresql-common (190ubuntu0.1) ...
Adding user postgres to group ssl-cert

Creating config file /etc/postgresql-common/createcluster.conf with new version
Building PostgreSQL dictionaries from installed myspell/hunspell packages...
Removing obsolete dictionary files:
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up postgresql-client-10 (10.15-0ubuntu0.18.04.1) ...
update-alternatives: using /usr/share/postgresql/10/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode
Setting up postgresql-10 (10.15-0ubuntu0.18.04.1) ...
Creating new PostgreSQL cluster 10/main ...
/usr/lib/postgresql/10/bin/initdb -D /var/lib/postgresql/10/main --auth-local peer --auth-host md5
The files belonging to this database system will be owned by user "postgres".
This user must also own the server process.

The database cluster will be initialized with locale "en_US.UTF-8".
The default database encoding has accordingly been set to "UTF8".
The default text search configuration will be set to "english".

Data page checksums are disabled.

fixing permissions on existing directory /var/lib/postgresql/10/main ... ok
creating subdirectories ... ok
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default timezone ... Etc/UTC
selecting dynamic shared memory implementation ... posix
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

Success. You can now start the database server using:

    /usr/lib/postgresql/10/bin/pg_ctl -D /var/lib/postgresql/10/main -l logfile start

Ver Cluster Port Status Owner    Data directory              Log file
10  main    5432 down   postgres /var/lib/postgresql/10/main /var/log/postgresql/postgresql-10-main.log
update-alternatives: using /usr/share/postgresql/10/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up postgresql (10+190ubuntu0.1) ...
Setting up postgresql-contrib (10+190ubuntu0.1) ...
--2021-01-14 17:06:17--  https://jdbc.postgresql.org/download/postgresql-42.2.9.jar
Resolving jdbc.postgresql.org (jdbc.postgresql.org)... 72.32.157.228, 2001:4800:3e1:1::228
Connecting to jdbc.postgresql.org (jdbc.postgresql.org)|72.32.157.228|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 914037 (893K) [application/java-archive]
Saving to: ‘/opt/jupyter/spark/jars/postgresql-42.2.9.jar’

     0K .......... .......... .......... .......... ..........  5% 4.18M 0s
    50K .......... .......... .......... .......... .......... 11% 4.49M 0s
   100K .......... .......... .......... .......... .......... 16% 5.18M 0s
   150K .......... .......... .......... .......... .......... 22% 33.4M 0s
   200K .......... .......... .......... .......... .......... 28% 34.0M 0s
   250K .......... .......... .......... .......... .......... 33% 6.37M 0s
   300K .......... .......... .......... .......... .......... 39% 29.6M 0s
   350K .......... .......... .......... .......... .......... 44% 26.2M 0s
   400K .......... .......... .......... .......... .......... 50% 36.5M 0s
   450K .......... .......... .......... .......... .......... 56% 31.6M 0s
   500K .......... .......... .......... .......... .......... 61% 17.7M 0s
   550K .......... .......... .......... .......... .......... 67% 39.7M 0s
   600K .......... .......... .......... .......... .......... 72% 43.2M 0s
   650K .......... .......... .......... .......... .......... 78% 39.7M 0s
   700K .......... .......... .......... .......... .......... 84% 41.8M 0s
   750K .......... .......... .......... .......... .......... 89% 26.5M 0s
   800K .......... .......... .......... .......... .......... 95% 36.7M 0s
   850K .......... .......... .......... .......... ..        100% 69.4M=0.06s

2021-01-14 17:06:17 (14.5 MB/s) - ‘/opt/jupyter/spark/jars/postgresql-42.2.9.jar’ saved [914037/914037]

Removing intermediate container 2583c249b7df
 ---> d449763f911a
Step 8/17 : COPY notebooks/demos ${JUPYTER_DIR}/notebooks/demos
 ---> a56bfb53d893
Step 9/17 : COPY notebooks/tutorials ${JUPYTER_DIR}/notebooks/tutorials
 ---> a0248c1c8349
Step 10/17 : COPY notebooks/sigma ${JUPYTER_DIR}/notebooks/sigma
 ---> 42f904f820ab
Step 11/17 : COPY spark/* ${SPARK_HOME}/conf/
 ---> 3d72d5473047
Step 12/17 : COPY scripts/* ${JUPYTER_DIR}/scripts/
 ---> f9540ebb823f
Step 13/17 : RUN chown -R ${USER} ${JUPYTER_DIR} ${HOME} ${SPARK_HOME}     && chown ${USER} /run/postgresql
 ---> Running in 06436810d528
Removing intermediate container 06436810d528
 ---> 4cd77423e44c
Step 14/17 : WORKDIR ${HOME}
 ---> Running in cb52adac39e2
Removing intermediate container cb52adac39e2
 ---> f39f3d0b44a5
Step 15/17 : ENTRYPOINT ["/opt/jupyter/scripts/jupyter-entrypoint.sh"]
 ---> Running in 2f57157e760a
Removing intermediate container 2f57157e760a
 ---> 0a0b71c97e25
Step 16/17 : CMD ["/opt/jupyter/scripts/jupyter-cmd.sh"]
 ---> Running in bde6453cec94
Removing intermediate container bde6453cec94
 ---> e2b74f5245f4
Step 17/17 : USER ${USER}
 ---> Running in ec320ccbf5f7
Removing intermediate container ec320ccbf5f7
 ---> 99f852a8f1bb

Successfully built 99f852a8f1bb
Successfully tagged docker_helk-jupyter:latest
Pulling helk-spark-master (otrf/helk-spark-master:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-master
Digest: sha256:1c3589bf181e5302153480b38e4e675afd1a29ef5d3fc6e31d9a33a566b95f18
Status: Downloaded newer image for otrf/helk-spark-master:2.4.5
Pulling helk-spark-worker (otrf/helk-spark-worker:2.4.5)...
2.4.5: Pulling from otrf/helk-spark-worker
Digest: sha256:0c3e2f759d6f286dbf740dab6a74740eb1b173d41156d50c3e4a32ea7e5aa74c
Status: Downloaded newer image for otrf/helk-spark-worker:2.4.5
Creating helk-elasticsearch ... done
Creating helk-kibana        ... done
Creating helk-nginx         ... done
Creating helk-logstash      ... done
Creating helk-zookeeper     ... done
Creating helk-jupyter       ... done
Creating helk-spark-master  ... done
Creating helk-spark-worker  ... done
Creating helk-kafka-broker  ... done
Creating helk-ksql-server   ... done
Creating helk-ksql-cli      ... done

What version of HELK are you using

run the command from within the HELK root directory cat .git/refs/heads/master
and include what date you cloned the HELK repo

8f5643e5457b0b903107670b167ce39a8e6cd713
Jan 14, 2021

What version of Winlogbeat are you using if you are using Windows/WEF logs

Place the version here

What steps did you take trying to fix the issue

Tried option 3 and 4, stuck at the same place. Used to configure the system to static ip via /etc/netplan/01-netcfg.yaml. Restored it back to DHCP. Still not working.

How could we replicate the issue

Not sure. New installation?

Any additionally code or log context you would like to provide

sudo docker logs helk-logstash
[HELK-LOGSTASH-DOCKER-INSTALLATION-INFO] Setting Elasticsearch server name to helk-elasticsearch
[HELK-LOGSTASH-DOCKER-INSTALLATION-INFO] Setting Elasticsearch server port to 9200
[HELK-LOGSTASH-DOCKER-INSTALLATION-INFO] Waiting for elasticsearch URI to be accessible..
[HELK-LOGSTASH-DOCKER-INSTALLATION-INFO] Waiting for elasticsearch URI to be accessible..
[HELK-LOGSTASH-DOCKER-INSTALLATION-INFO] Waiting for elasticsearch URI to be accessible..

Any additional context or input you have

pictures, comments, etc.

[C0ubv9]

Looks like similar issue has been reported as #376.

[C0ubv9]

Found the elasticsearch docker kept on restarting. Read some old post that it looked like the issue was related to elasticsearch couldn't start on some older hardware. Reinstalled on a new machine w/o any issue. Hence close the issue. Thx.