threefoldtecharchive / jumpscaleX_archived

Apache License 2.0
1 stars 6 forks source link

Container installer not interactive fails #799

Open LeeSmet opened 4 years ago

LeeSmet commented 4 years ago

Steps to reproduce:

On a fresh (linux) machine (prior installation fully removed), try installing jumpscale using the following script, based on the instructions provided here:

#! /usr/bin/env bash

curl https://raw.githubusercontent.com/threefoldtech/jumpscaleX/development_jumpscale/install/jsx.py$RANDOM > /tmp/jsx;
chmod +x /tmp/jsx;
/tmp/jsx configure -s --secret ${JSX_SECRET};
/tmp/jsx container-install -s

above was done on branch development_jumpscale, also tried development by changing the URL to retrieve the jsx file from accordingly. Same result on both occasions .

Full Output:

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 20579  100 20579    0     0  71954      0 --:--:-- --:--:-- --:--:-- 71954
DOWNLOADED INSTALLTOOLS TO /tmp/InstallTools.py
DOWNLOADED INSTALLTOOLS TO /tmp/InstallTools.py
DOWNLOADED INSTALLTOOLS TO /tmp/InstallTools.py
 - Docker machine gets created: 
db729d8b680904ac71511d4b1d8b2d18fcbd56c48daa0108535a8ffbf97d8d3b
 - Docker machine OK
 - Start SSH server
cat: /root/.BASEINSTALL_OK: No such file or directory
 * Starting OpenBSD Secure Shell server sshd                             [ OK ] 
 - Upgrade ubuntu
Hit:1 http://mirror.unix-solutions.be/ubuntu bionic InRelease
Hit:2 http://ppa.launchpad.net/wireguard/wireguard/ubuntu bionic InRelease     
Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease                        
Get:4 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB]      
Get:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]    
Get:6 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]    
Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main Sources [371 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe Sources [341 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Sources [4825 B]
Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Sources [3341 B]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [925 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [7216 B]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [16.8 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1276 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic-backports/universe Sources [2516 B]
Get:16 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4212 B]
Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse Sources [2773 B]
Get:18 http://security.ubuntu.com/ubuntu bionic-security/universe Sources [199 kB]
Get:19 http://security.ubuntu.com/ubuntu bionic-security/restricted Sources [1976 B]
Get:20 http://security.ubuntu.com/ubuntu bionic-security/main Sources [156 kB]
Get:21 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [755 kB]
Get:22 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [4173 B]
Get:23 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [6222 B]
Get:24 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [622 kB]
Fetched 4951 kB in 2s (2634 kB/s)                      
Reading package lists... Done
Building dependency tree       
Reading state information... Done
30 packages can be upgraded. Run 'apt list --upgradable' to see them.
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
The following packages have been kept back:
  linux-headers-generic
The following packages will be upgraded:
  base-files bash cmake cmake-data dkms dpkg dpkg-dev iputils-ping
  language-pack-en libdpkg-perl libglib2.0-0 libldap-2.4-2 libldap-common
  libpq-dev libpq5 libprocps6 libssl-dev libssl1.1 libsystemd0 libudev1
  linux-libc-dev openssl patch procps python3-software-properties redis-server
  redis-tools software-properties-common tmux
29 upgraded, 0 newly installed, 0 to remove and 1 not upgraded.
Need to get 15.1 MB of archives.
After this operation, 2587 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 base-files amd64 10.1ubuntu2.6 [60.1 kB]
Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 bash amd64 4.4.18-2ubuntu1.2 [614 kB]
Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 dpkg amd64 1.19.0.5ubuntu2.2 [1136 kB]
Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libsystemd0 amd64 237-3ubuntu10.25 [204 kB]
Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 language-pack-en all 1:18.04+20190718 [250 kB]
Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libudev1 amd64 237-3ubuntu10.25 [53.5 kB]
Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libprocps6 amd64 2:3.3.12-3ubuntu1.2 [31.8 kB]
Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 procps amd64 2:3.3.12-3ubuntu1.2 [225 kB]
Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 iputils-ping amd64 3:20161105-1ubuntu3 [54.2 kB]
Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libglib2.0-0 amd64 2.56.4-0ubuntu0.18.04.4 [1169 kB]
Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.4 [1566 kB]
Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.4 [1300 kB]
Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 openssl amd64 1.1.1-1ubuntu2.1~18.04.4 [613 kB]
Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 cmake amd64 3.10.2-1ubuntu2.18.04.1 [3152 kB]
Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 cmake-data all 3.10.2-1ubuntu2.18.04.1 [1332 kB]
Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 dpkg-dev all 1.19.0.5ubuntu2.2 [607 kB]
Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libdpkg-perl all 1.19.0.5ubuntu2.2 [211 kB]
Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 patch amd64 2.7.6-2ubuntu1.1 [102 kB]
Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 dkms all 2.3-3ubuntu9.5 [68.1 kB]
Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libldap-common all 2.4.45+dfsg-1ubuntu1.3 [16.9 kB]
Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libldap-2.4-2 amd64 2.4.45+dfsg-1ubuntu1.3 [155 kB]
Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpq-dev amd64 10.10-0ubuntu0.18.04.1 [218 kB]
Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpq5 amd64 10.10-0ubuntu0.18.04.1 [108 kB]
Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-libc-dev amd64 4.15.0-58.64 [1043 kB]
Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 software-properties-common all 0.96.24.32.11 [9996 B]
Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-software-properties all 0.96.24.32.11 [23.6 kB]
Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 redis-server amd64 5:4.0.9-1ubuntu0.2 [35.4 kB]
Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 redis-tools amd64 5:4.0.9-1ubuntu0.2 [516 kB]
Get:29 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 tmux amd64 2.6-3ubuntu0.2 [248 kB]
Fetched 15.1 MB in 1s (11.1 MB/s)
Preconfiguring packages ...
(Reading database ... 55691 files and directories currently installed.)
Preparing to unpack .../base-files_10.1ubuntu2.6_amd64.deb ...
Unpacking base-files (10.1ubuntu2.6) over (10.1ubuntu2.4) ...
Setting up base-files (10.1ubuntu2.6) ...
Installing new version of config file /etc/issue ...
Installing new version of config file /etc/issue.net ...
Installing new version of config file /etc/lsb-release ...
(Reading database ... 55691 files and directories currently installed.)
Preparing to unpack .../bash_4.4.18-2ubuntu1.2_amd64.deb ...
Unpacking bash (4.4.18-2ubuntu1.2) over (4.4.18-2ubuntu1.1) ...
Setting up bash (4.4.18-2ubuntu1.2) ...
update-alternatives: error: alternative path /usr/share/man/man7/bash-builtins.7.gz doesn't exist
(Reading database ... 55691 files and directories currently installed.)
Preparing to unpack .../dpkg_1.19.0.5ubuntu2.2_amd64.deb ...
Unpacking dpkg (1.19.0.5ubuntu2.2) over (1.19.0.5ubuntu2.1) ...
Setting up dpkg (1.19.0.5ubuntu2.2) ...
(Reading database ... 55691 files and directories currently installed.)
Preparing to unpack .../libsystemd0_237-3ubuntu10.25_amd64.deb ...
Unpacking libsystemd0:amd64 (237-3ubuntu10.25) over (237-3ubuntu10.24) ...
Setting up libsystemd0:amd64 (237-3ubuntu10.25) ...
(Reading database ... 55691 files and directories currently installed.)
Preparing to unpack .../language-pack-en_1%3a18.04+20190718_all.deb ...
Unpacking language-pack-en (1:18.04+20190718) over (1:18.04+20180712) ...
Replacing files in old package language-pack-en-base (1:18.04+20180712) ...
Preparing to unpack .../libudev1_237-3ubuntu10.25_amd64.deb ...
Unpacking libudev1:amd64 (237-3ubuntu10.25) over (237-3ubuntu10.24) ...
Setting up libudev1:amd64 (237-3ubuntu10.25) ...
(Reading database ... 55697 files and directories currently installed.)
Preparing to unpack .../00-libprocps6_2%3a3.3.12-3ubuntu1.2_amd64.deb ...
Unpacking libprocps6:amd64 (2:3.3.12-3ubuntu1.2) over (2:3.3.12-3ubuntu1.1) ...
Preparing to unpack .../01-procps_2%3a3.3.12-3ubuntu1.2_amd64.deb ...
Unpacking procps (2:3.3.12-3ubuntu1.2) over (2:3.3.12-3ubuntu1.1) ...
Preparing to unpack .../02-iputils-ping_3%3a20161105-1ubuntu3_amd64.deb ...
Unpacking iputils-ping (3:20161105-1ubuntu3) over (3:20161105-1ubuntu2) ...
Preparing to unpack .../03-libglib2.0-0_2.56.4-0ubuntu0.18.04.4_amd64.deb ...
Unpacking libglib2.0-0:amd64 (2.56.4-0ubuntu0.18.04.4) over (2.56.4-0ubuntu0.18.04.3) ...
Preparing to unpack .../04-libssl-dev_1.1.1-1ubuntu2.1~18.04.4_amd64.deb ...
Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.4) over (1.1.1-1ubuntu2.1~18.04.3) ...
Preparing to unpack .../05-libssl1.1_1.1.1-1ubuntu2.1~18.04.4_amd64.deb ...
Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.4) over (1.1.1-1ubuntu2.1~18.04.3) ...
Preparing to unpack .../06-openssl_1.1.1-1ubuntu2.1~18.04.4_amd64.deb ...
Unpacking openssl (1.1.1-1ubuntu2.1~18.04.4) over (1.1.1-1ubuntu2.1~18.04.3) ...
Preparing to unpack .../07-cmake_3.10.2-1ubuntu2.18.04.1_amd64.deb ...
Unpacking cmake (3.10.2-1ubuntu2.18.04.1) over (3.10.2-1ubuntu2) ...
Preparing to unpack .../08-cmake-data_3.10.2-1ubuntu2.18.04.1_all.deb ...
Unpacking cmake-data (3.10.2-1ubuntu2.18.04.1) over (3.10.2-1ubuntu2) ...
Preparing to unpack .../09-dpkg-dev_1.19.0.5ubuntu2.2_all.deb ...
Unpacking dpkg-dev (1.19.0.5ubuntu2.2) over (1.19.0.5ubuntu2.1) ...
Preparing to unpack .../10-libdpkg-perl_1.19.0.5ubuntu2.2_all.deb ...
Unpacking libdpkg-perl (1.19.0.5ubuntu2.2) over (1.19.0.5ubuntu2.1) ...
Preparing to unpack .../11-patch_2.7.6-2ubuntu1.1_amd64.deb ...
Unpacking patch (2.7.6-2ubuntu1.1) over (2.7.6-2ubuntu1) ...
Preparing to unpack .../12-dkms_2.3-3ubuntu9.5_all.deb ...
Unpacking dkms (2.3-3ubuntu9.5) over (2.3-3ubuntu9.3) ...
Preparing to unpack .../13-libldap-common_2.4.45+dfsg-1ubuntu1.3_all.deb ...
Unpacking libldap-common (2.4.45+dfsg-1ubuntu1.3) over (2.4.45+dfsg-1ubuntu1.2) ...
Preparing to unpack .../14-libldap-2.4-2_2.4.45+dfsg-1ubuntu1.3_amd64.deb ...
Unpacking libldap-2.4-2:amd64 (2.4.45+dfsg-1ubuntu1.3) over (2.4.45+dfsg-1ubuntu1.2) ...
Preparing to unpack .../15-libpq-dev_10.10-0ubuntu0.18.04.1_amd64.deb ...
Unpacking libpq-dev (10.10-0ubuntu0.18.04.1) over (10.9-0ubuntu0.18.04.1) ...
Preparing to unpack .../16-libpq5_10.10-0ubuntu0.18.04.1_amd64.deb ...
Unpacking libpq5:amd64 (10.10-0ubuntu0.18.04.1) over (10.9-0ubuntu0.18.04.1) ...
Preparing to unpack .../17-linux-libc-dev_4.15.0-58.64_amd64.deb ...
Unpacking linux-libc-dev:amd64 (4.15.0-58.64) over (4.15.0-54.58) ...
Preparing to unpack .../18-software-properties-common_0.96.24.32.11_all.deb ...
Unpacking software-properties-common (0.96.24.32.11) over (0.96.24.32.9) ...
Preparing to unpack .../19-python3-software-properties_0.96.24.32.11_all.deb ...
Unpacking python3-software-properties (0.96.24.32.11) over (0.96.24.32.9) ...
Preparing to unpack .../20-redis-server_5%3a4.0.9-1ubuntu0.2_amd64.deb ...
Unpacking redis-server (5:4.0.9-1ubuntu0.2) over (5:4.0.9-1ubuntu0.1) ...
Preparing to unpack .../21-redis-tools_5%3a4.0.9-1ubuntu0.2_amd64.deb ...
Unpacking redis-tools (5:4.0.9-1ubuntu0.2) over (5:4.0.9-1ubuntu0.1) ...
Preparing to unpack .../22-tmux_2.6-3ubuntu0.2_amd64.deb ...
Unpacking tmux (2.6-3ubuntu0.2) over (2.6-3ubuntu0.1) ...
Setting up iputils-ping (3:20161105-1ubuntu3) ...
Setting up redis-tools (5:4.0.9-1ubuntu0.2) ...
Setting up libldap-common (2.4.45+dfsg-1ubuntu1.3) ...
Setting up libglib2.0-0:amd64 (2.56.4-0ubuntu0.18.04.4) ...
No schema files found: doing nothing.
Setting up linux-libc-dev:amd64 (4.15.0-58.64) ...
Setting up libdpkg-perl (1.19.0.5ubuntu2.2) ...
Setting up cmake-data (3.10.2-1ubuntu2.18.04.1) ...
Setting up libprocps6:amd64 (2:3.3.12-3ubuntu1.2) ...
Setting up procps (2:3.3.12-3ubuntu1.2) ...
Setting up language-pack-en (1:18.04+20190718) ...
Setting up patch (2.7.6-2ubuntu1.1) ...
Setting up libldap-2.4-2:amd64 (2.4.45+dfsg-1ubuntu1.3) ...
Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.4) ...
Setting up openssl (1.1.1-1ubuntu2.1~18.04.4) ...
Setting up tmux (2.6-3ubuntu0.2) ...
Setting up python3-software-properties (0.96.24.32.11) ...
Setting up cmake (3.10.2-1ubuntu2.18.04.1) ...
Setting up redis-server (5:4.0.9-1ubuntu0.2) ...
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of restart.
Setting up software-properties-common (0.96.24.32.11) ...
Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.4) ...
Setting up dpkg-dev (1.19.0.5ubuntu2.2) ...
Setting up dkms (2.3-3ubuntu9.5) ...
Setting up libpq5:amd64 (10.10-0ubuntu0.18.04.1) ...
Setting up libpq-dev (10.10-0ubuntu0.18.04.1) ...
Processing triggers for dbus (1.12.2-1ubuntu1.1) ...
Processing triggers for libc-bin (2.27-3ubuntu1) ...
W: --force-yes is deprecated, use one of the options starting with --allow instead.
 - Upgrade ubuntu ended
Reading package lists... Done
Building dependency tree       
Reading state information... Done
mc is already the newest version (3:4.8.19-1).
git is already the newest version (1:2.17.1-1ubuntu0.4).
0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded.
getaddrinfo 3bot: Name or service not known
getaddrinfo 3bot: Name or service not known
getaddrinfo 3bot: Name or service not known
--TRACEBACK------------------
/tmp/jsx in <module>
    594    cli()
/tmp/jsx in container_install
    249    docker.install()
/tmp/InstallTools.py in install
    3972    Tools.execute("ssh-keyscan -H 3bot >> %s/.ssh/known_hosts" % MyEnv.config["DIR_HOME"])
/tmp/InstallTools.py in execute
    1902    raise Tools.exceptions.Base(msg)
-----------------------------
Wed 21 11:51:24 /tmp/InstallTools.py -1902 - execute                            : EXCEPTION: 

    Could not execute:    ssh-keyscan -H 3bot >> /home/lee/.ssh/known_hosts

    stderr:
        getaddrinfo 3bot: Name or service not known
        getaddrinfo 3bot: Name or service not known
        getaddrinfo 3bot: Name or service not known
LeeSmet commented 4 years ago

Currently I have exactly the same behavior when trying the interactive install documentation. Fails on exactly the same step.

serboctor commented 4 years ago

I found some bugs in the -s option but they're not related to this error. I've successfully installed using jsx install, jsx install-container, and jsx install-container -s and I can't reproduce it at all so I am thinking it may be os-specific?