Open imnyang opened 2 months ago
@imnyang
We will test the installation issue on Proxmox tomorrow.
Tried today on Debian 12 LXC on Proxmox:
root@terminus:~# curl -fsSL https://terminus.sh | bash -
Downloading Install-Wizard 1.7.0-rc.1 from https://dc3p1870nn3cj.cloudfront.net/install-wizard-v1.77.-rc.1.tar.gz ...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 6021M 100 6021M 0 0 5308k 0 0:19:21 0:19:21 --:--:-- 5218k
Install-Wizard 1.7.0-rc.1 Download Complete!
2024-08-25 06:37:30.268237546 +0000 [INFO] Start to Install Terminus ...
debian
2024-08-25 06:37:30.271785322 +0000 [INFO] Precheck and Installing dependencies ...
2024-08-25 06:37:30.284892706 +0000 [FATAL] unsupported os version ''
2024-08-25 06:37:30.286318916 +0000 [FATAL] command error occurs, exit with '1' directly
root@terminus:~#
root@terminus:~# lsb_release
bash: lsb_release: command not found
root@terminus:~# apt install lsb-release
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
lsb-release
0 upgraded, 1 newly installed, 0 to remove and 61 not upgraded.
Need to get 6416 B of archives.
After this operation, 17.4 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian bookworm/main amd64 lsb-release all 12.0-1 [6416 B]
Fetched 6416 B in 0s (61.0 kB/s)
Selecting previously unselected package lsb-release.
(Reading database ... 19288 files and directories currently installed.)
Preparing to unpack .../lsb-release_12.0-1_all.deb ...
Unpacking lsb-release (12.0-1) ...
Setting up lsb-release (12.0-1) ...
Processing triggers for man-db (2.11.2-2) ...
root@terminus:~# lsb_release
No LSB modules are available.
root@terminus:~# lsb_release=$(lsb_release -d 2>&1 | awk -F'\t' '{print $2}')
root@terminus:~# echo $lsb_release
Debian GNU/Linux 12 (bookworm)
Let me retry the installation, will post here.
root@terminus:~# cat /etc/hosts
127.0.0.1 localhost
::1 localhost ip6-localhost ip6-loopback
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
# --- BEGIN PVE ---
192.168.50.117 terminus.. terminus
# need to disable below line (I believe this was generated by Proxmox automatically)
# terminus installer wants to ping the $HOSTNAME and it is expecting IP other than 127.0.x.x.
#127.0.1.1 terminus.. terminus
And finally, got another error:
Aug 25 07:05:29 terminus systemd[1]: Starting minio.service - MinIO...
Aug 25 07:05:29 terminus systemd[1]: Started minio.service - MinIO.
2024-08-25 07:05:30.024566858 +0000 [INFO] start to install redis
2024-08-25 07:05:44.277134406 +0000 [FATAL] command: 'sh -c sysctl -w vm.overcommit_memory=1 net.core.somaxconn=10240 >/dev/null'
2024-08-25 07:05:44.278666523 +0000 [FATAL] sysctl: permission denied on key "vm.overcommit_memory"
@pengpeng any idea? 🤔
@husniadil I'm guessing we'll need @aby913 to take a look tomorrow.
We have already reproduced the issue locally. However, considering the significant differences between our latest installer and the online installation process, we prefer to address this with the new version release, expected by the end of August.
FYI, I tried to bypass that vm.overcommit_memory
, it continues, but got another error, the error is getting harder, related to file system.
Aug 25 07:29:29 terminus systemd[1]: Starting minio.service - MinIO...
Aug 25 07:29:29 terminus systemd[1]: Started minio.service - MinIO.
2024-08-25 07:29:29.753494412 +0000 [INFO] start to install redis
2024-08-25 07:29:29.945201122 +0000 [INFO] redis service enabled
Please waiting
Continue ...
* redis-server.service - Redis
Loaded: loaded (/etc/systemd/system/redis-server.service; enabled; preset: enabled)
Active: active (running) since Sun 2024-08-25 07:29:29 UTC; 10s ago
Docs: https://redis.io/
Main PID: 9642 (redis-server)
Tasks: 4
Memory: 1.4M
CPU: 22ms
CGroup: /system.slice/redis-server.service
`-9642 "/usr/bin/redis-server 192.168.50.117:6379"
Aug 25 07:29:29 terminus systemd[1]: Starting redis-server.service - Redis...
Aug 25 07:29:29 terminus sh[9641]: /bin/sh: 1: cannot create /sys/kernel/mm/transparent_hugepage/enabled: Read-only file system
Aug 25 07:29:29 terminus systemd[1]: Started redis-server.service - Redis.
2024-08-25 07:29:40.060067815 +0000 [INFO] try to connect redis
2024-08-25 07:29:40.063684600 +0000 [INFO] success to install redis
2024-08-25 07:29:40.064366782 +0000 [INFO] start to install juicefs
* juicefs.service - JuicefsMount
Loaded: loaded (/etc/systemd/system/juicefs.service; enabled; preset: enabled)
Active: activating (auto-restart) (Result: exit-code) since Sun 2024-08-25 07:29:40 UTC; 5ms ago
Docs: https://juicefs.com/docs/zh/community/introduction/
Process: 9811 ExecStart=/usr/local/bin/juicefs mount -o writeback_cache --entry-cache 300 --attr-cache 300 --cache-dir /terminus/jfscache redis://:ddc3j8w28ju5qbv7@192.168.50.117:6379/1 /terminus/rootfs (code=exited, status=1/FAILURE)
Main PID: 9811 (code=exited, status=1/FAILURE)
CPU: 53ms
2024-08-25 07:29:40.787962148 +0000 [FATAL] command: 'sh -c systemctl --no-pager status juicefs'
2024-08-25 07:29:40.789380333 +0000 [FATAL] command error occurs, exit with '1' directly
I can't wait for the next release so I can install it on Proxmox.
@husniadil I'll ask my colleagues for you, but since today is a holiday, they might not see my message.
I anticipate that a daily build version fixing this issue will be released tomorrow or the day after.
We'll release this fix in version 1.8. You can try it out in the latest daily build.
curl -sSfL https://github.com/beclab/Terminus/releases/download/1.8.0-20240826/install.sh | bash -
@pengpeng @eball
I have tried to install terminus on an unprivileged LXC on PVE.
But, during installation, I noticed the following errors:
// setup starts
// installing
sysctl: permission denied on key "vm.overcommit_memory"
net.core.somaxconn = 10240
/usr/local/bin/kube-scripts/initOS.sh: line 121: /proc/sys/vm/drop_caches: Read-only file system
// setup continues ...
2024-08-27T06:49:36.429Z import error beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:49:36Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount47737782: lchown /var/lib/containerd/tmpmounts/containerd-mount47737782/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-229878917-uCvJ sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount47737782: lchown /var/lib/containerd/tmpmounts/containerd-mount47737782/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1, wait for 15 seconds(1 times)
2024-08-27T06:49:52.934Z import error beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:49:52Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount2525403919: lchown /var/lib/containerd/tmpmounts/containerd-mount2525403919/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-743901221-nwmH sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount2525403919: lchown /var/lib/containerd/tmpmounts/containerd-mount2525403919/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1, wait for 25 seconds(2 times)
2024-08-27T06:50:19.390Z import error beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:50:19Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount4035734320: lchown /var/lib/containerd/tmpmounts/containerd-mount4035734320/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-198854000-4DTo sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount4035734320: lchown /var/lib/containerd/tmpmounts/containerd-mount4035734320/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1, wait for 35 seconds(3 times)
2024-08-27T06:50:55.835Z import error beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:50:55Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount1867878525: lchown /var/lib/containerd/tmpmounts/containerd-mount1867878525/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-650818410-z5_t sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount1867878525: lchown /var/lib/containerd/tmpmounts/containerd-mount1867878525/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1, wait for 45 seconds(4 times)
2024-08-27T06:51:42.358Z import error beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:51:42Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount3707893426: lchown /var/lib/containerd/tmpmounts/containerd-mount3707893426/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-119452876-R7q9 sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount3707893426: lchown /var/lib/containerd/tmpmounts/containerd-mount3707893426/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1, wait for 55 seconds(5 times)
2024-08-27T06:51:42.359Z terminus beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:51:42Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount3707893426: lchown /var/lib/containerd/tmpmounts/containerd-mount3707893426/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-119452876-R7q9 sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount3707893426: lchown /var/lib/containerd/tmpmounts/containerd-mount3707893426/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1
2024-08-27T06:51:42.359Z [A] terminus: PreloadImages failed (31m18.898950954s)
2024-08-27T06:51:42.359Z [Job] [Initialize KubeSphere] execute failed <nil>
2024-08-27T06:51:42.359Z initialize kube error: Module[PreloadImages] exec failed:
failed - terminus: [A] PreloadImages: PreloadImages exec failed after 1 retires: beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: beclab/s3rver:latest(a019d387e343c10aec18235b432c7da9.tar.gz) error: Failed to exec command: /bin/sh -c sudo -E /bin/bash -c "env PATH=$PATH gunzip -c /root/.terminus/images/a019d387e343c10aec18235b432c7da9.tar.gz | ctr -n k8s.io images import -"
unpacking docker.io/beclab/s3rver:latest (sha256:62f9b234493ecc495e3fb35def9c3ceaa2a6038643b289833a2c3c0ffe712732)...time="2024-08-27T06:51:42Z" level=info msg="apply failure, attempting cleanup" error="failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount3707893426: lchown /var/lib/containerd/tmpmounts/containerd-mount3707893426/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown" key="extract-119452876-R7q9 sha256:5cf1267288b1b1471e35eb96d43547d0ee5a1f8d0e2e3caf2eaaebdcca3ed3c4"
ctr: failed to extract layer sha256:3da369ba7b574143489223beda2653bbf27865104cc4e7031793896b687e878e: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount3707893426: lchown /var/lib/containerd/tmpmounts/containerd-mount3707893426/usr/local/lib/node_modules/s3rver/node_modules/http-errors/node_modules/statuses/HISTORY.md: invalid argument: unknown: exit status 1
2024-08-27 06:51:42.364854396 +0000 [FATAL] command: 'sh -c export OS_LOCALIP=192.168.50.119 && export TERMINUS_IS_CLOUD_VERSION= && /root/install-wizard-v1.8.0-20240826/terminus-cli terminus init --kube k3s '
2024-08-27 06:51:42.366079220 +0000 [FATAL] command error occurs, exit with '1' directly
Then I got this:
You have mail in /var/mail/root
root@terminus:~# cat /var/mail/root
From root@terminus.localdomain Tue Aug 27 06:56:01 2024
Return-Path: <root@terminus.localdomain>
X-Original-To: root
Delivered-To: root@terminus.localdomain
Received: by terminus.localdomain (Postfix, from userid 0)
id E7159381860; Tue, 27 Aug 2024 06:56:01 +0000 (UTC)
From: root@terminus.localdomain (Cron Daemon)
To: root@terminus.localdomain
Subject: Cron <root@terminus> test -x /usr/sbin/anacron || { cd / && run-parts --report /etc/cron.daily; }
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 8bit
X-Cron-Env: <SHELL=/bin/sh>
X-Cron-Env: <PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin>
X-Cron-Env: <HOME=/root>
X-Cron-Env: <LOGNAME=root>
Message-Id: <20240827065601.E7159381860@terminus.localdomain>
Date: Tue, 27 Aug 2024 06:56:01 +0000 (UTC)
/etc/cron.daily/ntpdate:
CLOCK: step_systime: Operation not permitted
2024-08-27 06:56:01.859267 (+0000) +0.000878 +/- 0.008278 pool.ntp.org 103.17.182.30 s2 no-leap
@husniadil Could you please share with us how's your 'unprivileged LXC on PVE' installing. Does it follow this https://pve.proxmox.com/wiki/Unprivileged_LXC_containers docs configuration? We'll test the installation issue on the same environment, and very appreciate your help.
@eball it was done via the GUI.
The Unprivileged container and Nesting were set to true.
@husniadil thx, we'll test it later
My Proxmox is somehow unstable and freezing. I have replaced it with Windows, so I might not be able to help on this very soon. I am now trying to install terminus on Windows. Will get back to Proxmox later if possible (using Hyper-v).
./install_cmd.sh: line 2221: rm -rf /tmp/install_log: No such file or directory
2024-08-22 22:40:51.429681907 +0900 [INFO] Start to Install Terminus ...
debian
2024-08-22 22:40:51.432773495 +0900 [INFO] Precheck and Installing dependencies ...
2024-08-22 22:40:51.442545015 +0900 [FATAL] unsupported os version ''
2024-08-22 22:40:51.443663124 +0900 [FATAL] command error occurs, exit with '1' directly