pimox / pimox7

Proxmox V7 for Raspberry Pi
1.7k stars 157 forks source link

issues starting up CL #150

Open sanderweg opened 1 year ago

sanderweg commented 1 year ago

hi,

i'm fairly new to proxmox but i already manage to build a cluster withe 4 Pi's. now i'm trying to build a CL but it keeps crasing on boot. in de console line it gives me this error code

lxc-console: 101: ../src/lxc/tools/lxc_console.c: main: 129 101 is not running

TheBossME commented 1 year ago

I have setup cluster with 2 arm devices with iscsi storage and 1 amd device as quorum.

Let me know your exact setup.

Are you running Proxmox 7 oder Proxmox 8 ? Is it plain Debian used or RaspOS with chroot kernel ?

I also setup a similar config for somebody else and it‘s running with success On 7.4.3 and 8.0.3 Proxmox Arm architecture.

Feel free to,contact me to make a fresh clean and running setup.

sanderweg commented 1 year ago

hi

i'm running the proxmox 7 version (7.2 to be exact). the OS that are running on the Pi's are the debianbullseye from the rasbarry image aplication. i have not attache a storage device yet so i still run the micro sd cards withe 64 gb. i'm planning to do in the future.

TheBossME commented 1 year ago

Building a Cluster without a shared storage for the nodes isn‘t possible.

sanderweg commented 1 year ago

i can't use the local storage that is on 1 of my pi"s ? i have a synology Nas where i tried to make a shared storrage but that wasn't going as planned

TheBossME commented 1 year ago

Create an iSCSI LUN in needed size for the cluster on the Synology NAS if there is a 1GB network connection on your LAN.

Use VLAN‘s if possible in your network for the cluster communication. (Only recommendation).

Install open-iscsi on both nodes (if not installed automatically) Run scsi discovery on the nodes (keep in mind, that you have min 3 nodes for quorum)

Change the manual startup for iSCSI setting to Automatic on all nodes use only static ip addresses (no SLAAC) for the iscsi connection. Do prefer ipv4 static.

To,see the iscsi LUNs on the Proxmox nodes, you can use the iscsi option in web interface, but I do prefer cli only on the nodes.

Good luck 👍🍀

sanderweg commented 1 year ago

aah thank you. i manage to make a shared storage trough ISCSIs. but i still get the error when i want to boot up my first container

lxc-console: 100: ../src/lxc/tools/lxc_console.c: main: 129 100 is not running

TheBossME commented 1 year ago

do you get that rootfs image from here ?

https://us.lxd.images.canonical.com/images/debian/bookworm/arm64/default/

You need Arm LXC default Container templates. The templates you see from web interface are amd64 templates and not useable with arm devices.

If yes, keep in mind to not setup dhcp and slaac before „apt update“ and installing ifupdown package with "apt install ifupdown" from repo into the LXC container after you have an ip with "dhclient" command, so please start the container with static and no ip setup first.

image

image

Recommendations for the Proxmox node:

Please make a fresh installation from that repo:

https://github.com/jiangcuo/Proxmox-Port/blob/main/help/repo.md And Flash Debian plain image, not raspos.

https://raspi.debian.net/tested-images/

I've converted the image after 1st boot from a running arm64 Linux to btrfs (btrfs-progs) installed first to use the snapshot features like the btrfs on amd64.

So raspberry run very similar than the amd64 supported distribution.

You found me on Discord if you like.

sanderweg commented 1 year ago

do you mean make a whole new proxcluster withe the new clients? that might be handy to get your discord cause i'm running in a lot of issues withe this. i will build from a plain new debian image then add the repo's and then run the script .

TheBossME commented 1 year ago

Correct.

If you like to contact me on discord

https://discord.gg/rpicloud

Ask for Beatrice in the voice channels, voice language is German.

sanderweg commented 1 year ago

thank you, i added you on discord. now i'm trying to use bookworm but every time im making the new sd card it doesn't remember my user credentials. is there a standart user account i know nothing about? XD