pimox / pimox7

Proxmox V7 for Raspberry Pi
1.71k stars 156 forks source link

ZFS does not work #87

Closed JWheelMaker closed 2 years ago

JWheelMaker commented 2 years ago

Hey there! For any reason ZFS does not work in my Pimox7 Instance.

When I choose ZFS in the node menu I get the following error: command '/sbin/zpool list -HpPLo name,size,alloc,free,frag,dedup,health' failed: exit code 1 (500)

I tried executing zfs list in the Shell but then I receive this: Try running '/sbin/modprobe zfs' as root to load them.

Running the recommended command brings me to this message: modprobe: FATAL: Module zfs not found in directory /lib/modules/5.15.56-v8+

I am at a loss what to do now and not sure if this is a general error or just in my installation.

Best regards Jonas

hastmu commented 2 years ago

Hi Jonas,

grafik

so if you have zfs-2.0.3 this dkms will not compile for 5.15, so my workaround was to download zfsonlinux 2.0.7 and compile as deb, install the kernel module package and it was good to go.

UPDATE!: make -> make install (make deb is not needed) - see below

JWheelMaker commented 2 years ago

hastmu

Thanks for the idea! I tried your solution the whole day but I didn't manage to build the deb package. I downloaded the 2.0.7 sources and followed the build docs but it didn't work. Could you explain how you built it?

hastmu commented 2 years ago

Hi, sure: 1) download (is clear) 2) folllow https://openzfs.github.io/openzfs-docs/Developer%20Resources/Building%20ZFS.html in regards to preparation 3) make 4) make install grafik

so you should reboot (which i did not today)

So ending up. grafik

So "make deb" is not needed as i have reproduced it and i just used "make install" in the end, which i forgot in the first comment. (sorry for that - hope i did not waste too much time of your life).

JWheelMaker commented 2 years ago

@hastmu thank you very much for your help and effort :) In the last weeks I honestly have lost sigth of this project but now I'm back in and I was actually successfull! After a few tries your solution worked fine but I found another way to run the latest zfs version. After the usual installation of Pimox you need to perform the following steps:

apt update
apt install dpkg-dev raspberrypi-kernel-headers linux-image-generic
apt install zfs-dkms zfsutils-linux

Then after a reboot everything should work as it should :) (In advance it is important to update your Pi to the latest EEPROM-Version by running rpi-update)

thiscantbeserious commented 1 year ago

I can confirm it works - but its not stable.

For example doing a simple docker image pull from within an LXC container on ZFS Storage will actually crash the Raspberry Pi after slowing it down to a pulp (RPi4B - 8GB). It can be a 100% reproduced with this script here (at least with mine):

https://github.com/tteck/Proxmox/blob/main/setup/homeassistant-install.sh

As such I will switch to BTRFS, which is much more lightweight and less demanding on all my other machines too. I really don't understand how Raspian doesn't ship it by default tought, will require me reinstalling everything on a proper debian or ubuntu image ... I had troubles with ZOL on Ubuntu on an 16 Core Intel too whenever I used Docker, so bye bye ZOL for me.

i-am-gizm0 commented 1 year ago

I was having a similar problem on regular Raspbian... installing the kernel headers helped: https://gizm0.dev/troubleshooting-pi-zfs-modprobe/