mac-linux-free
commented
3 years ago ok that is bad i only use zfs on proxmox
Closed mac-linux-free closed 3 years ago
mac-linux-free
commented
3 years ago ok that is bad i only use zfs on proxmox
mac-linux-free
commented
3 years ago checking for mlockall... yes checking for strlcat... no checking for strlcpy... no checking kernel source directory... /usr/src/linux-headers-5.10.9-1 checking kernel build directory... /usr/src/linux-headers-5.10.9-1 checking kernel source version... 5.10.9-1 checking kernel file name for module symbols... Module.symvers checking whether modules can be built... no configure: error: *** Unable to build an empty module.
root@backup:~/zfs#
fabianishere
commented
3 years ago As far as I know, ZFS (2.0.1) is already built into the kernel so you don't need to build the module yourself.
mac-linux-free
commented
3 years ago could not compile zfs 2.0.1 und 5.10.1 but on 5.9.16
mac-linux-free
commented
3 years ago but i have to compile the userland tools
mac-linux-free
commented
3 years ago could you publish a version with zfs 0.8.5 ?
fabianishere
commented
3 years ago I don't think it is compatible.
mac-linux-free
commented
3 years ago ok thank you...so i have to wait and sadly cannot update
TicoDePano
commented
3 years ago Same problem here, ZFS not working...
fabianishere
commented
3 years ago You are referring then to the userspace ZFS tools shipped with Proxmox, correct?
TicoDePano
commented
3 years ago After updating from 5.9 to 5.10, the ZFS module is not loaded, ending in a initramfs shell, if I remember correctly.
theAeon
commented
3 years ago yeesh.
thanks for the heads up, i was going to run the update.
mac-linux-free
commented
3 years ago ZFS Module is loaded but not fitting to to grub-zfs or zpool tools so no boot. (ZFS 2.0.1)
theAeon
commented
3 years ago so if my boot drive isn't zfs i should be fine?
fabianishere
commented
3 years ago If your boot drive isn’t ZFS you should be able to boot into Proxmox, but possibly you wont’t be able to access your ZFS disks.
mac-linux-free
commented
3 years ago I tried to compile the new userland-tools from proxmox git upstream..but there where errors
mac-linux-free
commented
3 years ago could you pull this version out of your update script?
fabianishere
commented
3 years ago @mac-linux-free To what update script are you referring exactly?
I still intend to publish 5.10.x kernel releases. As soon as the user-space tools are working, users that rely on ZFS can move to 5.10.x.
mac-linux-free
commented
3 years ago 
staehle
commented
3 years ago Can confirm this issue. ZFS partitions do not load in 5.10, but work in 5.9. I have a Ryzen 5950X, so I'm interested in 5.10 so I can finally get thermal sensor data (support added in 5.10). My root partition is on EXT4, but I have 2 SSDs for VMs that use ZFS. I found these interesting bits in the serial console log that may be the issue:
[ 9.698329] Disabling lock debugging due to kernel taint
[ OK ] Created slice User and Session Slice.
[ OK ] Reached target Slices.
[ 9.727963] zfs: Unknown symbol zfs_zstd_compress (err -2)
[ 9.733942] zfs: Unknown symbol zfs_zstd_decompress_level (err -2)
[ OK 9.740562] zfs: Unknown symbol zfs_zstd_cache_reap_now (err -2)
0m] Created slic[ 9.748020] zfs: Unknown symbol zfs_zstd_decompress (err -2)
e system-systemd\x2dfsck.slice.
[ OK ] Set up automount Arbitrary…s File System Automount Point.
[ OK ] Created slice system-zfs\x2dimport.slice.
...
[ 10.363221] RAPL PMU: API unit is 2^-32 Joules, 1 fixed counters, 163840 ms ovfl timer
[ 10.363235] zfs: Unknown symbol zfs_zstd_compress (err -2)
[ 10.364365] pstore: Using crash dump compression: deflate
[ 10.364369] pstore: Registered efi as persistent store backend
[ 10.371286] RAPL PMU: hw unit of domain package 2^-16 Joules
[ OK ] Found device[ 10.395674] cryptd: max_cpu_qlen set to 1000
/dev/t[ 10.395743] zfs: Unknown symbol zfs_zstd_decompress_level (err -2)
tyS0.
[ 10.413573] zfs: Unknown symbol zfs_zstd_cache_reap_now (err -2)
[ 10.420017] AVX2 version of gcm_enc/dec engaged.
[ 10.420124] zfs: Unknown symbol zfs_zstd_decompress (err -2)
[ 10.424768] AES CTR mode by8 optimization enabled
[ OK ] Found device SAMSUNG_MZHPV256HDGL-00000 2.
[ OK ] Found device /dev/pve/swap.
[ 10.501574] zfs: Unknown symbol zfs_zstd_compress (err -2)
[ 10.511763] zfs: Unknown symbol zfs_zstd_decompress_level (err -2)
[ OK ] Found device SanDisk_SSD_PLUS_1000G[ 10.522534] zfs: Unknown symbol zfs_zstd_cache_reap_now (err -2)
B 1.
[ 10.522573] kvm: Nested Virtualization enabled
...
[ OK ] Started Helper to synchronize boot up for ifupdown.
Starting Import ZFS pool satacheap...
Starting Import ZFS pool satafast...
Starting Import ZFS pool m2mpe...
[FAILED] Failed to start Import ZFS pool satacheap.
See 'systemctl status zfs-import@satacheap.service' for details.
[FAILED] Failed to start Import ZFS pool satafast.
See 'systemctl status zfs-import@satafast.service' for details.
[FAILED] Failed to start Import ZFS pool m2mpe.
See 'systemctl status zfs-import@m2mpe.service' for details.
[ OK ] Reached target ZFS pool import target.
Starting Wait for ZFS Volume (zvol) links in /dev...
[ OK ] Reached target Local File Systems.I get these errors on the web console:
Here is the full serial console log:
fabianishere
commented
3 years ago Thank you for the information. It looks like it might be related to this issue: https://github.com/openzfs/zfs/issues/11004
It seems that we don’t install the zzstd.ko module.
mac-linux-free
commented
3 years ago installed 5.10.10 and the compile error is:
`
install -D -t '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/share/bash-completion/completions/' \ '/root/zfsonlinux/zfs-linux_2.0.1/contrib/bash_completion.d/zfs'
mkdir -p '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/sbin/'
mv '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/bin/arc_summary' '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/sbin/arc_summary'
mv '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/bin/arcstat' '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/sbin/arcstat'
mv '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/bin/dbufstat' '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/sbin/dbufstat'
mv '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/sbin/zed' '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/sbin/zed'
mkdir -p /root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/lib/x86_64-linux-gnu
for i in ls /root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/lib/x86_64-linux-gnu/*.so; do \
ln -s /lib/x86_64-linux-gnu/readlink ${i} /root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/lib/x86_64-linux-gnu/basename ${i}; \
rm ${i}; \
done
chmod a-x '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/etc/zfs/zfs-functions'
chmod a-x '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/etc/default/zfs'
chmod a-x '/root/zfsonlinux/zfs-linux_2.0.1/debian/tmp/usr/share/bash-completion/completions/zfs'
make[2]: Leaving directory '/root/zfsonlinux/zfs-linux_2.0.1'
dh_install
dh_install: Cannot find (any matches for) "lib/*/security/pam_zfs_key.so" (tried in ., debian/tmp)
dh_install: zfsutils-linux missing files: lib/*/security/pam_zfs_key.so dh_install: Cannot find (any matches for) "usr/share/pam-configs/zfs_key" (tried in ., debian/tmp)
dh_install: zfsutils-linux missing files: usr/share/pam-configs/zfs_key dh_install: missing files, aborting make[1]: [debian/rules:13: binary] Error 25 make[1]: Leaving directory '/root/zfsonlinux/zfs-linux_2.0.1' dpkg-buildpackage: error: debian/rules binary subprocess returned exit status 2 make: [Makefile:48: libnvpair2linux_2.0.1-pve1_amd64.deb] Error 2 root@backup:~/zfsonlinux# `
fabianishere
commented
3 years ago I have updated the build to resolve the issues regarding ZFS's zzstd.ko module. Could anyone test these new builds and verify whether it resolves the issue for you?
staehle
commented
3 years ago @fabianishere The 5.10.10-2 build appears to have fixed it! Or at least for my usage, the ZFS volumes are auto-mounted now and VMs auto-start successfully from it.
Thanks!
fabianishere
commented
3 years ago @staehle Thanks for the feedback! I will create a proper release for this fix now.
mac-linux-free
commented
3 years ago where can i download this build?
fabianishere
commented
3 years ago @mac-linux-free
You can download the build from here: https://github.com/fabianishere/pve-edge-kernel/actions/runs/510412397 (in the artifacts, you should download debs-.zip which will contain the appropriate Debian packages).
Also, for Proxmox' ZFS package, you should apply to follow patch to get it to build:
index 932153d..53d31ef 100755
--- a/debian/rules
+++ b/debian/rules
@@ -35,7 +35,6 @@ override_dh_auto_configure:
--enable-systemd \
--enable-pyzfs \
--with-python=python3 \
- --with-pammoduledir='/lib/$(DEB_HOST_MULTIARCH)/security' \
--with-systemdunitdir=/lib/systemd/system \
--with-systemdpresetdir=/lib/systemd/system-preset \
--with-systemdgeneratordir=/lib/systemd/system-generators \
@@ -103,7 +102,6 @@ override_dh_auto_clean:
override_dh_missing:
find . -name lib*.la -delete
- rm debian/tmp/lib/$(DEB_HOST_MULTIARCH)/security/pam_zfs_key.la
dh_missing --fail-missing
override_dh_installdocs:
diff --git a/debian/zfsutils-linux.install b/debian/zfsutils-linux.install
index 04f0fe4..77b3ab8 100644
--- a/debian/zfsutils-linux.install
+++ b/debian/zfsutils-linux.install
@@ -2,7 +2,6 @@
etc/default/zfs
etc/zfs/zfs-functions
etc/zfs/zpool.d/
-lib/*/security/pam_zfs_key.so
lib/systemd/system-preset/
lib/systemd/system/zfs-import-cache.service
lib/systemd/system/zfs-import-scan.service
@@ -119,4 +118,3 @@ usr/share/man/man8/zpoolconcepts.8
usr/share/man/man8/zpoolprops.8
usr/share/man/man8/zstream.8
usr/share/man/man8/zstreamdump.8
-usr/share/pam-configs/zfs_keyAlternatively, you could try this pre-built package for ZFS 2.0.1 with the above patches applied: zfsonlinux-build.tar.gz
mac-linux-free
commented
3 years ago thank you very much but this error occurs:
`root@backup:~/2.0# dpkg -i libzfs3linux_2.0.1-pve1_amd64.deb (Reading database ... 375638 files and directories currently installed.) Preparing to unpack libzfs3linux_2.0.1-pve1_amd64.deb ... Unpacking libzfs3linux (2.0.1-pve1) over (2.0.1-pve1) ... dpkg: dependency problems prevent configuration of libzfs3linux: libzfs3linux depends on libc6 (>= 2.29); however: Version of libc6:amd64 on system is 2.28-10.
dpkg: error processing package libzfs3linux (--install): dependency problems - leaving unconfigured Processing triggers for libc-bin (2.28-10) ... Errors were encountered while processing: libzfs3linux root@backup:~/2.0# `
mac-linux-free
commented
3 years ago Is there a solution to the libc problem?
fabianishere
commented
3 years ago @mac-linux-free Could you try to build the package yourself? This issue might be related to the build environment being different from yours.
mac-linux-free
commented
3 years ago I use a plain Proxmox Server to compile. Could you please provide the ZFS deb files working on an standard Proxmox Server?
mac-linux-free
commented
3 years ago Ok so I have to wait for Proxmox 6.4?
fabianishere
commented
3 years ago @mac-linux-free You can always try to build the package yourself. I don’t have time currently to setup a compatible build environment for the package.
mac-linux-free
commented
3 years ago Ok thank you. I'll close the issue. Could you please provide the patch syntax and the patch file. I did it manually editing the files and it worked.
fabianishere
commented
3 years ago The patch I used is the one that I have posted previously.
mac-linux-free
commented
3 years ago but patch -n -p did not work
fabianishere
commented
3 years ago Hmm, what about git apply?
I have not tested ZFS on Linux 5.10 myself given that I don't use ZFS. However, I believe it should work since ZFS 2.0.1: https://github.com/openzfs/zfs/releases/tag/zfs-2.0.1