zfs module doesn't work in latest kernel (6.2.9-100.fc36) and "dnf remove zfs" tries to remove dkms, libvirt etc.

[gmipf]

System information

Distribution Name | Fedora Distribution Version | 36 Kernel Version | 6.2.7-100.fc36 Architecture | x86_64 OpenZFS Version | zfs-2.1.9-1

Describe the problem you're observing

Since zfs module doesn't work in the latest 6.2.9-100.fc36 kernel anymore I wanted to remove it, since I don't need it.

Trying to reinstall the latest kernel-core again results in the following:

Building module:
Cleaning build area...
make -j24 KERNELRELEASE=6.2.9-100.fc36.x86_64..........(bad exit status: 2)
Error! Bad return status for module build on kernel: 6.2.9-100.fc36.x86_64 (x86_64)
Consult /var/lib/dkms/zfs/2.1.9/build/make.log for more information.
Error! One or more modules failed to install during autoinstall.
Refer to previous errors for more information.
 Failed. 

Trying to remove zfs:

Dependencies resolved.
============================================================================================================================================================================================================================================
 Package                                                                         Architecture                                Version                                                    Repository                                     Size
============================================================================================================================================================================================================================================
Removing:
 zfs                                                                             x86_64                                      2.1.9-1.fc36                                               @zfs                                          1.7 M
Removing dependent packages:
 libvirt-daemon-kvm                                                              x86_64                                      8.1.0-2.fc36                                               @fedora                                         0  
Removing unused dependencies:
 dkms                                                                            noarch                                      3.0.10-1.fc36                                              @updates                                      188 k
 glusterfs                                                                       x86_64                                      10.3-1.fc36                                                @updates                                      2.7 M
 glusterfs-cli                                                                   x86_64                                      10.3-1.fc36                                                @updates                                      480 k
 glusterfs-fuse                                                                  x86_64                                      10.3-1.fc36                                                @updates                                      563 k
 libglusterd0                                                                    x86_64                                      10.3-1.fc36                                                @updates                                       21 k
 libnvpair3                                                                      x86_64                                      2.1.9-1.fc36                                               @zfs                                          105 k
 libuutil3                                                                       x86_64                                      2.1.9-1.fc36                                               @zfs                                           71 k
 libvirt-daemon-driver-interface                                                 x86_64                                      8.1.0-2.fc36                                               @fedora                                       594 k
 libvirt-daemon-driver-nodedev                                                   x86_64                                      8.1.0-2.fc36                                               @fedora                                       659 k
 libvirt-daemon-driver-nwfilter                                                  x86_64                                      8.1.0-2.fc36                                               @fedora                                       680 k
 libvirt-daemon-driver-storage                                                   x86_64                                      8.1.0-2.fc36                                               @fedora                                         0  
 libvirt-daemon-driver-storage-disk                                              x86_64                                      8.1.0-2.fc36                                               @fedora                                        32 k
 libvirt-daemon-driver-storage-gluster                                           x86_64                                      8.1.0-2.fc36                                               @fedora                                        40 k
 libvirt-daemon-driver-storage-iscsi                                             x86_64                                      8.1.0-2.fc36                                               @fedora                                        24 k
 libvirt-daemon-driver-storage-iscsi-direct                                      x86_64                                      8.1.0-2.fc36                                               @fedora                                        32 k
 libvirt-daemon-driver-storage-logical                                           x86_64                                      8.1.0-2.fc36                                               @fedora                                        32 k
 libvirt-daemon-driver-storage-mpath                                             x86_64                                      8.1.0-2.fc36                                               @fedora                                        16 k
 libvirt-daemon-driver-storage-rbd                                               x86_64                                      8.1.0-2.fc36                                               @fedora                                        44 k
 libvirt-daemon-driver-storage-scsi                                              x86_64                                      8.1.0-2.fc36                                               @fedora                                        24 k
 libvirt-daemon-driver-storage-sheepdog                                          x86_64                                      8.1.0-2.fc36                                               @fedora                                        20 k
 libvirt-daemon-driver-storage-zfs                                               x86_64                                      8.1.0-2.fc36                                               @fedora                                        24 k
 libzfs5                                                                         x86_64                                      2.1.9-1.fc36                                               @zfs                                          592 k
 libzpool5                                                                       x86_64                                      2.1.9-1.fc36                                               @zfs                                          4.0 M
 mdevctl                                                                         x86_64                                      1.2.0-1.fc36                                               @updates                                      1.9 M
 pcp-conf                                                                        x86_64                                      6.0.1-2.fc36                                               @updates                                       66 k
 pcp-libs                                                                        x86_64                                      6.0.1-2.fc36                                               @updates                                      1.5 M
 perl                                                                            x86_64                                      4:5.34.1-486.fc36                                          @fedora                                         0  
 perl-Algorithm-Diff                                                             noarch                                      1.2010-5.fc36                                              @fedora                                       108 k
 perl-Archive-Tar                                                                noarch                                      2.40-2.fc36                                                @fedora                                       154 k
 perl-Archive-Zip                                                                noarch                                      1.68-7.fc36                                                @fedora                                       292 k
 perl-Attribute-Handlers                                                         noarch                                      1.01-486.fc36                                              @fedora                                        38 k
 perl-CPAN                                                                       noarch                                      2.34-1.fc36                                                @updates                                      1.9 M
 perl-CPAN-DistnameInfo                                                          noarch                                      0.12-24.fc36                                               @fedora                                        11 k
 perl-Compress-Bzip2                                                             x86_64                                      2.28-7.fc36                                                @fedora                                       147 k
 perl-Compress-Raw-Lzma                                                          x86_64                                      2.201-7.fc36                                               @updates                                      122 k
 perl-Config-Extensions                                                          noarch                                      0.03-486.fc36                                              @fedora                                       3.6 k
 perl-Config-Perl-V                                                              noarch                                      0.33-481.fc36                                              @fedora                                        25 k
 perl-DBM_Filter                                                                 noarch                                      0.06-486.fc36                                              @fedora                                        34 k
 perl-DB_File                                                                    x86_64                                      1.857-1.fc36                                               @fedora                                       190 k
 perl-Data-Section                                                               noarch                                      0.200007-15.fc36                                           @fedora                                        42 k
 perl-Devel-Peek                                                                 x86_64                                      1.30-486.fc36                                              @fedora                                        45 k
 perl-Devel-SelfStubber                                                          noarch                                      1.06-486.fc36                                              @fedora                                       7.7 k
 perl-Devel-Size                                                                 x86_64                                      0.83-11.fc36                                               @fedora                                        46 k
 perl-DirHandle                                                                  noarch                                      1.05-486.fc36                                              @fedora                                       4.3 k
 perl-Dumpvalue                                                                  noarch                                      2.27-486.fc36                                              @fedora                                        21 k
 perl-Encode-devel                                                               x86_64                                      4:3.17-485.fc36                                            @updates                                      100 k
 perl-Env                                                                        noarch                                      1.05-479.fc36                                              @fedora                                        26 k
 perl-ExtUtils-CBuilder                                                          noarch                                      1:0.280236-479.fc36                                        @fedora                                        96 k
 perl-ExtUtils-Embed                                                             noarch                                      1.35-486.fc36                                              @fedora                                        16 k
 perl-ExtUtils-MM-Utils                                                          noarch                                      2:7.64-2.fc36                                              @fedora                                       3.2 k
 perl-ExtUtils-Miniperl                                                          noarch                                      1.10-486.fc36                                              @fedora                                       8.7 k
 perl-File-DosGlob                                                               x86_64                                      1.12-486.fc36                                              @fedora                                        26 k
 perl-File-Fetch                                                                 noarch                                      1.04-1.fc36                                                @fedora                                        59 k
 perl-File-HomeDir                                                               noarch                                      1.006-5.fc36                                               @fedora                                       122 k
 perl-File-Which                                                                 noarch                                      1.27-4.fc36                                                @fedora                                        31 k
 perl-FileCache                                                                  noarch                                      1.10-486.fc36                                              @fedora                                       8.4 k
 perl-Filter-Simple                                                              noarch                                      0.96-479.fc36                                              @fedora                                        51 k
 perl-FindBin                                                                    noarch                                      1.52-486.fc36                                              @fedora                                       7.4 k
 perl-GDBM_File                                                                  x86_64                                      1:1.19-486.fc36                                            @fedora                                        52 k
 perl-Hash-Util                                                                  x86_64                                      0.25-486.fc36                                              @fedora                                        52 k
 perl-Hash-Util-FieldHash                                                        x86_64                                      1.21-486.fc36                                              @fedora                                        60 k
 perl-I18N-Collate                                                               noarch                                      1.02-486.fc36                                              @fedora                                       8.0 k
 perl-I18N-LangTags                                                              noarch                                      0.45-486.fc36                                              @fedora                                        85 k
 perl-IO-Compress-Lzma                                                           noarch                                      2.101-5.fc36                                               @fedora                                       207 k
 perl-IO-Zlib                                                                    noarch                                      1:1.11-479.fc36                                            @fedora                                        25 k
 perl-IPC-Cmd                                                                    noarch                                      2:1.04-480.fc36                                            @fedora                                        85 k
 perl-IPC-SysV                                                                   x86_64                                      2.09-480.fc36                                              @fedora                                        75 k
 perl-Locale-Maketext                                                            noarch                                      1.29-480.fc36                                              @fedora                                       171 k
 perl-Locale-Maketext-Simple                                                     noarch                                      1:0.21-486.fc36                                            @fedora                                        14 k
 perl-MRO-Compat                                                                 noarch                                      0.15-2.fc36                                                @fedora                                        43 k
 perl-Math-BigInt-FastCalc                                                       x86_64                                      0.501.200-2.fc36                                           @fedora                                        44 k
 perl-Math-BigRat                                                                noarch                                      0.2622-1.fc36                                              @updates                                      115 k
 perl-Memoize                                                                    noarch                                      1.03-486.fc36                                              @fedora                                        82 k
 perl-Module-Build                                                               noarch                                      2:0.42.31-11.fc36                                          @fedora                                       653 k
 perl-Module-CoreList                                                            noarch                                      1:5.20230320-1.fc36                                        @updates                                      1.0 M
 perl-Module-CoreList-tools                                                      noarch                                      1:5.20230320-1.fc36                                        @updates                                       19 k
 perl-Module-Load                                                                noarch                                      1:0.36-479.fc36                                            @fedora                                        15 k
 perl-Module-Load-Conditional                                                    noarch                                      0.74-479.fc36                                              @fedora                                        29 k
 perl-Module-Loaded                                                              noarch                                      1:0.08-486.fc36                                            @fedora                                       5.9 k
 perl-Module-Metadata                                                            noarch                                      1.000037-479.fc36                                          @fedora                                        68 k
 perl-Module-Signature                                                           noarch                                      0.88-2.fc36                                                @fedora                                       136 k
 perl-NEXT                                                                       noarch                                      0.68-486.fc36                                              @fedora                                        25 k
 perl-Net                                                                        noarch                                      1.02-486.fc36                                              @fedora                                        27 k
 perl-Net-Ping                                                                   noarch                                      2.75-1.fc36                                                @updates                                      135 k
 perl-ODBM_File                                                                  x86_64                                      1.17-486.fc36                                              @fedora                                        34 k
 perl-Opcode                                                                     x86_64                                      1.50-486.fc36                                              @fedora                                        55 k
 perl-Params-Check                                                               noarch                                      1:0.38-479.fc36                                            @fedora                                        28 k
 perl-Perl-OSType                                                                noarch                                      1.010-480.fc36                                             @fedora                                        33 k
 perl-PerlIO-via-QuotedPrint                                                     noarch                                      0.09-479.fc36                                              @fedora                                        30 k
 perl-Pod-Checker                                                                noarch                                      4:1.75-1.fc36                                              @updates                                       52 k
 perl-Pod-Functions                                                              noarch                                      1.13-486.fc36                                              @fedora                                        14 k
 perl-Pod-Html                                                                   noarch                                      1.27-486.fc36                                              @fedora                                        38 k
 perl-Safe                                                                       noarch                                      2.43-486.fc36                                              @fedora                                        32 k
 perl-Search-Dict                                                                noarch                                      1.07-486.fc36                                              @fedora                                       5.6 k
 perl-SelfLoader                                                                 noarch                                      1.26-486.fc36                                              @fedora                                        23 k
 perl-Software-License                                                           noarch                                      0.104001-2.fc36                                            @fedora                                       459 k
 perl-Sys-Syslog                                                                 x86_64                                      0.36-480.fc36                                              @fedora                                        99 k
 perl-Term-Complete                                                              noarch                                      1.403-486.fc36                                             @fedora                                       6.7 k
 perl-Test                                                                       noarch                                      1.31-486.fc36                                              @fedora                                        38 k
 perl-Text-Abbrev                                                                noarch                                      1.02-486.fc36                                              @fedora                                       4.0 k
 perl-Text-Balanced                                                              noarch                                      2.04-479.fc36                                              @fedora                                       107 k
 perl-Text-Diff                                                                  noarch                                      1.45-14.fc36                                               @fedora                                        84 k
 perl-Text-Glob                                                                  noarch                                      0.11-16.fc36                                               @fedora                                       8.6 k
 perl-Text-Template                                                              noarch                                      1.60-2.fc36                                                @fedora                                       113 k
 perl-Thread                                                                     noarch                                      3.05-486.fc36                                              @fedora                                        13 k
 perl-Thread-Semaphore                                                           noarch                                      2.13-486.fc36                                              @fedora                                        11 k
 perl-Tie-File                                                                   noarch                                      1.06-486.fc36                                              @fedora                                        86 k
 perl-Tie-Memoize                                                                noarch                                      1.1-486.fc36                                               @fedora                                       7.1 k
 perl-Time                                                                       noarch                                      1.03-486.fc36                                              @fedora                                        13 k
 perl-Unicode-Collate                                                            x86_64                                      1.31-1.fc36                                                @fedora                                       4.9 M
 perl-Unicode-Normalize                                                          x86_64                                      1.28-479.fc36                                              @fedora                                       645 k
 perl-Unicode-UCD                                                                noarch                                      0.75-486.fc36                                              @fedora                                       206 k
 perl-User-pwent                                                                 noarch                                      1.03-486.fc36                                              @fedora                                        19 k
 perl-autouse                                                                    noarch                                      1.11-486.fc36                                              @fedora                                       6.8 k
 perl-bignum                                                                     noarch                                      0.65-1.fc36                                                @updates                                      134 k
 perl-blib                                                                       noarch                                      1.07-486.fc36                                              @fedora                                       4.1 k
 perl-debugger                                                                   noarch                                      1.60-486.fc36                                              @fedora                                       403 k
 perl-deprecate                                                                  noarch                                      0.04-486.fc36                                              @fedora                                       7.5 k
 perl-diagnostics                                                                noarch                                      1.37-486.fc36                                              @fedora                                       447 k
 perl-encoding-warnings                                                          noarch                                      0.13-486.fc36                                              @fedora                                        11 k
 perl-experimental                                                               noarch                                      0.027-1.fc36                                               @fedora                                        32 k
 perl-fields                                                                     noarch                                      2.27-486.fc36                                              @fedora                                        13 k
 perl-inc-latest                                                                 noarch                                      2:0.500-21.fc36                                            @fedora                                        35 k
 perl-less                                                                       noarch                                      0.03-486.fc36                                              @fedora                                       5.8 k
 perl-libnetcfg                                                                  noarch                                      4:5.34.1-486.fc36                                          @fedora                                        18 k
 perl-local-lib                                                                  noarch                                      2.000029-1.fc36                                            @updates                                      119 k
 perl-meta-notation                                                              noarch                                      5.34.1-486.fc36                                            @fedora                                       2.1 k
 perl-perlfaq                                                                    noarch                                      5.20210520-479.fc36                                        @fedora                                       728 k
 perl-ph                                                                         x86_64                                      5.34.1-486.fc36                                            @fedora                                       266 k
 perl-sigtrap                                                                    noarch                                      1.09-486.fc36                                              @fedora                                        12 k
 perl-sort                                                                       noarch                                      2.04-486.fc36                                              @fedora                                       6.7 k
 perl-utils                                                                      noarch                                      5.34.1-486.fc36                                            @fedora                                       101 k
 perl-vmsish                                                                     noarch                                      1.04-486.fc36                                              @fedora                                       7.5 k
 qemu-kvm                                                                        x86_64                                      2:6.2.0-17.fc36                                            @updates                                        0  
 qemu-system-x86                                                                 x86_64                                      2:6.2.0-17.fc36                                            @updates                                        0  
 sheepdog                                                                        x86_64                                      1.0.1-17.fc36                                              @fedora                                       736 k
 sysstat                                                                         x86_64                                      12.5.6-2.fc36                                              @updates                                      1.6 M
 zfs-dkms                                                                        noarch                                      2.1.9-1.fc36                                               @zfs                                           63 M

Transaction Summary
============================================================================================================================================================================================================================================
Remove  140 Packages

Describe how to reproduce the problem

sudo dnf reinstall kernel-core sudo dnf remove zfs

Include any warning/errors/backtraces from the system logs

[gmipf]

Here are the last lines of "/var/lib/dkms/zfs/2.1.9/build/make.log":

  CC [M]  /var/lib/dkms/zfs/2.1.9/build/module/zfs/vdev_raidz_math_avx512f.o
  CC [M]  /var/lib/dkms/zfs/2.1.9/build/module/zfs/vdev_raidz_math_avx512bw.o
  LD [M]  /var/lib/dkms/zfs/2.1.9/build/module/zfs/zfs.o
  LD [M]  /var/lib/dkms/zfs/2.1.9/build/module/zstd/zzstd.o
  MODPOST /var/lib/dkms/zfs/2.1.9/build/module/Module.symvers
ERROR: modpost: GPL-incompatible module zfs.ko uses GPL-only symbol 'bio_start_io_acct'
ERROR: modpost: GPL-incompatible module zfs.ko uses GPL-only symbol 'bio_end_io_acct_remapped'
make[4]: *** [scripts/Makefile.modpost:138: /var/lib/dkms/zfs/2.1.9/build/module/Module.symvers] Error 1
make[3]: *** [Makefile:1977: modpost] Error 2
make[3]: Leaving directory '/usr/src/kernels/6.2.9-100.fc36.x86_64'
make[2]: *** [Makefile:55: modules-Linux] Error 2
make[2]: Leaving directory '/var/lib/dkms/zfs/2.1.9/build/module'
make[1]: *** [Makefile:933: all-recursive] Error 1
make[1]: Leaving directory '/var/lib/dkms/zfs/2.1.9/build'
make: *** [Makefile:794: all] Error 2

[rincebrain]

14658, will be fixed in 2.1.10 whenever that comes out.

And as far as why it's removing everything and the kitchen sink, I'd need to look more, but at a glance, it seems like libvirt-daemon-kvm depends on something providing zfs, and then it's just cleaning out dependencies of libvirt-daemon-kvm and zfs that are no longer used, recursively, which is not a bug.

[gmipf]

Yes but it also tries to remove qemu-system-x86 which is a no go. And isn't dkms needed by the proprietary nvidia drivers and a lot other stuff?

[rincebrain]

Well, once you've uninstalled all libvirt's other dependencies, nothing that wanted qemu remained.

And I can't speak to what else is on your system and registered in the package manager, but if you installed the NVIDIA drivers not in RPMs, it's not going to know you need that for that, though I think you can manually mark it as needed and not just a dependency.

[SanyaPilot]

I haven't checked zfs package removal, but this problem really exists with the latest Fedora kernel (6.1.9-200), but on Fedora 37. Time for kernel downgrade...

[gmipf]

Since 2.1.10-1 my latest kernel 6.2.9-100.fc36 boots correctly. But now there is another problem. I was testing other custom modules and wanted to restore all default kernel modules as I always did before like this:

sudo rm -v /lib/modules/$(uname -r)/kernel/fs/ufs/ufs.ko*
koji download-build --rpm kernel-core-$(uname -r).rpm
sudo dnf -y reinstall kernel-core-$(uname -r).rpm

But the default module didn't appear at all this time, I suspect it has to do with the zfs dkms script, here the output:

Downloading [1/1]: kernel-core-6.2.9-100.fc36.x86_64.rpm
File kernel-core-6.2.9-100.fc36.x86_64.rpm already downloaded, skipping
Letzte Prüfung auf abgelaufene Metadaten: vor 0:00:03 am So 16 Apr 2023 05:08:54 CEST.
Abhängigkeiten sind aufgelöst.
======================================================================================================
 Paket                   Architektur        Version                    Paketquelle              Größe
======================================================================================================
Neuinstallieren:
 kernel-core             x86_64             6.2.9-100.fc36             @commandline              15 M

Transaktionszusammenfassung
======================================================================================================

Gesamtgröße: 15 M
Installationsgröße: 64 M
Pakete werden heruntergeladen:
Transaktionsüberprüfung wird ausgeführt
Transaktionsüberprüfung war erfolgreich.
Transaktion wird getestet
Transaktionstest war erfolgreich.
Transaktion wird ausgeführt
  Vorbereitung läuft    :                                                                         1/1 
  Neuinstallieren       : kernel-core-6.2.9-100.fc36.x86_64                                       1/2 
  Ausgeführtes Scriptlet: kernel-core-6.2.9-100.fc36.x86_64                                       1/2 
  Ausgeführtes Scriptlet: kernel-core-6.2.9-100.fc36.x86_64                                       2/2 
dkms: removing: zfs 2.1.10 (6.2.9-100.fc36.x86_64) (x86_64)
Module zfs-2.1.10 for kernel 6.2.9-100.fc36.x86_64 (x86_64).
Before uninstall, this module version was ACTIVE on this kernel.

zavl.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

znvpair.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

zunicode.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

zcommon.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

zfs.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

icp.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

zlua.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

spl.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

zzstd.ko.xz:
 - Uninstallation
   - Deleting from: /lib/modules/6.2.9-100.fc36.x86_64/extra/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.
depmod.....

  Aufräumen             : kernel-core-6.2.9-100.fc36.x86_64                                       2/2 
  Ausgeführtes Scriptlet: kernel-core-6.2.9-100.fc36.x86_64                                       2/2 
dkms: running auto installation service for kernel 6.2.9-100.fc36.x86_64
Error! Could not locate dkms.conf file.
File: /var/lib/dkms/zfs/2.1.9/source/dkms.conf does not exist.
Sign command: /lib/modules/6.2.9-100.fc36.x86_64/build/scripts/sign-file
Signing key: /var/lib/dkms/mok.key
Public certificate (MOK): /var/lib/dkms/mok.pub

and:

config.status: executing depfiles commands
config.status: executing libtool commands
config.status: executing po-directories commands

Building module:
Cleaning build area...
make -j24 KERNELRELEASE=6.2.9-100.fc36.x86_64...........
Signing module /var/lib/dkms/zfs/2.1.10/build/module/avl/zavl.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/nvpair/znvpair.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/unicode/zunicode.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/zcommon/zcommon.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/zfs/zfs.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/icp/icp.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/lua/zlua.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/spl/spl.ko
Signing module /var/lib/dkms/zfs/2.1.10/build/module/zstd/zzstd.ko

Running the post_build script:
Cleaning build area...

zavl.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

znvpair.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

zunicode.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

zcommon.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

zfs.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

icp.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

zlua.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

spl.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/

zzstd.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/6.2.9-100.fc36.x86_64/extra/
depmod.....
 Done. 
WARNING: Multiple block group profiles detected, see 'man btrfs(5)'
WARNING:    Metadata: single, dup
WARNING:    System: single, dup
dkms: running auto installation service for kernel 6.2.9-100.fc36.x86_64
Error! Could not locate dkms.conf file.
File: /var/lib/dkms/zfs/2.1.9/source/dkms.conf does not exist.
 Done. 

  Überprüfung läuft     : kernel-core-6.2.9-100.fc36.x86_64                                       1/2 
  Überprüfung läuft     : kernel-core-6.2.9-100.fc36.x86_64                                       2/2 

Erneut installiert:
  kernel-core-6.2.9-100.fc36.x86_64                                                                   

Fertig!

[rincebrain]

It seems like it thinks you have DKMS packages for 2.1.9 and 2.1.10 both configured. What does dkms status say? What does rpm -qa | grep zfs say?

[gmipf]

@rincebrain I have upgraded to the new 6.2.10-100.fc36.x86_64 now and already running it. But dkms status still mentions the older version it seems:

Error! Could not locate dkms.conf file.
File: /var/lib/dkms/zfs/2.1.9/source/dkms.conf does not exist.
zfs/2.1.10, 6.2.10-100.fc36.x86_64, x86_64: installed
zfs/2.1.10, 6.2.7-100.fc36.x86_64, x86_64: installed (WARNING! Diff between built and installed module!)
zfs/2.1.10, 6.2.9-100.fc36.x86_64, x86_64: installed

and rpm -qa | grep zfs

libvirt-daemon-driver-storage-zfs-8.1.0-2.fc36.x86_64
zfs-release-2-2.fc36.noarch
libzfs5-2.1.10-1.fc36.x86_64
zfs-dkms-2.1.10-1.fc36.noarch
zfs-2.1.10-1.fc36.x86_64

[rincebrain]

That seems like it still thinks 2.1.9 exists in DKMS's "someone ran dkms add on this" list but it can't find the files for it. Oof. dkms remove -m zfs/2.1.9 should convince it otherwise, possibly with some force flag if need be, without removing 2.1.10.

[gmipf]

sudo dkms remove -m zfs/2.1.9 wasn't the solution, just output this:

Module zfs 2.1.9 is not installed for kernel 6.2.10-100.fc36.x86_64 (x86_64). Skipping...
Module zfs 2.1.9 is not built for kernel 6.2.10-100.fc36.x86_64 (x86_64). Skipping...

Removing this directory fixed it though: sudo mv /var/lib/dkms/zfs/2.1.9 .

My suspicion still was wrong, the ufs module isn't even contained in kernel-core-$(uname -r).rpm but in kernel-modules-extra-$(uname -r).rpm

[rincebrain]

As an aside, where do you find an out of tree ufs kernel module?

[gmipf]

It is in-tree, just recompiled it with different config to enable the write option.