openzfs / zfs

OpenZFS on Linux and FreeBSD
https://openzfs.github.io/openzfs-docs
Other
10.6k stars 1.75k forks source link

Dracut initramfs emergency mode when an extra pool is added. #11249

Closed sotiris-bos closed 1 year ago

sotiris-bos commented 3 years ago

System information

Type Version/Name
Distribution Name Arch Linux
Distribution Version
Linux Kernel 5.4.79-1-lts
Architecture x86_64
ZFS Version v0.8.5-1
SPL Version 0.8.5-1

Describe the problem you're observing

I have my root on encrypted ZFS. Boot is on unencrypted ZFS. I also have one HDD based storage pool and a pool on a Dell ioDrive II Duo PCIe SSD.

My system boots fine with just the boot, root and HDD pools. However, If I add the ioDrive pool to the zpool.cache, regenerate the initramfs (I am using dracut) and then try to boot, I get tossed to the emergency shell. If I exit the shell manually, then boot continues just fine.

Removing the pool, regenerating the initramfs and rebooting gets rid of the problem again.

The ioDrive takes quite a while to initialize. I don't know how relevant this is. Also, booting the system with the ioDrive attached (meaning it still needs the time to be initialized) but its pool not configured to be imported at boot, the system boots fine.

Describe how to reproduce the problem

Include any warning/errors/backtraces from the system logs

-sh-5.0# cat /run/initramfs/rdsosreport.txt 
+ cat /lib/dracut/dracut-
dracut-
+ cat /proc/cmdline
+ sed -e 's/\(ftp:\/\/.*\):.*@/\1:*******@/g;s/\(cifs:\/\/.*\):.*@/\1:*******@/g;s/cifspass=[^ ]*/cifspass=*******/g;s/iscsi:.*@/iscsi:******@/g;s/rd.iscsi.password=[^ ]*/rd.iscsi.password=******/g;s/rd.iscsi.in.password=[^ ]*/rd.iscsi.in.password=******/g'
BOOT_IMAGE=/BOOT@/vmlinuz-linux-lts root=ZFS=/enc/ROOT rw root=ZFS=nasrpool/enc/ROOT loglevel=3 quiet
+ '[' -f /etc/cmdline ']'
+ for _i in /etc/cmdline.d/*.conf
+ '[' -f /etc/cmdline.d/95root-dev.conf ']'
+ echo /etc/cmdline.d/95root-dev.conf
/etc/cmdline.d/95root-dev.conf
+ cat /etc/cmdline.d/95root-dev.conf
+ sed -e 's/\(ftp:\/\/.*\):.*@/\1:*******@/g;s/\(cifs:\/\/.*\):.*@/\1:*******@/g;s/cifspass=[^ ]*/cifspass=*******/g;s/iscsi:.*@/iscsi:******@/g;s/rd.iscsi.password=[^ ]*/rd.iscsi.password=******/g;s/rd.iscsi.in.password=[^ ]*/rd.iscsi.in.password=******/g'
 root=/dev/block/ rootfstype=zfs rootflags=rw,relatime,xattr,posixacl
+ cat /proc/self/mountinfo
1 1 0:2 / / rw shared:1 - rootfs none rw
24 1 0:23 / /sys rw,nosuid,nodev,noexec,relatime shared:2 - sysfs sysfs rw
25 1 0:5 / /proc rw,nosuid,nodev,noexec,relatime shared:10 - proc proc rw
26 1 0:6 / /dev rw,nosuid,noexec shared:11 - devtmpfs devtmpfs rw,size=132023148k,nr_inodes=33005787,mode=755
27 24 0:8 / /sys/kernel/security rw,nosuid,nodev,noexec,relatime shared:3 - securityfs securityfs rw
28 26 0:24 / /dev/shm rw,nosuid,nodev shared:12 - tmpfs tmpfs rw
29 26 0:25 / /dev/pts rw,nosuid,noexec,relatime shared:13 - devpts devpts rw,gid=5,mode=620,ptmxmode=000
30 1 0:26 / /run rw,nosuid,nodev shared:14 - tmpfs tmpfs rw,size=52815304k,nr_inodes=819200,mode=755
31 24 0:27 / /sys/fs/cgroup ro,nosuid,nodev,noexec shared:4 - tmpfs tmpfs ro,size=4096k,nr_inodes=1024,mode=755
32 31 0:28 / /sys/fs/cgroup/unified rw,nosuid,nodev,noexec,relatime shared:5 - cgroup2 cgroup2 rw,nsdelegate
33 31 0:29 / /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:6 - cgroup cgroup rw,xattr,name=systemd
34 24 0:30 / /sys/fs/pstore rw,nosuid,nodev,noexec,relatime shared:7 - pstore pstore rw
35 24 0:31 / /sys/firmware/efi/efivars rw,nosuid,nodev,noexec,relatime shared:8 - efivarfs efivarfs rw
36 24 0:32 / /sys/fs/bpf rw,nosuid,nodev,noexec,relatime shared:9 - bpf none rw,mode=700
37 31 0:33 / /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:15 - cgroup cgroup rw,cpu,cpuacct
38 31 0:34 / /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:16 - cgroup cgroup rw,freezer
39 31 0:35 / /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:17 - cgroup cgroup rw,net_cls,net_prio
40 31 0:36 / /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:18 - cgroup cgroup rw,blkio
41 31 0:37 / /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:19 - cgroup cgroup rw,cpuset
42 31 0:38 / /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:20 - cgroup cgroup rw,memory
43 31 0:39 / /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:21 - cgroup cgroup rw,hugetlb
44 31 0:40 / /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:22 - cgroup cgroup rw,pids
45 31 0:41 / /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:23 - cgroup cgroup rw,rdma
46 31 0:42 / /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:24 - cgroup cgroup rw,devices
47 31 0:43 / /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:25 - cgroup cgroup rw,perf_event
100 24 0:22 / /sys/kernel/config rw,nosuid,nodev,noexec,relatime shared:53 - configfs configfs rw
+ cat /proc/mounts
none / rootfs rw 0 0
sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0
devtmpfs /dev devtmpfs rw,nosuid,noexec,size=132023148k,nr_inodes=33005787,mode=755 0 0
securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0
devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
tmpfs /run tmpfs rw,nosuid,nodev,size=52815304k,nr_inodes=819200,mode=755 0 0
tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,size=4096k,nr_inodes=1024,mode=755 0 0
cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0
cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0
pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0
efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0
none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0
cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0
cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0
cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0
cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0
cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0
cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0
cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0
cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0
cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0
configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0
+ blkid
/dev/sdd1: UUID="488D-4614" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="ba2f1f6b-01"
/dev/sdb1: PARTUUID="50a76323-98d8-11e9-a9ef-0024e82f37ee"
/dev/sdb2: LABEL="main" UUID="4068880524349787059" UUID_SUB="16686133485379142622" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="50b82411-98d8-11e9-a9ef-0024e82f37ee"
/dev/sdc1: PARTUUID="4ac4b64e-98d8-11e9-a9ef-0024e82f37ee"
/dev/sdc2: LABEL="main" UUID="4068880524349787059" UUID_SUB="6444248278969565953" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="4ad4bc39-98d8-11e9-a9ef-0024e82f37ee"
/dev/sda1: UUID="1443-65F8" BLOCK_SIZE="512" TYPE="vfat" PARTUUID="07bedb26-5e0c-6b46-b8bb-5093b02495b2"
/dev/sda2: LABEL="nasbpool" UUID="8926936304853254586" UUID_SUB="8999527589862826686" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="c8572716-2350-384d-967e-10882428274d"
/dev/sda3: LABEL="nasrpool" UUID="18381753640952077507" UUID_SUB="2077051618758709746" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="bc389bb8-a2df-b44c-b147-e0f9616ae52d"
/dev/sde1: PARTUUID="56536a41-98d8-11e9-a9ef-0024e82f37ee"
/dev/sde2: LABEL="main" UUID="4068880524349787059" UUID_SUB="2491358965300709161" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="5663ab35-98d8-11e9-a9ef-0024e82f37ee"
/dev/sdf1: PARTUUID="4591b217-98d8-11e9-a9ef-0024e82f37ee"
/dev/sdf2: LABEL="main" UUID="4068880524349787059" UUID_SUB="15386235235376389156" BLOCK_SIZE="4096" TYPE="zfs_member" PARTUUID="45a157a6-98d8-11e9-a9ef-0024e82f37ee"
/dev/fioa: LABEL="io" UUID="3885660286060511234" UUID_SUB="6172893222530756339" BLOCK_SIZE="4096" TYPE="zfs_member"
/dev/fiob: LABEL="io" UUID="3885660286060511234" UUID_SUB="16174133063736597666" BLOCK_SIZE="4096" TYPE="zfs_member"
/dev/fioc: LABEL="io" UUID="3885660286060511234" UUID_SUB="7500163447568057293" BLOCK_SIZE="4096" TYPE="zfs_member"
/dev/fiod: LABEL="io" UUID="3885660286060511234" UUID_SUB="8597267080448553666" BLOCK_SIZE="4096" TYPE="zfs_member"
/dev/zd0: UUID="6a487e62-63fb-477e-a8d0-55baf3baf3c8" TYPE="swap"
+ blkid -o udev
ID_FS_UUID=488D-4614
ID_FS_UUID_ENC=488D-4614
ID_FS_BLOCK_SIZE=512
ID_FS_TYPE=vfat
ID_FS_PARTUUID=ba2f1f6b-01

ID_FS_LABEL=main
ID_FS_LABEL_ENC=main
ID_FS_UUID=4068880524349787059
ID_FS_UUID_ENC=4068880524349787059
ID_FS_UUID_SUB=16686133485379142622
ID_FS_UUID_SUB_ENC=16686133485379142622
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member
ID_FS_PARTUUID=50b82411-98d8-11e9-a9ef-0024e82f37ee

ID_FS_LABEL=main
ID_FS_LABEL_ENC=main
ID_FS_UUID=4068880524349787059
ID_FS_UUID_ENC=4068880524349787059
ID_FS_UUID_SUB=6444248278969565953
ID_FS_UUID_SUB_ENC=6444248278969565953
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member
ID_FS_PARTUUID=4ad4bc39-98d8-11e9-a9ef-0024e82f37ee

ID_FS_UUID=1443-65F8
ID_FS_UUID_ENC=1443-65F8
ID_FS_BLOCK_SIZE=512
ID_FS_TYPE=vfat
ID_FS_PARTUUID=07bedb26-5e0c-6b46-b8bb-5093b02495b2

ID_FS_LABEL=nasbpool
ID_FS_LABEL_ENC=nasbpool
ID_FS_UUID=8926936304853254586
ID_FS_UUID_ENC=8926936304853254586
ID_FS_UUID_SUB=8999527589862826686
ID_FS_UUID_SUB_ENC=8999527589862826686
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member
ID_FS_PARTUUID=c8572716-2350-384d-967e-10882428274d

ID_FS_LABEL=nasrpool
ID_FS_LABEL_ENC=nasrpool
ID_FS_UUID=18381753640952077507
ID_FS_UUID_ENC=18381753640952077507
ID_FS_UUID_SUB=2077051618758709746
ID_FS_UUID_SUB_ENC=2077051618758709746
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member
ID_FS_PARTUUID=bc389bb8-a2df-b44c-b147-e0f9616ae52d

ID_FS_LABEL=main
ID_FS_LABEL_ENC=main
ID_FS_UUID=4068880524349787059
ID_FS_UUID_ENC=4068880524349787059
ID_FS_UUID_SUB=2491358965300709161
ID_FS_UUID_SUB_ENC=2491358965300709161
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member
ID_FS_PARTUUID=5663ab35-98d8-11e9-a9ef-0024e82f37ee

ID_FS_LABEL=main
ID_FS_LABEL_ENC=main
ID_FS_UUID=4068880524349787059
ID_FS_UUID_ENC=4068880524349787059
ID_FS_UUID_SUB=15386235235376389156
ID_FS_UUID_SUB_ENC=15386235235376389156
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member
ID_FS_PARTUUID=45a157a6-98d8-11e9-a9ef-0024e82f37ee

ID_FS_LABEL=io
ID_FS_LABEL_ENC=io
ID_FS_UUID=3885660286060511234
ID_FS_UUID_ENC=3885660286060511234
ID_FS_UUID_SUB=6172893222530756339
ID_FS_UUID_SUB_ENC=6172893222530756339
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member

ID_FS_LABEL=io
ID_FS_LABEL_ENC=io
ID_FS_UUID=3885660286060511234
ID_FS_UUID_ENC=3885660286060511234
ID_FS_UUID_SUB=16174133063736597666
ID_FS_UUID_SUB_ENC=16174133063736597666
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member

ID_FS_LABEL=io
ID_FS_LABEL_ENC=io
ID_FS_UUID=3885660286060511234
ID_FS_UUID_ENC=3885660286060511234
ID_FS_UUID_SUB=7500163447568057293
ID_FS_UUID_SUB_ENC=7500163447568057293
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member

ID_FS_LABEL=io
ID_FS_LABEL_ENC=io
ID_FS_UUID=3885660286060511234
ID_FS_UUID_ENC=3885660286060511234
ID_FS_UUID_SUB=8597267080448553666
ID_FS_UUID_SUB_ENC=8597267080448553666
ID_FS_BLOCK_SIZE=4096
ID_FS_TYPE=zfs_member

ID_FS_UUID=6a487e62-63fb-477e-a8d0-55baf3baf3c8
ID_FS_UUID_ENC=6a487e62-63fb-477e-a8d0-55baf3baf3c8
ID_FS_TYPE=swap

ID_FS_PARTUUID=50a76323-98d8-11e9-a9ef-0024e82f37ee

ID_FS_PARTUUID=4ac4b64e-98d8-11e9-a9ef-0024e82f37ee

ID_FS_PARTUUID=56536a41-98d8-11e9-a9ef-0024e82f37ee

ID_FS_PARTUUID=4591b217-98d8-11e9-a9ef-0024e82f37ee
+ ls -l /dev/disk/by-id /dev/disk/by-label /dev/disk/by-partuuid /dev/disk/by-path /dev/disk/by-uuid
/dev/disk/by-id:
total 0
lrwxrwxrwx 1 root root  9 Nov 27 17:51 ata-Samsung_SSD_850_EVO_250GB_S2R6NX0J938715V -> ../../sda
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-Samsung_SSD_850_EVO_250GB_S2R6NX0J938715V-part1 -> ../../sda1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-Samsung_SSD_850_EVO_250GB_S2R6NX0J938715V-part2 -> ../../sda2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-Samsung_SSD_850_EVO_250GB_S2R6NX0J938715V-part3 -> ../../sda3
lrwxrwxrwx 1 root root  9 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK6H0YN -> ../../sdc
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK6H0YN-part1 -> ../../sdc1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK6H0YN-part2 -> ../../sdc2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK6H90N -> ../../sdf
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK6H90N-part1 -> ../../sdf1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK6H90N-part2 -> ../../sdf2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK72V1N -> ../../sde
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK72V1N-part1 -> ../../sde1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK72V1N-part2 -> ../../sde2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK76PDN -> ../../sdb
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK76PDN-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ata-WDC_WD100EZAZ-11TDBA0_JEK76PDN-part2 -> ../../sdb2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 usb-SanDisk_Extreme_AA011130151832003483-0:0 -> ../../sdd
lrwxrwxrwx 1 root root 10 Nov 27 17:51 usb-SanDisk_Extreme_AA011130151832003483-0:0-part1 -> ../../sdd1
lrwxrwxrwx 1 root root  9 Nov 27 17:51 wwn-0x5000cca267ed3929 -> ../../sdc
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed3929-part1 -> ../../sdc1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed3929-part2 -> ../../sdc2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 wwn-0x5000cca267ed3a23 -> ../../sdf
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed3a23-part1 -> ../../sdf1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed3a23-part2 -> ../../sdf2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 wwn-0x5000cca267ed7fc5 -> ../../sde
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed7fc5-part1 -> ../../sde1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed7fc5-part2 -> ../../sde2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 wwn-0x5000cca267ed8e39 -> ../../sdb
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed8e39-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5000cca267ed8e39-part2 -> ../../sdb2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 wwn-0x5002538d42388c8c -> ../../sda
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5002538d42388c8c-part1 -> ../../sda1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5002538d42388c8c-part2 -> ../../sda2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 wwn-0x5002538d42388c8c-part3 -> ../../sda3

/dev/disk/by-label:
total 0
lrwxrwxrwx 1 root root 10 Nov 27 17:51 main -> ../../sde2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 nasbpool -> ../../sda2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 nasrpool -> ../../sda3

/dev/disk/by-partuuid:
total 0
lrwxrwxrwx 1 root root 10 Nov 27 17:51 07bedb26-5e0c-6b46-b8bb-5093b02495b2 -> ../../sda1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 4591b217-98d8-11e9-a9ef-0024e82f37ee -> ../../sdf1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 45a157a6-98d8-11e9-a9ef-0024e82f37ee -> ../../sdf2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 4ac4b64e-98d8-11e9-a9ef-0024e82f37ee -> ../../sdc1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 4ad4bc39-98d8-11e9-a9ef-0024e82f37ee -> ../../sdc2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 50a76323-98d8-11e9-a9ef-0024e82f37ee -> ../../sdb1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 50b82411-98d8-11e9-a9ef-0024e82f37ee -> ../../sdb2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 56536a41-98d8-11e9-a9ef-0024e82f37ee -> ../../sde1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 5663ab35-98d8-11e9-a9ef-0024e82f37ee -> ../../sde2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 ba2f1f6b-01 -> ../../sdd1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 bc389bb8-a2df-b44c-b147-e0f9616ae52d -> ../../sda3
lrwxrwxrwx 1 root root 10 Nov 27 17:51 c8572716-2350-384d-967e-10882428274d -> ../../sda2

/dev/disk/by-path:
total 0
lrwxrwxrwx 1 root root  9 Nov 27 17:51 pci-0000:00:1a.0-usb-0:1.2.1:1.0-scsi-0:0:0:0 -> ../../sdd
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:00:1a.0-usb-0:1.2.1:1.0-scsi-0:0:0:0-part1 -> ../../sdd1
lrwxrwxrwx 1 root root  9 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy12-lun-0 -> ../../sdf
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy12-lun-0-part1 -> ../../sdf1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy12-lun-0-part2 -> ../../sdf2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy5-lun-0 -> ../../sda
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy5-lun-0-part1 -> ../../sda1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy5-lun-0-part2 -> ../../sda2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy5-lun-0-part3 -> ../../sda3
lrwxrwxrwx 1 root root  9 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy6-lun-0 -> ../../sdb
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy6-lun-0-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy6-lun-0-part2 -> ../../sdb2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy8-lun-0 -> ../../sdc
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy8-lun-0-part1 -> ../../sdc1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy8-lun-0-part2 -> ../../sdc2
lrwxrwxrwx 1 root root  9 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy9-lun-0 -> ../../sde
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy9-lun-0-part1 -> ../../sde1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 pci-0000:02:00.0-sas-exp0x500056b37789abff-phy9-lun-0-part2 -> ../../sde2

/dev/disk/by-uuid:
total 0
lrwxrwxrwx 1 root root 10 Nov 27 17:51 1443-65F8 -> ../../sda1
lrwxrwxrwx 1 root root 10 Nov 27 17:51 18381753640952077507 -> ../../sda3
lrwxrwxrwx 1 root root 10 Nov 27 17:51 4068880524349787059 -> ../../sde2
lrwxrwxrwx 1 root root 10 Nov 27 17:51 488D-4614 -> ../../sdd1
lrwxrwxrwx 1 root root  9 Nov 27 17:52 6a487e62-63fb-477e-a8d0-55baf3baf3c8 -> ../../zd0
lrwxrwxrwx 1 root root 10 Nov 27 17:51 8926936304853254586 -> ../../sda2
+ for _i in /etc/conf.d/*.conf
+ '[' -f /etc/conf.d/systemd.conf ']'
+ echo /etc/conf.d/systemd.conf
/etc/conf.d/systemd.conf
+ cat /etc/conf.d/systemd.conf
+ sed -e 's/\(ftp:\/\/.*\):.*@/\1:*******@/g;s/\(cifs:\/\/.*\):.*@/\1:*******@/g;s/cifspass=[^ ]*/cifspass=*******/g;s/iscsi:.*@/iscsi:******@/g;s/rd.iscsi.password=[^ ]*/rd.iscsi.password=******/g;s/rd.iscsi.in.password=[^ ]*/rd.iscsi.in.password=******/g'
systemdutildir="/usr/lib/systemd"
systemdsystemunitdir="/usr/lib/systemd/system"
systemdsystemconfdir="/etc/systemd/system"
+ command -v lvm
+ command -v dmsetup
+ cat /proc/mdstat
cat: /proc/mdstat: No such file or directory
+ command -v ip
+ ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether b8:ca:3a:65:75:f4 brd ff:ff:ff:ff:ff:ff
3: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether b8:ca:3a:65:75:f5 brd ff:ff:ff:ff:ff:ff
4: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether b8:ca:3a:65:75:f0 brd ff:ff:ff:ff:ff:ff
    inet 10.0.10.10/24 brd 10.0.10.255 scope global dynamic eno1
       valid_lft 5183963sec preferred_lft 5183963sec
5: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether b8:ca:3a:65:75:f2 brd ff:ff:ff:ff:ff:ff
+ command -v journalctl
+ journalctl -ab --no-pager -o short-monotonic
+ sed -e 's/\(ftp:\/\/.*\):.*@/\1:*******@/g;s/\(cifs:\/\/.*\):.*@/\1:*******@/g;s/cifspass=[^ ]*/cifspass=*******/g;s/iscsi:.*@/iscsi:******@/g;s/rd.iscsi.password=[^ ]*/rd.iscsi.password=******/g;s/rd.iscsi.in.password=[^ ]*/rd.iscsi.in.password=******/g'
-- Logs begin at Fri 2020-11-27 17:51:29 UTC, end at Fri 2020-11-27 17:52:09 UTC. --
[    0.000000] centnas kernel: Linux version 5.4.79-1-lts (linux-lts@archlinux) (gcc version 10.2.0 (GCC)) #1 SMP Sun, 22 Nov 2020 14:22:21 +0000
[    0.000000] centnas kernel: Command line: BOOT_IMAGE=/BOOT@/vmlinuz-linux-lts root=ZFS=/enc/ROOT rw root=ZFS=nasrpool/enc/ROOT loglevel=3 quiet
[    0.000000] centnas kernel: KERNEL supported cpus:
[    0.000000] centnas kernel:   Intel GenuineIntel
[    0.000000] centnas kernel:   AMD AuthenticAMD
[    0.000000] centnas kernel:   Hygon HygonGenuine
[    0.000000] centnas kernel:   Centaur CentaurHauls
[    0.000000] centnas kernel:   zhaoxin   Shanghai  
[    0.000000] centnas kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] centnas kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] centnas kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] centnas kernel: x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] centnas kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] centnas kernel: BIOS-provided physical RAM map:
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000000010000-0x000000000009ffff] usable
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000000100000-0x0000000076690fff] usable
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000076691000-0x0000000076a90fff] ACPI NVS
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000076a91000-0x0000000076b88fff] usable
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000076b89000-0x0000000076d89fff] reserved
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000076d8a000-0x00000000786bffff] usable
[    0.000000] centnas kernel: BIOS-e820: [mem 0x00000000786c0000-0x00000000787bffff] type 20
[    0.000000] centnas kernel: BIOS-e820: [mem 0x00000000787c0000-0x00000000788c3fff] reserved
[    0.000000] centnas kernel: BIOS-e820: [mem 0x00000000788c4000-0x00000000789c3fff] ACPI NVS
[    0.000000] centnas kernel: BIOS-e820: [mem 0x00000000789c4000-0x0000000078a43fff] ACPI data
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000078a44000-0x000000007ca87fff] usable
[    0.000000] centnas kernel: BIOS-e820: [mem 0x000000007cab8000-0x000000007caeffff] usable
[    0.000000] centnas kernel: BIOS-e820: [mem 0x000000007d2f0000-0x000000007d31bfff] reserved
[    0.000000] centnas kernel: BIOS-e820: [mem 0x000000007d31c000-0x000000007d35afff] ACPI data
[    0.000000] centnas kernel: BIOS-e820: [mem 0x000000007d35b000-0x000000007fffffff] reserved
[    0.000000] centnas kernel: BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] centnas kernel: BIOS-e820: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[    0.000000] centnas kernel: BIOS-e820: [mem 0x0000000100000000-0x000000407fffffff] usable
[    0.000000] centnas kernel: NX (Execute Disable) protection: active
[    0.000000] centnas kernel: efi: EFI v2.30 by Dell
[    0.000000] centnas kernel: efi:  ACPI 2.0=0x789a0000  ACPI=0x7899f000  SMBIOS=0x7899d000  MPS=0x7899c000 
[    0.000000] centnas kernel: SMBIOS 2.7 present.
[    0.000000] centnas kernel: DMI: Dell Inc. PowerEdge R720xd/0X3D66, BIOS 2.9.0 12/06/2019
[    0.000000] centnas kernel: tsc: Fast TSC calibration using PIT
[    0.000000] centnas kernel: tsc: Detected 2599.986 MHz processor
[    0.004640] centnas kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.004641] centnas kernel: e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.004646] centnas kernel: last_pfn = 0x4080000 max_arch_pfn = 0x400000000
[    0.004650] centnas kernel: MTRR default type: uncachable
[    0.004650] centnas kernel: MTRR fixed ranges enabled:
[    0.004651] centnas kernel:   00000-9FFFF write-back
[    0.004652] centnas kernel:   A0000-BFFFF uncachable
[    0.004652] centnas kernel:   C0000-C7FFF write-protect
[    0.004653] centnas kernel:   C8000-EBFFF write-back
[    0.004654] centnas kernel:   EC000-FFFFF write-protect
[    0.004654] centnas kernel: MTRR variable ranges enabled:
[    0.004655] centnas kernel:   0 base 000000000000 mask 3FFF80000000 write-back
[    0.004656] centnas kernel:   1 base 000100000000 mask 3FFF00000000 write-back
[    0.004657] centnas kernel:   2 base 000200000000 mask 3FFE00000000 write-back
[    0.004657] centnas kernel:   3 base 000400000000 mask 3FFC00000000 write-back
[    0.004658] centnas kernel:   4 base 000800000000 mask 3FF800000000 write-back
[    0.004659] centnas kernel:   5 base 001000000000 mask 3FF000000000 write-back
[    0.004659] centnas kernel:   6 base 002000000000 mask 3FE000000000 write-back
[    0.004660] centnas kernel:   7 base 004000000000 mask 3FFF80000000 write-back
[    0.004660] centnas kernel:   8 disabled
[    0.004661] centnas kernel:   9 disabled
[    0.004928] centnas kernel: x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.005052] centnas kernel: e820: update [mem 0x80000000-0xffffffff] usable ==> reserved
[    0.005056] centnas kernel: last_pfn = 0x7caf0 max_arch_pfn = 0x400000000
[    0.014003] centnas kernel: found SMP MP-table at [mem 0x000fe710-0x000fe71f]
[    0.014089] centnas kernel: Using GB pages for direct mapping
[    0.014469] centnas kernel: Secure boot could not be determined
[    0.014470] centnas kernel: RAMDISK: [mem 0x35055000-0x36821fff]
[    0.014474] centnas kernel: ACPI: Early table checksum verification disabled
[    0.014476] centnas kernel: ACPI: RSDP 0x00000000789A0000 000024 (v02 DELL  )
[    0.014479] centnas kernel: ACPI: XSDT 0x00000000000F0D88 0000A4 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014483] centnas kernel: ACPI: FACP 0x000000007D33534C 0000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014488] centnas kernel: ACPI: DSDT 0x000000007D31C000 008029 (v01 DELL   PE_SC3   00000001 INTL 20110211)
[    0.014490] centnas kernel: ACPI: FACS 0x000000007D337000 000040
[    0.014492] centnas kernel: ACPI: FACS 0x000000007D337000 000040
[    0.014494] centnas kernel: ACPI: APIC 0x000000007D334478 0001EA (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014497] centnas kernel: ACPI: SPCR 0x000000007D334664 000050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014499] centnas kernel: ACPI: HPET 0x000000007D3346B8 000038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014501] centnas kernel: ACPI: DMAR 0x000000007D3346F4 000190 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014503] centnas kernel: ACPI: MCFG 0x000000007D334A10 00003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014506] centnas kernel: ACPI: WD__ 0x000000007D334A50 000134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014508] centnas kernel: ACPI: SLIC 0x000000007D334B88 000024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014510] centnas kernel: ACPI: ERST 0x000000007D3241EC 000270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014513] centnas kernel: ACPI: HEST 0x000000007D32445C 0005E8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014515] centnas kernel: ACPI: BERT 0x000000007D32402C 000030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014517] centnas kernel: ACPI: EINJ 0x000000007D32405C 000190 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014520] centnas kernel: ACPI: TCPA 0x000000007D3352E4 000064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014522] centnas kernel: ACPI: PC__ 0x000000007D335274 00006E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014524] centnas kernel: ACPI: SRAT 0x000000007D334DB0 0004C0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014527] centnas kernel: ACPI: SSDT 0x000000007D338000 00EE14 (v01 INTEL  PPM RCM  80000001 INTL 20061109)
[    0.014534] centnas kernel: ACPI: Local APIC address 0xfee00000
[    0.014551] centnas kernel: SRAT: PXM 1 -> APIC 0x00 -> Node 0
[    0.014552] centnas kernel: SRAT: PXM 2 -> APIC 0x20 -> Node 1
[    0.014553] centnas kernel: SRAT: PXM 1 -> APIC 0x02 -> Node 0
[    0.014553] centnas kernel: SRAT: PXM 2 -> APIC 0x22 -> Node 1
[    0.014553] centnas kernel: SRAT: PXM 1 -> APIC 0x04 -> Node 0
[    0.014554] centnas kernel: SRAT: PXM 2 -> APIC 0x24 -> Node 1
[    0.014554] centnas kernel: SRAT: PXM 1 -> APIC 0x06 -> Node 0
[    0.014555] centnas kernel: SRAT: PXM 2 -> APIC 0x26 -> Node 1
[    0.014555] centnas kernel: SRAT: PXM 1 -> APIC 0x08 -> Node 0
[    0.014556] centnas kernel: SRAT: PXM 2 -> APIC 0x28 -> Node 1
[    0.014556] centnas kernel: SRAT: PXM 1 -> APIC 0x0a -> Node 0
[    0.014557] centnas kernel: SRAT: PXM 2 -> APIC 0x2a -> Node 1
[    0.014557] centnas kernel: SRAT: PXM 1 -> APIC 0x0c -> Node 0
[    0.014557] centnas kernel: SRAT: PXM 2 -> APIC 0x2c -> Node 1
[    0.014558] centnas kernel: SRAT: PXM 1 -> APIC 0x0e -> Node 0
[    0.014558] centnas kernel: SRAT: PXM 2 -> APIC 0x2e -> Node 1
[    0.014559] centnas kernel: SRAT: PXM 1 -> APIC 0x01 -> Node 0
[    0.014559] centnas kernel: SRAT: PXM 2 -> APIC 0x21 -> Node 1
[    0.014560] centnas kernel: SRAT: PXM 1 -> APIC 0x03 -> Node 0
[    0.014560] centnas kernel: SRAT: PXM 2 -> APIC 0x23 -> Node 1
[    0.014560] centnas kernel: SRAT: PXM 1 -> APIC 0x05 -> Node 0
[    0.014561] centnas kernel: SRAT: PXM 2 -> APIC 0x25 -> Node 1
[    0.014561] centnas kernel: SRAT: PXM 1 -> APIC 0x07 -> Node 0
[    0.014562] centnas kernel: SRAT: PXM 2 -> APIC 0x27 -> Node 1
[    0.014562] centnas kernel: SRAT: PXM 1 -> APIC 0x09 -> Node 0
[    0.014563] centnas kernel: SRAT: PXM 2 -> APIC 0x29 -> Node 1
[    0.014563] centnas kernel: SRAT: PXM 1 -> APIC 0x0b -> Node 0
[    0.014564] centnas kernel: SRAT: PXM 2 -> APIC 0x2b -> Node 1
[    0.014564] centnas kernel: SRAT: PXM 1 -> APIC 0x0d -> Node 0
[    0.014564] centnas kernel: SRAT: PXM 2 -> APIC 0x2d -> Node 1
[    0.014565] centnas kernel: SRAT: PXM 1 -> APIC 0x0f -> Node 0
[    0.014565] centnas kernel: SRAT: PXM 2 -> APIC 0x2f -> Node 1
[    0.014569] centnas kernel: ACPI: SRAT: Node 0 PXM 1 [mem 0x00000000-0x207fffffff]
[    0.014569] centnas kernel: ACPI: SRAT: Node 1 PXM 2 [mem 0x2080000000-0x407fffffff]
[    0.014575] centnas kernel: NODE_DATA(0) allocated [mem 0x207fffc000-0x207fffffff]
[    0.014579] centnas kernel: NODE_DATA(1) allocated [mem 0x407fffc000-0x407fffffff]
[    0.014924] centnas kernel: Zone ranges:
[    0.014924] centnas kernel:   DMA      [mem 0x0000000000010000-0x0000000000ffffff]
[    0.014925] centnas kernel:   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.014926] centnas kernel:   Normal   [mem 0x0000000100000000-0x000000407fffffff]
[    0.014927] centnas kernel:   Device   empty
[    0.014927] centnas kernel: Movable zone start for each node
[    0.014928] centnas kernel: Early memory node ranges
[    0.014929] centnas kernel:   node   0: [mem 0x0000000000010000-0x000000000009ffff]
[    0.014929] centnas kernel:   node   0: [mem 0x0000000000100000-0x0000000076690fff]
[    0.014930] centnas kernel:   node   0: [mem 0x0000000076a91000-0x0000000076b88fff]
[    0.014931] centnas kernel:   node   0: [mem 0x0000000076d8a000-0x00000000786bffff]
[    0.014931] centnas kernel:   node   0: [mem 0x0000000078a44000-0x000000007ca87fff]
[    0.014932] centnas kernel:   node   0: [mem 0x000000007cab8000-0x000000007caeffff]
[    0.014932] centnas kernel:   node   0: [mem 0x0000000100000000-0x000000207fffffff]
[    0.014942] centnas kernel:   node   1: [mem 0x0000002080000000-0x000000407fffffff]
[    0.015153] centnas kernel: Zeroed struct page in unavailable ranges: 16181 pages
[    0.015154] centnas kernel: Initmem setup node 0 [mem 0x0000000000010000-0x000000207fffffff]
[    0.015156] centnas kernel: On node 0 totalpages: 33538251
[    0.015156] centnas kernel:   DMA zone: 64 pages used for memmap
[    0.015157] centnas kernel:   DMA zone: 3850 pages reserved
[    0.015157] centnas kernel:   DMA zone: 3984 pages, LIFO batch:0
[    0.015245] centnas kernel:   DMA32 zone: 7877 pages used for memmap
[    0.015246] centnas kernel:   DMA32 zone: 504123 pages, LIFO batch:63
[    0.026326] centnas kernel:   Normal zone: 516096 pages used for memmap
[    0.026327] centnas kernel:   Normal zone: 33030144 pages, LIFO batch:63
[    0.504975] centnas kernel: Initmem setup node 1 [mem 0x0000002080000000-0x000000407fffffff]
[    0.504978] centnas kernel: On node 1 totalpages: 33554432
[    0.504980] centnas kernel:   Normal zone: 524288 pages used for memmap
[    0.504980] centnas kernel:   Normal zone: 33554432 pages, LIFO batch:63
[    1.106115] centnas kernel: ACPI: PM-Timer IO Port: 0x808
[    1.106119] centnas kernel: ACPI: Local APIC address 0xfee00000
[    1.106129] centnas kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    1.106140] centnas kernel: IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    1.106144] centnas kernel: IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 32-55
[    1.106148] centnas kernel: IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 64-87
[    1.106150] centnas kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    1.106152] centnas kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    1.106153] centnas kernel: ACPI: IRQ0 used by override.
[    1.106154] centnas kernel: ACPI: IRQ9 used by override.
[    1.106156] centnas kernel: Using ACPI (MADT) for SMP configuration information
[    1.106157] centnas kernel: ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    1.106161] centnas kernel: ACPI: SPCR: SPCR table version 1
[    1.106162] centnas kernel: ACPI: SPCR: Unexpected SPCR Access Width.  Defaulting to byte size
[    1.106163] centnas kernel: ACPI: SPCR: console: uart,mmio,0x0
[    1.106165] centnas kernel: TSC deadline timer available
[    1.106166] centnas kernel: smpboot: Allowing 48 CPUs, 16 hotplug CPUs
[    1.106192] centnas kernel: PM: Registered nosave memory: [mem 0x00000000-0x0000ffff]
[    1.106193] centnas kernel: PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    1.106195] centnas kernel: PM: Registered nosave memory: [mem 0x76691000-0x76a90fff]
[    1.106197] centnas kernel: PM: Registered nosave memory: [mem 0x76b89000-0x76d89fff]
[    1.106198] centnas kernel: PM: Registered nosave memory: [mem 0x786c0000-0x787bffff]
[    1.106199] centnas kernel: PM: Registered nosave memory: [mem 0x787c0000-0x788c3fff]
[    1.106199] centnas kernel: PM: Registered nosave memory: [mem 0x788c4000-0x789c3fff]
[    1.106200] centnas kernel: PM: Registered nosave memory: [mem 0x789c4000-0x78a43fff]
[    1.106202] centnas kernel: PM: Registered nosave memory: [mem 0x7ca88000-0x7cab7fff]
[    1.106203] centnas kernel: PM: Registered nosave memory: [mem 0x7caf0000-0x7d2effff]
[    1.106204] centnas kernel: PM: Registered nosave memory: [mem 0x7d2f0000-0x7d31bfff]
[    1.106204] centnas kernel: PM: Registered nosave memory: [mem 0x7d31c000-0x7d35afff]
[    1.106205] centnas kernel: PM: Registered nosave memory: [mem 0x7d35b000-0x7fffffff]
[    1.106205] centnas kernel: PM: Registered nosave memory: [mem 0x80000000-0xdfffffff]
[    1.106206] centnas kernel: PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    1.106206] centnas kernel: PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff]
[    1.106206] centnas kernel: PM: Registered nosave memory: [mem 0xfe000000-0xffffffff]
[    1.106208] centnas kernel: [mem 0x80000000-0xdfffffff] available for PCI devices
[    1.106210] centnas kernel: Booting paravirtualized kernel on bare hardware
[    1.106213] centnas kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    1.200469] centnas kernel: setup_percpu: NR_CPUS:320 nr_cpumask_bits:320 nr_cpu_ids:48 nr_node_ids:2
[    1.204051] centnas kernel: percpu: Embedded 54 pages/cpu s184320 r8192 d28672 u262144
[    1.204062] centnas kernel: pcpu-alloc: s184320 r8192 d28672 u262144 alloc=1*2097152
[    1.204062] centnas kernel: pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 24 26 28 30 
[    1.204066] centnas kernel: pcpu-alloc: [0] 32 34 36 38 40 42 44 46 [1] 01 03 05 07 09 11 13 15 
[    1.204069] centnas kernel: pcpu-alloc: [1] 17 19 21 23 25 27 29 31 [1] 33 35 37 39 41 43 45 47 
[    1.204099] centnas kernel: Built 2 zonelists, mobility grouping on.  Total pages: 66040508
[    1.204100] centnas kernel: Policy zone: Normal
[    1.204101] centnas kernel: Kernel command line: BOOT_IMAGE=/BOOT@/vmlinuz-linux-lts root=ZFS=/enc/ROOT rw root=ZFS=nasrpool/enc/ROOT loglevel=3 quiet
[    1.204158] centnas kernel: printk: log_buf_len individual max cpu contribution: 4096 bytes
[    1.204159] centnas kernel: printk: log_buf_len total cpu_extra contributions: 192512 bytes
[    1.204159] centnas kernel: printk: log_buf_len min size: 131072 bytes
[    1.204345] centnas kernel: printk: log_buf_len: 524288 bytes
[    1.204345] centnas kernel: printk: early log buf free: 117280(89%)
[    1.204839] centnas kernel: mem auto-init: stack:byref_all, heap alloc:on, heap free:off
[    1.216701] centnas kernel: Calgary: detecting Calgary via BIOS EBDA area
[    1.216703] centnas kernel: Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    1.999661] centnas kernel: Memory: 263866840K/268370732K available (12291K kernel code, 1327K rwdata, 4012K rodata, 1712K init, 3396K bss, 4503892K reserved, 0K cma-reserved)
[    1.999669] centnas kernel: random: get_random_u64 called from __kmem_cache_create+0x3e/0x600 with crng_init=0
[    2.000068] centnas kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=48, Nodes=2
[    2.000090] centnas kernel: Kernel/User page tables isolation: enabled
[    2.000120] centnas kernel: ftrace: allocating 37498 entries in 147 pages
[    2.012713] centnas kernel: rcu: Hierarchical RCU implementation.
[    2.012715] centnas kernel: rcu:     RCU restricting CPUs from NR_CPUS=320 to nr_cpu_ids=48.
[    2.012716] centnas kernel: rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    2.012716] centnas kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=48
[    2.015338] centnas kernel: NR_IRQS: 20736, nr_irqs: 1896, preallocated irqs: 16
[    2.015664] centnas kernel: Console: colour dummy device 80x25
[    2.015672] centnas kernel: printk: console [tty0] enabled
[    2.015739] centnas kernel: mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    2.015741] centnas kernel: ACPI: Core revision 20190816
[    2.015879] centnas kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    2.015889] centnas kernel: APIC: Switch to symmetric I/O mode setup
[    2.015890] centnas kernel: DMAR: Host address width 46
[    2.015891] centnas kernel: DMAR: DRHD base: 0x000000d0100000 flags: 0x0
[    2.015896] centnas kernel: DMAR: dmar0: reg_base_addr d0100000 ver 1:0 cap d2078c106f0466 ecap f020de
[    2.015897] centnas kernel: DMAR: DRHD base: 0x000000df100000 flags: 0x1
[    2.015900] centnas kernel: DMAR: dmar1: reg_base_addr df100000 ver 1:0 cap d2078c106f0466 ecap f020de
[    2.015901] centnas kernel: DMAR: RMRR base: 0x0000007f458000 end: 0x0000007f46ffff
[    2.015902] centnas kernel: DMAR: RMRR base: 0x0000007f450000 end: 0x0000007f450fff
[    2.015903] centnas kernel: DMAR: RMRR base: 0x0000007f452000 end: 0x0000007f452fff
[    2.015903] centnas kernel: DMAR: ATSR flags: 0x0
[    2.015905] centnas kernel: DMAR-IR: IOAPIC id 2 under DRHD base  0xd0100000 IOMMU 0
[    2.015906] centnas kernel: DMAR-IR: IOAPIC id 0 under DRHD base  0xdf100000 IOMMU 1
[    2.015907] centnas kernel: DMAR-IR: IOAPIC id 1 under DRHD base  0xdf100000 IOMMU 1
[    2.015907] centnas kernel: DMAR-IR: HPET id 0 under DRHD base 0xdf100000
[    2.015908] centnas kernel: DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    2.015909] centnas kernel: DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    2.016503] centnas kernel: DMAR-IR: Enabled IRQ remapping in xapic mode
[    2.016503] centnas kernel: x2apic: IRQ remapping doesn't support X2APIC mode
[    2.016507] centnas kernel: Switched APIC routing to physical flat.
[    2.017118] centnas kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    2.065906] centnas kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x257a2ed2992, max_idle_ns: 440795215955 ns
[    2.065909] centnas kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 5199.97 BogoMIPS (lpj=25999860)
[    2.065910] centnas kernel: pid_max: default: 49152 minimum: 384
[    2.071081] centnas kernel: LSM: Security Framework initializing
[    2.071085] centnas kernel: Yama: becoming mindful.
[    2.097569] centnas kernel: Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc)
[    2.110810] centnas kernel: Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc)
[    2.111268] centnas kernel: Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    2.111682] centnas kernel: Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    2.111714] centnas kernel: *** VALIDATE tmpfs ***
[    2.111928] centnas kernel: *** VALIDATE proc ***
[    2.112057] centnas kernel: *** VALIDATE cgroup1 ***
[    2.112058] centnas kernel: *** VALIDATE cgroup2 ***
[    2.112147] centnas kernel: mce: CPU0: Thermal monitoring enabled (TM1)
[    2.112192] centnas kernel: process: using mwait in idle threads
[    2.112195] centnas kernel: Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    2.112196] centnas kernel: Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[    2.112202] centnas kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    2.112204] centnas kernel: Spectre V2 : Mitigation: Full generic retpoline
[    2.112205] centnas kernel: Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    2.112205] centnas kernel: Spectre V2 : Enabling Restricted Speculation for firmware calls
[    2.112207] centnas kernel: Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    2.112207] centnas kernel: Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl
[    2.112209] centnas kernel: Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    2.112210] centnas kernel: MDS: Mitigation: Clear CPU buffers
[    2.112453] centnas kernel: Freeing SMP alternatives memory: 32K
[    2.115329] centnas kernel: smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz (family: 0x6, model: 0x3e, stepping: 0x4)
[    2.115508] centnas kernel: Performance Events: PEBS fmt1+, IvyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    2.115515] centnas kernel: ... version:                3
[    2.115516] centnas kernel: ... bit width:              48
[    2.115516] centnas kernel: ... generic registers:      4
[    2.115517] centnas kernel: ... value mask:             0000ffffffffffff
[    2.115517] centnas kernel: ... max period:             00007fffffffffff
[    2.115518] centnas kernel: ... fixed-purpose events:   3
[    2.115518] centnas kernel: ... event mask:             000000070000000f
[    2.115586] centnas kernel: rcu: Hierarchical SRCU implementation.
[    2.115907] centnas kernel: NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    2.115907] centnas kernel: smp: Bringing up secondary CPUs ...
[    2.115907] centnas kernel: x86: Booting SMP configuration:
[    2.115907] centnas kernel: .... node  #1, CPUs:        #1
[    0.010352] centnas kernel: smpboot: CPU 1 Converting physical 0 to logical die 1
[    2.266053] centnas kernel: .... node  #0, CPUs:    #2
[    2.271288] centnas kernel: .... node  #1, CPUs:    #3
[    2.271288] centnas kernel: .... node  #0, CPUs:    #4
[    2.278691] centnas kernel: .... node  #1, CPUs:    #5
[    2.279681] centnas kernel: .... node  #0, CPUs:    #6
[    2.286134] centnas kernel: .... node  #1, CPUs:    #7
[    2.289654] centnas kernel: .... node  #0, CPUs:    #8
[    2.289654] centnas kernel: .... node  #1, CPUs:    #9
[    2.296110] centnas kernel: .... node  #0, CPUs:   #10
[    2.298954] centnas kernel: .... node  #1, CPUs:   #11
[    2.299650] centnas kernel: .... node  #0, CPUs:   #12
[    2.306129] centnas kernel: .... node  #1, CPUs:   #13
[    2.309642] centnas kernel: .... node  #0, CPUs:   #14
[    2.309642] centnas kernel: .... node  #1, CPUs:   #15
[    2.316097] centnas kernel: .... node  #0, CPUs:   #16
[    2.319104] centnas kernel: MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[    2.319104] centnas kernel: .... node  #1, CPUs:   #17
[    2.319781] centnas kernel: .... node  #0, CPUs:   #18
[    2.326139] centnas kernel: .... node  #1, CPUs:   #19
[    2.329686] centnas kernel: .... node  #0, CPUs:   #20
[    2.329686] centnas kernel: .... node  #1, CPUs:   #21
[    2.336101] centnas kernel: .... node  #0, CPUs:   #22
[    2.338940] centnas kernel: .... node  #1, CPUs:   #23
[    2.339656] centnas kernel: .... node  #0, CPUs:   #24
[    2.346150] centnas kernel: .... node  #1, CPUs:   #25
[    2.349673] centnas kernel: .... node  #0, CPUs:   #26
[    2.349673] centnas kernel: .... node  #1, CPUs:   #27
[    2.356113] centnas kernel: .... node  #0, CPUs:   #28
[    2.358977] centnas kernel: .... node  #1, CPUs:   #29
[    2.359639] centnas kernel: .... node  #0, CPUs:   #30
[    2.366139] centnas kernel: .... node  #1, CPUs:   #31
[    2.369649] centnas kernel: smp: Brought up 2 nodes, 32 CPUs
[    2.369649] centnas kernel: smpboot: Max logical packages: 3
[    2.369649] centnas kernel: smpboot: Total of 32 processors activated (166487.94 BogoMIPS)
[    2.387030] centnas kernel: devtmpfs: initialized
[    2.387030] centnas kernel: x86/mm: Memory block size: 2048MB
[    2.387367] centnas kernel: PM: Registering ACPI NVS region [mem 0x76691000-0x76a90fff] (4194304 bytes)
[    2.387367] centnas kernel: PM: Registering ACPI NVS region [mem 0x788c4000-0x789c3fff] (1048576 bytes)
[    2.387367] centnas kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    2.387367] centnas kernel: futex hash table entries: 16384 (order: 8, 1048576 bytes, vmalloc)
[    2.387367] centnas kernel: pinctrl core: initialized pinctrl subsystem
[    2.387367] centnas kernel: PM: RTC time: 17:51:28, date: 2020-11-27
[    2.387367] centnas kernel: NET: Registered protocol family 16
[    2.387367] centnas kernel: audit: initializing netlink subsys (disabled)
[    2.387367] centnas kernel: audit: type=2000 audit(1606499487.370:1): state=initialized audit_enabled=0 res=1
[    2.387367] centnas kernel: cpuidle: using governor ladder
[    2.387367] centnas kernel: cpuidle: using governor menu
[    2.387367] centnas kernel: ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.387367] centnas kernel: ACPI: bus type PCI registered
[    2.387367] centnas kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    2.387367] centnas kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[    2.387367] centnas kernel: PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    2.387367] centnas kernel: PCI: Using configuration type 1 for base access
[    2.387367] centnas kernel: PCI: Dell System detected, enabling pci=bfsort.
[    2.387367] centnas kernel: core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    2.387367] centnas kernel: ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    2.387367] centnas kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    2.387367] centnas kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    2.396107] centnas kernel: ACPI: Added _OSI(Module Device)
[    2.396108] centnas kernel: ACPI: Added _OSI(Processor Device)
[    2.396109] centnas kernel: ACPI: Added _OSI(3.0 _SCP Extensions)
[    2.396110] centnas kernel: ACPI: Added _OSI(Processor Aggregator Device)
[    2.396110] centnas kernel: ACPI: Added _OSI(Linux-Dell-Video)
[    2.396111] centnas kernel: ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    2.396112] centnas kernel: ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    2.403258] centnas kernel: ACPI: 2 ACPI AML tables successfully acquired and loaded
[    2.403668] centnas kernel: ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    2.409349] centnas kernel: ACPI: Interpreter enabled
[    2.409366] centnas kernel: ACPI: (supports S0 S4 S5)
[    2.409367] centnas kernel: ACPI: Using IOAPIC for interrupt routing
[    2.409672] centnas kernel: HEST: Table parsing has been initialized.
[    2.409675] centnas kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    2.409877] centnas kernel: ACPI: Enabled 4 GPEs in block 00 to 3F
[    2.418390] centnas kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    2.418394] centnas kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.418516] centnas kernel: acpi PNP0A08:00: PCIe AER handled by firmware
[    2.418757] centnas kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.418758] centnas kernel: acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.419715] centnas kernel: PCI host bridge to bus 0000:00
[    2.419717] centnas kernel: pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    2.419718] centnas kernel: pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    2.419719] centnas kernel: pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    2.419720] centnas kernel: pci_bus 0000:00: root bus resource [io  0x0d00-0x1fff window]
[    2.419721] centnas kernel: pci_bus 0000:00: root bus resource [io  0xc000-0xdfff window]
[    2.419722] centnas kernel: pci_bus 0000:00: root bus resource [io  0xe000-0xffff window]
[    2.419723] centnas kernel: pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.419724] centnas kernel: pci_bus 0000:00: root bus resource [mem 0xd4000000-0xdfffffff window]
[    2.419725] centnas kernel: pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[    2.419726] centnas kernel: pci_bus 0000:00: root bus resource [bus 00-3d]
[    2.419766] centnas kernel: pci 0000:00:00.0: [8086:0e00] type 00 class 0x060000
[    2.419841] centnas kernel: pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    2.419918] centnas kernel: pci 0000:00:01.0: [8086:0e02] type 01 class 0x060400
[    2.420004] centnas kernel: pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.420120] centnas kernel: pci 0000:00:02.0: [8086:0e04] type 01 class 0x060400
[    2.420207] centnas kernel: pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    2.420340] centnas kernel: pci 0000:00:02.2: [8086:0e06] type 01 class 0x060400
[    2.420426] centnas kernel: pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    2.420515] centnas kernel: pci 0000:00:03.0: [8086:0e08] type 01 class 0x060400
[    2.420556] centnas kernel: pci 0000:00:03.0: enabling Extended Tags
[    2.420606] centnas kernel: pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.420736] centnas kernel: pci 0000:00:04.0: [8086:0e20] type 00 class 0x088000
[    2.420754] centnas kernel: pci 0000:00:04.0: reg 0x10: [mem 0xdf0d8000-0xdf0dbfff 64bit]
[    2.420870] centnas kernel: pci 0000:00:04.1: [8086:0e21] type 00 class 0x088000
[    2.420887] centnas kernel: pci 0000:00:04.1: reg 0x10: [mem 0xdf0dc000-0xdf0dffff 64bit]
[    2.421004] centnas kernel: pci 0000:00:04.2: [8086:0e22] type 00 class 0x088000
[    2.421021] centnas kernel: pci 0000:00:04.2: reg 0x10: [mem 0xdf0e0000-0xdf0e3fff 64bit]
[    2.421145] centnas kernel: pci 0000:00:04.3: [8086:0e23] type 00 class 0x088000
[    2.421162] centnas kernel: pci 0000:00:04.3: reg 0x10: [mem 0xdf0e4000-0xdf0e7fff 64bit]
[    2.421276] centnas kernel: pci 0000:00:04.4: [8086:0e24] type 00 class 0x088000
[    2.421292] centnas kernel: pci 0000:00:04.4: reg 0x10: [mem 0xdf0e8000-0xdf0ebfff 64bit]
[    2.421403] centnas kernel: pci 0000:00:04.5: [8086:0e25] type 00 class 0x088000
[    2.421419] centnas kernel: pci 0000:00:04.5: reg 0x10: [mem 0xdf0ec000-0xdf0effff 64bit]
[    2.421531] centnas kernel: pci 0000:00:04.6: [8086:0e26] type 00 class 0x088000
[    2.421547] centnas kernel: pci 0000:00:04.6: reg 0x10: [mem 0xdf0f0000-0xdf0f3fff 64bit]
[    2.421660] centnas kernel: pci 0000:00:04.7: [8086:0e27] type 00 class 0x088000
[    2.421677] centnas kernel: pci 0000:00:04.7: reg 0x10: [mem 0xdf0f4000-0xdf0f7fff 64bit]
[    2.421787] centnas kernel: pci 0000:00:05.0: [8086:0e28] type 00 class 0x088000
[    2.421906] centnas kernel: pci 0000:00:05.2: [8086:0e2a] type 00 class 0x088000
[    2.422020] centnas kernel: pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[    2.422123] centnas kernel: pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[    2.422213] centnas kernel: pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[    2.422232] centnas kernel: pci 0000:00:16.0: reg 0x10: [mem 0xdf0fb000-0xdf0fb00f 64bit]
[    2.422290] centnas kernel: pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    2.422357] centnas kernel: pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[    2.422375] centnas kernel: pci 0000:00:16.1: reg 0x10: [mem 0xdf0fc000-0xdf0fc00f 64bit]
[    2.422433] centnas kernel: pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[    2.422512] centnas kernel: pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[    2.422532] centnas kernel: pci 0000:00:1a.0: reg 0x10: [mem 0xdf0fd000-0xdf0fd3ff]
[    2.422610] centnas kernel: pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[    2.422640] centnas kernel: pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:00:1c.4: [8086:1d18] type 01 class 0x060400
[    2.422640] centnas kernel: pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[    2.422640] centnas kernel: pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[    2.422640] centnas kernel: pci 0000:00:1d.0: reg 0x10: [mem 0xdf0fe000-0xdf0fe3ff]
[    2.422640] centnas kernel: pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    2.422640] centnas kernel: pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[    2.422640] centnas kernel: pci 0000:01:00.0: [8086:10fb] type 00 class 0x020000
[    2.422640] centnas kernel: pci 0000:01:00.0: reg 0x10: [mem 0xd8d00000-0xd8dfffff 64bit]
[    2.422640] centnas kernel: pci 0000:01:00.0: reg 0x18: [io  0xfcc0-0xfcdf]
[    2.422640] centnas kernel: pci 0000:01:00.0: reg 0x20: [mem 0xd8ff8000-0xd8ffbfff 64bit]
[    2.422640] centnas kernel: pci 0000:01:00.0: reg 0x30: [mem 0xd8000000-0xd807ffff pref]
[    2.422640] centnas kernel: pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:01:00.0: reg 0x184: [mem 0xd5000000-0xd5003fff 64bit pref]
[    2.422640] centnas kernel: pci 0000:01:00.0: VF(n) BAR0 space: [mem 0xd5000000-0xd50fffff 64bit pref] (contains BAR0 for 64 VFs)
[    2.422640] centnas kernel: pci 0000:01:00.0: reg 0x190: [mem 0xd5100000-0xd5103fff 64bit pref]
[    2.422640] centnas kernel: pci 0000:01:00.0: VF(n) BAR3 space: [mem 0xd5100000-0xd51fffff 64bit pref] (contains BAR3 for 64 VFs)
[    2.422640] centnas kernel: pci 0000:01:00.1: [8086:10fb] type 00 class 0x020000
[    2.422640] centnas kernel: pci 0000:01:00.1: reg 0x10: [mem 0xd8e00000-0xd8efffff 64bit]
[    2.422640] centnas kernel: pci 0000:01:00.1: reg 0x18: [io  0xfce0-0xfcff]
[    2.422640] centnas kernel: pci 0000:01:00.1: reg 0x20: [mem 0xd8ffc000-0xd8ffffff 64bit]
[    2.422640] centnas kernel: pci 0000:01:00.1: reg 0x30: [mem 0xd8000000-0xd807ffff pref]
[    2.422640] centnas kernel: pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    2.422640] centnas kernel: pci 0000:01:00.1: reg 0x184: [mem 0xd5200000-0xd5203fff 64bit pref]
[    2.422640] centnas kernel: pci 0000:01:00.1: VF(n) BAR0 space: [mem 0xd5200000-0xd52fffff 64bit pref] (contains BAR0 for 64 VFs)
[    2.422640] centnas kernel: pci 0000:01:00.1: reg 0x190: [mem 0xd5300000-0xd5303fff 64bit pref]
[    2.422640] centnas kernel: pci 0000:01:00.1: VF(n) BAR3 space: [mem 0xd5300000-0xd53fffff 64bit pref] (contains BAR3 for 64 VFs)
[    2.422640] centnas kernel: pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.422640] centnas kernel: pci 0000:00:01.0:   bridge window [io  0xf000-0xffff]
[    2.422640] centnas kernel: pci 0000:00:01.0:   bridge window [mem 0xd8000000-0xd8ffffff]
[    2.422640] centnas kernel: pci 0000:00:01.0:   bridge window [mem 0xd5000000-0xd53fffff 64bit pref]
[    2.422640] centnas kernel: pci 0000:03:00.0: [1aed:2100] type 01 class 0x060400
[    2.422640] centnas kernel: pci 0000:03:00.0: reg 0x10: [mem 0xdb7e0000-0xdb7fffff]
[    2.422640] centnas kernel: pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[    2.455948] centnas kernel: pci 0000:00:02.0: PCI bridge to [bus 03-07]
[    2.455954] centnas kernel: pci 0000:00:02.0:   bridge window [mem 0xd9000000-0xdb7fffff]
[    2.455994] centnas kernel: pci 0000:04:04.0: [1aed:2100] type 01 class 0x060400
[    2.456065] centnas kernel: pci 0000:04:04.0: PME# supported from D0 D3hot D3cold
[    2.456112] centnas kernel: pci 0000:04:05.0: [1aed:2100] type 01 class 0x060400
[    2.456182] centnas kernel: pci 0000:04:05.0: PME# supported from D0 D3hot D3cold
[    2.456230] centnas kernel: pci 0000:04:06.0: [1aed:2100] type 01 class 0x060400
[    2.456298] centnas kernel: pci 0000:04:06.0: PME# supported from D0 D3hot D3cold
[    2.456353] centnas kernel: pci 0000:03:00.0: PCI bridge to [bus 04-07]
[    2.456358] centnas kernel: pci 0000:03:00.0:   bridge window [mem 0xd9000000-0xdaffffff]
[    2.456386] centnas kernel: pci 0000:04:04.0: PCI bridge to [bus 05]
[    2.456427] centnas kernel: pci 0000:06:00.0: [1aed:2001] type 00 class 0x018000
[    2.456477] centnas kernel: pci 0000:06:00.0: reg 0x20: [mem 0xd9ffe000-0xd9ffffff]
[    2.456486] centnas kernel: pci 0000:06:00.0: reg 0x24: [mem 0xd9fc0000-0xd9fdffff]
[    2.456494] centnas kernel: pci 0000:06:00.0: reg 0x30: [mem 0xd9000000-0xd90fffff pref]
[    2.456550] centnas kernel: pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot
[    2.495945] centnas kernel: pci 0000:04:05.0: PCI bridge to [bus 06]
[    2.495951] centnas kernel: pci 0000:04:05.0:   bridge window [mem 0xd9000000-0xd9ffffff]
[    2.495997] centnas kernel: pci 0000:07:00.0: [1aed:2001] type 00 class 0x018000
[    2.496047] centnas kernel: pci 0000:07:00.0: reg 0x20: [mem 0xdaffe000-0xdaffffff]
[    2.496056] centnas kernel: pci 0000:07:00.0: reg 0x24: [mem 0xdafc0000-0xdafdffff]
[    2.496065] centnas kernel: pci 0000:07:00.0: reg 0x30: [mem 0xda000000-0xda0fffff pref]
[    2.496121] centnas kernel: pci 0000:07:00.0: PME# supported from D0 D1 D2 D3hot
[    2.535940] centnas kernel: pci 0000:04:06.0: PCI bridge to [bus 07]
[    2.535950] centnas kernel: pci 0000:04:06.0:   bridge window [mem 0xda000000-0xdaffffff]
[    2.536020] centnas kernel: pci 0000:02:00.0: [1000:0072] type 00 class 0x010400
[    2.536031] centnas kernel: pci 0000:02:00.0: reg 0x10: [io  0xec00-0xecff]
[    2.536038] centnas kernel: pci 0000:02:00.0: reg 0x14: [mem 0xdc7fc000-0xdc7fffff 64bit]
[    2.536045] centnas kernel: pci 0000:02:00.0: reg 0x1c: [mem 0xdc780000-0xdc7bffff 64bit]
[    2.536053] centnas kernel: pci 0000:02:00.0: reg 0x30: [mem 0xdb800000-0xdb87ffff pref]
[    2.536058] centnas kernel: pci 0000:02:00.0: enabling Extended Tags
[    2.536091] centnas kernel: pci 0000:02:00.0: supports D1 D2
[    2.536131] centnas kernel: pci 0000:00:02.2: PCI bridge to [bus 02]
[    2.536133] centnas kernel: pci 0000:00:02.2:   bridge window [io  0xe000-0xefff]
[    2.536136] centnas kernel: pci 0000:00:02.2:   bridge window [mem 0xdb800000-0xdc7fffff]
[    2.536169] centnas kernel: pci 0000:00:03.0: PCI bridge to [bus 08]
[    2.536213] centnas kernel: pci 0000:00:11.0: PCI bridge to [bus 09]
[    2.536255] centnas kernel: pci 0000:00:1c.0: PCI bridge to [bus 0a]
[    2.536334] centnas kernel: pci 0000:0b:00.0: [8086:1521] type 00 class 0x020000
[    2.536370] centnas kernel: pci 0000:0b:00.0: reg 0x10: [mem 0xdd680000-0xdd6fffff]
[    2.536405] centnas kernel: pci 0000:0b:00.0: reg 0x1c: [mem 0xdd7f8000-0xdd7fbfff]
[    2.536440] centnas kernel: pci 0000:0b:00.0: reg 0x30: [mem 0xdc800000-0xdc87ffff pref]
[    2.536554] centnas kernel: pci 0000:0b:00.0: PME# supported from D0 D3hot D3cold
[    2.536601] centnas kernel: pci 0000:0b:00.0: 8.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x2 link at 0000:00:1c.4 (capable of 16.000 Gb/s with 5 GT/s x4 link)
[    2.536707] centnas kernel: pci 0000:0b:00.1: [8086:1521] type 00 class 0x020000
[    2.536742] centnas kernel: pci 0000:0b:00.1: reg 0x10: [mem 0xdd700000-0xdd77ffff]
[    2.536777] centnas kernel: pci 0000:0b:00.1: reg 0x1c: [mem 0xdd7fc000-0xdd7fffff]
[    2.536813] centnas kernel: pci 0000:0b:00.1: reg 0x30: [mem 0xdc800000-0xdc87ffff pref]
[    2.536921] centnas kernel: pci 0000:0b:00.1: PME# supported from D0 D3hot D3cold
[    2.537084] centnas kernel: pci 0000:00:1c.4: PCI bridge to [bus 0b]
[    2.537089] centnas kernel: pci 0000:00:1c.4:   bridge window [mem 0xdc800000-0xdd7fffff]
[    2.537440] centnas kernel: pci 0000:0c:00.0: [1912:0013] type 01 class 0x060400
[    2.540457] centnas kernel: pci 0000:0c:00.0: PME# supported from D0 D3hot D3cold
[    2.541561] centnas kernel: pci 0000:00:1c.7: PCI bridge to [bus 0c-10]
[    2.541566] centnas kernel: pci 0000:00:1c.7:   bridge window [mem 0xdd800000-0xdeffffff]
[    2.541571] centnas kernel: pci 0000:00:1c.7:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.542729] centnas kernel: pci 0000:0d:00.0: [1912:0013] type 01 class 0x060400
[    2.546198] centnas kernel: pci 0000:0d:00.0: PME# supported from D0 D3hot D3cold
[    2.547379] centnas kernel: pci 0000:0d:01.0: [1912:0013] type 01 class 0x060400
[    2.551068] centnas kernel: pci 0000:0d:01.0: PME# supported from D0 D3hot D3cold
[    2.553625] centnas kernel: pci 0000:0c:00.0: PCI bridge to [bus 0d-10]
[    2.553818] centnas kernel: pci 0000:0c:00.0:   bridge window [mem 0xdd800000-0xdeffffff]
[    2.553943] centnas kernel: pci 0000:0c:00.0:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.555153] centnas kernel: pci 0000:0e:00.0: [1912:0012] type 01 class 0x060400
[    2.569631] centnas kernel: pci 0000:0d:00.0: PCI bridge to [bus 0e-0f]
[    2.569847] centnas kernel: pci 0000:0d:00.0:   bridge window [mem 0xdd800000-0xde7fffff]
[    2.569991] centnas kernel: pci 0000:0d:00.0:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.571062] centnas kernel: pci_bus 0000:0f: extended config space not accessible
[    2.571292] centnas kernel: pci 0000:0f:00.0: [102b:0534] type 00 class 0x030000
[    2.571776] centnas kernel: pci 0000:0f:00.0: reg 0x10: [mem 0xd4000000-0xd4ffffff pref]
[    2.572037] centnas kernel: pci 0000:0f:00.0: reg 0x14: [mem 0xde7fc000-0xde7fffff]
[    2.572298] centnas kernel: pci 0000:0f:00.0: reg 0x18: [mem 0xdd800000-0xddffffff]
[    2.573461] centnas kernel: pci 0000:0f:00.0: BAR 0: assigned to efifb
[    2.576512] centnas kernel: pci 0000:0e:00.0: PCI bridge to [bus 0f]
[    2.576735] centnas kernel: pci 0000:0e:00.0:   bridge window [mem 0xdd800000-0xde7fffff]
[    2.576880] centnas kernel: pci 0000:0e:00.0:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.578126] centnas kernel: pci 0000:0d:01.0: PCI bridge to [bus 10]
[    2.578345] centnas kernel: pci 0000:0d:01.0:   bridge window [mem 0xdef00000-0xdeffffff]
[    2.579472] centnas kernel: pci_bus 0000:11: extended config space not accessible
[    2.579516] centnas kernel: pci 0000:00:1e.0: PCI bridge to [bus 11] (subtractive decode)
[    2.579524] centnas kernel: pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    2.579525] centnas kernel: pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    2.579526] centnas kernel: pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df window] (subtractive decode)
[    2.579527] centnas kernel: pci 0000:00:1e.0:   bridge window [io  0x0d00-0x1fff window] (subtractive decode)
[    2.579528] centnas kernel: pci 0000:00:1e.0:   bridge window [io  0xc000-0xdfff window] (subtractive decode)
[    2.579529] centnas kernel: pci 0000:00:1e.0:   bridge window [io  0xe000-0xffff window] (subtractive decode)
[    2.579530] centnas kernel: pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    2.579531] centnas kernel: pci 0000:00:1e.0:   bridge window [mem 0xd4000000-0xdfffffff window] (subtractive decode)
[    2.579531] centnas kernel: pci 0000:00:1e.0:   bridge window [mem 0xfed40000-0xfed44fff window] (subtractive decode)
[    2.579578] centnas kernel: pci_bus 0000:00: on NUMA node 0
[    2.581173] centnas kernel: ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 40-7e])
[    2.581176] centnas kernel: acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.581297] centnas kernel: acpi PNP0A08:01: PCIe AER handled by firmware
[    2.581537] centnas kernel: acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.581538] centnas kernel: acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.582473] centnas kernel: PCI host bridge to bus 0000:40
[    2.582474] centnas kernel: pci_bus 0000:40: root bus resource [io  0x2000-0x3fff window]
[    2.582475] centnas kernel: pci_bus 0000:40: root bus resource [io  0x4000-0x5fff window]
[    2.582476] centnas kernel: pci_bus 0000:40: root bus resource [io  0x6000-0x7fff window]
[    2.582477] centnas kernel: pci_bus 0000:40: root bus resource [io  0x8000-0x9fff window]
[    2.582478] centnas kernel: pci_bus 0000:40: root bus resource [io  0xa000-0xbfff window]
[    2.582479] centnas kernel: pci_bus 0000:40: root bus resource [mem 0xd0000000-0xd3ffffff window]
[    2.582480] centnas kernel: pci_bus 0000:40: root bus resource [bus 40-7e]
[    2.582521] centnas kernel: pci 0000:40:01.0: [8086:0e02] type 01 class 0x060400
[    2.582622] centnas kernel: pci 0000:40:01.0: PME# supported from D0 D3hot D3cold
[    2.582754] centnas kernel: pci 0000:40:02.0: [8086:0e04] type 01 class 0x060400
[    2.582854] centnas kernel: pci 0000:40:02.0: PME# supported from D0 D3hot D3cold
[    2.582984] centnas kernel: pci 0000:40:03.0: [8086:0e08] type 01 class 0x060400
[    2.583031] centnas kernel: pci 0000:40:03.0: enabling Extended Tags
[    2.583089] centnas kernel: pci 0000:40:03.0: PME# supported from D0 D3hot D3cold
[    2.583212] centnas kernel: pci 0000:40:03.2: [8086:0e0a] type 01 class 0x060400
[    2.583311] centnas kernel: pci 0000:40:03.2: PME# supported from D0 D3hot D3cold
[    2.583435] centnas kernel: pci 0000:40:04.0: [8086:0e20] type 00 class 0x088000
[    2.583454] centnas kernel: pci 0000:40:04.0: reg 0x10: [mem 0xd00e0000-0xd00e3fff 64bit]
[    2.583569] centnas kernel: pci 0000:40:04.1: [8086:0e21] type 00 class 0x088000
[    2.583588] centnas kernel: pci 0000:40:04.1: reg 0x10: [mem 0xd00e4000-0xd00e7fff 64bit]
[    2.583700] centnas kernel: pci 0000:40:04.2: [8086:0e22] type 00 class 0x088000
[    2.583719] centnas kernel: pci 0000:40:04.2: reg 0x10: [mem 0xd00e8000-0xd00ebfff 64bit]
[    2.583839] centnas kernel: pci 0000:40:04.3: [8086:0e23] type 00 class 0x088000
[    2.583858] centnas kernel: pci 0000:40:04.3: reg 0x10: [mem 0xd00ec000-0xd00effff 64bit]
[    2.583969] centnas kernel: pci 0000:40:04.4: [8086:0e24] type 00 class 0x088000
[    2.583988] centnas kernel: pci 0000:40:04.4: reg 0x10: [mem 0xd00f0000-0xd00f3fff 64bit]
[    2.584099] centnas kernel: pci 0000:40:04.5: [8086:0e25] type 00 class 0x088000
[    2.584117] centnas kernel: pci 0000:40:04.5: reg 0x10: [mem 0xd00f4000-0xd00f7fff 64bit]
[    2.584227] centnas kernel: pci 0000:40:04.6: [8086:0e26] type 00 class 0x088000
[    2.584246] centnas kernel: pci 0000:40:04.6: reg 0x10: [mem 0xd00f8000-0xd00fbfff 64bit]
[    2.584356] centnas kernel: pci 0000:40:04.7: [8086:0e27] type 00 class 0x088000
[    2.584375] centnas kernel: pci 0000:40:04.7: reg 0x10: [mem 0xd00fc000-0xd00fffff 64bit]
[    2.584484] centnas kernel: pci 0000:40:05.0: [8086:0e28] type 00 class 0x088000
[    2.584615] centnas kernel: pci 0000:40:05.2: [8086:0e2a] type 00 class 0x088000
[    2.584759] centnas kernel: pci 0000:40:01.0: PCI bridge to [bus 41]
[    2.584799] centnas kernel: pci 0000:40:02.0: PCI bridge to [bus 42]
[    2.584839] centnas kernel: pci 0000:40:03.0: PCI bridge to [bus 43]
[    2.584879] centnas kernel: pci 0000:40:03.2: PCI bridge to [bus 44]
[    2.584911] centnas kernel: pci_bus 0000:40: on NUMA node 1
[    2.585002] centnas kernel: ACPI: PCI Root Bridge [P0B1] (domain 0000 [bus 3f])
[    2.585005] centnas kernel: acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.585127] centnas kernel: acpi PNP0A08:02: PCIe AER handled by firmware
[    2.585368] centnas kernel: acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.585369] centnas kernel: acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.585437] centnas kernel: PCI host bridge to bus 0000:3f
[    2.585439] centnas kernel: pci_bus 0000:3f: root bus resource [bus 3f]
[    2.585446] centnas kernel: pci 0000:3f:08.0: [8086:0e80] type 00 class 0x088000
[    2.585502] centnas kernel: pci 0000:3f:09.0: [8086:0e90] type 00 class 0x088000
[    2.585546] centnas kernel: pci 0000:3f:0a.0: [8086:0ec0] type 00 class 0x088000
[    2.585585] centnas kernel: pci 0000:3f:0a.1: [8086:0ec1] type 00 class 0x088000
[    2.585624] centnas kernel: pci 0000:3f:0a.2: [8086:0ec2] type 00 class 0x088000
[    2.585664] centnas kernel: pci 0000:3f:0a.3: [8086:0ec3] type 00 class 0x088000
[    2.585705] centnas kernel: pci 0000:3f:0b.0: [8086:0e1e] type 00 class 0x088000
[    2.585743] centnas kernel: pci 0000:3f:0b.3: [8086:0e1f] type 00 class 0x088000
[    2.585796] centnas kernel: pci 0000:3f:0c.0: [8086:0ee0] type 00 class 0x088000
[    2.585842] centnas kernel: pci 0000:3f:0c.1: [8086:0ee2] type 00 class 0x088000
[    2.585879] centnas kernel: pci 0000:3f:0c.2: [8086:0ee4] type 00 class 0x088000
[    2.585918] centnas kernel: pci 0000:3f:0c.3: [8086:0ee6] type 00 class 0x088000
[    2.585959] centnas kernel: pci 0000:3f:0d.0: [8086:0ee1] type 00 class 0x088000
[    2.585996] centnas kernel: pci 0000:3f:0d.1: [8086:0ee3] type 00 class 0x088000
[    2.586034] centnas kernel: pci 0000:3f:0d.2: [8086:0ee5] type 00 class 0x088000
[    2.586071] centnas kernel: pci 0000:3f:0d.3: [8086:0ee7] type 00 class 0x088000
[    2.586111] centnas kernel: pci 0000:3f:0e.0: [8086:0ea0] type 00 class 0x088000
[    2.586161] centnas kernel: pci 0000:3f:0e.1: [8086:0e30] type 00 class 0x110100
[    2.586206] centnas kernel: pci 0000:3f:0f.0: [8086:0ea8] type 00 class 0x088000
[    2.586264] centnas kernel: pci 0000:3f:0f.1: [8086:0e71] type 00 class 0x088000
[    2.586321] centnas kernel: pci 0000:3f:0f.2: [8086:0eaa] type 00 class 0x088000
[    2.586377] centnas kernel: pci 0000:3f:0f.3: [8086:0eab] type 00 class 0x088000
[    2.586435] centnas kernel: pci 0000:3f:0f.4: [8086:0eac] type 00 class 0x088000
[    2.586495] centnas kernel: pci 0000:3f:0f.5: [8086:0ead] type 00 class 0x088000
[    2.586553] centnas kernel: pci 0000:3f:10.0: [8086:0eb0] type 00 class 0x088000
[    2.586624] centnas kernel: pci 0000:3f:10.1: [8086:0eb1] type 00 class 0x088000
[    2.586682] centnas kernel: pci 0000:3f:10.2: [8086:0eb2] type 00 class 0x088000
[    2.586739] centnas kernel: pci 0000:3f:10.3: [8086:0eb3] type 00 class 0x088000
[    2.586798] centnas kernel: pci 0000:3f:10.4: [8086:0eb4] type 00 class 0x088000
[    2.586856] centnas kernel: pci 0000:3f:10.5: [8086:0eb5] type 00 class 0x088000
[    2.586915] centnas kernel: pci 0000:3f:10.7: [8086:0eb7] type 00 class 0x088000
[    2.586972] centnas kernel: pci 0000:3f:13.0: [8086:0e1d] type 00 class 0x088000
[    2.587011] centnas kernel: pci 0000:3f:13.1: [8086:0e34] type 00 class 0x110100
[    2.587062] centnas kernel: pci 0000:3f:13.4: [8086:0e81] type 00 class 0x088000
[    2.587103] centnas kernel: pci 0000:3f:13.5: [8086:0e36] type 00 class 0x110100
[    2.587144] centnas kernel: pci 0000:3f:16.0: [8086:0ec8] type 00 class 0x088000
[    2.587182] centnas kernel: pci 0000:3f:16.1: [8086:0ec9] type 00 class 0x088000
[    2.587221] centnas kernel: pci 0000:3f:16.2: [8086:0eca] type 00 class 0x088000
[    2.587268] centnas kernel: pci_bus 0000:3f: on NUMA node 0
[    2.587339] centnas kernel: ACPI: PCI Root Bridge [P1B1] (domain 0000 [bus 7f])
[    2.587341] centnas kernel: acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    2.587464] centnas kernel: acpi PNP0A08:03: PCIe AER handled by firmware
[    2.587704] centnas kernel: acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.587705] centnas kernel: acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.587745] centnas kernel: PCI host bridge to bus 0000:7f
[    2.587746] centnas kernel: pci_bus 0000:7f: root bus resource [bus 7f]
[    2.587754] centnas kernel: pci 0000:7f:08.0: [8086:0e80] type 00 class 0x088000
[    2.587818] centnas kernel: pci 0000:7f:09.0: [8086:0e90] type 00 class 0x088000
[    2.587866] centnas kernel: pci 0000:7f:0a.0: [8086:0ec0] type 00 class 0x088000
[    2.587920] centnas kernel: pci 0000:7f:0a.1: [8086:0ec1] type 00 class 0x088000
[    2.587962] centnas kernel: pci 0000:7f:0a.2: [8086:0ec2] type 00 class 0x088000
[    2.588003] centnas kernel: pci 0000:7f:0a.3: [8086:0ec3] type 00 class 0x088000
[    2.588047] centnas kernel: pci 0000:7f:0b.0: [8086:0e1e] type 00 class 0x088000
[    2.588086] centnas kernel: pci 0000:7f:0b.3: [8086:0e1f] type 00 class 0x088000
[    2.588126] centnas kernel: pci 0000:7f:0c.0: [8086:0ee0] type 00 class 0x088000
[    2.588166] centnas kernel: pci 0000:7f:0c.1: [8086:0ee2] type 00 class 0x088000
[    2.588207] centnas kernel: pci 0000:7f:0c.2: [8086:0ee4] type 00 class 0x088000
[    2.588255] centnas kernel: pci 0000:7f:0c.3: [8086:0ee6] type 00 class 0x088000
[    2.588297] centnas kernel: pci 0000:7f:0d.0: [8086:0ee1] type 00 class 0x088000
[    2.588337] centnas kernel: pci 0000:7f:0d.1: [8086:0ee3] type 00 class 0x088000
[    2.588380] centnas kernel: pci 0000:7f:0d.2: [8086:0ee5] type 00 class 0x088000
[    2.588421] centnas kernel: pci 0000:7f:0d.3: [8086:0ee7] type 00 class 0x088000
[    2.588463] centnas kernel: pci 0000:7f:0e.0: [8086:0ea0] type 00 class 0x088000
[    2.588513] centnas kernel: pci 0000:7f:0e.1: [8086:0e30] type 00 class 0x110100
[    2.588566] centnas kernel: pci 0000:7f:0f.0: [8086:0ea8] type 00 class 0x088000
[    2.588640] centnas kernel: pci 0000:7f:0f.1: [8086:0e71] type 00 class 0x088000
[    2.588704] centnas kernel: pci 0000:7f:0f.2: [8086:0eaa] type 00 class 0x088000
[    2.588771] centnas kernel: pci 0000:7f:0f.3: [8086:0eab] type 00 class 0x088000
[    2.588835] centnas kernel: pci 0000:7f:0f.4: [8086:0eac] type 00 class 0x088000
[    2.588899] centnas kernel: pci 0000:7f:0f.5: [8086:0ead] type 00 class 0x088000
[    2.588965] centnas kernel: pci 0000:7f:10.0: [8086:0eb0] type 00 class 0x088000
[    2.589029] centnas kernel: pci 0000:7f:10.1: [8086:0eb1] type 00 class 0x088000
[    2.589093] centnas kernel: pci 0000:7f:10.2: [8086:0eb2] type 00 class 0x088000
[    2.589168] centnas kernel: pci 0000:7f:10.3: [8086:0eb3] type 00 class 0x088000
[    2.589232] centnas kernel: pci 0000:7f:10.4: [8086:0eb4] type 00 class 0x088000
[    2.589296] centnas kernel: pci 0000:7f:10.5: [8086:0eb5] type 00 class 0x088000
[    2.589362] centnas kernel: pci 0000:7f:10.7: [8086:0eb7] type 00 class 0x088000
[    2.589425] centnas kernel: pci 0000:7f:13.0: [8086:0e1d] type 00 class 0x088000
[    2.589465] centnas kernel: pci 0000:7f:13.1: [8086:0e34] type 00 class 0x110100
[    2.589508] centnas kernel: pci 0000:7f:13.4: [8086:0e81] type 00 class 0x088000
[    2.589550] centnas kernel: pci 0000:7f:13.5: [8086:0e36] type 00 class 0x110100
[    2.589602] centnas kernel: pci 0000:7f:16.0: [8086:0ec8] type 00 class 0x088000
[    2.589643] centnas kernel: pci 0000:7f:16.1: [8086:0ec9] type 00 class 0x088000
[    2.589684] centnas kernel: pci 0000:7f:16.2: [8086:0eca] type 00 class 0x088000
[    2.589732] centnas kernel: pci_bus 0000:7f: on NUMA node 1
[    2.589914] centnas kernel: ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 11 14 *15)
[    2.589994] centnas kernel: ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 11 *14 15)
[    2.590071] centnas kernel: ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 *6 7 11 14 15)
[    2.590148] centnas kernel: ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *11 14 15)
[    2.590224] centnas kernel: ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 11 14 15)
[    2.590302] centnas kernel: ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 6 7 11 14 15) *0, disabled.
[    2.590379] centnas kernel: ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 *6 7 11 14 15)
[    2.590455] centnas kernel: ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 11 *14 15)
[    2.590662] centnas kernel: iommu: Default domain type: Translated 
[    2.590681] centnas kernel: pci 0000:0f:00.0: vgaarb: setting as boot VGA device
[    2.590681] centnas kernel: pci 0000:0f:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    2.590681] centnas kernel: pci 0000:0f:00.0: vgaarb: bridge control possible
[    2.590681] centnas kernel: vgaarb: loaded
[    2.590681] centnas kernel: ACPI: bus type USB registered
[    2.590681] centnas kernel: usbcore: registered new interface driver usbfs
[    2.590681] centnas kernel: usbcore: registered new interface driver hub
[    2.590681] centnas kernel: usbcore: registered new device driver usb
[    2.590681] centnas kernel: pps_core: LinuxPPS API ver. 1 registered
[    2.590681] centnas kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.590681] centnas kernel: PTP clock support registered
[    2.590681] centnas kernel: EDAC MC: Ver: 3.0.0
[    2.590681] centnas kernel: Registered efivars operations
[    2.590681] centnas kernel: PCI: Using ACPI for IRQ routing
[    2.596738] centnas kernel: PCI: pci_cache_line_size set to 64 bytes
[    2.597250] centnas kernel: e820: reserve RAM buffer [mem 0x76691000-0x77ffffff]
[    2.597251] centnas kernel: e820: reserve RAM buffer [mem 0x76b89000-0x77ffffff]
[    2.597252] centnas kernel: e820: reserve RAM buffer [mem 0x786c0000-0x7bffffff]
[    2.597252] centnas kernel: e820: reserve RAM buffer [mem 0x7ca88000-0x7fffffff]
[    2.597253] centnas kernel: e820: reserve RAM buffer [mem 0x7caf0000-0x7fffffff]
[    2.597500] centnas kernel: NetLabel: Initializing
[    2.597501] centnas kernel: NetLabel:  domain hash size = 128
[    2.597501] centnas kernel: NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    2.597519] centnas kernel: NetLabel:  unlabeled traffic allowed by default
[    2.597523] centnas kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    2.597523] centnas kernel: hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    2.598062] centnas kernel: clocksource: Switched to clocksource tsc-early
[    2.608857] centnas kernel: *** VALIDATE bpf ***
[    2.609028] centnas kernel: VFS: Disk quotas dquot_6.6.0
[    2.609060] centnas kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    2.609078] centnas kernel: *** VALIDATE ramfs ***
[    2.609087] centnas kernel: *** VALIDATE hugetlbfs ***
[    2.609139] centnas kernel: pnp: PnP ACPI init
[    2.609364] centnas kernel: system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    2.609400] centnas kernel: pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[    2.609617] centnas kernel: pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    2.609830] centnas kernel: pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    2.610256] centnas kernel: system 00:04: [io  0x0800-0x087f] has been reserved
[    2.610257] centnas kernel: system 00:04: [io  0x0880-0x08ff] has been reserved
[    2.610259] centnas kernel: system 00:04: [io  0x0900-0x091f] has been reserved
[    2.610260] centnas kernel: system 00:04: [io  0x0920-0x0923] has been reserved
[    2.610261] centnas kernel: system 00:04: [io  0x0924] has been reserved
[    2.610262] centnas kernel: system 00:04: [io  0x0370-0x0377] has been reserved
[    2.610263] centnas kernel: system 00:04: [io  0x0ca0-0x0ca7] has been reserved
[    2.610264] centnas kernel: system 00:04: [io  0x0ca9-0x0cab] has been reserved
[    2.610267] centnas kernel: system 00:04: [io  0x0cad-0x0caf] has been reserved
[    2.610268] centnas kernel: system 00:04: [io  0x0cb0-0x0cbf] has been reserved
[    2.610271] centnas kernel: system 00:04: Plug and Play ACPI device, IDs PNP0c01 (active)
[    2.610356] centnas kernel: system 00:05: [io  0x0ca8] has been reserved
[    2.610357] centnas kernel: system 00:05: [io  0x0cac] has been reserved
[    2.610361] centnas kernel: system 00:05: Plug and Play ACPI device, IDs IPI0001 PNP0c01 (active)
[    2.610817] centnas kernel: system 00:06: [mem 0xe0000000-0xe3efffff] has been reserved
[    2.610820] centnas kernel: system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[    2.611043] centnas kernel: system 00:07: [mem 0xe4000000-0xe7ffffff] has been reserved
[    2.611046] centnas kernel: system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[    2.611139] centnas kernel: system 00:08: [mem 0xe3f00000-0xe3ffffff] has been reserved
[    2.611142] centnas kernel: system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    2.611244] centnas kernel: system 00:09: [mem 0xdf100000-0xdf101fff] could not be reserved
[    2.611247] centnas kernel: system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
[    2.611371] centnas kernel: system 00:0a: [mem 0xd0100000-0xd0101fff] could not be reserved
[    2.611374] centnas kernel: system 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active)
[    2.611572] centnas kernel: pnp: PnP ACPI: found 11 devices
[    2.612716] centnas kernel: thermal_sys: Registered thermal governor 'fair_share'
[    2.612716] centnas kernel: thermal_sys: Registered thermal governor 'bang_bang'
[    2.612717] centnas kernel: thermal_sys: Registered thermal governor 'step_wise'
[    2.612718] centnas kernel: thermal_sys: Registered thermal governor 'user_space'
[    2.612718] centnas kernel: thermal_sys: Registered thermal governor 'power_allocator'
[    2.617247] centnas kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    2.617274] centnas kernel: pci 0000:01:00.1: can't claim BAR 6 [mem 0xd8000000-0xd807ffff pref]: address conflict with 0000:01:00.0 [mem 0xd8000000-0xd807ffff pref]
[    2.617278] centnas kernel: pci 0000:0b:00.1: can't claim BAR 6 [mem 0xdc800000-0xdc87ffff pref]: address conflict with 0000:0b:00.0 [mem 0xdc800000-0xdc87ffff pref]
[    2.617289] centnas kernel: pci 0000:04:05.0: bridge window [io  0x1000-0x0fff] to [bus 06] add_size 1000
[    2.617291] centnas kernel: pci 0000:04:05.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 06] add_size 200000 add_align 100000
[    2.617293] centnas kernel: pci 0000:03:00.0: bridge window [io  0x1000-0x0fff] to [bus 04-07] add_size 1000
[    2.617295] centnas kernel: pci 0000:03:00.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 04-07] add_size 200000 add_align 100000
[    2.617296] centnas kernel: pci 0000:00:02.0: bridge window [io  0x1000-0x0fff] to [bus 03-07] add_size 1000
[    2.617298] centnas kernel: pci 0000:00:02.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 03-07] add_size 200000 add_align 100000
[    2.617308] centnas kernel: pci 0000:00:02.0: BAR 15: assigned [mem 0xd5400000-0xd56fffff 64bit pref]
[    2.617311] centnas kernel: pci 0000:00:02.0: BAR 13: assigned [io  0x1000-0x1fff]
[    2.617313] centnas kernel: pci 0000:01:00.1: BAR 6: assigned [mem 0xd8080000-0xd80fffff pref]
[    2.617315] centnas kernel: pci 0000:00:01.0: PCI bridge to [bus 01]
[    2.617317] centnas kernel: pci 0000:00:01.0:   bridge window [io  0xf000-0xffff]
[    2.617320] centnas kernel: pci 0000:00:01.0:   bridge window [mem 0xd8000000-0xd8ffffff]
[    2.617322] centnas kernel: pci 0000:00:01.0:   bridge window [mem 0xd5000000-0xd53fffff 64bit pref]
[    2.617327] centnas kernel: pci 0000:03:00.0: BAR 15: assigned [mem 0xd5400000-0xd56fffff 64bit pref]
[    2.617328] centnas kernel: pci 0000:03:00.0: BAR 13: assigned [io  0x1000-0x1fff]
[    2.617330] centnas kernel: pci 0000:04:05.0: BAR 15: assigned [mem 0xd5400000-0xd55fffff 64bit pref]
[    2.617331] centnas kernel: pci 0000:04:05.0: BAR 13: assigned [io  0x1000-0x1fff]
[    2.617332] centnas kernel: pci 0000:04:04.0: PCI bridge to [bus 05]
[    2.617339] centnas kernel: pci 0000:04:05.0: PCI bridge to [bus 06]
[    2.617340] centnas kernel: pci 0000:04:05.0:   bridge window [io  0x1000-0x1fff]
[    2.617343] centnas kernel: pci 0000:04:05.0:   bridge window [mem 0xd9000000-0xd9ffffff]
[    2.617345] centnas kernel: pci 0000:04:05.0:   bridge window [mem 0xd5400000-0xd55fffff 64bit pref]
[    2.617349] centnas kernel: pci 0000:04:06.0: PCI bridge to [bus 07]
[    2.617352] centnas kernel: pci 0000:04:06.0:   bridge window [mem 0xda000000-0xdaffffff]
[    2.617356] centnas kernel: pci 0000:03:00.0: PCI bridge to [bus 04-07]
[    2.617358] centnas kernel: pci 0000:03:00.0:   bridge window [io  0x1000-0x1fff]
[    2.617361] centnas kernel: pci 0000:03:00.0:   bridge window [mem 0xd9000000-0xdaffffff]
[    2.617363] centnas kernel: pci 0000:03:00.0:   bridge window [mem 0xd5400000-0xd56fffff 64bit pref]
[    2.617366] centnas kernel: pci 0000:00:02.0: PCI bridge to [bus 03-07]
[    2.617368] centnas kernel: pci 0000:00:02.0:   bridge window [io  0x1000-0x1fff]
[    2.617371] centnas kernel: pci 0000:00:02.0:   bridge window [mem 0xd9000000-0xdb7fffff]
[    2.617373] centnas kernel: pci 0000:00:02.0:   bridge window [mem 0xd5400000-0xd56fffff 64bit pref]
[    2.617377] centnas kernel: pci 0000:00:02.2: PCI bridge to [bus 02]
[    2.617378] centnas kernel: pci 0000:00:02.2:   bridge window [io  0xe000-0xefff]
[    2.617381] centnas kernel: pci 0000:00:02.2:   bridge window [mem 0xdb800000-0xdc7fffff]
[    2.617387] centnas kernel: pci 0000:00:03.0: PCI bridge to [bus 08]
[    2.617395] centnas kernel: pci 0000:00:11.0: PCI bridge to [bus 09]
[    2.617405] centnas kernel: pci 0000:00:1c.0: PCI bridge to [bus 0a]
[    2.617415] centnas kernel: pci 0000:0b:00.1: BAR 6: assigned [mem 0xdc880000-0xdc8fffff pref]
[    2.617416] centnas kernel: pci 0000:00:1c.4: PCI bridge to [bus 0b]
[    2.617420] centnas kernel: pci 0000:00:1c.4:   bridge window [mem 0xdc800000-0xdd7fffff]
[    2.617428] centnas kernel: pci 0000:0e:00.0: PCI bridge to [bus 0f]
[    2.617567] centnas kernel: pci 0000:0e:00.0:   bridge window [mem 0xdd800000-0xde7fffff]
[    2.617661] centnas kernel: pci 0000:0e:00.0:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.617856] centnas kernel: pci 0000:0d:00.0: PCI bridge to [bus 0e-0f]
[    2.618000] centnas kernel: pci 0000:0d:00.0:   bridge window [mem 0xdd800000-0xde7fffff]
[    2.618094] centnas kernel: pci 0000:0d:00.0:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.618288] centnas kernel: pci 0000:0d:01.0: PCI bridge to [bus 10]
[    2.618432] centnas kernel: pci 0000:0d:01.0:   bridge window [mem 0xdef00000-0xdeffffff]
[    2.618782] centnas kernel: pci 0000:0c:00.0: PCI bridge to [bus 0d-10]
[    2.618912] centnas kernel: pci 0000:0c:00.0:   bridge window [mem 0xdd800000-0xdeffffff]
[    2.618996] centnas kernel: pci 0000:0c:00.0:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.619235] centnas kernel: pci 0000:00:1c.7: PCI bridge to [bus 0c-10]
[    2.619239] centnas kernel: pci 0000:00:1c.7:   bridge window [mem 0xdd800000-0xdeffffff]
[    2.619242] centnas kernel: pci 0000:00:1c.7:   bridge window [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.619246] centnas kernel: pci 0000:00:1e.0: PCI bridge to [bus 11]
[    2.619255] centnas kernel: pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    2.619256] centnas kernel: pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    2.619257] centnas kernel: pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    2.619258] centnas kernel: pci_bus 0000:00: resource 7 [io  0x0d00-0x1fff window]
[    2.619259] centnas kernel: pci_bus 0000:00: resource 8 [io  0xc000-0xdfff window]
[    2.619259] centnas kernel: pci_bus 0000:00: resource 9 [io  0xe000-0xffff window]
[    2.619260] centnas kernel: pci_bus 0000:00: resource 10 [mem 0x000a0000-0x000bffff window]
[    2.619261] centnas kernel: pci_bus 0000:00: resource 11 [mem 0xd4000000-0xdfffffff window]
[    2.619262] centnas kernel: pci_bus 0000:00: resource 12 [mem 0xfed40000-0xfed44fff window]
[    2.619263] centnas kernel: pci_bus 0000:01: resource 0 [io  0xf000-0xffff]
[    2.619264] centnas kernel: pci_bus 0000:01: resource 1 [mem 0xd8000000-0xd8ffffff]
[    2.619265] centnas kernel: pci_bus 0000:01: resource 2 [mem 0xd5000000-0xd53fffff 64bit pref]
[    2.619266] centnas kernel: pci_bus 0000:03: resource 0 [io  0x1000-0x1fff]
[    2.619266] centnas kernel: pci_bus 0000:03: resource 1 [mem 0xd9000000-0xdb7fffff]
[    2.619267] centnas kernel: pci_bus 0000:03: resource 2 [mem 0xd5400000-0xd56fffff 64bit pref]
[    2.619268] centnas kernel: pci_bus 0000:04: resource 0 [io  0x1000-0x1fff]
[    2.619269] centnas kernel: pci_bus 0000:04: resource 1 [mem 0xd9000000-0xdaffffff]
[    2.619270] centnas kernel: pci_bus 0000:04: resource 2 [mem 0xd5400000-0xd56fffff 64bit pref]
[    2.619271] centnas kernel: pci_bus 0000:06: resource 0 [io  0x1000-0x1fff]
[    2.619272] centnas kernel: pci_bus 0000:06: resource 1 [mem 0xd9000000-0xd9ffffff]
[    2.619273] centnas kernel: pci_bus 0000:06: resource 2 [mem 0xd5400000-0xd55fffff 64bit pref]
[    2.619274] centnas kernel: pci_bus 0000:07: resource 1 [mem 0xda000000-0xdaffffff]
[    2.619274] centnas kernel: pci_bus 0000:02: resource 0 [io  0xe000-0xefff]
[    2.619275] centnas kernel: pci_bus 0000:02: resource 1 [mem 0xdb800000-0xdc7fffff]
[    2.619276] centnas kernel: pci_bus 0000:0b: resource 1 [mem 0xdc800000-0xdd7fffff]
[    2.619277] centnas kernel: pci_bus 0000:0c: resource 1 [mem 0xdd800000-0xdeffffff]
[    2.619278] centnas kernel: pci_bus 0000:0c: resource 2 [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.619279] centnas kernel: pci_bus 0000:0d: resource 1 [mem 0xdd800000-0xdeffffff]
[    2.619280] centnas kernel: pci_bus 0000:0d: resource 2 [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.619281] centnas kernel: pci_bus 0000:0e: resource 1 [mem 0xdd800000-0xde7fffff]
[    2.619281] centnas kernel: pci_bus 0000:0e: resource 2 [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.619282] centnas kernel: pci_bus 0000:0f: resource 1 [mem 0xdd800000-0xde7fffff]
[    2.619283] centnas kernel: pci_bus 0000:0f: resource 2 [mem 0xd4000000-0xd4ffffff 64bit pref]
[    2.619284] centnas kernel: pci_bus 0000:10: resource 1 [mem 0xdef00000-0xdeffffff]
[    2.619285] centnas kernel: pci_bus 0000:11: resource 4 [io  0x0000-0x03af window]
[    2.619286] centnas kernel: pci_bus 0000:11: resource 5 [io  0x03e0-0x0cf7 window]
[    2.619287] centnas kernel: pci_bus 0000:11: resource 6 [io  0x03b0-0x03df window]
[    2.619288] centnas kernel: pci_bus 0000:11: resource 7 [io  0x0d00-0x1fff window]
[    2.619288] centnas kernel: pci_bus 0000:11: resource 8 [io  0xc000-0xdfff window]
[    2.619289] centnas kernel: pci_bus 0000:11: resource 9 [io  0xe000-0xffff window]
[    2.619290] centnas kernel: pci_bus 0000:11: resource 10 [mem 0x000a0000-0x000bffff window]
[    2.619291] centnas kernel: pci_bus 0000:11: resource 11 [mem 0xd4000000-0xdfffffff window]
[    2.619292] centnas kernel: pci_bus 0000:11: resource 12 [mem 0xfed40000-0xfed44fff window]
[    2.619322] centnas kernel: pci 0000:40:01.0: PCI bridge to [bus 41]
[    2.619331] centnas kernel: pci 0000:40:02.0: PCI bridge to [bus 42]
[    2.619339] centnas kernel: pci 0000:40:03.0: PCI bridge to [bus 43]
[    2.619348] centnas kernel: pci 0000:40:03.2: PCI bridge to [bus 44]
[    2.619356] centnas kernel: pci_bus 0000:40: resource 4 [io  0x2000-0x3fff window]
[    2.619357] centnas kernel: pci_bus 0000:40: resource 5 [io  0x4000-0x5fff window]
[    2.619358] centnas kernel: pci_bus 0000:40: resource 6 [io  0x6000-0x7fff window]
[    2.619359] centnas kernel: pci_bus 0000:40: resource 7 [io  0x8000-0x9fff window]
[    2.619360] centnas kernel: pci_bus 0000:40: resource 8 [io  0xa000-0xbfff window]
[    2.619361] centnas kernel: pci_bus 0000:40: resource 9 [mem 0xd0000000-0xd3ffffff window]
[    2.619453] centnas kernel: NET: Registered protocol family 2
[    2.620376] centnas kernel: tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    2.621751] centnas kernel: TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc)
[    2.622603] centnas kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    2.622674] centnas kernel: TCP: Hash tables configured (established 524288 bind 65536)
[    2.623413] centnas kernel: UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    2.624238] centnas kernel: UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    2.624590] centnas kernel: NET: Registered protocol family 1
[    2.624595] centnas kernel: NET: Registered protocol family 44
[    2.624624] centnas kernel: pci 0000:00:05.0: disabled boot interrupts on device [8086:0e28]
[    2.625797] centnas kernel: pci 0000:0f:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    2.625904] centnas kernel: pci 0000:40:05.0: disabled boot interrupts on device [8086:0e28]
[    2.625981] centnas kernel: PCI: CLS 64 bytes, default 64
[    2.626062] centnas kernel: Trying to unpack rootfs image as initramfs...
[    2.685388] centnas kernel: Freeing initrd memory: 24372K
[    2.756093] centnas kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    2.756094] centnas kernel: software IO TLB: mapped [mem 0x70dcc000-0x74dcc000] (64MB)
[    2.757525] centnas kernel: Initialise system trusted keyrings
[    2.757537] centnas kernel: Key type blacklist registered
[    2.757611] centnas kernel: workingset: timestamp_bits=41 max_order=26 bucket_order=0
[    2.758725] centnas kernel: zbud: loaded
[    2.762499] centnas kernel: Key type asymmetric registered
[    2.762500] centnas kernel: Asymmetric key parser 'x509' registered
[    2.762508] centnas kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[    2.762610] centnas kernel: io scheduler mq-deadline registered
[    2.762611] centnas kernel: io scheduler kyber registered
[    2.762635] centnas kernel: io scheduler bfq registered
[    2.763641] centnas kernel: pcieport 0000:00:01.0: PME: Signaling with IRQ 25
[    2.763975] centnas kernel: pcieport 0000:00:02.0: PME: Signaling with IRQ 26
[    2.764297] centnas kernel: pcieport 0000:00:02.2: PME: Signaling with IRQ 27
[    2.764626] centnas kernel: pcieport 0000:00:03.0: PME: Signaling with IRQ 28
[    2.764926] centnas kernel: pcieport 0000:00:11.0: PME: Signaling with IRQ 29
[    2.765048] centnas kernel: pcieport 0000:00:1c.0: PME: Signaling with IRQ 30
[    2.765323] centnas kernel: pcieport 0000:00:1c.4: PME: Signaling with IRQ 31
[    2.765609] centnas kernel: pcieport 0000:00:1c.7: PME: Signaling with IRQ 32
[    2.766160] centnas kernel: pcieport 0000:04:05.0: pciehp: Slot #117 AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- LLActRep+
[    2.771924] centnas kernel: pcieport 0000:40:01.0: PME: Signaling with IRQ 42
[    2.772275] centnas kernel: pcieport 0000:40:02.0: PME: Signaling with IRQ 43
[    2.772595] centnas kernel: pcieport 0000:40:03.0: PME: Signaling with IRQ 44
[    2.772921] centnas kernel: pcieport 0000:40:03.2: PME: Signaling with IRQ 45
[    2.773274] centnas kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    2.773402] centnas kernel: efifb: probing for efifb
[    2.773420] centnas kernel: efifb: No BGRT, not showing boot graphics
[    2.773421] centnas kernel: efifb: framebuffer at 0xd4000000, using 1920k, total 1920k
[    2.773422] centnas kernel: efifb: mode is 800x600x32, linelength=3200, pages=1
[    2.773423] centnas kernel: efifb: scrolling: redraw
[    2.773424] centnas kernel: efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    2.773469] centnas kernel: fbcon: Deferring console take-over
[    2.773470] centnas kernel: fb0: EFI VGA frame buffer device
[    2.773477] centnas kernel: intel_idle: MWAIT substates: 0x1120
[    2.773478] centnas kernel: intel_idle: v0.4.1 model 0x3E
[    2.774597] centnas kernel: intel_idle: lapic_timer_reliable_states 0xffffffff
[    2.774701] centnas kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    2.774853] centnas kernel: ACPI: Power Button [PWRF]
[    2.783101] centnas kernel: ERST: Error Record Serialization Table (ERST) support is initialized.
[    2.783103] centnas kernel: pstore: Registered erst as persistent store backend
[    2.783354] centnas kernel: GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    2.783497] centnas kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    2.804120] centnas kernel: 00:02: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    2.824807] centnas kernel: 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    2.825202] centnas kernel: AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    2.825203] centnas kernel: AMD-Vi: AMD IOMMUv2 functionality not available on this system
[    2.828322] centnas kernel: usbcore: registered new interface driver usbserial_generic
[    2.828325] centnas kernel: usbserial: USB Serial support registered for generic
[    2.828340] centnas kernel: rtc_cmos 00:01: RTC can wake from S4
[    2.828559] centnas kernel: rtc_cmos 00:01: registered as rtc0
[    2.828571] centnas kernel: rtc_cmos 00:01: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    2.828606] centnas kernel: intel_pstate: Intel P-state driver initializing
[    2.836635] centnas kernel: ledtrig-cpu: registered to indicate activity on CPUs
[    2.836863] centnas kernel: drop_monitor: Initializing network drop monitor service
[    2.837278] centnas kernel: NET: Registered protocol family 10
[    2.849540] centnas kernel: Segment Routing with IPv6
[    2.849581] centnas kernel: NET: Registered protocol family 17
[    2.854705] centnas kernel: RAS: Correctable Errors collector initialized.
[    2.854801] centnas kernel: microcode: sig=0x306e4, pf=0x1, revision=0x42e
[    2.856002] centnas kernel: microcode: Microcode Update Driver: v2.2.
[    2.856008] centnas kernel: IPI shorthand broadcast: enabled
[    2.856024] centnas kernel: sched_clock: Marking stable (2855640253, 352243)->(2892598547, -36606051)
[    2.856188] centnas kernel: registered taskstats version 1
[    2.856200] centnas kernel: Loading compiled-in X.509 certificates
[    2.862944] centnas kernel: Loaded X.509 cert 'Build time autogenerated kernel key: 144a34135ebaf210834820c7184f1281e7441bf4'
[    2.863341] centnas kernel: zswap: loaded using pool lzo/zbud
[    2.863828] centnas kernel: Key type ._fscrypt registered
[    2.863829] centnas kernel: Key type .fscrypt registered
[    2.864580] centnas kernel: pstore: Using crash dump compression: zstd
[    2.875110] centnas kernel: Key type big_key registered
[    2.878322] centnas kernel: PM:   Magic number: 12:204:897
[    2.878541] centnas kernel: rtc_cmos 00:01: setting system clock to 2020-11-27T17:51:28 UTC (1606499488)
[    2.880675] centnas kernel: Freeing unused decrypted memory: 2040K
[    2.881544] centnas kernel: Freeing unused kernel image memory: 1712K
[    2.955975] centnas kernel: Write protecting the kernel read-only data: 18432k
[    2.957419] centnas kernel: Freeing unused kernel image memory: 2012K
[    2.957634] centnas kernel: Freeing unused kernel image memory: 84K
[    2.979928] centnas kernel: x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    2.979929] centnas kernel: x86/mm: Checking user space page tables
[    2.989689] centnas kernel: x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    2.989690] centnas kernel: Run /init as init process
[    2.999793] centnas kernel: ERST: NVRAM ERST Log Address Range not implemented yet.
[    3.003230] centnas systemd[1]: systemd 246.6-1-arch running in system mode. (+PAM +AUDIT -SELINUX -IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +ZSTD +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)
[    3.036058] centnas systemd[1]: Detected architecture x86-64.
[    3.036063] centnas systemd[1]: Running in initial RAM disk.
[    3.107878] centnas systemd[1]: Set hostname to <centnas>.
[    3.122520] centnas zfs-generator: starting
[    3.122686] centnas zfs-generator: loading Dracut library from /lib/dracut-lib.sh
[    3.124077] centnas kernel: random: ln: uninitialized urandom read (6 bytes read)
[    3.142620] centnas zfs-generator: writing extension for sysroot.mount to /run/systemd/generator/sysroot.mount.d/zfs-enhancement.conf
[    3.144641] centnas zfs-generator: finished
[    3.167725] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-udev.service:27: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.167733] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-udev.service:28: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.168013] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-trigger.service:23: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.168019] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-trigger.service:24: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.168342] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-pivot.service:30: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.168355] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-pivot.service:31: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.169338] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-mount.service:22: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.169345] centnas systemd[1]: /usr/lib/systemd/system/dracut-pre-mount.service:23: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.169634] centnas systemd[1]: /usr/lib/systemd/system/dracut-mount.service:22: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.169646] centnas systemd[1]: /usr/lib/systemd/system/dracut-mount.service:23: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.169866] centnas systemd[1]: /usr/lib/systemd/system/dracut-initqueue.service:24: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.169881] centnas systemd[1]: /usr/lib/systemd/system/dracut-initqueue.service:25: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.170109] centnas systemd[1]: /usr/lib/systemd/system/dracut-cmdline.service:26: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[    3.170127] centnas systemd[1]: /usr/lib/systemd/system/dracut-cmdline.service:27: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether.
[    3.173277] centnas systemd[1]: Queued start job for default target Initrd Default Target.
[    3.173448] centnas systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    3.173509] centnas systemd[1]: Reached target Initrd Root Device.
[    3.173527] centnas systemd[1]: Reached target Local File Systems.
[    3.173536] centnas systemd[1]: Reached target Paths.
[    3.173556] centnas systemd[1]: Reached target Slices.
[    3.173572] centnas systemd[1]: Reached target Swap.
[    3.173590] centnas systemd[1]: Reached target Timers.
[    3.173778] centnas systemd[1]: Listening on Journal Audit Socket.
[    3.173877] centnas systemd[1]: Listening on Journal Socket (/dev/log).
[    3.173991] centnas systemd[1]: Listening on Journal Socket.
[    3.174129] centnas systemd[1]: Listening on Network Service Netlink Socket.
[    3.174246] centnas systemd[1]: Listening on udev Control Socket.
[    3.174331] centnas systemd[1]: Listening on udev Kernel Socket.
[    3.174345] centnas systemd[1]: Reached target Sockets.
[    3.176604] centnas systemd[1]: Starting Create list of static device nodes for the current kernel...
[    3.177650] centnas systemd[1]: Started OpenSSH server daemon.
[    3.179398] centnas systemd[1]: Starting Journal Service...
[    3.180695] centnas systemd[1]: Starting Load Kernel Modules...
[    3.181571] centnas systemd[1]: Starting Setup Virtual Console...
[    3.182327] centnas systemd[1]: Finished Create list of static device nodes for the current kernel.
[    3.183280] centnas systemd[1]: Starting Create Static Device Nodes in /dev...
[    3.188109] centnas systemd[1]: Finished Setup Virtual Console.
[    3.189380] centnas systemd[1]: Starting dracut ask for additional cmdline parameters...
[    3.190386] centnas systemd[1]: Finished Create Static Device Nodes in /dev.
[    3.195688] centnas kernel: zlua: loading out-of-tree module taints kernel.
[    3.195692] centnas kernel: zlua: module license 'MIT' taints kernel.
[    3.195693] centnas kernel: Disabling lock debugging due to kernel taint
[    3.195797] centnas kernel: zlua: module verification failed: signature and/or required key missing - tainting kernel
[    3.251512] centnas systemd[1]: Finished dracut ask for additional cmdline parameters.
[    3.252624] centnas systemd[1]: Starting dracut cmdline hook...
[    3.306900] centnas systemd[1]: Finished dracut cmdline hook.
[    3.308253] centnas systemd[1]: Starting dracut pre-udev hook...
[    3.332100] centnas systemd[1]: Finished dracut pre-udev hook.
[    3.333932] centnas systemd[1]: Starting Rule-based Manager for Device Events and Files...
[    3.518159] centnas systemd-journald[382]: Journal started
[    3.518218] centnas systemd-journald[382]: Runtime Journal (/run/log/journal/a16b851012134e04914ffccb01dca84f) is 8.0M, max 4.0G, 3.9G free.
[    3.518597] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.518943] centnas dracut-cmdline[402]: dracut-dracut-
[    3.518943] centnas dracut-cmdline[402]: Using kernel command line parameters: root=/dev/block/ rootfstype=zfs rootflags=rw,relatime,xattr,posixacl BOOT_IMAGE=/BOOT@/vmlinuz-linux-lts root=ZFS=/enc/ROOT rw root=ZFS=nasrpool/enc/ROOT loglevel=3 quiet
[    3.518943] centnas dracut-cmdline[402]: ZFS: Using hostid from /etc/hostid: c7ca8233
[    3.518943] centnas dracut-cmdline[402]: ZFS: Set zfs:nasrpool/enc/ROOT as bootfs.
[    3.520176] centnas systemd[1]: Starting Create Volatile Files and Directories...
[    3.518782] centnas systemd[1]: Started Journal Service.
[    3.518935] centnas kernel: audit: type=1130 audit(1606499489.130:2): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.529967] centnas systemd[1]: Finished Create Volatile Files and Directories.
[    3.530024] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.530370] centnas kernel: audit: type=1130 audit(1606499489.140:3): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.603371] centnas systemd[1]: Started Rule-based Manager for Device Events and Files.
[    3.603427] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.603473] centnas systemd[1]: Condition check resulted in dracut pre-trigger hook being skipped.
[    3.604552] centnas systemd[1]: Starting Coldplug All udev Devices...
[    3.603766] centnas kernel: audit: type=1130 audit(1606499489.210:4): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.711791] centnas systemd[1]: Finished Coldplug All udev Devices.
[    3.712219] centnas kernel: audit: type=1130 audit(1606499489.320:5): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udev-trigger comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.711956] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udev-trigger comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    3.713518] centnas systemd[1]: Starting dracut initqueue hook...
[    3.714918] centnas systemd[1]: Starting Wait for udev To Complete Device Initialization...
[    3.712578] centnas kernel: dca service started, version 1.12.1
[    3.727423] centnas kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.729689] centnas kernel: ehci-pci: EHCI PCI platform driver
[    3.730273] centnas kernel: ehci-pci 0000:00:1a.0: EHCI Host Controller
[    3.730282] centnas kernel: ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    3.730297] centnas kernel: ehci-pci 0000:00:1a.0: debug port 2
[    3.734222] centnas kernel: ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    3.734250] centnas kernel: ehci-pci 0000:00:1a.0: irq 23, io mem 0xdf0fd000
[    3.734837] centnas kernel: SCSI subsystem initialized
[    3.744624] centnas kernel: igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k
[    3.744625] centnas kernel: igb: Copyright (c) 2007-2014 Intel Corporation.
[    3.751576] centnas systemd-udevd[485]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
[    3.754281] centnas kernel: ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[    3.754282] centnas kernel: ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    3.755930] centnas kernel: ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    3.756011] centnas kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[    3.756013] centnas kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.756016] centnas kernel: usb usb1: Product: EHCI Host Controller
[    3.756018] centnas kernel: usb usb1: Manufacturer: Linux 5.4.79-1-lts ehci_hcd
[    3.756019] centnas kernel: usb usb1: SerialNumber: 0000:00:1a.0
[    3.761356] centnas kernel: mpt3sas version 31.100.00.00 loaded
[    3.764147] centnas udevadm[490]: systemd-udev-settle.service is deprecated. Please fix zfs-import-cache.service, zfs-import-scan.service not to pull it in.
[    3.772032] centnas kernel: ixgbe 0000:01:00.0 0000:01:00.0 (uninitialized): WARNING: Intel (R) Network Connections are quality tested using Intel (R) Ethernet Optics.  Using untested modules is not supported and may cause unstable operation or damage to the module or the adapter.  Intel Corporation is not responsible for any harm caused by using untested modules.
[    3.775610] centnas kernel: mpt3sas 0000:02:00.0: can't disable ASPM; OS doesn't have ASPM control
[    3.775746] centnas kernel: hub 1-0:1.0: USB hub found
[    3.775928] centnas kernel: tsc: Refined TSC clocksource calibration: 2599.999 MHz
[    3.775959] centnas kernel: mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (264076516 kB)
[    3.775961] centnas kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x257a3b2ad7e, max_idle_ns: 440795282337 ns
[    3.776504] centnas kernel: hub 1-0:1.0: 2 ports detected
[    3.776528] centnas kernel: clocksource: Switched to clocksource tsc
[    3.777241] centnas kernel: ehci-pci 0000:00:1d.0: EHCI Host Controller
[    3.777249] centnas kernel: ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    3.777276] centnas kernel: ehci-pci 0000:00:1d.0: debug port 2
[    3.780723] centnas kernel: <6>fioinf VSL configuration hash: 8f82ea05bdf1195cb400fb48e4ef09fc49b3c1aa
[    3.780790] centnas kernel: <6>fioinf 
[    3.780791] centnas kernel: <6>fioinf Copyright (c) 2006-2014 Fusion-io, Inc. (acquired by SanDisk Corp. 2014)
[    3.780791] centnas kernel: <6>fioinf Copyright (c) 2014-2016 SanDisk Corp. and/or all its affiliates. (acquired by Western Digital Corp. 2016)
[    3.780792] centnas kernel: <6>fioinf Copyright (c) 2016-2018 Western Digital Technologies, Inc. All rights reserved.
[    3.780792] centnas kernel: <6>fioinf For Terms and Conditions see the License file included
[    3.780793] centnas kernel: <6>fioinf with this driver package.
[    3.780793] centnas kernel: <6>fioinf 
[    3.780794] centnas kernel: <6>fioinf ioDrive driver v5.6.0-3.2.16.1731                 loading...
[    3.781185] centnas kernel: ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    3.781207] centnas kernel: ehci-pci 0000:00:1d.0: irq 22, io mem 0xdf0fe000
[    3.790895] centnas kernel: <6>fioinf ioDrive 0000:06:00.0: mapping controller on BAR 5
[    3.790971] centnas kernel: <6>fioinf ioDrive 0000:06:00.0: MSI-X enabled (2 vectors)
[    3.790973] centnas kernel: <6>fioinf ioDrive 0000:06:00.0: using MSI-X interrupts
[    3.821179] centnas kernel: ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    3.821232] centnas kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[    3.821233] centnas kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.821234] centnas kernel: usb usb2: Product: EHCI Host Controller
[    3.821236] centnas kernel: usb usb2: Manufacturer: Linux 5.4.79-1-lts ehci_hcd
[    3.821238] centnas kernel: usb usb2: SerialNumber: 0000:00:1d.0
[    3.821433] centnas kernel: hub 2-0:1.0: USB hub found
[    3.821439] centnas kernel: hub 2-0:1.0: 2 ports detected
[    3.821831] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Starting master controller
[    3.837844] centnas kernel: igb 0000:0b:00.0: added PHC on eth0
[    3.837845] centnas kernel: igb 0000:0b:00.0: Intel(R) Gigabit Ethernet Network Connection
[    3.837847] centnas kernel: igb 0000:0b:00.0: eth0: (PCIe:5.0Gb/s:Width x2) b8:ca:3a:65:75:f4
[    3.838139] centnas kernel: igb 0000:0b:00.0: eth0: PBA No: G61346-000
[    3.838145] centnas kernel: igb 0000:0b:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    3.881498] centnas kernel: mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    3.881506] centnas kernel: mpt2sas_cm0: MSI-X vectors supported: 1
[    3.881507] centnas kernel:   no of cores: 32, max_msix_vectors: -1
[    3.881509] centnas kernel: mpt2sas_cm0:  0 1
[    3.881662] centnas kernel: mpt2sas_cm0: High IOPs queues : disabled
[    3.881664] centnas kernel: mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 68
[    3.881667] centnas kernel: mpt2sas_cm0: iomem(0x00000000dc7fc000), mapped(0x00000000eb1c0e9a), size(16384)
[    3.881669] centnas kernel: mpt2sas_cm0: ioport(0x000000000000ec00), size(256)
[    3.888530] centnas kernel: igb 0000:0b:00.1: added PHC on eth1
[    3.888532] centnas kernel: igb 0000:0b:00.1: Intel(R) Gigabit Ethernet Network Connection
[    3.888535] centnas kernel: igb 0000:0b:00.1: eth1: (PCIe:5.0Gb/s:Width x2) b8:ca:3a:65:75:f5
[    3.888831] centnas kernel: igb 0000:0b:00.1: eth1: PBA No: G61346-000
[    3.888837] centnas kernel: igb 0000:0b:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    3.906087] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: PMP Address: 1 1 2 1
[    3.906805] centnas systemd-udevd[484]: Using default interface naming scheme 'v245'.
[    3.907183] centnas systemd-udevd[504]: Using default interface naming scheme 'v245'.
[    3.907731] centnas systemd-udevd[484]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
[    3.908337] centnas kernel: igb 0000:0b:00.1 eno4: renamed from eth1
[    3.960659] centnas kernel: ixgbe 0000:01:00.0: Multiqueue Enabled: Rx Queue count = 32, Tx Queue count = 32 XDP Queue count = 0
[    3.961016] centnas kernel: ixgbe 0000:01:00.0: 32.000 Gb/s available PCIe bandwidth (5 GT/s x8 link)
[    3.961344] centnas kernel: ixgbe 0000:01:00.0: MAC: 2, PHY: 19, SFP+: 6, PBA No: G61346-000
[    3.961350] centnas kernel: ixgbe 0000:01:00.0: b8:ca:3a:65:75:f0
[    3.963161] centnas kernel: mpt2sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    4.005179] centnas kernel: mpt2sas_cm0: Allocated physical memory: size(1687 kB)
[    4.005182] centnas kernel: mpt2sas_cm0: Current Controller Queue Depth(3364),Max Controller Queue Depth(3432)
[    4.005187] centnas kernel: mpt2sas_cm0: Scatter Gather Elements per IO(128)
[    4.026739] centnas systemd-udevd[504]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
[    4.027323] centnas kernel: igb 0000:0b:00.0 eno3: renamed from eth0
[    4.036070] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: SMP Controller Firmware APP  version 1.0.29 0
[    4.036072] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: SMP Controller Firmware BOOT version 0.0.9 1
[    4.036073] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: SMP Adapter    Firmware APP  version 1.0.35 0
[    4.036074] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: SMP Adapter    Firmware BOOT version 0.0.8 1
[    4.036866] centnas systemd-udevd[478]: Using default interface naming scheme 'v245'.
[    4.050026] centnas kernel: mpt2sas_cm0: LSISAS2008: FWVersion(20.00.07.00), ChipRevision(0x03), BiosVersion(07.27.01.01)
[    4.050028] centnas kernel: mpt2sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
[    4.050108] centnas kernel: scsi host0: Fusion MPT SAS Host
[    4.051606] centnas kernel: mpt2sas_cm0: sending port enable !!
[    4.155934] centnas kernel: usb 1-1: new high-speed USB device number 2 using ehci-pci
[    4.205937] centnas kernel: usb 2-1: new high-speed USB device number 2 using ehci-pci
[    4.356292] centnas kernel: usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    4.356294] centnas kernel: usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.356562] centnas kernel: hub 1-1:1.0: USB hub found
[    4.356666] centnas kernel: hub 1-1:1.0: 6 ports detected
[    4.416291] centnas kernel: usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    4.416293] centnas kernel: usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.416438] centnas kernel: hub 2-1:1.0: USB hub found
[    4.416539] centnas kernel: hub 2-1:1.0: 8 ports detected
[    4.675929] centnas kernel: usb 1-1.2: new high-speed USB device number 3 using ehci-pci
[    4.745929] centnas kernel: usb 2-1.2: new low-speed USB device number 3 using ehci-pci
[    4.826291] centnas kernel: usb 1-1.2: New USB device found, idVendor=0424, idProduct=2512, bcdDevice= b.b3
[    4.826293] centnas kernel: usb 1-1.2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.826436] centnas kernel: hub 1-1.2:1.0: USB hub found
[    4.826537] centnas kernel: hub 1-1.2:1.0: 1 port detected
[    4.909068] centnas kernel: usb 2-1.2: New USB device found, idVendor=051d, idProduct=0002, bcdDevice= 0.06
[    4.909069] centnas kernel: usb 2-1.2: New USB device strings: Mfr=3, Product=1, SerialNumber=2
[    4.909076] centnas kernel: usb 2-1.2: Product: Smart-UPS 1500 RM FW:667.18.I USB FW:7.4
[    4.909077] centnas kernel: usb 2-1.2: Manufacturer: American Power Conversion
[    4.909081] centnas kernel: usb 2-1.2: SerialNumber: AS0940211902
[    4.925927] centnas kernel: usb 1-1.6: new high-speed USB device number 4 using ehci-pci
[    5.076915] centnas kernel: usb 1-1.6: New USB device found, idVendor=413c, idProduct=a001, bcdDevice= 0.00
[    5.076917] centnas kernel: usb 1-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    5.076923] centnas kernel: usb 1-1.6: Product: Gadget USB HUB
[    5.076925] centnas kernel: usb 1-1.6: Manufacturer: no manufacturer
[    5.076930] centnas kernel: usb 1-1.6: SerialNumber: 0123456789
[    5.077185] centnas kernel: hub 1-1.6:1.0: USB hub found
[    5.077294] centnas kernel: hub 1-1.6:1.0: 6 ports detected
[    5.155209] centnas kernel: ZFS: Loaded module v0.8.5-1, ZFS pool version 5000, ZFS filesystem version 5
[    5.155928] centnas systemd-modules-load[383]: Inserted module 'zfs'
[    5.157566] centnas kernel: hidraw: raw HID events driver (C) Jiri Kosina
[    5.157923] centnas systemd[1]: Finished Load Kernel Modules.
[    5.158183] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-modules-load comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    5.159466] centnas systemd[1]: Mounting Kernel Configuration File System...
[    5.160535] centnas systemd[1]: Starting Apply Kernel Variables...
[    5.161803] centnas systemd[1]: Mounted Kernel Configuration File System.
[    5.158352] centnas kernel: audit: type=1130 audit(1606499490.768:6): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-modules-load comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    5.167884] centnas systemd-sysctl[554]: Not setting net/ipv4/conf/all/rp_filter (explicit setting exists).
[    5.168175] centnas systemd-sysctl[554]: Not setting net/ipv4/conf/default/rp_filter (explicit setting exists).
[    5.168213] centnas systemd-sysctl[554]: Not setting net/ipv4/conf/all/accept_source_route (explicit setting exists).
[    5.168241] centnas systemd-sysctl[554]: Not setting net/ipv4/conf/default/accept_source_route (explicit setting exists).
[    5.168266] centnas systemd-sysctl[554]: Not setting net/ipv4/conf/all/promote_secondaries (explicit setting exists).
[    5.168290] centnas systemd-sysctl[554]: Not setting net/ipv4/conf/default/promote_secondaries (explicit setting exists).
[    5.168948] centnas systemd[1]: Finished Apply Kernel Variables.
[    5.169006] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-sysctl comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    5.170420] centnas systemd[1]: Starting Network Service...
[    5.169338] centnas kernel: audit: type=1130 audit(1606499490.778:7): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-sysctl comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    5.220977] centnas kernel: usbcore: registered new interface driver usbhid
[    5.220978] centnas kernel: usbhid: USB HID core driver
[    5.226130] centnas kernel: hid-generic 0003:051D:0002.0001: hiddev0,hidraw0: USB HID v1.10 Device [American Power Conversion Smart-UPS 1500 RM FW:667.18.I USB FW:7.4] on usb-0000:00:1d.0-1.2/input0
[    5.226220] centnas kernel: ixgbe 0000:01:00.0: Intel(R) 10 Gigabit Network Connection
[    5.226265] centnas kernel: libphy: ixgbe-mdio: probed
[    5.442000] centnas systemd-networkd[555]: Enumeration completed
[    5.442277] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-networkd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    5.442349] centnas systemd-networkd[555]: eno3: Interface name change detected, eno3 has been renamed to eth0.
[    5.442398] centnas systemd[1]: Started Network Service.
[    5.442444] centnas systemd[1]: Reached target Network.
[    5.442502] centnas kernel: audit: type=1130 audit(1606499491.048:8): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-networkd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    5.446026] centnas systemd-networkd[555]: eno4: Interface name change detected, eno4 has been renamed to eth1.
[    5.446514] centnas systemd-networkd[555]: eth1: Interface name change detected, eth1 has been renamed to eno4.
[    5.447016] centnas systemd-networkd[555]: eth0: Interface name change detected, eth0 has been renamed to eno3.
[    5.567654] centnas kernel: random: fast init done
[    5.568518] centnas kernel: mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x5c81f660e71c6700), phys(8)
[    5.571773] centnas kernel: mpt2sas_cm0: expander_add: handle(0x0009), parent(0x0001), sas_addr(0x500056b37789abff), phys(26)
[    5.635951] centnas kernel: usb 1-1.6.1: new high-speed USB device number 5 using ehci-pci
[    5.806926] centnas kernel: usb 1-1.6.1: New USB device found, idVendor=0624, idProduct=0249, bcdDevice= 0.00
[    5.806929] centnas kernel: usb 1-1.6.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
[    5.806935] centnas kernel: usb 1-1.6.1: Product: Keyboard/Mouse Function
[    5.806937] centnas kernel: usb 1-1.6.1: Manufacturer: Avocent
[    5.806939] centnas kernel: usb 1-1.6.1: SerialNumber: 20121018
[    5.808376] centnas kernel: input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.0/0003:0624:0249.0002/input/input1
[    5.876096] centnas kernel: hid-generic 0003:0624:0249.0002: input,hidraw1: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input0
[    5.877147] centnas kernel: input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.1/0003:0624:0249.0003/input/input2
[    5.877260] centnas kernel: hid-generic 0003:0624:0249.0003: input,hidraw2: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input1
[    5.878385] centnas kernel: input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.2/0003:0624:0249.0004/input/input3
[    5.878505] centnas kernel: hid-generic 0003:0624:0249.0004: input,hidraw3: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input2
[    6.025968] centnas kernel: usb 1-1.2.1: new high-speed USB device number 6 using ehci-pci
[    6.116184] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Required PCIE bandwidth 2.000 GBytes per sec
[    6.116189] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Board serial number is 1231D1459-1121
[    6.116191] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Adapter serial number is 1231D1459
[    6.116196] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Default capacity        576.304 GBytes
[    6.116197] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Default sector size     512 bytes
[    6.116199] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Rated endurance         8.130 PBytes
[    6.116201] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: 100C temp range hardware found
[    6.116203] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Maximum capacity        618.869 GBytes
[    6.177425] centnas kernel: usb 1-1.2.1: New USB device found, idVendor=0781, idProduct=5580, bcdDevice= 0.10
[    6.177428] centnas kernel: usb 1-1.2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    6.177431] centnas kernel: usb 1-1.2.1: Product: Extreme
[    6.177433] centnas kernel: usb 1-1.2.1: Manufacturer: SanDisk
[    6.177435] centnas kernel: usb 1-1.2.1: SerialNumber: AA011130151832003483
[    6.190222] centnas kernel: usb-storage 1-1.2.1:1.0: USB Mass Storage device detected
[    6.190390] centnas kernel: scsi host1: usb-storage 1-1.2.1:1.0
[    6.190462] centnas kernel: usbcore: registered new interface driver usb-storage
[    6.193265] centnas kernel: usbcore: registered new interface driver uas
[    6.531142] centnas kernel: ixgbe 0000:01:00.1: Multiqueue Enabled: Rx Queue count = 32, Tx Queue count = 32 XDP Queue count = 0
[    6.531466] centnas kernel: ixgbe 0000:01:00.1: 32.000 Gb/s available PCIe bandwidth (5 GT/s x8 link)
[    6.531789] centnas kernel: ixgbe 0000:01:00.1: MAC: 2, PHY: 1, PBA No: G61346-000
[    6.531791] centnas kernel: ixgbe 0000:01:00.1: b8:ca:3a:65:75:f2
[    6.535027] centnas kernel: ixgbe 0000:01:00.1: Intel(R) 10 Gigabit Network Connection
[    6.535104] centnas kernel: libphy: ixgbe-mdio: probed
[    6.536706] centnas systemd-udevd[491]: Using default interface naming scheme 'v245'.
[    6.537273] centnas systemd-udevd[474]: Using default interface naming scheme 'v245'.
[    6.537809] centnas systemd-udevd[491]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
[    6.537583] centnas kernel: ixgbe 0000:01:00.0 eno1: renamed from eth1
[    6.566195] centnas kernel: scsi 0:0:0:0: Direct-Access     ATA      Samsung SSD 850  2B6Q PQ: 0 ANSI: 6
[    6.566200] centnas kernel: scsi 0:0:0:0: SATA: handle(0x000a), sas_addr(0x500056b37789abe5), phy(5), device_name(0x0000000000000000)
[    6.566202] centnas kernel: scsi 0:0:0:0: enclosure logical id (0x500056b36789abff), slot(10) 
[    6.566294] centnas kernel: scsi 0:0:0:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    6.665680] centnas systemd-networkd[555]: eth1: Interface name change detected, eth1 has been renamed to eno1.
[    6.666141] centnas systemd-udevd[474]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
[    6.666753] centnas kernel: ixgbe 0000:01:00.1 eno2: renamed from eth0
[    6.814948] centnas kernel: scsi 0:0:1:0: Direct-Access     ATA      WDC WD100EZAZ-11 0A83 PQ: 0 ANSI: 6
[    6.814957] centnas kernel: scsi 0:0:1:0: SATA: handle(0x000b), sas_addr(0x500056b37789abe6), phy(6), device_name(0x0000000000000000)
[    6.814959] centnas kernel: scsi 0:0:1:0: enclosure logical id (0x500056b36789abff), slot(8) 
[    6.815059] centnas kernel: scsi 0:0:1:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    6.835799] centnas systemd-networkd[555]: eth0: Interface name change detected, eth0 has been renamed to eno2.
[    6.988453] centnas kernel: ixgbe 0000:01:00.0: registered PHC device on eno1
[    7.064924] centnas kernel: scsi 0:0:2:0: Direct-Access     ATA      WDC WD100EZAZ-11 0A83 PQ: 0 ANSI: 6
[    7.064932] centnas kernel: scsi 0:0:2:0: SATA: handle(0x000c), sas_addr(0x500056b37789abe8), phy(8), device_name(0x0000000000000000)
[    7.064934] centnas kernel: scsi 0:0:2:0: enclosure logical id (0x500056b36789abff), slot(2) 
[    7.065027] centnas kernel: scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    7.107799] centnas systemd-networkd[555]: eno1: Link UP
[    7.120789] centnas kernel: ixgbe 0000:01:00.0 eno1: WARNING: Intel (R) Network Connections are quality tested using Intel (R) Ethernet Optics.  Using untested modules is not supported and may cause unstable operation or damage to the module or the adapter.  Intel Corporation is not responsible for any harm caused by using untested modules.
[    7.182018] centnas kernel: ixgbe 0000:01:00.0 eno1: detected SFP+: 6
[    7.216696] centnas kernel: scsi 1:0:0:0: Direct-Access     SanDisk  Extreme          0001 PQ: 0 ANSI: 6
[    7.228985] centnas kernel: sd 0:0:0:0: Power-on or device reset occurred
[    7.228986] centnas kernel: sd 0:0:1:0: Power-on or device reset occurred
[    7.228987] centnas kernel: sd 0:0:2:0: Power-on or device reset occurred
[    7.229674] centnas kernel: sd 1:0:0:0: [sdd] 122544516 512-byte logical blocks: (62.7 GB/58.4 GiB)
[    7.229902] centnas kernel: sd 0:0:2:0: [sdc] 19532873728 512-byte logical blocks: (10.0 TB/9.10 TiB)
[    7.229904] centnas kernel: sd 0:0:2:0: [sdc] 4096-byte physical blocks
[    7.229921] centnas kernel: sd 0:0:1:0: [sdb] 19532873728 512-byte logical blocks: (10.0 TB/9.10 TiB)
[    7.229923] centnas kernel: sd 0:0:1:0: [sdb] 4096-byte physical blocks
[    7.230671] centnas kernel: sd 1:0:0:0: [sdd] Write Protect is off
[    7.230674] centnas kernel: sd 1:0:0:0: [sdd] Mode Sense: 53 00 00 08
[    7.231496] centnas kernel: sd 0:0:0:0: [sda] 488397168 512-byte logical blocks: (250 GB/233 GiB)
[    7.231669] centnas kernel: sd 1:0:0:0: [sdd] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[    7.232420] centnas kernel: sd 0:0:0:0: [sda] Write Protect is off
[    7.232422] centnas kernel: sd 0:0:0:0: [sda] Mode Sense: 7f 00 10 08
[    7.232774] centnas kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    7.232895] centnas kernel: sd 0:0:2:0: [sdc] Write Protect is off
[    7.232897] centnas kernel: sd 0:0:2:0: [sdc] Mode Sense: 7f 00 10 08
[    7.232898] centnas kernel: sd 0:0:1:0: [sdb] Write Protect is off
[    7.232900] centnas kernel: sd 0:0:1:0: [sdb] Mode Sense: 7f 00 10 08
[    7.233240] centnas kernel: sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    7.233256] centnas kernel: sd 0:0:2:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    7.276081] centnas kernel:  sdd: sdd1
[    7.280075] centnas kernel: sd 1:0:0:0: [sdd] Attached SCSI removable disk
[    7.301933] centnas kernel:  sda: sda1 sda2 sda3
[    7.305513] centnas kernel: sd 0:0:0:0: [sda] Attached SCSI disk
[    7.314909] centnas kernel: scsi 0:0:3:0: Direct-Access     ATA      WDC WD100EZAZ-11 0A83 PQ: 0 ANSI: 6
[    7.314918] centnas kernel: scsi 0:0:3:0: SATA: handle(0x000d), sas_addr(0x500056b37789abe9), phy(9), device_name(0x0000000000000000)
[    7.314921] centnas kernel: scsi 0:0:3:0: enclosure logical id (0x500056b36789abff), slot(5) 
[    7.315023] centnas kernel: scsi 0:0:3:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    7.315106] centnas kernel: random: crng init done
[    7.315781] centnas kernel: sd 0:0:3:0: Power-on or device reset occurred
[    7.316781] centnas kernel: sd 0:0:3:0: [sde] 19532873728 512-byte logical blocks: (10.0 TB/9.10 TiB)
[    7.316785] centnas kernel: sd 0:0:3:0: [sde] 4096-byte physical blocks
[    7.319893] centnas kernel: sd 0:0:3:0: [sde] Write Protect is off
[    7.319904] centnas kernel: sd 0:0:3:0: [sde] Mode Sense: 7f 00 10 08
[    7.320321] centnas kernel: sd 0:0:3:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    7.321987] centnas sshd[381]: Server listening on 0.0.0.0 port 22.
[    7.321987] centnas sshd[381]: Server listening on :: port 22.
[    7.346072] centnas systemd-networkd[555]: eno1: Gained carrier
[    7.346007] centnas kernel: ixgbe 0000:01:00.0 eno1: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[    7.346142] centnas kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[    7.348350] centnas systemd-networkd[555]: eno1: DHCPv4 address 10.0.10.10/24 via 10.0.10.1
[    7.348540] centnas kernel:  sdb: sdb1 sdb2
[    7.349572] centnas kernel:  sdc: sdc1 sdc2
[    7.355061] centnas kernel: sd 0:0:1:0: [sdb] Attached SCSI disk
[    7.355871] centnas kernel: sd 0:0:2:0: [sdc] Attached SCSI disk
[    7.432358] centnas kernel:  sde: sde1 sde2
[    7.439086] centnas kernel: sd 0:0:3:0: [sde] Attached SCSI disk
[    7.564967] centnas kernel: scsi 0:0:4:0: Direct-Access     ATA      WDC WD100EZAZ-11 0A83 PQ: 0 ANSI: 6
[    7.564977] centnas kernel: scsi 0:0:4:0: SATA: handle(0x000e), sas_addr(0x500056b37789abec), phy(12), device_name(0x0000000000000000)
[    7.564980] centnas kernel: scsi 0:0:4:0: enclosure logical id (0x500056b36789abff), slot(1) 
[    7.565118] centnas kernel: scsi 0:0:4:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    7.565980] centnas kernel: sd 0:0:4:0: Power-on or device reset occurred
[    7.567010] centnas kernel: sd 0:0:4:0: [sdf] 19532873728 512-byte logical blocks: (10.0 TB/9.10 TiB)
[    7.567011] centnas kernel: sd 0:0:4:0: [sdf] 4096-byte physical blocks
[    7.569333] centnas kernel: scsi 0:0:5:0: scsih_slave_alloc : sas_device->starget set to starget @ 1812
[    7.570016] centnas kernel: sd 0:0:4:0: [sdf] Write Protect is off
[    7.570018] centnas kernel: sd 0:0:4:0: [sdf] Mode Sense: 7f 00 10 08
[    7.570388] centnas kernel: sd 0:0:4:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    7.729142] centnas kernel:  sdf: sdf1 sdf2
[    7.735527] centnas kernel: sd 0:0:4:0: [sdf] Attached SCSI disk
[    8.706055] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Firmware version 7.1.17 116786 (0x700411 0x1c832)
[    8.706058] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Platform version 16 
[    8.706059] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Firmware VCS version 116786 [0x1c832]
[    8.706067] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Firmware VCS uid 0xaeb15671994a45642f91efbb214fa428e4245f8a
[    8.709639] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Powercut flush: Enabled
[    8.964239] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Configuring for three modules
[    9.036051] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: PCIe power monitor enabled (master). Limit set to 74.750 watts.
[    9.036060] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Thermal monitoring: Enabled
[    9.036068] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.0: Hardware temperature alarm set for 100C.
[    9.166042] centnas kernel: <6>fioinf ioDrive 0000:06:00.0: Found device fct0 (Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0) on pipeline 0
[   11.075919] centnas kernel: mpt2sas_cm0: port enable: SUCCESS
[   11.135133] centnas systemd[1]: Found device Samsung_SSD_850_EVO_250GB nasbpool.
[   11.138724] centnas systemd[1]: Found device Samsung_SSD_850_EVO_250GB nasrpool.
[   13.553953] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: probed fct0
[   13.554581] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Starting virtual controller
[   13.554600] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Required PCIE bandwidth 2.000 GBytes per sec
[   13.554603] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Board serial number is 1231D1459-1121P1
[   13.554604] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Adapter serial number is 1231D1459
[   13.554607] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Default capacity        576.304 GBytes
[   13.554608] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Default sector size     512 bytes
[   13.554609] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Rated endurance         8.130 PBytes
[   13.554611] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: 100C temp range hardware found
[   13.554612] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Maximum capacity        618.869 GBytes
[   13.554632] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Firmware version 7.1.17 116786 (0x700411 0x1c832)
[   13.554633] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Platform version 16 
[   13.554634] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Firmware VCS version 116786 [0x1c832]
[   13.554641] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Firmware VCS uid 0xaeb15671994a45642f91efbb214fa428e4245f8a
[   13.557873] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Powercut flush: Enabled
[   13.812464] centnas kernel: <6>fioinf ioDrive 0000:06:00.0.1: Configuring for three modules
[   13.853727] centnas kernel: <6>fioinf ioDrive 0000:06:00.0: Found device fct1 (Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0) on pipeline 1
[   14.001997] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: sector_size=512
[   14.002002] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: setting channel range data to [2 .. 2047]
[   14.165372] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Found metadata in EBs 472-421, loading...
[   14.585782] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: setting recovered append point 421+358465536
[   14.596529] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Creating device of size 576304000000 bytes with 1125593750 sectors of 512 bytes (1111652648 mapped).
[   14.616071] centnas kernel: fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Creating block device fioa: major: 254 minor: 0 sector size: 512...
[   14.616710] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Attach succeeded.
[   18.177843] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: probed fct1
[   18.178138] centnas kernel: <6>fioinf ioDrive 0000:07:00.0: mapping controller on BAR 5
[   18.178277] centnas kernel: <6>fioinf ioDrive 0000:07:00.0: MSI-X enabled (2 vectors)
[   18.178279] centnas kernel: <6>fioinf ioDrive 0000:07:00.0: using MSI-X interrupts
[   18.208731] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Starting master controller
[   18.305918] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: PMP Address: 1 1 1 1
[   18.342213] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: sector_size=512
[   18.342219] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: setting channel range data to [2 .. 2047]
[   18.497444] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Found metadata in EBs 1204-856, loading...
[   18.506128] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: SMP Controller Firmware APP  version 1.0.29 0
[   18.506129] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: SMP Controller Firmware BOOT version 0.0.9 1
[   18.506130] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: SMP Adapter    Firmware APP  version 1.0.35 0
[   18.506131] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: SMP Adapter    Firmware BOOT version 0.0.8 1
[   18.903549] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: setting recovered append point 856+358465536
[   18.912786] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Creating device of size 576304000000 bytes with 1125593750 sectors of 512 bytes (1102950037 mapped).
[   18.912910] centnas kernel: fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Creating block device fiob: major: 254 minor: 16 sector size: 512...
[   18.913427] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:06:00.0: Attach succeeded.
[   19.336196] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Required PCIE bandwidth 2.000 GBytes per sec
[   19.336201] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Board serial number is 1231D1459-1111
[   19.336207] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Adapter serial number is 1231D1459
[   19.336212] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Default capacity        576.304 GBytes
[   19.336218] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Default sector size     512 bytes
[   19.336224] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Rated endurance         8.130 PBytes
[   19.336227] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: 100C temp range hardware found
[   19.336233] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Maximum capacity        618.869 GBytes
[   20.856114] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Firmware version 7.1.17 116786 (0x700411 0x1c832)
[   20.856117] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Platform version 16 
[   20.856119] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Firmware VCS version 116786 [0x1c832]
[   20.856131] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Firmware VCS uid 0xaeb15671994a45642f91efbb214fa428e4245f8a
[   20.859691] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Powercut flush: Enabled
[   21.114280] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Configuring for three modules
[   21.186067] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: PCIe power monitor enabled (slave). Limit set to 74.750 watts.
[   21.186075] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Thermal monitoring: Enabled
[   21.186077] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.0: Hardware temperature alarm set for 100C.
[   21.346029] centnas kernel: <6>fioinf ioDrive 0000:07:00.0: Found device fct2 (Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0) on pipeline 0
[   25.921546] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: probed fct2
[   25.922162] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Starting virtual controller
[   25.922180] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Required PCIE bandwidth 2.000 GBytes per sec
[   25.922183] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Board serial number is 1231D1459-1111P1
[   25.922184] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Adapter serial number is 1231D1459
[   25.922186] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Default capacity        576.304 GBytes
[   25.922187] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Default sector size     512 bytes
[   25.922189] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Rated endurance         8.130 PBytes
[   25.922190] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: 100C temp range hardware found
[   25.922191] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Maximum capacity        618.869 GBytes
[   25.922210] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Firmware version 7.1.17 116786 (0x700411 0x1c832)
[   25.922211] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Platform version 16 
[   25.922212] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Firmware VCS version 116786 [0x1c832]
[   25.922219] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Firmware VCS uid 0xaeb15671994a45642f91efbb214fa428e4245f8a
[   25.925394] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Powercut flush: Enabled
[   26.179982] centnas kernel: <6>fioinf ioDrive 0000:07:00.0.1: Configuring for three modules
[   26.221208] centnas kernel: <6>fioinf ioDrive 0000:07:00.0: Found device fct3 (Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0) on pipeline 1
[   27.238082] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: sector_size=512
[   27.238087] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: setting channel range data to [2 .. 2047]
[   27.388848] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Found metadata in EBs 471-1755, loading...
[   27.790227] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: setting recovered append point 1755+358465536
[   27.799542] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Creating device of size 576304000000 bytes with 1125593750 sectors of 512 bytes (1101935472 mapped).
[   27.799656] centnas kernel: fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Creating block device fioc: major: 254 minor: 32 sector size: 512...
[   27.801497] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Attach succeeded.
[   30.469071] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: probed fct3
[   30.603315] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: sector_size=512
[   30.603319] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: setting channel range data to [2 .. 2047]
[   30.756974] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Found metadata in EBs 393-537, loading...
[   31.160499] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: setting recovered append point 537+358465536
[   31.169811] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Creating device of size 576304000000 bytes with 1125593750 sectors of 512 bytes (1112725040 mapped).
[   31.169966] centnas kernel: fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Creating block device fiod: major: 254 minor: 48 sector size: 512...
[   31.170497] centnas kernel: <6>fioinf Dell ioDrive2 Duo 2410GB MLC 0000:07:00.0: Attach succeeded.
[   31.320017] centnas systemd[1]: Finished Wait for udev To Complete Device Initialization.
[   31.320615] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udev-settle comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   31.320723] centnas systemd[1]: Reached target System Initialization.
[   31.320799] centnas systemd[1]: Reached target Basic System.
[   31.322672] centnas systemd[1]: Starting Import ZFS pools by cache file...
[   31.322784] centnas systemd[1]: Condition check resulted in Import ZFS pools by device scanning being skipped.
[   31.324651] centnas systemd[1]: Finished dracut initqueue hook.
[   31.324783] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   31.325135] centnas systemd[1]: Reached target Remote File Systems (Pre).
[   31.325213] centnas systemd[1]: Reached target Remote File Systems.
[   31.320424] centnas kernel: audit: type=1130 audit(1606499516.928:9): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udev-settle comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   31.325066] centnas kernel: audit: type=1130 audit(1606499516.928:10): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   31.327041] centnas systemd[1]: Starting dracut pre-mount hook...
[   43.575911] centnas dracut-pre-mount[2017]: cannot open 'nasrpool': no such pool
[   43.579168] centnas systemd[1]: Finished dracut pre-mount hook.
[   43.579707] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   43.577102] centnas kernel: fbcon: Taking over console
[   43.577531] centnas kernel: Console: switching to colour frame buffer device 100x37
[   43.579649] centnas kernel: audit: type=1130 audit(1606499529.188:11): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.017438] centnas systemd[1]: Finished Import ZFS pools by cache file.
[   44.017616] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=zfs-import-cache comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.019728] centnas systemd[1]: Starting Set BOOTFS environment for dracut...
[   44.017858] centnas kernel: audit: type=1130 audit(1606499529.628:12): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=zfs-import-cache comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.044870] centnas systemd[1]: zfs-env-bootfs.service: Succeeded.
[   44.045471] centnas systemd[1]: Finished Set BOOTFS environment for dracut.
[   44.045584] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=zfs-env-bootfs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.045651] centnas audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=zfs-env-bootfs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.045705] centnas systemd[1]: Reached target ZFS pool import target.
[   44.046884] centnas systemd[1]: Mounting /sysroot...
[   44.045935] centnas kernel: audit: type=1130 audit(1606499529.648:13): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=zfs-env-bootfs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.045955] centnas kernel: audit: type=1131 audit(1606499529.648:14): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=zfs-env-bootfs comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.061343] centnas mount[2905]: filesystem 'nasrpool/enc/ROOT' can not be mounted: Permission denied
[   44.062081] centnas systemd[1]: sysroot.mount: Mount process exited, code=exited, status=1/FAILURE
[   44.062153] centnas systemd[1]: sysroot.mount: Failed with result 'exit-code'.
[   44.062799] centnas systemd[1]: Failed to mount /sysroot.
[   44.063066] centnas systemd[1]: Dependency failed for Initrd Root File System.
[   44.063350] centnas systemd[1]: Dependency failed for Reload Configuration from the Real Root.
[   44.063706] centnas systemd[1]: initrd-parse-etc.service: Job initrd-parse-etc.service/start failed with result 'dependency'.
[   44.063820] centnas systemd[1]: initrd-parse-etc.service: Triggering OnFailure= dependencies.
[   44.063890] centnas systemd[1]: initrd-root-fs.target: Job initrd-root-fs.target/start failed with result 'dependency'.
[   44.063938] centnas systemd[1]: initrd-root-fs.target: Triggering OnFailure= dependencies.
[   44.064139] centnas systemd[1]: systemd-ask-password-console.path: Succeeded.
[   44.095727] centnas systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.
[   44.095865] centnas systemd[1]: Stopped target Basic System.
[   44.095936] centnas systemd[1]: Reached target Initrd File Systems.
[   44.096018] centnas systemd[1]: Stopped target System Initialization.
[   44.096093] centnas systemd[1]: dracut-pre-mount.service: Succeeded.
[   44.096170] centnas systemd[1]: Stopped dracut pre-mount hook.
[   44.096286] centnas audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.096383] centnas systemd[1]: dracut-initqueue.service: Succeeded.
[   44.096473] centnas systemd[1]: Stopped dracut initqueue hook.
[   44.096537] centnas audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.096604] centnas systemd[1]: dracut-pre-udev.service: Succeeded.
[   44.096709] centnas systemd[1]: Stopped dracut pre-udev hook.
[   44.096777] centnas audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.096842] centnas systemd[1]: dracut-cmdline.service: Succeeded.
[   44.096932] centnas systemd[1]: Stopped dracut cmdline hook.
[   44.097005] centnas audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.097072] centnas systemd[1]: dracut-cmdline-ask.service: Succeeded.
[   44.097156] centnas systemd[1]: Stopped dracut ask for additional cmdline parameters.
[   44.097241] centnas audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-cmdline-ask comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.098926] centnas systemd[1]: Started Emergency Shell.
[   44.099111] centnas audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=emergency comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.099181] centnas systemd[1]: Reached target Emergency Mode.
[   44.099268] centnas systemd[1]: Startup finished in 2.993s (kernel) + 0 (initrd) + 41.105s (userspace) = 44.099s.
[   44.096637] centnas kernel: audit: type=1131 audit(1606499529.708:15): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.096865] centnas kernel: audit: type=1131 audit(1606499529.708:16): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.097106] centnas kernel: audit: type=1131 audit(1606499529.708:17): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.097316] centnas kernel: audit: type=1131 audit(1606499529.708:18): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.097570] centnas kernel: audit: type=1131 audit(1606499529.708:19): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-cmdline-ask comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   44.099463] centnas kernel: audit: type=1130 audit(1606499529.708:20): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=emergency comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
bghira commented 3 years ago

boot using rd.debug

sotiris-bos commented 3 years ago

Github won't let me paste it here, comment too long.

https://pastebin.com/TckAFL6k

sotiris-bos commented 3 years ago

Maybe related to https://github.com/openzfs/zfs/issues/8343 ?

sotiris-bos commented 3 years ago

https://github.com/openzfs/zfs/issues/8885

sotiris-bos commented 3 years ago

Using zfs-import-scan vs zfs-import-cache solves the problem. No idea why.

ajakk commented 2 years ago

The solution mentioned here fixes this for me: https://github.com/openzfs/zfs/issues/8343#issuecomment-464903476

I think something is going wrong in https://github.com/openzfs/zfs/blob/master/contrib/dracut/90zfs/zfs-load-key.sh.in, where it does not expect there to be multiple pools available in early boot when the root pool is encrypted.

stale[bot] commented 1 year ago

This issue has been automatically marked as "stale" because it has not had any activity for a while. It will be closed in 90 days if no further activity occurs. Thank you for your contributions.