Why the bandwidth is very low in OpenSSD mode?

GaryLee1101 commented 1 year ago

I try to test the bandwidth of Daisy Plus by command: fio -filename=/dev/nvme0n1 -direct=1 -iodepth 256 -thread -rw=read -ioengine=psync -bs=32k -size=10G -numjobs=8 -runtime=20 -group_reporting -name=sqe_read_32k

However, the bandwidth is very low, varying between hundreds of KB and thousands of KB. Here is one test result:

I tried three types of NAND modules, including two same Toshiba modules and a Hynix module(bought with Cosmos Plus in 2020). Unfortunately, all of them perform badly.

I want to know how to increase its bandwidth, Thanks.

Here is my configuration: Board: Daisy Plus (LPDDR4_B) NAND Modules: Toshiba 256GB or Hynix 512GB Firmware: OpenSSD-OpenChannelSSD\DaisyPlus\OpenSSD\Toshiba_NAND\daisyplus_openssd_toshiba_4c8w_lpddr4 or OpenSSD-OpenChannelSSD\DaisyPlus\OpenSSD\Hynix_NAND\daisyplus_openssd_hynix_4c8w_lpddr4 CPU: Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz Main board: ASRock Z77 Extreme 6 Memory: DDR3 1600M 12GB OS: Ubuntu16.04 with Kernel 4.4.4

By the way, Cosmos plus is able to reach a normal bandwidth (about 1.4GB/s) in this configuration.

CRZ-Technology commented 1 year ago

Try with NVMe driver of linux kernel 4.17.0 or above. It is found that NVMe driver of linux kernel 4.16.0 or below is not compatible with Xilinx UltraScale+ PCIe.

If not working, please upload the output of 'dmesg'.

GaryLee1101 commented 1 year ago

Try with NVMe driver of linux kernel 4.17.0 or above. It is found that NVMe driver of linux kernel 4.16.0 or below is not compatible with Xilinx UltraScale+ PCIe.

If not working, please upload the output of 'dmesg'.

I changed my kernel to 4.19.282, however the bandwidth turned to 0. Here is the FIO result: ` Run status group 0 (all jobs): READ: io=256KB, aggrb=8KB/s, minb=8KB/s, maxb=8KB/s, mint=30607msec, maxt=30607msec

Disk stats (read/write): nvme0n1: ios=0/0, merge=0/0, ticks=0/0, in_queue=243296, util=99.71% `

This is my dmesg information: ` [ 0.000000] microcode: microcode updated early to revision 0x21, date = 2019-02-13 [ 0.000000] Linux version 4.19.282 (gary@gary-desktop) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.12)) #1 SMP Tue May 9 10:28:52 CST 2023 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.19.282 root=UUID=74d19090-3140-4a9f-983c-80d58db35b74 ro quiet splash vt.handoff=7 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Centaur CentaurHauls [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'

[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009efff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009f000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000dd83dfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000dd83e000-0x00000000de023fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000de024000-0x00000000de0aefff] usable [ 0.000000] BIOS-e820: [mem 0x00000000de0af000-0x00000000de153fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000de154000-0x00000000de95cfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000de95d000-0x00000000de95dfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000de95e000-0x00000000de9a0fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000de9a1000-0x00000000df3ecfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000df3ed000-0x00000000df7f1fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000df7f2000-0x00000000df7fffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed03fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000031effffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] e820: update [mem 0x98dfb018-0x98e0a657] usable ==> usable [ 0.000000] e820: update [mem 0x98dfb018-0x98e0a657] usable ==> usable [ 0.000000] e820: update [mem 0x98df2018-0x98dfa057] usable ==> usable [ 0.000000] e820: update [mem 0x98df2018-0x98dfa057] usable ==> usable [ 0.000000] e820: update [mem 0x98de3018-0x98df1657] usable ==> usable [ 0.000000] e820: update [mem 0x98de3018-0x98df1657] usable ==> usable [ 0.000000] extended physical RAM map: [ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009efff] usable [ 0.000000] reserve setup_data: [mem 0x000000000009f000-0x000000000009ffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x0000000098de3017] usable [ 0.000000] reserve setup_data: [mem 0x0000000098de3018-0x0000000098df1657] usable [ 0.000000] reserve setup_data: [mem 0x0000000098df1658-0x0000000098df2017] usable [ 0.000000] reserve setup_data: [mem 0x0000000098df2018-0x0000000098dfa057] usable [ 0.000000] reserve setup_data: [mem 0x0000000098dfa058-0x0000000098dfb017] usable [ 0.000000] reserve setup_data: [mem 0x0000000098dfb018-0x0000000098e0a657] usable [ 0.000000] reserve setup_data: [mem 0x0000000098e0a658-0x00000000dd83dfff] usable [ 0.000000] reserve setup_data: [mem 0x00000000dd83e000-0x00000000de023fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000de024000-0x00000000de0aefff] usable [ 0.000000] reserve setup_data: [mem 0x00000000de0af000-0x00000000de153fff] ACPI NVS [ 0.000000] reserve setup_data: [mem 0x00000000de154000-0x00000000de95cfff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000de95d000-0x00000000de95dfff] usable [ 0.000000] reserve setup_data: [mem 0x00000000de95e000-0x00000000de9a0fff] ACPI NVS [ 0.000000] reserve setup_data: [mem 0x00000000de9a1000-0x00000000df3ecfff] usable [ 0.000000] reserve setup_data: [mem 0x00000000df3ed000-0x00000000df7f1fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000df7f2000-0x00000000df7fffff] usable [ 0.000000] reserve setup_data: [mem 0x00000000f8000000-0x00000000fbffffff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fed00000-0x00000000fed03fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000031effffff] usable [ 0.000000] efi: EFI v2.31 by American Megatrends [ 0.000000] efi: ACPI=0xde137000 ACPI 2.0=0xde137000 SMBIOS=0xf04c0 MPS=0xfd570 [ 0.000000] SMBIOS 2.7 present. [ 0.000000] DMI: To Be Filled By O.E.M. To Be Filled By O.E.M./Z77 Extreme6, BIOS P2.80 07/01/2013 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3299.928 MHz processor [ 0.001449] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.001450] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.001457] last_pfn = 0x31f000 max_arch_pfn = 0x400000000 [ 0.001460] MTRR default type: uncachable [ 0.001461] MTRR fixed ranges enabled: [ 0.001462] 00000-9FFFF write-back [ 0.001462] A0000-BFFFF uncachable [ 0.001463] C0000-CFFFF write-protect [ 0.001463] D0000-DFFFF uncachable [ 0.001464] E0000-FFFFF write-protect [ 0.001464] MTRR variable ranges enabled: [ 0.001465] 0 base 000000000 mask E00000000 write-back [ 0.001466] 1 base 200000000 mask F00000000 write-back [ 0.001467] 2 base 300000000 mask FF0000000 write-back [ 0.001467] 3 base 310000000 mask FF8000000 write-back [ 0.001468] 4 base 318000000 mask FFC000000 write-back [ 0.001469] 5 base 31C000000 mask FFE000000 write-back [ 0.001469] 6 base 31E000000 mask FFF000000 write-back [ 0.001470] 7 base 0E0000000 mask FE0000000 uncachable [ 0.001470] 8 disabled [ 0.001471] 9 disabled [ 0.002622] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.002781] total RAM covered: 12272M [ 0.003170] Found optimal setting for mtrr clean up [ 0.003171] gran_size: 64K chunk_size: 32M num_reg: 7 lose cover RAM: 0G [ 0.004067] e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved [ 0.004071] last_pfn = 0xdf800 max_archpfn = 0x400000000 [ 0.012160] found SMP MP-table at [mem 0x000fda80-0x000fda8f] [ 0.012179] Scanning 1 areas for low memory corruption [ 0.013132] Secure boot disabled [ 0.013133] RAMDISK: [mem 0x20a06000-0x3d3cefff] [ 0.013137] ACPI: Early table checksum verification disabled [ 0.013140] ACPI: RSDP 0x00000000DE137000 000024 (v02 ALASKA) [ 0.013143] ACPI: XSDT 0x00000000DE137080 00007C (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.013148] ACPI: FACP 0x00000000DE141520 00010C (v05 ALASKA A M I 01072009 AMI 00010013) [ 0.013153] ACPI: DSDT 0x00000000DE137190 00A38E (v02 ALASKA A M I 00000022 INTL 20051117) [ 0.013155] ACPI: FACS 0x00000000DE152080 000040 [ 0.013157] ACPI: APIC 0x00000000DE141630 000092 (v03 ALASKA A M I 01072009 AMI 00010013) [ 0.013159] ACPI: FPDT 0x00000000DE1416C8 000044 (v01 ALASKA A M I 01072009 AMI 00010013) [ 0.013161] ACPI: MCFG 0x00000000DE141710 00003C (v01 ALASKA A M I 01072009 MSFT 00000097) [ 0.013163] ACPI: SSDT 0x00000000DE141750 0007E1 (v01 Intel AoacTabl 00001000 INTL 20091112) [ 0.013166] ACPI: AAFT 0x00000000DE141F38 000112 (v01 ALASKA OEMAAFT 01072009 MSFT 00000097) [ 0.013168] ACPI: HPET 0x00000000DE142050 000038 (v01 ALASKA A M I 01072009 AMI. 00000005) [ 0.013170] ACPI: SSDT 0x00000000DE142088 00036D (v01 SataRe SataTabl 00001000 INTL 20091112) [ 0.013172] ACPI: SSDT 0x00000000DE1423F8 0009AA (v01 PmRef Cpu0Ist 00003000 INTL 20051117) [ 0.013174] ACPI: SSDT 0x00000000DE142DA8 000A92 (v01 PmRef CpuPm 00003000 INTL 20051117) [ 0.013177] ACPI: BGRT 0x00000000DE143840 000038 (v00 ALASKA A M I 01072009 AMI 00010013) [ 0.013179] ACPI: Reserving FACP table memory at [mem 0xde141520-0xde14162b] [ 0.013180] ACPI: Reserving DSDT table memory at [mem 0xde137190-0xde14151d] [ 0.013180] ACPI: Reserving FACS table memory at [mem 0xde152080-0xde1520bf] [ 0.013181] ACPI: Reserving APIC table memory at [mem 0xde141630-0xde1416c1] [ 0.013181] ACPI: Reserving FPDT table memory at [mem 0xde1416c8-0xde14170b] [ 0.013182] ACPI: Reserving MCFG table memory at [mem 0xde141710-0xde14174b] [ 0.013182] ACPI: Reserving SSDT table memory at [mem 0xde141750-0xde141f30] [ 0.013183] ACPI: Reserving AAFT table memory at [mem 0xde141f38-0xde142049] [ 0.013184] ACPI: Reserving HPET table memory at [mem 0xde142050-0xde142087] [ 0.013184] ACPI: Reserving SSDT table memory at [mem 0xde142088-0xde1423f4] [ 0.013185] ACPI: Reserving SSDT table memory at [mem 0xde1423f8-0xde142da1] [ 0.013185] ACPI: Reserving SSDT table memory at [mem 0xde142da8-0xde143839] [ 0.013186] ACPI: Reserving BGRT table memory at [mem 0xde143840-0xde143877] [ 0.013195] ACPI: Local APIC address 0xfee00000 [ 0.013266] No NUMA configuration found [ 0.013267] Faking a node at [mem 0x0000000000000000-0x000000031effffff] [ 0.013275] NODE_DATA(0) allocated [mem 0x31efcc000-0x31eff6fff] [ 0.013499] Zone ranges: [ 0.013500] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.013501] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.013501] Normal [mem 0x0000000100000000-0x000000031effffff] [ 0.013502] Device empty [ 0.013503] Movable zone start for each node [ 0.013505] Early memory node ranges [ 0.013506] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.013506] node 0: [mem 0x0000000000100000-0x00000000dd83dfff] [ 0.013507] node 0: [mem 0x00000000de024000-0x00000000de0aefff] [ 0.013507] node 0: [mem 0x00000000de95d000-0x00000000de95dfff] [ 0.013508] node 0: [mem 0x00000000de9a1000-0x00000000df3ecfff] [ 0.013508] node 0: [mem 0x00000000df7f2000-0x00000000df7fffff] [ 0.013509] node 0: [mem 0x0000000100000000-0x000000031effffff] [ 0.013673] Zeroed struct page in unavailable ranges: 11582 pages [ 0.013674] Initmem setup node 0 [mem 0x0000000000001000-0x000000031effffff] [ 0.013675] On node 0 totalpages: 3134146 [ 0.013676] DMA zone: 64 pages used for memmap [ 0.013676] DMA zone: 25 pages reserved [ 0.013677] DMA zone: 3998 pages, LIFO batch:0 [ 0.013755] DMA32 zone: 14157 pages used for memmap [ 0.013755] DMA32 zone: 906020 pages, LIFO batch:63 [ 0.031329] Normal zone: 34752 pages used for memmap [ 0.031330] Normal zone: 2224128 pages, LIFO batch:63 [ 0.072754] tboot: non-0 tboot_addr but it is not of type E820_TYPE_RESERVED [ 0.072861] ACPI: PM-Timer IO Port: 0x408 [ 0.072863] ACPI: Local APIC address 0xfee00000 [ 0.072869] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) [ 0.072879] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23 [ 0.072881] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.072882] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.072883] ACPI: IRQ0 used by override. [ 0.072884] ACPI: IRQ9 used by override. [ 0.072886] Using ACPI (MADT) for SMP configuration information [ 0.072887] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.072896] e820: update [mem 0xd0e23000-0xd1063fff] usable ==> reserved [ 0.072906] TSC deadline timer available [ 0.072907] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.072923] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.072924] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.072925] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff] [ 0.072926] PM: Registered nosave memory: [mem 0x98de3000-0x98de3fff] [ 0.072927] PM: Registered nosave memory: [mem 0x98df1000-0x98df1fff] [ 0.072928] PM: Registered nosave memory: [mem 0x98df2000-0x98df2fff] [ 0.072929] PM: Registered nosave memory: [mem 0x98dfa000-0x98dfafff] [ 0.072929] PM: Registered nosave memory: [mem 0x98dfb000-0x98dfbfff] [ 0.072930] PM: Registered nosave memory: [mem 0x98e0a000-0x98e0afff] [ 0.072932] PM: Registered nosave memory: [mem 0xd0e23000-0xd1063fff] [ 0.072933] PM: Registered nosave memory: [mem 0xdd83e000-0xde023fff] [ 0.072934] PM: Registered nosave memory: [mem 0xde0af000-0xde153fff] [ 0.072934] PM: Registered nosave memory: [mem 0xde154000-0xde95cfff] [ 0.072936] PM: Registered nosave memory: [mem 0xde95e000-0xde9a0fff] [ 0.072937] PM: Registered nosave memory: [mem 0xdf3ed000-0xdf7f1fff] [ 0.072938] PM: Registered nosave memory: [mem 0xdf800000-0xf7ffffff] [ 0.072939] PM: Registered nosave memory: [mem 0xf8000000-0xfbffffff] [ 0.072939] PM: Registered nosave memory: [mem 0xfc000000-0xfebfffff] [ 0.072939] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.072940] PM: Registered nosave memory: [mem 0xfec01000-0xfecfffff] [ 0.072940] PM: Registered nosave memory: [mem 0xfed00000-0xfed03fff] [ 0.072941] PM: Registered nosave memory: [mem 0xfed04000-0xfed1bfff] [ 0.072941] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.072941] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff] [ 0.072942] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.072942] PM: Registered nosave memory: [mem 0xfee01000-0xfeffffff] [ 0.072943] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.072944] [mem 0xdf800000-0xf7ffffff] available for PCI devices [ 0.072945] Booting paravirtualized kernel on bare hardware [ 0.072947] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.072952] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.073126] percpu: Embedded 51 pages/cpu s172032 r8192 d28672 u262144 [ 0.073131] pcpu-alloc: s172032 r8192 d28672 u262144 alloc=1*2097152 [ 0.073131] pcpu-alloc: [0] 0 1 2 3 4 5 6 7 [ 0.073153] Built 1 zonelists, mobility grouping on. Total pages: 3085148 [ 0.073154] Policy zone: Normal [ 0.073155] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.19.282 root=UUID=74d19090-3140-4a9f-983c-80d58db35b74 ro quiet splash vt.handoff=7 [ 0.076198] Calgary: detecting Calgary via BIOS EBDA area [ 0.076200] Calgary: Unable to locate Rio Grande table in EBDA - bailing! [ 0.107174] Memory: 11551768K/12536584K available (14348K kernel code, 2680K rwdata, 4108K rodata, 2484K init, 17236K bss, 984816K reserved, 0K cma-reserved) [ 0.107328] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.107333] Kernel/User page tables isolation: enabled [ 0.107389] ftrace: allocating 41029 entries in 161 pages [ 0.122010] rcu: Hierarchical RCU implementation. [ 0.122011] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.122012] Tasks RCU enabled. [ 0.122012] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.124416] NR_IRQS: 524544, nr_irqs: 488, preallocated irqs: 16 [ 0.124598] random: crng init done [ 0.124616] Console: colour dummy device 80x25 [ 0.124620] console [tty0] enabled [ 0.124632] ACPI: Core revision 20180810 [ 0.124767] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.124775] hpet clockevent registered [ 0.124778] APIC: Switch to symmetric I/O mode setup [ 0.124847] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.125262] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.144779] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2f91085fbee, max_idle_ns: 440795335525 ns [ 0.144789] Calibrating delay loop (skipped), value calculated using timer frequency.. 6599.85 BogoMIPS (lpj=13199712) [ 0.144790] pid_max: default: 32768 minimum: 301 [ 0.144983] Security Framework initialized [ 0.144984] Yama: becoming mindful. [ 0.144997] AppArmor: AppArmor initialized [ 0.147338] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes) [ 0.148420] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes) [ 0.148462] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.148495] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.148677] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' [ 0.148678] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) [ 0.148690] CPU0: Thermal monitoring enabled (TM1) [ 0.148697] process: using mwait in idle threads [ 0.148699] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8 [ 0.148700] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0 [ 0.148701] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.148702] Spectre V2 : Mitigation: Retpolines [ 0.148703] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.148703] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.148703] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 0.148710] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 0.148711] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 0.148711] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 0.148733] MDS: Mitigation: Clear CPU buffers [ 0.148733] MMIO Stale Data: Unknown: No mitigations [ 0.148734] SRBDS: Vulnerable: No microcode [ 0.148900] Freeing SMP alternatives memory: 36K [ 0.158470] smpboot: CPU0: Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz (family: 0x6, model: 0x3a, stepping: 0x9) [ 0.158548] Performance Events: PEBS fmt1+, IvyBridge events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.158564] ... version: 3 [ 0.158564] ... bit width: 48 [ 0.158565] ... generic registers: 4 [ 0.158565] ... value mask: 0000ffffffffffff [ 0.158566] ... max period: 00007fffffffffff [ 0.158566] ... fixed-purpose events: 3 [ 0.158566] ... event mask: 000000070000000f [ 0.158596] rcu: Hierarchical SRCU implementation. [ 0.159319] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.159374] smp: Bringing up secondary CPUs ... [ 0.159433] x86: Booting SMP configuration: [ 0.159434] .... node #0, CPUs: #1 #2 #3 #4 [ 0.168961] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.168961] #5 #6 #7 [ 0.175178] smp: Brought up 1 node, 8 CPUs [ 0.175178] smpboot: Max logical packages: 1 [ 0.175178] smpboot: Total of 8 processors activated (52798.84 BogoMIPS) [ 0.177168] devtmpfs: initialized [ 0.177168] x86/mm: Memory block size: 128MB [ 0.177678] PM: Registering ACPI NVS region [mem 0xde0af000-0xde153fff] (675840 bytes) [ 0.177678] PM: Registering ACPI NVS region [mem 0xde95e000-0xde9a0fff] (274432 bytes) [ 0.177678] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 0.177678] futex hash table entries: 2048 (order: 5, 131072 bytes) [ 0.177678] pinctrl core: initialized pinctrl subsystem [ 0.177678] RTC time: 3:26:59, date: 05/09/23 [ 0.177678] NET: Registered protocol family 16 [ 0.177678] audit: initializing netlink subsys (disabled) [ 0.177678] audit: type=2000 audit(1683602818.052:1): state=initialized audit_enabled=0 res=1 [ 0.177678] cpuidle: using governor ladder [ 0.177678] cpuidle: using governor menu [ 0.177678] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.177678] ACPI: bus type PCI registered [ 0.177678] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.177678] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000) [ 0.177678] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820 [ 0.177678] PCI: Using configuration type 1 for base access [ 0.177678] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.177789] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.177789] ACPI: Added _OSI(Module Device) [ 0.177789] ACPI: Added _OSI(Processor Device) [ 0.177789] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.177789] ACPI: Added _OSI(Processor Aggregator Device) [ 0.177789] ACPI: Added _OSI(Linux-Dell-Video) [ 0.177789] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.186386] ACPI: 5 ACPI AML tables successfully acquired and loaded [ 0.188001] ACPI: Dynamic OEM Table Load: [ 0.188006] ACPI: SSDT 0xFFFF981910659000 00083B (v01 PmRef Cpu0Cst 00003001 INTL 20051117) [ 0.188408] ACPI: Dynamic OEM Table Load: [ 0.188410] ACPI: SSDT 0xFFFF9819100B0000 000303 (v01 PmRef ApIst 00003000 INTL 20051117) [ 0.188656] ACPI: Dynamic OEM Table Load: [ 0.188658] ACPI: SSDT 0xFFFF981910109800 000119 (v01 PmRef ApCst 00003000 INTL 20051117) [ 0.190229] ACPI: Interpreter enabled [ 0.190243] ACPI: (supports S0 S3 S4 S5) [ 0.190244] ACPI: Using IOAPIC for interrupt routing [ 0.190299] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.190515] ACPI: Enabled 16 GPEs in block 00 to 3F [ 0.198086] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3e]) [ 0.198090] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 0.198339] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug PME LTR] [ 0.198501] acpi PNP0A08:00: _OSC: OS now controls [AER PCIeCapability] [ 0.198502] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.198973] PCI host bridge to bus 0000:00 [ 0.198975] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.198976] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.198976] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.198977] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window] [ 0.198978] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff window] [ 0.198979] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 0.198979] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 0.198980] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xfeafffff window] [ 0.198981] pci_bus 0000:00: root bus resource [bus 00-3e] [ 0.198987] pci 0000:00:00.0: [8086:0158] type 00 class 0x060000 [ 0.199070] pci 0000:00:01.0: [8086:0151] type 01 class 0x060400 [ 0.199101] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.199172] pci 0000:00:01.1: [8086:0155] type 01 class 0x060400 [ 0.199200] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold [ 0.199291] pci 0000:00:14.0: [8086:1e31] type 00 class 0x0c0330 [ 0.199313] pci 0000:00:14.0: reg 0x10: [mem 0xf7600000-0xf760ffff 64bit] [ 0.199378] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 0.199451] pci 0000:00:16.0: [8086:1e3a] type 00 class 0x078000 [ 0.199474] pci 0000:00:16.0: reg 0x10: [mem 0xf761a000-0xf761a00f 64bit] [ 0.199542] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 0.199621] pci 0000:00:1a.0: [8086:1e2d] type 00 class 0x0c0320 [ 0.199641] pci 0000:00:1a.0: reg 0x10: [mem 0xf7618000-0xf76183ff] [ 0.199720] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 0.199797] pci 0000:00:1b.0: [8086:1e20] type 00 class 0x040300 [ 0.199814] pci 0000:00:1b.0: reg 0x10: [mem 0xf7610000-0xf7613fff 64bit] [ 0.199876] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold [ 0.199955] pci 0000:00:1c.0: [8086:1e10] type 01 class 0x060400 [ 0.200104] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 0.200204] pci 0000:00:1c.4: [8086:1e18] type 01 class 0x060400 [ 0.200291] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 0.200372] pci 0000:00:1c.5: [8086:1e1a] type 01 class 0x060400 [ 0.200458] pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold [ 0.200540] pci 0000:00:1c.6: [8086:1e1c] type 01 class 0x060400 [ 0.200626] pci 0000:00:1c.6: PME# supported from D0 D3hot D3cold [ 0.200709] pci 0000:00:1c.7: [8086:1e1e] type 01 class 0x060400 [ 0.200796] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold [ 0.200881] pci 0000:00:1d.0: [8086:1e26] type 00 class 0x0c0320 [ 0.200901] pci 0000:00:1d.0: reg 0x10: [mem 0xf7617000-0xf76173ff] [ 0.200980] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 0.201056] pci 0000:00:1f.0: [8086:1e44] type 00 class 0x060100 [ 0.201225] pci 0000:00:1f.2: [8086:1e02] type 00 class 0x010601 [ 0.201241] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 0.201247] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 0.201253] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 0.201259] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 0.201265] pci 0000:00:1f.2: reg 0x20: [io 0xf020-0xf03f] [ 0.201271] pci 0000:00:1f.2: reg 0x24: [mem 0xf7616000-0xf76167ff] [ 0.201308] pci 0000:00:1f.2: PME# supported from D3hot [ 0.201377] pci 0000:00:1f.3: [8086:1e22] type 00 class 0x0c0500 [ 0.201393] pci 0000:00:1f.3: reg 0x10: [mem 0xf7615000-0xf76150ff 64bit] [ 0.201412] pci 0000:00:1f.3: reg 0x20: [io 0xf000-0xf01f] [ 0.201520] pci 0000:01:00.0: [10de:0f00] type 00 class 0x030000 [ 0.201532] pci 0000:01:00.0: reg 0x10: [mem 0xf6000000-0xf6ffffff] [ 0.201539] pci 0000:01:00.0: reg 0x14: [mem 0xe8000000-0xefffffff 64bit pref] [ 0.201546] pci 0000:01:00.0: reg 0x1c: [mem 0xf0000000-0xf1ffffff 64bit pref] [ 0.201551] pci 0000:01:00.0: reg 0x24: [io 0xe000-0xe07f] [ 0.201555] pci 0000:01:00.0: reg 0x30: [mem 0xf7000000-0xf707ffff pref] [ 0.201559] pci 0000:01:00.0: enabling Extended Tags [ 0.201567] pci 0000:01:00.0: BAR 3: assigned to efifb [ 0.201601] pci 0000:01:00.0: 16.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s x8 link at 0000:00:01.0 (capable of 32.000 Gb/s with 2.5 GT/s x16 link) [ 0.201631] pci 0000:01:00.1: [10de:0bea] type 00 class 0x040300 [ 0.201640] pci 0000:01:00.1: reg 0x10: [mem 0xf7080000-0xf7083fff] [ 0.201661] pci 0000:01:00.1: enabling Extended Tags [ 0.201727] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.201729] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 0.201730] pci 0000:00:01.0: bridge window [mem 0xf6000000-0xf70fffff] [ 0.201732] pci 0000:00:01.0: bridge window [mem 0xe8000000-0xf1ffffff 64bit pref] [ 0.201755] pci 0000:02:00.0: [10ee:903f] type 00 class 0x010802 [ 0.201765] pci 0000:02:00.0: reg 0x10: [mem 0xf7500000-0xf7501fff] [ 0.201790] pci 0000:02:00.0: enabling Extended Tags [ 0.201824] pci 0000:02:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8 GT/s x8 link at 0000:00:01.1 (capable of 126.016 Gb/s with 8 GT/s x16 link) [ 0.201849] pci 0000:00:01.1: PCI bridge to [bus 02] [ 0.201851] pci 0000:00:01.1: bridge window [mem 0xf7500000-0xf75fffff] [ 0.201903] pci 0000:00:1c.0: PCI bridge to [bus 03] [ 0.201967] pci 0000:04:00.0: [1b21:0612] type 00 class 0x010601 [ 0.201995] pci 0000:04:00.0: reg 0x10: [io 0xd050-0xd057] [ 0.202007] pci 0000:04:00.0: reg 0x14: [io 0xd040-0xd043] [ 0.202019] pci 0000:04:00.0: reg 0x18: [io 0xd030-0xd037] [ 0.202031] pci 0000:04:00.0: reg 0x1c: [io 0xd020-0xd023] [ 0.202043] pci 0000:04:00.0: reg 0x20: [io 0xd000-0xd01f] [ 0.202055] pci 0000:04:00.0: reg 0x24: [mem 0xf7400000-0xf74001ff] [ 0.202221] pci 0000:00:1c.4: PCI bridge to [bus 04] [ 0.202224] pci 0000:00:1c.4: bridge window [io 0xd000-0xdfff] [ 0.202226] pci 0000:00:1c.4: bridge window [mem 0xf7400000-0xf74fffff] [ 0.202286] pci 0000:05:00.0: [14e4:16b1] type 00 class 0x020000 [ 0.202330] pci 0000:05:00.0: reg 0x10: [mem 0xf2110000-0xf211ffff 64bit pref] [ 0.202351] pci 0000:05:00.0: reg 0x18: [mem 0xf2100000-0xf210ffff 64bit pref] [ 0.202390] pci 0000:05:00.0: reg 0x30: [mem 0xf7300000-0xf73007ff pref] [ 0.202510] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold [ 0.202628] pci 0000:00:1c.5: PCI bridge to [bus 05] [ 0.202633] pci 0000:00:1c.5: bridge window [mem 0xf7300000-0xf73fffff] [ 0.202638] pci 0000:00:1c.5: bridge window [mem 0xf2100000-0xf21fffff 64bit pref] [ 0.202688] pci 0000:06:00.0: [1b6f:7023] type 00 class 0x0c0330 [ 0.202725] pci 0000:06:00.0: reg 0x10: [mem 0xf7200000-0xf7207fff 64bit] [ 0.202794] pci 0000:06:00.0: enabling Extended Tags [ 0.202874] pci 0000:06:00.0: supports D1 D2 [ 0.202874] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.202957] pci 0000:00:1c.6: PCI bridge to [bus 06] [ 0.202962] pci 0000:00:1c.6: bridge window [mem 0xf7200000-0xf72fffff] [ 0.203028] pci 0000:07:00.0: [10b5:8605] type 01 class 0x060400 [ 0.203253] pci 0000:07:00.0: supports D1 D2 [ 0.203254] pci 0000:07:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.212812] pci 0000:00:1c.7: PCI bridge to [bus 07-0c] [ 0.212816] pci 0000:00:1c.7: bridge window [io 0xc000-0xcfff] [ 0.212820] pci 0000:00:1c.7: bridge window [mem 0xf7100000-0xf71fffff] [ 0.212940] pci 0000:08:01.0: [10b5:8605] type 01 class 0x060400 [ 0.213168] pci 0000:08:01.0: supports D1 D2 [ 0.213169] pci 0000:08:01.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.213283] pci 0000:08:02.0: [10b5:8605] type 01 class 0x060400 [ 0.213509] pci 0000:08:02.0: supports D1 D2 [ 0.213510] pci 0000:08:02.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.213622] pci 0000:08:03.0: [10b5:8605] type 01 class 0x060400 [ 0.213848] pci 0000:08:03.0: supports D1 D2 [ 0.213849] pci 0000:08:03.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.213993] pci 0000:07:00.0: PCI bridge to [bus 08-0c] [ 0.214002] pci 0000:07:00.0: bridge window [io 0xc000-0xcfff] [ 0.214007] pci 0000:07:00.0: bridge window [mem 0xf7100000-0xf71fffff] [ 0.214070] pci 0000:08:01.0: PCI bridge to [bus 09] [ 0.214147] pci 0000:08:02.0: PCI bridge to [bus 0a] [ 0.214250] pci 0000:0b:00.0: [1b21:1080] type 01 class 0x060401 [ 0.214488] pci 0000:08:03.0: PCI bridge to [bus 0b-0c] [ 0.214497] pci 0000:08:03.0: bridge window [io 0xc000-0xcfff] [ 0.214501] pci 0000:08:03.0: bridge window [mem 0xf7100000-0xf71fffff] [ 0.214553] pci_bus 0000:0c: extended config space not accessible [ 0.214588] pci 0000:0c:02.0: [1106:3044] type 00 class 0x0c0010 [ 0.214630] pci 0000:0c:02.0: reg 0x10: [mem 0xf7100000-0xf71007ff] [ 0.214652] pci 0000:0c:02.0: reg 0x14: [io 0xc000-0xc07f] [ 0.214847] pci 0000:0c:02.0: supports D2 [ 0.214847] pci 0000:0c:02.0: PME# supported from D2 D3hot D3cold [ 0.214984] pci 0000:0b:00.0: PCI bridge to [bus 0c] (subtractive decode) [ 0.214996] pci 0000:0b:00.0: bridge window [io 0xc000-0xcfff] [ 0.215002] pci 0000:0b:00.0: bridge window [mem 0xf7100000-0xf71fffff] [ 0.215015] pci 0000:0b:00.0: bridge window [io 0xc000-0xcfff] (subtractive decode) [ 0.215015] pci 0000:0b:00.0: bridge window [mem 0xf7100000-0xf71fffff] (subtractive decode) [ 0.215766] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 11 12 14 15) [ 0.215818] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 10 11 12 14 15) [ 0.215868] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 10 11 12 14 15) [ 0.215920] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 11 12 14 15) [ 0.215971] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 10 11 12 14 15) 0, disabled. [ 0.216022] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 11 12 14 15) 0, disabled. [ 0.216073] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 10 11 12 14 15) [ 0.216125] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 10 11 12 14 15) [ 0.216264] pci 0000:01:00.0: vgaarb: setting as boot VGA device [ 0.216264] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 0.216264] pci 0000:01:00.0: vgaarb: bridge control possible [ 0.216264] vgaarb: loaded [ 0.216264] SCSI subsystem initialized [ 0.216264] libata version 3.00 loaded. [ 0.216264] ACPI: bus type USB registered [ 0.216264] usbcore: registered new interface driver usbfs [ 0.216264] usbcore: registered new interface driver hub [ 0.216264] usbcore: registered new device driver usb [ 0.216264] pps_core: LinuxPPS API ver. 1 registered [ 0.216264] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti giometti@linux.it [ 0.216264] PTP clock support registered [ 0.216264] EDAC MC: Ver: 3.0.0 [ 0.216264] Registered efivars operations [ 0.216264] PCI: Using ACPI for IRQ routing [ 0.216264] PCI: pci_cache_line_size set to 64 bytes [ 0.216264] e820: reserve RAM buffer [mem 0x0009f000-0x0009ffff] [ 0.216264] e820: reserve RAM buffer [mem 0x98de3018-0x9bffffff] [ 0.216264] e820: reserve RAM buffer [mem 0x98df2018-0x9bffffff] [ 0.216264] e820: reserve RAM buffer [mem 0x98dfb018-0x9bffffff] [ 0.216264] e820: reserve RAM buffer [mem 0xd0e23000-0xd3ffffff] [ 0.216264] e820: reserve RAM buffer [mem 0xdd83e000-0xdfffffff] [ 0.216264] e820: reserve RAM buffer [mem 0xde0af000-0xdfffffff] [ 0.216264] e820: reserve RAM buffer [mem 0xde95e000-0xdfffffff] [ 0.216264] e820: reserve RAM buffer [mem 0xdf3ed000-0xdfffffff] [ 0.216264] e820: reserve RAM buffer [mem 0xdf800000-0xdfffffff] [ 0.216264] e820: reserve RAM buffer [mem 0x31f000000-0x31fffffff] [ 0.216264] NetLabel: Initializing [ 0.216264] NetLabel: domain hash size = 128 [ 0.216264] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.216264] NetLabel: unlabeled traffic allowed by default [ 0.217519] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 0.217522] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 0.220801] clocksource: Switched to clocksource tsc-early [ 0.229247] VFS: Disk quotas dquot_6.6.0 [ 0.229260] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.229347] AppArmor: AppArmor Filesystem Enabled [ 0.229371] pnp: PnP ACPI init [ 0.229482] system 00:00: [mem 0xfed40000-0xfed44fff] has been reserved [ 0.229487] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active) [ 0.229568] system 00:01: [io 0x0680-0x069f] has been reserved [ 0.229570] system 00:01: [io 0x1000-0x100f] has been reserved [ 0.229571] system 00:01: [io 0xffff] has been reserved [ 0.229572] system 00:01: [io 0xffff] has been reserved [ 0.229572] system 00:01: [io 0x0400-0x0453] has been reserved [ 0.229573] system 00:01: [io 0x0458-0x047f] has been reserved [ 0.229574] system 00:01: [io 0x0500-0x057f] has been reserved [ 0.229575] system 00:01: [io 0x164e-0x164f] has been reserved [ 0.229578] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.229596] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active) [ 0.229643] system 00:03: [io 0x0454-0x0457] has been reserved [ 0.229646] system 00:03: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active) [ 0.229727] system 00:04: [io 0x0290-0x029f] has been reserved [ 0.229730] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.230014] system 00:05: [io 0x04d0-0x04d1] has been reserved [ 0.230017] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.230163] pnp 00:06: [dma 0 disabled] [ 0.230197] pnp 00:06: Plug and Play ACPI device, IDs PNP0501 (active) [ 0.230409] system 00:07: [mem 0xfed1c000-0xfed1ffff] has been reserved [ 0.230410] system 00:07: [mem 0xfed10000-0xfed17fff] has been reserved [ 0.230411] system 00:07: [mem 0xfed18000-0xfed18fff] has been reserved [ 0.230412] system 00:07: [mem 0xfed19000-0xfed19fff] has been reserved [ 0.230413] system 00:07: [mem 0xf8000000-0xfbffffff] has been reserved [ 0.230414] system 00:07: [mem 0xfed20000-0xfed3ffff] has been reserved [ 0.230415] system 00:07: [mem 0xfed90000-0xfed93fff] has been reserved [ 0.230416] system 00:07: [mem 0xfed45000-0xfed8ffff] has been reserved [ 0.230417] system 00:07: [mem 0xff000000-0xffffffff] has been reserved [ 0.230418] system 00:07: [mem 0xfee00000-0xfeefffff] could not be reserved [ 0.230419] system 00:07: [mem 0xe0000000-0xe0000fff] has been reserved [ 0.230422] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active) [ 0.230554] pnp: PnP ACPI: found 8 devices [ 0.235973] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.235983] pci 0000:08:01.0: bridge window [io 0x1000-0x0fff] to [bus 09] add_size 1000 [ 0.235984] pci 0000:08:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 09] add_size 200000 add_align 100000 [ 0.235985] pci 0000:08:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus 09] add_size 200000 add_align 100000 [ 0.235988] pci 0000:07:00.0: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 08-0c] add_size 200000 add_align 100000 [ 0.235989] pci 0000:00:1c.7: bridge window [mem 0x00100000-0x001fffff 64bit pref] to [bus 07-0c] add_size 200000 add_align 100000 [ 0.235998] pci 0000:00:1c.7: BAR 15: assigned [mem 0xe0100000-0xe03fffff 64bit pref] [ 0.235999] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.236001] pci 0000:00:01.0: bridge window [io 0xe000-0xefff] [ 0.236003] pci 0000:00:01.0: bridge window [mem 0xf6000000-0xf70fffff] [ 0.236005] pci 0000:00:01.0: bridge window [mem 0xe8000000-0xf1ffffff 64bit pref] [ 0.236007] pci 0000:00:01.1: PCI bridge to [bus 02] [ 0.236008] pci 0000:00:01.1: bridge window [mem 0xf7500000-0xf75fffff] [ 0.236011] pci 0000:00:1c.0: PCI bridge to [bus 03] [ 0.236028] pci 0000:00:1c.4: PCI bridge to [bus 04] [ 0.236029] pci 0000:00:1c.4: bridge window [io 0xd000-0xdfff] [ 0.236033] pci 0000:00:1c.4: bridge window [mem 0xf7400000-0xf74fffff] [ 0.236040] pci 0000:00:1c.5: PCI bridge to [bus 05] [ 0.236043] pci 0000:00:1c.5: bridge window [mem 0xf7300000-0xf73fffff] [ 0.236046] pci 0000:00:1c.5: bridge window [mem 0xf2100000-0xf21fffff 64bit pref] [ 0.236051] pci 0000:00:1c.6: PCI bridge to [bus 06] [ 0.236054] pci 0000:00:1c.6: bridge window [mem 0xf7200000-0xf72fffff] [ 0.236062] pci 0000:07:00.0: BAR 15: assigned [mem 0xe0100000-0xe03fffff 64bit pref] [ 0.236064] pci 0000:08:01.0: BAR 14: no space for [mem size 0x00200000] [ 0.236065] pci 0000:08:01.0: BAR 14: failed to assign [mem size 0x00200000] [ 0.236066] pci 0000:08:01.0: BAR 15: assigned [mem 0xe0100000-0xe02fffff 64bit pref] [ 0.236067] pci 0000:08:01.0: BAR 13: no space for [io size 0x1000] [ 0.236068] pci 0000:08:01.0: BAR 13: failed to assign [io size 0x1000] [ 0.236069] pci 0000:08:01.0: BAR 14: no space for [mem size 0x00200000] [ 0.236070] pci 0000:08:01.0: BAR 14: failed to assign [mem size 0x00200000] [ 0.236071] pci 0000:08:01.0: BAR 13: no space for [io size 0x1000] [ 0.236071] pci 0000:08:01.0: BAR 13: failed to assign [io size 0x1000] [ 0.236072] pci 0000:08:01.0: PCI bridge to [bus 09] [ 0.236083] pci 0000:08:01.0: bridge window [mem 0xe0100000-0xe02fffff 64bit pref] [ 0.236092] pci 0000:08:02.0: PCI bridge to [bus 0a] [ 0.236110] pci 0000:0b:00.0: PCI bridge to [bus 0c] [ 0.236114] pci 0000:0b:00.0: bridge window [io 0xc000-0xcfff] [ 0.236123] pci 0000:0b:00.0: bridge window [mem 0xf7100000-0xf71fffff] [ 0.236141] pci 0000:08:03.0: PCI bridge to [bus 0b-0c] [ 0.236144] pci 0000:08:03.0: bridge window [io 0xc000-0xcfff] [ 0.236150] pci 0000:08:03.0: bridge window [mem 0xf7100000-0xf71fffff] [ 0.236162] pci 0000:07:00.0: PCI bridge to [bus 08-0c] [ 0.236165] pci 0000:07:00.0: bridge window [io 0xc000-0xcfff] [ 0.236172] pci 0000:07:00.0: bridge window [mem 0xf7100000-0xf71fffff] [ 0.236176] pci 0000:07:00.0: bridge window [mem 0xe0100000-0xe03fffff 64bit pref] [ 0.236185] pci 0000:00:1c.7: PCI bridge to [bus 07-0c] [ 0.236186] pci 0000:00:1c.7: bridge window [io 0xc000-0xcfff] [ 0.236190] pci 0000:00:1c.7: bridge window [mem 0xf7100000-0xf71fffff] [ 0.236193] pci 0000:00:1c.7: bridge window [mem 0xe0100000-0xe03fffff 64bit pref] [ 0.236198] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.236199] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.236200] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.236201] pci_bus 0000:00: resource 7 [mem 0x000d0000-0x000d3fff window] [ 0.236201] pci_bus 0000:00: resource 8 [mem 0x000d4000-0x000d7fff window] [ 0.236202] pci_bus 0000:00: resource 9 [mem 0x000d8000-0x000dbfff window] [ 0.236203] pci_bus 0000:00: resource 10 [mem 0x000dc000-0x000dffff window] [ 0.236204] pci_bus 0000:00: resource 11 [mem 0xe0000000-0xfeafffff window] [ 0.236205] pci_bus 0000:01: resource 0 [io 0xe000-0xefff] [ 0.236206] pci_bus 0000:01: resource 1 [mem 0xf6000000-0xf70fffff] [ 0.236206] pci_bus 0000:01: resource 2 [mem 0xe8000000-0xf1ffffff 64bit pref] [ 0.236207] pci_bus 0000:02: resource 1 [mem 0xf7500000-0xf75fffff] [ 0.236208] pci_bus 0000:04: resource 0 [io 0xd000-0xdfff] [ 0.236209] pci_bus 0000:04: resource 1 [mem 0xf7400000-0xf74fffff] [ 0.236210] pci_bus 0000:05: resource 1 [mem 0xf7300000-0xf73fffff] [ 0.236211] pci_bus 0000:05: resource 2 [mem 0xf2100000-0xf21fffff 64bit pref] [ 0.236212] pci_bus 0000:06: resource 1 [mem 0xf7200000-0xf72fffff] [ 0.236212] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 0.236213] pci_bus 0000:07: resource 1 [mem 0xf7100000-0xf71fffff] [ 0.236214] pci_bus 0000:07: resource 2 [mem 0xe0100000-0xe03fffff 64bit pref] [ 0.236215] pci_bus 0000:08: resource 0 [io 0xc000-0xcfff] [ 0.236216] pci_bus 0000:08: resource 1 [mem 0xf7100000-0xf71fffff] [ 0.236216] pci_bus 0000:08: resource 2 [mem 0xe0100000-0xe03fffff 64bit pref] [ 0.236217] pci_bus 0000:09: resource 2 [mem 0xe0100000-0xe02fffff 64bit pref] [ 0.236218] pci_bus 0000:0b: resource 0 [io 0xc000-0xcfff] [ 0.236219] pci_bus 0000:0b: resource 1 [mem 0xf7100000-0xf71fffff] [ 0.236220] pci_bus 0000:0c: resource 0 [io 0xc000-0xcfff] [ 0.236221] pci_bus 0000:0c: resource 1 [mem 0xf7100000-0xf71fffff] [ 0.236221] pci_bus 0000:0c: resource 4 [io 0xc000-0xcfff] [ 0.236222] pci_bus 0000:0c: resource 5 [mem 0xf7100000-0xf71fffff] [ 0.236305] NET: Registered protocol family 2 [ 0.236466] IP idents hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.238110] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes) [ 0.238151] TCP established hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.238299] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 0.238408] TCP: Hash tables configured (established 131072 bind 65536) [ 0.238440] UDP hash table entries: 8192 (order: 6, 262144 bytes) [ 0.238474] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes) [ 0.238534] NET: Registered protocol family 1 [ 0.260907] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x6e0 took 21651 usecs [ 0.284903] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x6e0 took 23416 usecs [ 0.284919] pci 0000:01:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 0.284927] pci 0000:01:00.1: Linked as a consumer to 0000:01:00.0 [ 0.284928] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0 [ 0.284936] PCI: CLS mismatch (64 != 32), using 64 bytes [ 0.285104] pci 0000:0b:00.0: Disabling ASPM L0s/L1 [ 0.285140] Unpacking initramfs... [ 5.547287] Freeing initrd memory: 468772K [ 5.547314] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.547316] software IO TLB: mapped [mem 0xc93c6000-0xcd3c6000] (64MB) [ 5.547597] Scanning for low memory corruption every 60 seconds [ 5.548153] Initialise system trusted keyrings [ 5.548162] Key type blacklist registered [ 5.548184] workingset: timestamp_bits=36 max_order=22 bucket_order=0 [ 5.549094] zbud: loaded [ 5.549446] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 5.549579] fuse init (API version 7.27) [ 5.550390] Key type asymmetric registered [ 5.550391] Asymmetric key parser 'x509' registered [ 5.550397] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 5.550415] io scheduler noop registered [ 5.550416] io scheduler deadline registered [ 5.550435] io scheduler cfq registered (default) [ 5.552018] efifb: probing for efifb [ 5.552028] efifb: framebuffer at 0xf1000000, using 3072k, total 3072k [ 5.552029] efifb: mode is 1024x768x32, linelength=4096, pages=1 [ 5.552029] efifb: scrolling: redraw [ 5.552030] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0 [ 5.554246] Console: switching to colour frame buffer device 128x48 [ 5.556392] fb0: EFI VGA frame buffer device [ 5.556398] intel_idle: MWAIT substates: 0x1120 [ 5.556399] intel_idle: v0.4.1 model 0x3A [ 5.556591] intel_idle: lapic_timer_reliable_states 0xffffffff [ 5.556674] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 5.556682] ACPI: Power Button [PWRB] [ 5.556707] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 5.556716] ACPI: Power Button [PWRF] [ 5.557058] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 5.577532] 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 5.578647] Linux agpgart interface v0.103 [ 5.579960] loop: module loaded [ 5.580080] tun: Universal TUN/TAP device driver, 1.6 [ 5.580109] PPP generic driver version 2.4.2 [ 5.580132] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 5.580134] ehci-pci: EHCI PCI platform driver [ 5.580221] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 5.580225] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 5.580235] ehci-pci 0000:00:1a.0: debug port 2 [ 5.584150] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 5.584159] ehci-pci 0000:00:1a.0: irq 16, io mem 0xf7618000 [ 5.596812] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 5.596876] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.19 [ 5.596878] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.596878] usb usb1: Product: EHCI Host Controller [ 5.596879] usb usb1: Manufacturer: Linux 4.19.282 ehci_hcd [ 5.596880] usb usb1: SerialNumber: 0000:00:1a.0 [ 5.597040] hub 1-0:1.0: USB hub found [ 5.597046] hub 1-0:1.0: 2 ports detected [ 5.597236] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 5.597239] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 5.597248] ehci-pci 0000:00:1d.0: debug port 2 [ 5.601149] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 5.601157] ehci-pci 0000:00:1d.0: irq 23, io mem 0xf7617000 [ 5.616813] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 5.616874] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.19 [ 5.616875] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.616876] usb usb2: Product: EHCI Host Controller [ 5.616877] usb usb2: Manufacturer: Linux 4.19.282 ehci_hcd [ 5.616878] usb usb2: SerialNumber: 0000:00:1d.0 [ 5.617028] hub 2-0:1.0: USB hub found [ 5.617034] hub 2-0:1.0: 2 ports detected [ 5.617141] ehci-platform: EHCI generic platform driver [ 5.617147] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 5.617150] ohci-pci: OHCI PCI platform driver [ 5.617157] ohci-platform: OHCI generic platform driver [ 5.617162] uhci_hcd: USB Universal Host Controller Interface driver [ 5.617250] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.617253] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 5.618300] xhci_hcd 0000:00:14.0: hcc params 0x20007181 hci version 0x100 quirks 0x000000000000b930 [ 5.618304] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 5.618415] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.19 [ 5.618416] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.618417] usb usb3: Product: xHCI Host Controller [ 5.618418] usb usb3: Manufacturer: Linux 4.19.282 xhci-hcd [ 5.618418] usb usb3: SerialNumber: 0000:00:14.0 [ 5.618548] hub 3-0:1.0: USB hub found [ 5.618557] hub 3-0:1.0: 4 ports detected [ 5.618853] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 5.618855] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 5.618857] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 5.618881] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.19 [ 5.618882] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.618883] usb usb4: Product: xHCI Host Controller [ 5.618884] usb usb4: Manufacturer: Linux 4.19.282 xhci-hcd [ 5.618884] usb usb4: SerialNumber: 0000:00:14.0 [ 5.619034] hub 4-0:1.0: USB hub found [ 5.619043] hub 4-0:1.0: 4 ports detected [ 5.619393] xhci_hcd 0000:06:00.0: xHCI Host Controller [ 5.619397] xhci_hcd 0000:06:00.0: new USB bus registered, assigned bus number 5 [ 5.619470] xhci_hcd 0000:06:00.0: hcc params 0x040050af hci version 0x100 quirks 0x0000000000080490 [ 5.619628] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.19 [ 5.619629] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.619629] usb usb5: Product: xHCI Host Controller [ 5.619630] usb usb5: Manufacturer: Linux 4.19.282 xhci-hcd [ 5.619631] usb usb5: SerialNumber: 0000:06:00.0 [ 5.619733] hub 5-0:1.0: USB hub found [ 5.619741] hub 5-0:1.0: 2 ports detected [ 5.619829] xhci_hcd 0000:06:00.0: xHCI Host Controller [ 5.619831] xhci_hcd 0000:06:00.0: new USB bus registered, assigned bus number 6 [ 5.619832] xhci_hcd 0000:06:00.0: Host supports USB 3.0 SuperSpeed [ 5.619845] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM. [ 5.619857] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.19 [ 5.619858] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.619859] usb usb6: Product: xHCI Host Controller [ 5.619859] usb usb6: Manufacturer: Linux 4.19.282 xhci-hcd [ 5.619860] usb usb6: SerialNumber: 0000:06:00.0 [ 5.620006] hub 6-0:1.0: USB hub found [ 5.620015] hub 6-0:1.0: 2 ports detected [ 5.620116] i8042: PNP: No PS/2 controller found. [ 5.620233] mousedev: PS/2 mouse device common for all mice [ 5.620372] rtc_cmos 00:02: RTC can wake from S4 [ 5.620517] rtc_cmos 00:02: registered as rtc0 [ 5.620526] rtc_cmos 00:02: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 5.620531] i2c /dev entries driver [ 5.620565] device-mapper: uevent: version 1.0.3 [ 5.620601] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 5.620605] intel_pstate: Intel P-state driver initializing [ 5.621080] ledtrig-cpu: registered to indicate activity on CPUs [ 5.621081] EFI Variables Facility v0.08 2004-May-17 [ 5.626376] NET: Registered protocol family 10 [ 5.629434] Segment Routing with IPv6 [ 5.629451] NET: Registered protocol family 17 [ 5.629504] Key type dns_resolver registered [ 5.629955] mce: Using 9 MCE banks [ 5.629962] RAS: Correctable Errors collector initialized. [ 5.629981] microcode: sig=0x306a9, pf=0x2, revision=0x21 [ 5.630176] microcode: Microcode Update Driver: v2.2. [ 5.630202] sched_clock: Marking stable (5629982821, 187645)->(5639587380, -9416914) [ 5.630401] registered taskstats version 1 [ 5.630407] Loading compiled-in X.509 certificates [ 5.631060] Loaded X.509 cert 'Build time autogenerated kernel key: 287482907faaf26fe33adb5892d6cda33ebd9c9c' [ 5.631077] zswap: loaded using pool lzo/zbud [ 5.633689] Key type big_key registered [ 5.633692] Key type trusted registered [ 5.634869] Key type encrypted registered [ 5.634871] AppArmor: AppArmor sha1 policy hashing enabled [ 5.634880] ima: No TPM chip found, activating TPM-bypass! [ 5.634883] ima: Allocated hash algorithm: sha1 [ 5.634892] evm: Initialising EVM extended attributes: [ 5.634893] evm: security.selinux [ 5.634893] evm: security.SMACK64 [ 5.634893] evm: security.SMACK64EXEC [ 5.634894] evm: security.SMACK64TRANSMUTE [ 5.634894] evm: security.SMACK64MMAP [ 5.634894] evm: security.apparmor [ 5.634894] evm: security.ima [ 5.634895] evm: security.capability [ 5.634895] evm: HMAC attrs: 0x1 [ 5.635007] Magic number: 7:359:411 [ 5.635110] rtc_cmos 00:02: setting system clock to 2023-05-09 03:27:04 UTC (1683602824) [ 5.636674] Freeing unused decrypted memory: 2040K [ 5.637516] Freeing unused kernel image memory: 2484K [ 5.708813] Write protecting the kernel read-only data: 22528k [ 5.709332] Freeing unused kernel image memory: 2008K [ 5.709584] Freeing unused kernel image memory: 2036K [ 5.716739] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.716740] x86/mm: Checking user space page tables [ 5.723629] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.723630] Run /init as init process [ 5.794160] tg3.c:v3.137 (May 11, 2014) [ 5.794541] ahci 0000:00:1f.2: version 3.0 [ 5.799679] nvme nvme0: pci function 0000:02:00.0 [ 5.804828] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.804831] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.805747] tg3 0000:05:00.0 eth0: Tigon3 [partno(BCM57781) rev 57785100] (PCI Express) MAC address bc:5f:f4:4a:54:e0 [ 5.805750] tg3 0000:05:00.0 eth0: attached PHY is 57765 (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 5.805752] tg3 0000:05:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] TSOcap[1] [ 5.805754] tg3 0000:05:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit] [ 5.877452] scsi host0: ahci [ 5.877709] scsi host1: ahci [ 5.877896] scsi host2: ahci [ 5.877986] scsi host3: ahci [ 5.878041] scsi host4: ahci [ 5.878131] scsi host5: ahci [ 5.878170] ata1: SATA max UDMA/133 abar m2048@0xf7616000 port 0xf7616100 irq 30 [ 5.878172] ata2: SATA max UDMA/133 abar m2048@0xf7616000 port 0xf7616180 irq 30 [ 5.878173] ata3: SATA max UDMA/133 abar m2048@0xf7616000 port 0xf7616200 irq 30 [ 5.878174] ata4: SATA max UDMA/133 abar m2048@0xf7616000 port 0xf7616280 irq 30 [ 5.878175] ata5: SATA max UDMA/133 abar m2048@0xf7616000 port 0xf7616300 irq 30 [ 5.878177] ata6: SATA max UDMA/133 abar m2048@0xf7616000 port 0xf7616380 irq 30 [ 5.878364] ahci 0000:04:00.0: SSS flag set, parallel bus scan disabled [ 5.878402] ahci 0000:04:00.0: AHCI 0001.0200 32 slots 2 ports 6 Gbps 0x3 impl SATA mode [ 5.878404] ahci 0000:04:00.0: flags: 64bit ncq sntf stag led clo pmp pio slum part ccc sxs [ 5.878571] scsi host6: ahci [ 5.878622] scsi host7: ahci [ 5.878646] ata7: SATA max UDMA/133 abar m512@0xf7400000 port 0xf7400100 irq 32 [ 5.878648] ata8: SATA max UDMA/133 abar m512@0xf7400000 port 0xf7400180 irq 32 [ 5.904811] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 5.904830] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.937897] WARNING: CPU: 3 PID: 69 at drivers/pci/msi.c:1315 pci_irq_get_affinity+0x6b/0x90 [ 5.937899] Modules linked in: drm mxm_wmi firewire_core nvme nvme_core ahci tg3 crc_itu_t libahci video wmi [ 5.937906] CPU: 3 PID: 69 Comm: kworker/u16:1 Not tainted 4.19.282 #1 [ 5.937907] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z77 Extreme6, BIOS P2.80 07/01/2013 [ 5.937914] Workqueue: nvme-reset-wq nvme_reset_work [nvme] [ 5.937918] RIP: 0010:pci_irq_get_affinity+0x6b/0x90 [ 5.937920] Code: 31 c0 5d c3 83 e2 10 48 c7 c0 a0 1c 69 ad 74 f2 48 8b 97 a8 02 00 00 48 85 d2 74 0e 48 8b 42 30 48 85 c0 74 05 39 72 14 77 06 <0f> 0b 31 c0 5d c3 48 63 f6 48 c1 e6 0a 48 01 f0 5d c3 48 8b 40 30 [ 5.937921] RSP: 0018:ffffb9c6c1d2bcc0 EFLAGS: 00010246 [ 5.937923] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff98190e581c80 [ 5.937924] RDX: ffff9818b46c5a20 RSI: 0000000000000000 RDI: ffff981910239000 [ 5.937925] RBP: ffffb9c6c1d2bcc0 R08: ffff981912aec080 R09: ffff981912403980 [ 5.937926] R10: ffff98190e581c80 R11: 0000000000000040 R12: ffff9819106bc008 [ 5.937927] R13: ffff9819106bc008 R14: 0000000000000000 R15: ffff981910239000 [ 5.937929] FS: 0000000000000000(0000) GS:ffff981912ac0000(0000) knlGS:0000000000000000 [ 5.937930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 5.937931] CR2: 00007f94db2c65a8 CR3: 0000000011a0a003 CR4: 00000000001606e0 [ 5.937932] Call Trace: [ 5.937939] blk_mq_pci_map_queues+0x34/0xc0 [ 5.937944] nvme_pci_map_queues+0x2c/0x30 [nvme] [ 5.937947] blk_mq_update_queue_map+0x52/0x60 [ 5.937949] blk_mq_alloc_tag_set+0x101/0x250 [ 5.937953] nvme_reset_work+0x11b7/0x1967 [nvme] [ 5.937958] ? check_preempt_curr+0x81/0x90 [ 5.937961] ? ttwu_do_wakeup+0x1e/0x150 [ 5.937965] process_one_work+0x167/0x400 [ 5.937967] worker_thread+0x4d/0x460 [ 5.937980] kthread+0x105/0x140 [ 5.937980] ? rescuer_thread+0x370/0x370 [ 5.937981] ? kthread_bind+0x40/0x40 [ 5.937984] ret_from_fork+0x35/0x40 [ 5.937985] ---[ end trace efb0618fa8deeca1 ]--- [ 6.061394] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00 [ 6.061397] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.061455] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00 [ 6.061458] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.061645] hub 2-1:1.0: USB hub found [ 6.061669] hub 1-1:1.0: USB hub found [ 6.061736] hub 2-1:1.0: 8 ports detected [ 6.061742] hub 1-1:1.0: 6 ports detected [ 6.191249] ata4: SATA link down (SStatus 0 SControl 300) [ 6.191270] ata3: SATA link down (SStatus 0 SControl 300) [ 6.191380] ata1: SATA link down (SStatus 0 SControl 300) [ 6.191413] ata2: SATA link down (SStatus 0 SControl 300) [ 6.191428] ata6: SATA link down (SStatus 0 SControl 300) [ 6.191452] ata5: SATA link down (SStatus 0 SControl 300) [ 6.348810] usb 2-1.5: new low-speed USB device number 3 using ehci-pci [ 6.352823] ata7: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.356625] ata7.00: ATA-9: WDC WD80EFZX-68UW8N0, 83.H0A83, max UDMA/133 [ 6.356626] ata7.00: 15628053168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.362796] ata7.00: configured for UDMA/133 [ 6.463128] usb 2-1.5: New USB device found, idVendor=046d, idProduct=c31c, bcdDevice=64.00 [ 6.463131] usb 2-1.5: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 6.463132] usb 2-1.5: Product: USB Keyboard [ 6.463134] usb 2-1.5: Manufacturer: Logitech [ 6.474453] hidraw: raw HID events driver (C) Jiri Kosina [ 6.544810] usb 2-1.6: new low-speed USB device number 4 using ehci-pci [ 6.556811] tsc: Refined TSC clocksource calibration: 3300.022 MHz [ 6.556821] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2f91614f8ec, max_idle_ns: 440795344305 ns [ 6.556927] clocksource: Switched to clocksource tsc [ 6.658244] usb 2-1.6: New USB device found, idVendor=17ef, idProduct=608d, bcdDevice= 1.00 [ 6.658245] usb 2-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 6.658245] usb 2-1.6: Product: Lenovo USB Optical Mouse [ 6.658246] usb 2-1.6: Manufacturer: PixArt [ 6.673085] usbcore: registered new interface driver usbhid [ 6.673085] usbhid: USB HID core driver [ 37.980825] nvme nvme0: I/O 30 QID 1 timeout, completion polled [ 66.786105] usb 2-1.6: USB disconnect, device number 4 [ 68.288809] usb 2-1.6: new low-speed USB device number 5 using ehci-pci [ 68.401221] usb 2-1.6: New USB device found, idVendor=17ef, idProduct=608d, bcdDevice= 1.00 [ 68.401224] usb 2-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 68.401225] usb 2-1.6: Product: Lenovo USB Optical Mouse [ 68.401227] usb 2-1.6: Manufacturer: PixArt [ 68.700820] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 99.420820] nvme nvme0: I/O 30 QID 1 timeout, completion polled [ 101.707470] scsi 6:0:0:0: Direct-Access ATA WDC WD80EFZX-68U 0A83 PQ: 0 ANSI: 5 [ 101.707714] sd 6:0:0:0: Attached scsi generic sg0 type 0 [ 101.707849] sd 6:0:0:0: [sda] 15628053168 512-byte logical blocks: (8.00 TB/7.28 TiB) [ 101.707850] sd 6:0:0:0: [sda] 4096-byte physical blocks [ 101.707872] sd 6:0:0:0: [sda] Write Protect is off [ 101.707873] sd 6:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 101.707923] sd 6:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 101.756319] sda: sda1 sda2 sda3 [ 101.756686] sd 6:0:0:0: [sda] Attached SCSI disk [ 102.023245] ata8: SATA link down (SStatus 0 SControl 300) [ 102.025294] tg3 0000:05:00.0 enp5s0: renamed from eth0 [ 102.026181] input: Logitech USB Keyboard as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.5/2-1.5:1.0/0003:046D:C31C.0001/input/input2 [ 102.085113] hid-generic 0003:046D:C31C.0001: input,hidraw0: USB HID v1.10 Keyboard [Logitech USB Keyboard] on usb-0000:00:1d.0-1.5/input0 [ 102.085338] input: Logitech USB Keyboard Consumer Control as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.5/2-1.5:1.1/0003:046D:C31C.0002/input/input3 [ 102.096889] firewire_ohci 0000:0c:02.0: added OHCI v1.10 device as card 0, 4 IR + 8 IT contexts, quirks 0x11 [ 102.144964] input: Logitech USB Keyboard System Control as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.5/2-1.5:1.1/0003:046D:C31C.0002/input/input4 [ 102.145156] hid-generic 0003:046D:C31C.0002: input,hidraw1: USB HID v1.10 Device [Logitech USB Keyboard] on usb-0000:00:1d.0-1.5/input1 [ 102.145272] input: PixArt Lenovo USB Optical Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.6/2-1.6:1.0/0003:17EF:608D.0004/input/input5 [ 102.145494] hid-generic 0003:17EF:608D.0004: input,hidraw2: USB HID v1.11 Mouse [PixArt Lenovo USB Optical Mouse] on usb-0000:00:1d.0-1.6/input0 [ 102.620908] firewire_core 0000:0c:02.0: created device fw0: GUID 008f13002ca81200, S400 [ 102.658316] MXM: GUID detected in BIOS [ 102.658465] checking generic (f1000000 300000) vs hw (e8000000 8000000) [ 102.658466] checking generic (f1000000 300000) vs hw (f0000000 2000000) [ 102.658466] fb: switching to nouveaufb from EFI VGA [ 102.658483] Console: switching to colour dummy device 80x25 [ 102.658596] nouveau 0000:01:00.0: NVIDIA GF108 (0c1000a1) [ 102.786358] nouveau 0000:01:00.0: bios: version 70.08.ae.00.00 [ 102.787484] nouveau 0000:01:00.0: fb: 1024 MiB DDR3 [ 104.097128] [TTM] Zone kernel: Available graphics memory: 6116412 kiB [ 104.097128] [TTM] Zone dma32: Available graphics memory: 2097152 kiB [ 104.097129] [TTM] Initializing pool allocator [ 104.097131] [TTM] Initializing DMA pool allocator [ 104.097140] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB [ 104.097140] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB [ 104.097142] nouveau 0000:01:00.0: DRM: TMDS table version 2.0 [ 104.097143] nouveau 0000:01:00.0: DRM: DCB version 4.0 [ 104.097144] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000302 00020030 [ 104.097145] nouveau 0000:01:00.0: DRM: DCB outp 01: 02000300 00000000 [ 104.097146] nouveau 0000:01:00.0: DRM: DCB outp 02: 08011392 00020020 [ 104.097146] nouveau 0000:01:00.0: DRM: DCB outp 03: 04022310 00000000 [ 104.097147] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001030 [ 104.097148] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161 [ 104.097148] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200 [ 104.113671] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013). [ 104.113672] [drm] Driver supports precise vblank timestamp query. [ 104.114443] nouveau 0000:01:00.0: DRM: MM: using COPY0 for buffer copies [ 104.182860] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb: 0x60000, bo 0000000056f600f8 [ 104.182927] fbcon: nouveaufb (fb0) is primary device [ 104.229980] Console: switching to colour frame buffer device 240x67 [ 104.231964] nouveau 0000:01:00.0: fb0: nouveaufb frame buffer device [ 104.244825] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0 [ 126.185380] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null) [ 132.188827] nvme nvme0: I/O 30 QID 1 timeout, completion polled [ 157.617348] systemd[1]: systemd 229 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN) [ 157.637047] systemd[1]: Detected architecture x86-64. [ 157.637632] systemd[1]: Set hostname to . [ 158.558821] systemd[1]: Listening on Journal Socket (/dev/log). [ 158.558982] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 158.558992] systemd[1]: Reached target Encrypted Volumes. [ 158.559036] systemd[1]: Listening on Journal Audit Socket. [ 158.559054] systemd[1]: Listening on fsck to fsckd communication Socket. [ 158.559071] systemd[1]: Listening on Syslog Socket. [ 158.559104] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 159.006841] EXT4-fs (sda2): re-mounted. Opts: errors=remount-ro [ 159.515131] lp: driver loaded but no devices found [ 159.572238] ppdev: user-space parallel port driver [ 159.832176] systemd-journald[313]: Received request to flush runtime journal from PID 1 [ 160.980982] EDAC ie31200: No ECC support [ 160.981007] EDAC ie31200: No ECC support [ 161.025108] ACPI Warning: SystemIO range 0x0000000000000428-0x000000000000042F conflicts with OpRegion 0x0000000000000400-0x000000000000047F (\PMIO) (20180810/utaddress-213) [ 161.025112] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 161.025114] ACPI Warning: SystemIO range 0x0000000000000540-0x000000000000054F conflicts with OpRegion 0x0000000000000500-0x000000000000057F (\GPR2) (20180810/utaddress-213) [ 161.025116] ACPI Warning: SystemIO range 0x0000000000000540-0x000000000000054F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20180810/utaddress-213) [ 161.025118] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 161.025118] ACPI Warning: SystemIO range 0x0000000000000530-0x000000000000053F conflicts with OpRegion 0x0000000000000500-0x000000000000057F (\GPR2) (20180810/utaddress-213) [ 161.025120] ACPI Warning: SystemIO range 0x0000000000000530-0x000000000000053F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20180810/utaddress-213) [ 161.025122] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 161.025122] ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000052F conflicts with OpRegion 0x0000000000000500-0x000000000000057F (\GPR2) (20180810/utaddress-213) [ 161.025124] ACPI Warning: SystemIO range 0x0000000000000500-0x000000000000052F conflicts with OpRegion 0x0000000000000500-0x0000000000000563 (\GPIO) (20180810/utaddress-213) [ 161.025125] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 161.025126] lpc_ich: Resource conflict(s) found affecting gpio_ich [ 161.528473] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer [ 161.528475] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules [ 161.528475] RAPL PMU: hw unit of domain package 2^-16 Joules [ 161.528476] RAPL PMU: hw unit of domain pp1-gpu 2^-16 Joules [ 162.375115] cryptd: max_cpu_qlen set to 1000 [ 162.826618] AVX version of gcm_enc/dec engaged. [ 162.826619] AES CTR mode by8 optimization enabled [ 162.908828] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 164.340847] snd_hda_intel 0000:00:1b.0: enabling device (0000 -> 0002) [ 164.341079] snd_hda_intel 0000:01:00.1: enabling device (0000 -> 0002) [ 164.341114] snd_hda_intel 0000:01:00.1: Disabling MSI [ 164.341118] snd_hda_intel 0000:01:00.1: Handle vga_switcheroo audio client [ 164.395617] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC898: line_outs=3 (0x14/0x15/0x16/0x0/0x0) type:line [ 164.395618] snd_hda_codec_realtek hdaudioC0D0: speaker_outs=0 (0x0/0x0/0x0/0x0/0x0) [ 164.395619] snd_hda_codec_realtek hdaudioC0D0: hp_outs=1 (0x1b/0x0/0x0/0x0/0x0) [ 164.395620] snd_hda_codec_realtek hdaudioC0D0: mono: mono_out=0x0 [ 164.395621] snd_hda_codec_realtek hdaudioC0D0: dig-out=0x1e/0x0 [ 164.395621] snd_hda_codec_realtek hdaudioC0D0: inputs: [ 164.395623] snd_hda_codec_realtek hdaudioC0D0: Front Mic=0x19 [ 164.395623] snd_hda_codec_realtek hdaudioC0D0: Rear Mic=0x18 [ 164.395624] snd_hda_codec_realtek hdaudioC0D0: Line=0x1a [ 164.407840] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input6 [ 164.407884] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input7 [ 164.407921] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1b.0/sound/card0/input8 [ 164.407962] input: HDA Intel PCH Line Out Front as /devices/pci0000:00/0000:00:1b.0/sound/card0/input9 [ 164.408002] input: HDA Intel PCH Line Out Surround as /devices/pci0000:00/0000:00:1b.0/sound/card0/input10 [ 164.408039] input: HDA Intel PCH Line Out CLFE as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11 [ 164.408076] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input12 [ 165.452239] intel_rapl: Found RAPL domain package [ 165.452240] intel_rapl: Found RAPL domain core [ 165.661166] input: HDA NVidia HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:01.0/0000:01:00.1/sound/card1/input13 [ 165.661206] input: HDA NVidia HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:01.0/0000:01:00.1/sound/card1/input14 [ 165.661241] input: HDA NVidia HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:01.0/0000:01:00.1/sound/card1/input15 [ 165.661273] input: HDA NVidia HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:01.0/0000:01:00.1/sound/card1/input16 [ 167.786923] Adding 1000444k swap on /dev/sda3. Priority:-2 extents:1 across:1000444k FS [ 172.473454] audit: type=1400 audit(1683602991.333:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=716 comm="apparmor_parser" [ 172.473466] audit: type=1400 audit(1683602991.333:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=716 comm="apparmor_parser" [ 172.473468] audit: type=1400 audit(1683602991.333:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=716 comm="apparmor_parser" [ 172.473470] audit: type=1400 audit(1683602991.333:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=716 comm="apparmor_parser" [ 172.473995] audit: type=1400 audit(1683602991.333:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="webbrowser-app" pid=719 comm="apparmor_parser" [ 172.474006] audit: type=1400 audit(1683602991.333:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="webbrowser-app//oxide_helper" pid=719 comm="apparmor_parser" [ 172.482084] audit: type=1400 audit(1683602991.341:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=720 comm="apparmor_parser" [ 172.482096] audit: type=1400 audit(1683602991.341:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=720 comm="apparmor_parser" [ 172.663987] audit: type=1400 audit(1683602991.521:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/ippusbxd" pid=723 comm="apparmor_parser" [ 172.685433] audit: type=1400 audit(1683602991.545:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/evince" pid=717 comm="apparmor_parser" [ 177.833980] IPv6: ADDRCONF(NETDEV_UP): enp5s0: link is not ready [ 177.988795] IPv6: ADDRCONF(NETDEV_UP): enp5s0: link is not ready [ 181.023039] tg3 0000:05:00.0 enp5s0: Link is up at 1000 Mbps, full duplex [ 181.023055] tg3 0000:05:00.0 enp5s0: Flow control is on for TX and on for RX [ 181.023057] tg3 0000:05:00.0 enp5s0: EEE is disabled [ 181.023085] IPv6: ADDRCONF(NETDEV_CHANGE): enp5s0: link becomes ready [ 187.298673] kauditd_printk_skb: 11 callbacks suppressed [ 187.298674] audit: type=1400 audit(1683603006.157:23): apparmor="STATUS" operation="profile_load" profile="unconfined" name="docker-default" pid=1364 comm="apparmor_parser" [ 187.750008] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. [ 187.778746] Bridge firewalling registered [ 188.247962] Initializing XFRM netlink socket [ 188.464533] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready [ 193.628831] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 224.018531] nvme nvme0: I/O 233 QID 1 timeout, completion polled [ 254.713182] nvme nvme0: I/O 243 QID 1 timeout, completion polled [ 285.426174] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 316.146498] nvme nvme0: I/O 233 QID 1 timeout, completion polled [ 346.866721] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 377.585171] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 408.302926] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 439.022885] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 469.744577] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 500.464886] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 531.184328] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 561.903255] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 592.621817] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 623.340195] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 654.058447] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 684.776898] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 715.498720] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 746.219849] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 776.940414] nvme nvme0: I/O 151 QID 1 timeout, completion polled [ 776.940421] nvme nvme0: I/O 152 QID 1 timeout, completion polled [ 776.940424] nvme nvme0: I/O 153 QID 1 timeout, completion polled [ 776.940431] nvme nvme0: I/O 154 QID 1 timeout, completion polled [ 807.660564] nvme nvme0: I/O 251 QID 1 timeout, completion polled [ 838.380341] nvme nvme0: I/O 154 QID 1 timeout, completion polled [ 838.380346] nvme nvme0: I/O 155 QID 1 timeout, completion polled [ 838.380351] nvme nvme0: I/O 156 QID 1 timeout, completion polled [ 838.380358] nvme nvme0: I/O 158 QID 1 timeout, completion polled [ 838.380361] nvme nvme0: I/O 161 QID 1 timeout, completion polled [ 869.099865] nvme nvme0: I/O 0 QID 1 timeout, completion polled [ 869.099871] nvme nvme0: I/O 1 QID 1 timeout, completion polled [ 869.099875] nvme nvme0: I/O 252 QID 1 timeout, completion polled [ 899.819149] nvme nvme0: I/O 161 QID 1 timeout, completion polled [ 1867.688649] tg3 0000:05:00.0 enp5s0: Link is down [ 1870.455451] tg3 0000:05:00.0 enp5s0: Link is up at 1000 Mbps, full duplex [ 1870.455466] tg3 0000:05:00.0 enp5s0: Flow control is on for TX and on for RX [ 1870.455470] tg3 0000:05:00.0 enp5s0: EEE is disabled [12573.432204] nvme nvme0: I/O 10 QID 1 timeout, completion polled [12573.432215] nvme nvme0: I/O 30 QID 1 timeout, completion polled [12573.432231] nvme nvme0: I/O 31 QID 1 timeout, completion polled [12573.432242] nvme nvme0: I/O 252 QID 1 timeout, completion polled `

CRZ-Technology commented 1 year ago

[12573.432242] nvme nvme0: I/O 252 QID 1 timeout, completion polled

From the log, NVMe IRQ was not properly processed. Instead 30s timeout happened.

Here is the log in success case:

user@ubuntu:~$ uname -r 6.1.11-060111-generic

user@ubuntu:~$ sudo fio -filename=/dev/nvme0n1 -direct=1 -iodepth 256 -thread -rw=read -ioengine=psync -bs=32k -size=10G -numjobs=8 -runtime=20 -group_reporting -name=sqe_read_32k sqe_read_32k: (g=0): rw=read, bs=(R) 32.0KiB-32.0KiB, (W) 32.0KiB-32.0KiB, (T) 32.0KiB-32.0KiB, ioengine=psync, iodepth=256 ... fio-3.30 Starting 8 threads Jobs: 8 (f=8): [R(8)][100.0%][r=1908MiB/s][r=61.1k IOPS][eta 00m:00s] sqe_read_32k: (groupid=0, jobs=8): err= 0: pid=2386: Wed May 10 10:37:34 2023 read: IOPS=39.3k, BW=1227MiB/s (1287MB/s)(24.0GiB/20001msec) clat (usec): min=29, max=1407, avg=201.36, stdev=135.25 lat (usec): min=29, max=1408, avg=201.62, stdev=135.44 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 127], 10.00th=[ 129], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 131], | 70.00th=[ 133], 80.00th=[ 396], 90.00th=[ 420], 95.00th=[ 461], | 99.00th=[ 529], 99.50th=[ 562], 99.90th=[ 1172], 99.95th=[ 1205], | 99.99th=[ 1270] bw ( MiB/s): min= 392, max= 1919, per=98.72%, avg=1211.18, stdev=82.77, samples=312 iops : min=12557, max=61410, avg=38757.72, stdev=2648.76, samples=312 lat (usec) : 50=0.01%, 100=0.90%, 250=75.44%, 500=21.90%, 750=1.53% lat (usec) : 1000=0.01% lat (msec) : 2=0.23% cpu : usr=2.98%, sys=7.97%, ctx=785317, majf=0, minf=64 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=785283,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=256

Run status group 0 (all jobs): READ: bw=1227MiB/s (1287MB/s), 1227MiB/s-1227MiB/s (1287MB/s-1287MB/s), io=24.0GiB (25.7GB), run=20001-20001msec

Disk stats (read/write): nvme0n1: ios=778468/0, merge=0/0, ticks=143155/0, in_queue=143154, util=99.67%

Would you try with the latest kernel 6.x.xx?

GaryLee1101 commented 1 year ago

I reinstalled Ubuntu 22.04 on my server, and download and compile kernel 6.3.1 on it. However, the origin kernel of Ubuntu(5.19) or the 6.3.1 kernel can not get a normal bandwidth: `gary@gary-desktop:~$ sudo fio -filename=/dev/nvme0n1 -direct=1 -iodepth 256 -thread -rw=read -ioengine=psync -bs=32k -size=100G -numjobs=8 -runtime=60 -group_reporting -name=sqe_100read_4k [sudo] password for gary: sqe_100read_4k: (g=0): rw=read, bs=(R) 32.0KiB-32.0KiB, (W) 32.0KiB-32.0KiB, (T) 32.0KiB-32.0KiB, ioengine=psync, iodepth=256 ... fio-3.28 Starting 8 threads Jobs: 8 (f=8): [R(8)][0.0%][eta 2351d:09h:45m:38s]
sqe_100read_4k: (groupid=0, jobs=8): err= 0: pid=1618: Wed May 10 16:55:12 2023 read: IOPS=0, BW=8431B/s (8431B/s)(512KiB/62185msec) clat (msec): min=30719, max=31463, avg=31091.35, stdev=383.90 lat (msec): min=30719, max=31463, avg=31091.35, stdev=383.90 clat percentiles (msec): | 1.00th=[17113], 5.00th=[17113], 10.00th=[17113], 20.00th=[17113], | 30.00th=[17113], 40.00th=[17113], 50.00th=[17113], 60.00th=[17113], | 70.00th=[17113], 80.00th=[17113], 90.00th=[17113], 95.00th=[17113], | 99.00th=[17113], 99.50th=[17113], 99.90th=[17113], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 512, max= 512, per=100.00%, avg=512.00, stdev= 0.00, samples=8 iops : min= 16, max= 16, avg=16.00, stdev= 0.00, samples=8 lat (msec) : >=2000=100.00% cpu : usr=0.00%, sys=0.00%, ctx=38, majf=0, minf=64 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=16,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=256

Run status group 0 (all jobs): READ: bw=8431B/s (8431B/s), 8431B/s-8431B/s (8431B/s-8431B/s), io=512KiB (524kB), run=62185-62185msec

Disk stats (read/write): nvme0n1: ios=8/0, merge=0/0, ticks=251705/0, in_queue=251705, util=99.91% gary@gary-desktop:~$ uname -r 6.3.1 `

CRZ-Technology commented 1 year ago

Could you please check the followings?

Print 'sudo lspci -vvv -d *:903f' with kernel 6.3.1 on Daisy+.
Cosmos+ is working good with kernel 6.3.1? Print 'sudo lspci -vvv -d *:7028' with kernel 6.3.1 on Cosmos+.
Daisy+ is working good on Windows?

Thanks a lot for your cooperation.

GaryLee1101 commented 1 year ago

Of course, I'm glad to work with you on this issue. *Here is the output of 'lspci -vvv -d :903f' with kernel 6.3.1 on Daisy+:* gary@gary-desktop:\~$ uname -r 6.3.1 gary@gary-desktop:\~$ sudo lspci -vvv -d :903f [sudo] password for gary: 02:00.0 Non-Volatile memory controller: Xilinx Corporation Device 903f (prog-if 02 [NVM Express]) Subsystem: Xilinx Corporation Device 0007 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- SERR- <PERR- INTx- Latency: 0, Cache Line Size: 64 bytes Interrupt: pin A routed to IRQ 32 NUMA node: 0 Region 0: Memory at f7500000 (32-bit, non-prefetchable) [size=8K] Capabilities: [40] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME- Capabilities: [48] MSI: Enable+ Count=1/8 Maskable- 64bit+ Address: 00000000fee08004 Data: 0022 Capabilities: [70] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 1024 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 75.000W DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+ RlxdOrd- ExtTag+ PhantFunc- AuxPwr- NoSnoop+ MaxPayload 128 bytes, MaxReadReq 512 bytes DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend- LnkCap: Port #0, Speed 8GT/s, Width x16, ASPM not supported ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+ LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 8GT/s (ok), Width x8 (downgraded) TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range BC, TimeoutDis+ NROPrPrP- LTR- 10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit- FRS- TPHComp- ExtTPHComp- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled, AtomicOpsCtl: ReqEn- LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS- LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis- Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+ EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest- Retimer- 2Retimers- CrosslinkRes: unsupported Capabilities: [100 v1] Advanced Error Reporting UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr- CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+ AERCap: First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap- ECRCChkEn- MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- HeaderLog: 00000000 00000000 00000000 00000000 Capabilities: [1c0 v1] Secondary PCI Express LnkCtl3: LnkEquIntrruptEn- PerformEqu- LaneErrStat: 0 Kernel driver in use: nvme Kernel modules: nvme

*Here is the output of 'lspci -vvv -d :7028' with kernel 6.3.1 on Cosmos+:** Run status group 0 (all jobs): READ: bw=1873MiB/s (1964MB/s), 1873MiB/s-1873MiB/s (1964MB/s-1964MB/s), io=9.78GiB (10.5GB), run=5345-5345msec

Disk stats (read/write): nvme0n1: ios=308294/0, merge=239/0, ticks=38757/0, in_queue=38757, util=98.11% gary@gary-desktop:\~$ uname -r 6.3.1 gary@gary-desktop:\~$ sudo lspci -vvv -d *:7028 02:00.0 Non-Volatile memory controller: Xilinx Corporation Device 7028 (prog-if 02 [NVM Express]) Subsystem: Xilinx Corporation Device 0007 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- SERR- <PERR- INTx- Latency: 0, Cache Line Size: 64 bytes Interrupt: pin A routed to IRQ 32 NUMA node: 0 Region 0: Memory at f7500000 (32-bit, non-prefetchable) [size=8K] Capabilities: [40] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME- Capabilities: [48] MSI: Enable+ Count=1/8 Maskable- 64bit+ Address: 00000000fee02004 Data: 0023 Capabilities: [60] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 unlimited ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 75.000W DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq- RlxdOrd- ExtTag+ PhantFunc- AuxPwr- NoSnoop+ MaxPayload 128 bytes, MaxReadReq 512 bytes DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend- LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp- LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 5GT/s (ok), Width x8 (ok) TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range B, TimeoutDis- NROPrPrP- LTR- 10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit- FRS- TPHComp- ExtTPHComp- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled, AtomicOpsCtl: ReqEn- LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis- Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1- EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest- Retimer- 2Retimers- CrosslinkRes: unsupported Kernel driver in use: nvme Kernel modules: nvme

Windows is not easy to install on this host because I have no extra disk, if the result of start-up in Windows is very helpful I could try my best to test it. By the way, I noticed some issues may be related to the issue.

Cosmos+ could work fine in all kernels I have tested on this host.
When I start up the host with Daisy+, the host startup time will become much longer than normal. And the test result of fio is very low(about thousands of Byte).
However, if I start up the host in Kernel 4.4.4 with Daisy+, the startup time of the host is normal. And the test result of fio will be much higher than other kernels and could reach about hundreds of KB.

CRZ-Technology commented 1 year ago

Thank you for sharing your observations.

I installed linux kernel 4.4.40 and observed the same problem, very low bandwith on Daisy+. Cosmos+ is good with 4.4.40. I'll investigate the cause of low bandwith on Daisy+ with kernel 4.4.40 and keep you informed.

GaryLee1101 commented 1 year ago

Thank you for sharing your observations.

I installed linux kernel 4.4.40 and observed the same problem, very low bandwith on Daisy+. Cosmos+ is good with 4.4.40. I'll investigate the cause of low bandwith on Daisy+ with kernel 4.4.40 and keep you informed.

Great, looking forward to your notification

CRZ-Technology commented 1 year ago

Dear Gary,

We can fix very critical bug thanks to your contribution. The problem was caused by wrong CQ IRQ vector number. Fixed file is attached.

https://github.com/CRZ-Technology/OpenSSD-OpenChannelSSD/blob/main/DaisyPlus/OpenSSD/Hynix_NAND/daisyplus_openssd_hynix_4c8w_lpddr4/cosm-plus-sys/cosm-plus-sys.ipdefs/ip-repo_0_0_0/nvme_ctrl/src/nvme_irq_handler.v

Best Regards, nvme_irq_handler.zip

GaryLee1101 commented 1 year ago

I'm glad to hear that you fixed this issue!

Besides, I see the bug is fixed by updating nvme controller. I'm not familiar with Vivado and RTL design(I tried to synthesis and implementation the vivado project "DaisyPlus\OpenSSD\Toshiba_NAND\daisyplus_openssd_toshiba_4c8w_lpddr4\cosm-plus-sys" but failed). So could you update the hdf file of each OpenSSD firmware of Daisy+?

Thanks.

CRZ-Technology commented 1 year ago

Dear Gary,

I've uploaded HDF and bitstream for Hynix/Toshiba design.

Best Regards,

GaryLee1101 commented 1 year ago

It works! I can reach about 1.8GB/s on my host with any kernel. Thanks for your efforts.

CRZ-Technology / OpenSSD-OpenChannelSSD

Why the bandwidth is very low in OpenSSD mode? #2