search

okx / exchain

⛓️ EVM & Wasm $ IBC-compatible, OKTC is a L1 blockchain network built on top of Cosmos SDK that aims for optimal interoperability and performance ✨
https://www.okx.com/oktc
Other
575 stars 182 forks source link

The node service is running normally, but the RPC cannot be accessed, and an error is reported #3220

Open danny-adu opened 1 year ago

danny-adu commented 1 year ago

E[2023-07-20|03:58:00.139][2031] Failed to read request. module=rpc-server protocol=websocket remote=157.245.40.246:56390 err="websocket: close 1006 (abnormal closure): unexpected EOF"

danny-adu commented 1 year ago

It was available before, but it suddenly became unavailable, I don’t know what’s going on?

EXCHAIN V1.7.0

giskook commented 1 year ago

@danny-dudu OKTC mainnet？ Could you paste more logs？

giskook commented 1 year ago

@danny-dudu Please help run dmesg -T | grep exchaind, and the output will show weather or not the node kill by system（OOM).

danny-adu commented 1 year ago

I am running under screen, because I need to switch back and forth between the running of the monitoring node service, does it have something to do with this?

danny-adu commented 1 year ago

OKTC mainnet

OKTC mainnet

danny-adu commented 1 year ago

dmesg -T | grep exchaind I am running cmd <dmesg -T | grep exchaind> , but nothing is displayed

danny-adu commented 1 year ago

i am running cmd <dmesg -T>, msg is as follows

[Thu Jul 6 06:34:52 2023] KERNEL supported cpus: [Thu Jul 6 06:34:52 2023] Intel GenuineIntel [Thu Jul 6 06:34:52 2023] AMD AuthenticAMD [Thu Jul 6 06:34:52 2023] Hygon HygonGenuine [Thu Jul 6 06:34:52 2023] Centaur CentaurHauls [Thu Jul 6 06:34:52 2023] zhaoxin Shanghai
[Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' [Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' [Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' [Thu Jul 6 06:34:52 2023] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'

[Thu Jul 6 06:34:52 2023] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. [Thu Jul 6 06:34:52 2023] signal: max sigframe size: 3632 [Thu Jul 6 06:34:52 2023] BIOS-provided physical RAM map: [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x0000000000100000-0x00000000bffe8fff] usable [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x00000000bffe9000-0x00000000bfffffff] reserved [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x00000000e0000000-0x00000000e03fffff] reserved [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x0000000100000000-0x0000000ffeffffff] usable [Thu Jul 6 06:34:52 2023] BIOS-e820: [mem 0x0000000fff000000-0x000000103fffffff] reserved [Thu Jul 6 06:34:52 2023] NX (Execute Disable) protection: active [Thu Jul 6 06:34:52 2023] SMBIOS 2.7 present. [Thu Jul 6 06:34:52 2023] DMI: Amazon EC2 m6i.4xlarge/, BIOS 1.0 10/16/2017 [Thu Jul 6 06:34:52 2023] Hypervisor detected: KVM [Thu Jul 6 06:34:52 2023] kvm-clock: Using msrs 4b564d01 and 4b564d00 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 0, msr d87201001, primary cpu clock [Thu Jul 6 06:34:52 2023] kvm-clock: using sched offset of 11534497184 cycles [Thu Jul 6 06:34:52 2023] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [Thu Jul 6 06:34:52 2023] tsc: Detected 2899.988 MHz processor [Thu Jul 6 06:34:52 2023] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [Thu Jul 6 06:34:52 2023] e820: remove [mem 0x000a0000-0x000fffff] usable [Thu Jul 6 06:34:52 2023] last_pfn = 0xfff000 max_arch_pfn = 0x400000000 [Thu Jul 6 06:34:52 2023] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[Thu Jul 6 06:34:52 2023] last_pfn = 0xbffe9 max_arch_pfn = 0x400000000 [Thu Jul 6 06:34:52 2023] Using GB pages for direct mapping [Thu Jul 6 06:34:52 2023] RAMDISK: [mem 0x372b3000-0x37950fff] [Thu Jul 6 06:34:52 2023] ACPI: Early table checksum verification disabled [Thu Jul 6 06:34:52 2023] ACPI: RSDP 0x00000000000F8F00 000014 (v00 AMAZON) [Thu Jul 6 06:34:52 2023] ACPI: RSDT 0x00000000BFFEDBC0 000044 (v01 AMAZON AMZNRSDT 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: WAET 0x00000000BFFEFFC0 000028 (v01 AMAZON AMZNWAET 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: SLIT 0x00000000BFFEFF40 00006C (v01 AMAZON AMZNSLIT 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: APIC 0x00000000BFFEFE40 0000E6 (v01 AMAZON AMZNAPIC 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: SRAT 0x00000000BFFEFCC0 000180 (v01 AMAZON AMZNSRAT 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: FACP 0x00000000BFFEFB80 000114 (v01 AMAZON AMZNFACP 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: DSDT 0x00000000BFFEE9C0 00115A (v01 AMAZON AMZNDSDT 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: FACS 0x00000000000F8EC0 000040 [Thu Jul 6 06:34:52 2023] ACPI: HPET 0x00000000BFFEFB40 000038 (v01 AMAZON AMZNHPET 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: SSDT 0x00000000BFFEDCC0 000CC4 (v01 AMAZON AMZNSSDT 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: SSDT 0x00000000BFFEDC40 00007F (v01 AMAZON AMZNSSDT 00000001 AMZN 00000001) [Thu Jul 6 06:34:52 2023] ACPI: Reserving WAET table memory at [mem 0xbffeffc0-0xbffeffe7] [Thu Jul 6 06:34:52 2023] ACPI: Reserving SLIT table memory at [mem 0xbffeff40-0xbffeffab] [Thu Jul 6 06:34:52 2023] ACPI: Reserving APIC table memory at [mem 0xbffefe40-0xbffeff25] [Thu Jul 6 06:34:52 2023] ACPI: Reserving SRAT table memory at [mem 0xbffefcc0-0xbffefe3f] [Thu Jul 6 06:34:52 2023] ACPI: Reserving FACP table memory at [mem 0xbffefb80-0xbffefc93] [Thu Jul 6 06:34:52 2023] ACPI: Reserving DSDT table memory at [mem 0xbffee9c0-0xbffefb19] [Thu Jul 6 06:34:52 2023] ACPI: Reserving FACS table memory at [mem 0xf8ec0-0xf8eff] [Thu Jul 6 06:34:52 2023] ACPI: Reserving HPET table memory at [mem 0xbffefb40-0xbffefb77] [Thu Jul 6 06:34:52 2023] ACPI: Reserving SSDT table memory at [mem 0xbffedcc0-0xbffee983] [Thu Jul 6 06:34:52 2023] ACPI: Reserving SSDT table memory at [mem 0xbffedc40-0xbffedcbe] [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x06 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x07 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x0e -> Node 0 [Thu Jul 6 06:34:52 2023] SRAT: PXM 0 -> APIC 0x0f -> Node 0 [Thu Jul 6 06:34:52 2023] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff] [Thu Jul 6 06:34:52 2023] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x103fffffff] [Thu Jul 6 06:34:52 2023] NUMA: Initialized distance table, cnt=1 [Thu Jul 6 06:34:52 2023] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0xffeffffff] -> [mem 0x00000000-0xffeffffff] [Thu Jul 6 06:34:52 2023] NODE_DATA(0) allocated [mem 0xffefd5000-0xffeffefff] [Thu Jul 6 06:34:52 2023] Zone ranges: [Thu Jul 6 06:34:52 2023] DMA [mem 0x0000000000001000-0x0000000000ffffff] [Thu Jul 6 06:34:52 2023] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [Thu Jul 6 06:34:52 2023] Normal [mem 0x0000000100000000-0x0000000ffeffffff] [Thu Jul 6 06:34:52 2023] Device empty [Thu Jul 6 06:34:52 2023] Movable zone start for each node [Thu Jul 6 06:34:52 2023] Early memory node ranges [Thu Jul 6 06:34:52 2023] node 0: [mem 0x0000000000001000-0x000000000009efff] [Thu Jul 6 06:34:52 2023] node 0: [mem 0x0000000000100000-0x00000000bffe8fff] [Thu Jul 6 06:34:52 2023] node 0: [mem 0x0000000100000000-0x0000000ffeffffff] [Thu Jul 6 06:34:52 2023] Initmem setup node 0 [mem 0x0000000000001000-0x0000000ffeffffff] [Thu Jul 6 06:34:52 2023] On node 0, zone DMA: 1 pages in unavailable ranges [Thu Jul 6 06:34:52 2023] On node 0, zone DMA: 97 pages in unavailable ranges [Thu Jul 6 06:34:52 2023] On node 0, zone Normal: 23 pages in unavailable ranges [Thu Jul 6 06:34:52 2023] On node 0, zone Normal: 4096 pages in unavailable ranges [Thu Jul 6 06:34:52 2023] ACPI: PM-Timer IO Port: 0xb008 [Thu Jul 6 06:34:52 2023] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [Thu Jul 6 06:34:52 2023] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 [Thu Jul 6 06:34:52 2023] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [Thu Jul 6 06:34:52 2023] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [Thu Jul 6 06:34:52 2023] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [Thu Jul 6 06:34:52 2023] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [Thu Jul 6 06:34:52 2023] ACPI: Using ACPI (MADT) for SMP configuration information [Thu Jul 6 06:34:52 2023] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [Thu Jul 6 06:34:52 2023] TSC deadline timer available [Thu Jul 6 06:34:52 2023] smpboot: Allowing 16 CPUs, 0 hotplug CPUs [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0xbffe9000-0xbfffffff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xdfffffff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0xe0000000-0xe03fffff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0xe0400000-0xfffbffff] [Thu Jul 6 06:34:52 2023] PM: hibernation: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [Thu Jul 6 06:34:52 2023] [mem 0xc0000000-0xdfffffff] available for PCI devices [Thu Jul 6 06:34:52 2023] Booting paravirtualized kernel on KVM [Thu Jul 6 06:34:52 2023] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [Thu Jul 6 06:34:52 2023] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:16 nr_cpu_ids:16 nr_node_ids:1 [Thu Jul 6 06:34:52 2023] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [Thu Jul 6 06:34:52 2023] pcpu-alloc: s208896 r8192 d28672 u262144 alloc=1*2097152 [Thu Jul 6 06:34:52 2023] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 [Thu Jul 6 06:34:52 2023] kvm-guest: stealtime: cpu 0, msr fbfa32080 [Thu Jul 6 06:34:52 2023] kvm-guest: PV spinlocks disabled, no host support [Thu Jul 6 06:34:52 2023] Built 1 zonelists, mobility grouping on. Total pages: 16252713 [Thu Jul 6 06:34:52 2023] Policy zone: Normal [Thu Jul 6 06:34:52 2023] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-1039-aws root=PARTUUID=649d63cb-5b71-44b7-8495-2466cb37066f ro console=tty1 console=ttyS0 nvme_core.io_timeout=4294967295 panic=-1 [Thu Jul 6 06:34:52 2023] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-1039-aws", will be passed to user space. [Thu Jul 6 06:34:52 2023] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear) [Thu Jul 6 06:34:52 2023] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [Thu Jul 6 06:34:52 2023] mem auto-init: stack:off, heap alloc:on, heap free:off [Thu Jul 6 06:34:52 2023] Memory: 64777452K/66043420K available (16393K kernel code, 4386K rwdata, 10876K rodata, 3248K init, 18836K bss, 1265708K reserved, 0K cma-reserved) [Thu Jul 6 06:34:52 2023] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=16, Nodes=1 [Thu Jul 6 06:34:52 2023] ftrace: allocating 50283 entries in 197 pages [Thu Jul 6 06:34:52 2023] ftrace: allocated 197 pages with 4 groups [Thu Jul 6 06:34:52 2023] rcu: Hierarchical RCU implementation. [Thu Jul 6 06:34:52 2023] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=16. [Thu Jul 6 06:34:52 2023] Rude variant of Tasks RCU enabled. [Thu Jul 6 06:34:52 2023] Tracing variant of Tasks RCU enabled. [Thu Jul 6 06:34:52 2023] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [Thu Jul 6 06:34:52 2023] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=16 [Thu Jul 6 06:34:52 2023] NR_IRQS: 524544, nr_irqs: 552, preallocated irqs: 16 [Thu Jul 6 06:34:52 2023] random: crng init done [Thu Jul 6 06:34:52 2023] Console: colour VGA+ 80x25 [Thu Jul 6 06:34:52 2023] printk: console [tty1] enabled [Thu Jul 6 06:34:52 2023] printk: console [ttyS0] enabled [Thu Jul 6 06:34:52 2023] ACPI: Core revision 20210730 [Thu Jul 6 06:34:52 2023] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns [Thu Jul 6 06:34:52 2023] APIC: Switch to symmetric I/O mode setup [Thu Jul 6 06:34:52 2023] x2apic enabled [Thu Jul 6 06:34:53 2023] Switched APIC routing to physical x2apic. [Thu Jul 6 06:34:53 2023] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x29cd37d08b9, max_idle_ns: 440795327070 ns [Thu Jul 6 06:34:53 2023] Calibrating delay loop (skipped) preset value.. 5799.97 BogoMIPS (lpj=11599952) [Thu Jul 6 06:34:53 2023] pid_max: default: 32768 minimum: 301 [Thu Jul 6 06:34:53 2023] LSM: Security Framework initializing [Thu Jul 6 06:34:53 2023] landlock: Up and running. [Thu Jul 6 06:34:53 2023] Yama: becoming mindful. [Thu Jul 6 06:34:53 2023] AppArmor: AppArmor initialized [Thu Jul 6 06:34:53 2023] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) [Thu Jul 6 06:34:53 2023] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) [Thu Jul 6 06:34:53 2023] x86/tme: enabled by BIOS [Thu Jul 6 06:34:53 2023] x86/mktme: No known encryption algorithm is supported: 0x0 [Thu Jul 6 06:34:53 2023] x86/mktme: disabled by BIOS [Thu Jul 6 06:34:53 2023] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [Thu Jul 6 06:34:53 2023] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [Thu Jul 6 06:34:53 2023] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [Thu Jul 6 06:34:53 2023] Spectre V2 : Mitigation: Enhanced IBRS [Thu Jul 6 06:34:53 2023] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [Thu Jul 6 06:34:53 2023] Spectre V2 : Spectre v2 / PBRSB-eIBRS: Retire a single CALL on VMEXIT [Thu Jul 6 06:34:53 2023] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [Thu Jul 6 06:34:53 2023] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [Thu Jul 6 06:34:53 2023] MMIO Stale Data: Mitigation: Clear CPU buffers [Thu Jul 6 06:34:53 2023] Freeing SMP alternatives memory: 40K [Thu Jul 6 06:34:53 2023] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1235 [Thu Jul 6 06:34:53 2023] smpboot: CPU0: Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz (family: 0x6, model: 0x6a, stepping: 0x6) [Thu Jul 6 06:34:53 2023] Performance Events: unsupported p6 CPU model 106 no PMU driver, software events only. [Thu Jul 6 06:34:53 2023] rcu: Hierarchical SRCU implementation. [Thu Jul 6 06:34:53 2023] NMI watchdog: Perf NMI watchdog permanently disabled [Thu Jul 6 06:34:53 2023] smp: Bringing up secondary CPUs ... [Thu Jul 6 06:34:53 2023] x86: Booting SMP configuration: [Thu Jul 6 06:34:53 2023] .... node #0, CPUs: #1 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 1, msr d87201041, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 1, msr fbfa72080 [Thu Jul 6 06:34:53 2023] #2 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 2, msr d87201081, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 2, msr fbfab2080 [Thu Jul 6 06:34:53 2023] #3 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 3, msr d872010c1, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 3, msr fbfaf2080 [Thu Jul 6 06:34:53 2023] #4 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 4, msr d87201101, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 4, msr fbfb32080 [Thu Jul 6 06:34:53 2023] #5 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 5, msr d87201141, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 5, msr fbfb72080 [Thu Jul 6 06:34:53 2023] #6 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 6, msr d87201181, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 6, msr fbfbb2080 [Thu Jul 6 06:34:53 2023] #7 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 7, msr d872011c1, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 7, msr fbfbf2080 [Thu Jul 6 06:34:53 2023] #8 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 8, msr d87201201, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 8, msr fbfc32080 [Thu Jul 6 06:34:53 2023] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [Thu Jul 6 06:34:53 2023] #9 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 9, msr d87201241, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 9, msr fbfc72080 [Thu Jul 6 06:34:53 2023] #10 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 10, msr d87201281, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 10, msr fbfcb2080 [Thu Jul 6 06:34:53 2023] #11 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 11, msr d872012c1, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 11, msr fbfcf2080 [Thu Jul 6 06:34:53 2023] #12 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 12, msr d87201301, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 12, msr fbfd32080 [Thu Jul 6 06:34:53 2023] #13 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 13, msr d87201341, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 13, msr fbfd72080 [Thu Jul 6 06:34:53 2023] #14 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 14, msr d87201381, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 14, msr fbfdb2080 [Thu Jul 6 06:34:53 2023] #15 [Thu Jul 6 06:34:52 2023] kvm-clock: cpu 15, msr d872013c1, secondary cpu clock [Thu Jul 6 06:34:53 2023] kvm-guest: stealtime: cpu 15, msr fbfdf2080 [Thu Jul 6 06:34:53 2023] smp: Brought up 1 node, 16 CPUs [Thu Jul 6 06:34:53 2023] smpboot: Max logical packages: 1 [Thu Jul 6 06:34:53 2023] smpboot: Total of 16 processors activated (92799.61 BogoMIPS) [Thu Jul 6 06:34:53 2023] devtmpfs: initialized [Thu Jul 6 06:34:53 2023] x86/mm: Memory block size: 128MB [Thu Jul 6 06:34:53 2023] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [Thu Jul 6 06:34:53 2023] futex hash table entries: 4096 (order: 6, 262144 bytes, linear) [Thu Jul 6 06:34:53 2023] pinctrl core: initialized pinctrl subsystem [Thu Jul 6 06:34:53 2023] PM: RTC time: 06:34:52, date: 2023-07-06 [Thu Jul 6 06:34:53 2023] NET: Registered PF_NETLINK/PF_ROUTE protocol family [Thu Jul 6 06:34:53 2023] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [Thu Jul 6 06:34:53 2023] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [Thu Jul 6 06:34:53 2023] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [Thu Jul 6 06:34:53 2023] audit: initializing netlink subsys (disabled) [Thu Jul 6 06:34:53 2023] audit: type=2000 audit(1688625291.882:1): state=initialized audit_enabled=0 res=1 [Thu Jul 6 06:34:53 2023] thermal_sys: Registered thermal governor 'fair_share' [Thu Jul 6 06:34:53 2023] thermal_sys: Registered thermal governor 'bang_bang' [Thu Jul 6 06:34:53 2023] thermal_sys: Registered thermal governor 'step_wise' [Thu Jul 6 06:34:53 2023] thermal_sys: Registered thermal governor 'user_space' [Thu Jul 6 06:34:53 2023] thermal_sys: Registered thermal governor 'power_allocator' [Thu Jul 6 06:34:53 2023] EISA bus registered [Thu Jul 6 06:34:53 2023] cpuidle: using governor ladder [Thu Jul 6 06:34:53 2023] cpuidle: using governor menu [Thu Jul 6 06:34:53 2023] ACPI: bus type PCI registered [Thu Jul 6 06:34:53 2023] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [Thu Jul 6 06:34:53 2023] PCI: Using configuration type 1 for base access [Thu Jul 6 06:34:53 2023] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [Thu Jul 6 06:34:53 2023] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [Thu Jul 6 06:34:53 2023] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(Module Device) [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(Processor Device) [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(3.0 _SCP Extensions) [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(Processor Aggregator Device) [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(Linux-Dell-Video) [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [Thu Jul 6 06:34:53 2023] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [Thu Jul 6 06:34:53 2023] ACPI: 3 ACPI AML tables successfully acquired and loaded [Thu Jul 6 06:34:53 2023] ACPI: Interpreter enabled [Thu Jul 6 06:34:53 2023] ACPI: PM: (supports S0 S4 S5) [Thu Jul 6 06:34:53 2023] ACPI: Using IOAPIC for interrupt routing [Thu Jul 6 06:34:53 2023] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [Thu Jul 6 06:34:53 2023] PCI: Using E820 reservations for host bridge windows [Thu Jul 6 06:34:53 2023] ACPI: Enabled 2 GPEs in block 00 to 0F [Thu Jul 6 06:34:53 2023] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [Thu Jul 6 06:34:53 2023] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3] [Thu Jul 6 06:34:53 2023] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [Thu Jul 6 06:34:53 2023] acpiphp: Slot [3] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [4] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [5] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [6] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [7] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [8] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [9] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [10] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [11] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [12] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [13] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [14] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [15] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [16] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [17] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [18] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [19] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [20] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [21] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [22] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [23] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [24] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [25] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [26] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [27] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [28] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [29] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [30] registered [Thu Jul 6 06:34:53 2023] acpiphp: Slot [31] registered [Thu Jul 6 06:34:53 2023] PCI host bridge to bus 0000:00 [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: root bus resource [bus 00-ff] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: root bus resource [mem 0x1040000000-0x20103fffffff window] [Thu Jul 6 06:34:53 2023] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [Thu Jul 6 06:34:53 2023] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: [8086:7113] type 00 class 0x000000 [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: PIIX4 devres E PIO at fff0-ffff [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: PIIX4 devres F MMIO at ffc00000-ffffffff [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: PIIX4 devres G PIO at fff0-ffff [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: PIIX4 devres H MMIO at ffc00000-ffffffff [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: PIIX4 devres I PIO at fff0-ffff [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: PIIX4 devres J PIO at fff0-ffff [Thu Jul 6 06:34:53 2023] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x180 took 19531 usecs [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: [1d0f:1111] type 00 class 0x030000 [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: reg 0x10: [mem 0xfe400000-0xfe7fffff pref] [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: reg 0x30: [mem 0xfebe0000-0xfebeffff pref] [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [Thu Jul 6 06:34:53 2023] pci 0000:00:04.0: [1d0f:8061] type 00 class 0x010802 [Thu Jul 6 06:34:53 2023] pci 0000:00:04.0: reg 0x10: [mem 0xfebf0000-0xfebf3fff] [Thu Jul 6 06:34:53 2023] pci 0000:00:04.0: enabling Extended Tags [Thu Jul 6 06:34:53 2023] pci 0000:00:05.0: [1d0f:ec20] type 00 class 0x020000 [Thu Jul 6 06:34:53 2023] pci 0000:00:05.0: reg 0x10: [mem 0xfebf8000-0xfebf9fff] [Thu Jul 6 06:34:53 2023] pci 0000:00:05.0: reg 0x14: [mem 0xfebfa000-0xfebfbfff] [Thu Jul 6 06:34:53 2023] pci 0000:00:05.0: reg 0x18: [mem 0xfe800000-0xfe8fffff pref] [Thu Jul 6 06:34:53 2023] pci 0000:00:05.0: enabling Extended Tags [Thu Jul 6 06:34:53 2023] pci 0000:00:1f.0: [1d0f:8061] type 00 class 0x010802 [Thu Jul 6 06:34:53 2023] pci 0000:00:1f.0: reg 0x10: [mem 0xfebf4000-0xfebf7fff] [Thu Jul 6 06:34:53 2023] pci 0000:00:1f.0: enabling Extended Tags [Thu Jul 6 06:34:53 2023] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [Thu Jul 6 06:34:53 2023] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [Thu Jul 6 06:34:53 2023] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [Thu Jul 6 06:34:53 2023] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [Thu Jul 6 06:34:53 2023] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [Thu Jul 6 06:34:53 2023] iommu: Default domain type: Translated [Thu Jul 6 06:34:53 2023] iommu: DMA domain TLB invalidation policy: lazy mode [Thu Jul 6 06:34:53 2023] SCSI subsystem initialized [Thu Jul 6 06:34:53 2023] libata version 3.00 loaded. [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: vgaarb: setting as boot VGA device [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [Thu Jul 6 06:34:53 2023] pci 0000:00:03.0: vgaarb: bridge control possible [Thu Jul 6 06:34:53 2023] vgaarb: loaded [Thu Jul 6 06:34:53 2023] ACPI: bus type USB registered [Thu Jul 6 06:34:53 2023] usbcore: registered new interface driver usbfs [Thu Jul 6 06:34:53 2023] usbcore: registered new interface driver hub [Thu Jul 6 06:34:53 2023] usbcore: registered new device driver usb [Thu Jul 6 06:34:53 2023] pps_core: LinuxPPS API ver. 1 registered [Thu Jul 6 06:34:53 2023] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti giometti@linux.it [Thu Jul 6 06:34:53 2023] PTP clock support registered [Thu Jul 6 06:34:53 2023] EDAC MC: Ver: 3.0.0 [Thu Jul 6 06:34:53 2023] NetLabel: Initializing [Thu Jul 6 06:34:53 2023] NetLabel: domain hash size = 128 [Thu Jul 6 06:34:53 2023] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [Thu Jul 6 06:34:53 2023] NetLabel: unlabeled traffic allowed by default [Thu Jul 6 06:34:53 2023] PCI: Using ACPI for IRQ routing [Thu Jul 6 06:34:53 2023] PCI: pci_cache_line_size set to 64 bytes [Thu Jul 6 06:34:53 2023] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] [Thu Jul 6 06:34:53 2023] e820: reserve RAM buffer [mem 0xbffe9000-0xbfffffff] [Thu Jul 6 06:34:53 2023] e820: reserve RAM buffer [mem 0xfff000000-0xfffffffff] [Thu Jul 6 06:34:53 2023] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [Thu Jul 6 06:34:53 2023] hpet0: 8 comparators, 32-bit 62.500000 MHz counter [Thu Jul 6 06:34:53 2023] clocksource: Switched to clocksource kvm-clock [Thu Jul 6 06:34:53 2023] VFS: Disk quotas dquot_6.6.0 [Thu Jul 6 06:34:53 2023] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [Thu Jul 6 06:34:53 2023] AppArmor: AppArmor Filesystem Enabled [Thu Jul 6 06:34:53 2023] pnp: PnP ACPI init [Thu Jul 6 06:34:53 2023] pnp: PnP ACPI: found 5 devices [Thu Jul 6 06:34:53 2023] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [Thu Jul 6 06:34:53 2023] NET: Registered PF_INET protocol family [Thu Jul 6 06:34:53 2023] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [Thu Jul 6 06:34:53 2023] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes, linear) [Thu Jul 6 06:34:53 2023] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [Thu Jul 6 06:34:53 2023] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear) [Thu Jul 6 06:34:53 2023] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [Thu Jul 6 06:34:53 2023] TCP: Hash tables configured (established 524288 bind 65536) [Thu Jul 6 06:34:53 2023] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, linear) [Thu Jul 6 06:34:53 2023] UDP hash table entries: 32768 (order: 8, 1048576 bytes, linear) [Thu Jul 6 06:34:53 2023] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes, linear) [Thu Jul 6 06:34:53 2023] NET: Registered PF_UNIX/PF_LOCAL protocol family [Thu Jul 6 06:34:53 2023] NET: Registered PF_XDP protocol family [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [Thu Jul 6 06:34:53 2023] pci_bus 0000:00: resource 8 [mem 0x1040000000-0x20103fffffff window] [Thu Jul 6 06:34:53 2023] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [Thu Jul 6 06:34:53 2023] pci 0000:00:01.0: Activating ISA DMA hang workarounds [Thu Jul 6 06:34:53 2023] PCI: CLS 0 bytes, default 64 [Thu Jul 6 06:34:53 2023] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [Thu Jul 6 06:34:53 2023] Trying to unpack rootfs image as initramfs... [Thu Jul 6 06:34:53 2023] software IO TLB: mapped [mem 0x00000000bbfe9000-0x00000000bffe9000] (64MB) [Thu Jul 6 06:34:53 2023] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x29cd37d08b9, max_idle_ns: 440795327070 ns [Thu Jul 6 06:34:53 2023] Freeing initrd memory: 6776K [Thu Jul 6 06:34:53 2023] clocksource: Switched to clocksource tsc [Thu Jul 6 06:34:53 2023] Initialise system trusted keyrings [Thu Jul 6 06:34:53 2023] Key type blacklist registered [Thu Jul 6 06:34:53 2023] workingset: timestamp_bits=36 max_order=24 bucket_order=0 [Thu Jul 6 06:34:53 2023] zbud: loaded [Thu Jul 6 06:34:53 2023] squashfs: version 4.0 (2009/01/31) Phillip Lougher [Thu Jul 6 06:34:53 2023] fuse: init (API version 7.34) [Thu Jul 6 06:34:53 2023] integrity: Platform Keyring initialized [Thu Jul 6 06:34:53 2023] Key type asymmetric registered [Thu Jul 6 06:34:53 2023] Asymmetric key parser 'x509' registered [Thu Jul 6 06:34:53 2023] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [Thu Jul 6 06:34:53 2023] io scheduler mq-deadline registered [Thu Jul 6 06:34:53 2023] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [Thu Jul 6 06:34:53 2023] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [Thu Jul 6 06:34:53 2023] ACPI: button: Power Button [PWRF] [Thu Jul 6 06:34:53 2023] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1 [Thu Jul 6 06:34:53 2023] ACPI: button: Sleep Button [SLPF] [Thu Jul 6 06:34:53 2023] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [Thu Jul 6 06:34:53 2023] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, basebaud = 115200) is a 16550A [Thu Jul 6 06:34:53 2023] Linux agpgart interface v0.103 [Thu Jul 6 06:34:53 2023] loop: module loaded [Thu Jul 6 06:34:53 2023] nvme nvme0: pci function 0000:00:04.0 [Thu Jul 6 06:34:53 2023] nvme nvme1: pci function 0000:00:1f.0 [Thu Jul 6 06:34:53 2023] ACPI: _SB.LNKD: Enabled at IRQ 11 [Thu Jul 6 06:34:53 2023] tun: Universal TUN/TAP device driver, 1.6 [Thu Jul 6 06:34:53 2023] ACPI: _SB_.LNKC: Enabled at IRQ 10 [Thu Jul 6 06:34:53 2023] PPP generic driver version 2.4.2 [Thu Jul 6 06:34:53 2023] nvme nvme0: 2/0/0 default/read/poll queues [Thu Jul 6 06:34:53 2023] VFIO - User Level meta-driver version: 0.3 [Thu Jul 6 06:34:53 2023] nvme nvme1: 2/0/0 default/read/poll queues [Thu Jul 6 06:34:53 2023] nvme0n1: p1 p14 p15 [Thu Jul 6 06:34:53 2023] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [Thu Jul 6 06:34:53 2023] ehci-pci: EHCI PCI platform driver [Thu Jul 6 06:34:53 2023] ehci-platform: EHCI generic platform driver [Thu Jul 6 06:34:53 2023] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [Thu Jul 6 06:34:53 2023] ohci-pci: OHCI PCI platform driver [Thu Jul 6 06:34:53 2023] ohci-platform: OHCI generic platform driver [Thu Jul 6 06:34:53 2023] uhci_hcd: USB Universal Host Controller Interface driver [Thu Jul 6 06:34:53 2023] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [Thu Jul 6 06:34:53 2023] i8042: Warning: Keylock active [Thu Jul 6 06:34:53 2023] serio: i8042 KBD port at 0x60,0x64 irq 1 [Thu Jul 6 06:34:53 2023] serio: i8042 AUX port at 0x60,0x64 irq 12 [Thu Jul 6 06:34:53 2023] mousedev: PS/2 mouse device common for all mice [Thu Jul 6 06:34:53 2023] rtc_cmos 00:00: RTC can wake from S4 [Thu Jul 6 06:34:53 2023] rtc_cmos 00:00: registered as rtc0 [Thu Jul 6 06:34:53 2023] rtc_cmos 00:00: setting system clock to 2023-07-06T06:34:52 UTC (1688625292) [Thu Jul 6 06:34:53 2023] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram [Thu Jul 6 06:34:53 2023] i2c_dev: i2c /dev entries driver [Thu Jul 6 06:34:53 2023] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [Thu Jul 6 06:34:53 2023] device-mapper: uevent: version 1.0.3 [Thu Jul 6 06:34:53 2023] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [Thu Jul 6 06:34:53 2023] platform eisa.0: Probing EISA bus 0 [Thu Jul 6 06:34:53 2023] platform eisa.0: EISA: Cannot allocate resource for mainboard [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 1 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 2 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 3 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 4 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 5 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 6 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 7 [Thu Jul 6 06:34:53 2023] platform eisa.0: Cannot allocate resource for EISA slot 8 [Thu Jul 6 06:34:53 2023] platform eisa.0: EISA: Detected 0 cards [Thu Jul 6 06:34:53 2023] intel_pstate: P-states controlled by the platform [Thu Jul 6 06:34:53 2023] ledtrig-cpu: registered to indicate activity on CPUs [Thu Jul 6 06:34:53 2023] drop_monitor: Initializing network drop monitor service [Thu Jul 6 06:34:53 2023] NET: Registered PF_INET6 protocol family [Thu Jul 6 06:34:53 2023] Segment Routing with IPv6 [Thu Jul 6 06:34:53 2023] In-situ OAM (IOAM) with IPv6 [Thu Jul 6 06:34:53 2023] NET: Registered PF_PACKET protocol family [Thu Jul 6 06:34:54 2023] Key type dns_resolver registered [Thu Jul 6 06:34:54 2023] IPI shorthand broadcast: enabled [Thu Jul 6 06:34:54 2023] sched_clock: Marking stable (1273551540, 735505612)->(2464522614, -455465462) [Thu Jul 6 06:34:54 2023] registered taskstats version 1 [Thu Jul 6 06:34:54 2023] Loading compiled-in X.509 certificates [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Build time autogenerated kernel key: cd49a347ef0c774df18e6c9426ecf6c81ebcbb6a' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [Thu Jul 6 06:34:54 2023] blacklist: Loading compiled-in revocation X.509 certificates [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [Thu Jul 6 06:34:54 2023] zswap: loaded using pool lzo/zbud [Thu Jul 6 06:34:54 2023] Key type .fscrypt registered [Thu Jul 6 06:34:54 2023] Key type fscrypt-provisioning registered [Thu Jul 6 06:34:54 2023] Key type encrypted registered [Thu Jul 6 06:34:54 2023] AppArmor: AppArmor sha1 policy hashing enabled [Thu Jul 6 06:34:54 2023] ima: No TPM chip found, activating TPM-bypass! [Thu Jul 6 06:34:54 2023] Loading compiled-in module X.509 certificates [Thu Jul 6 06:34:54 2023] Loaded X.509 cert 'Build time autogenerated kernel key: cd49a347ef0c774df18e6c9426ecf6c81ebcbb6a' [Thu Jul 6 06:34:54 2023] ima: Allocated hash algorithm: sha1 [Thu Jul 6 06:34:54 2023] ima: No architecture policies found [Thu Jul 6 06:34:54 2023] evm: Initialising EVM extended attributes: [Thu Jul 6 06:34:54 2023] evm: security.selinux [Thu Jul 6 06:34:54 2023] evm: security.SMACK64 [Thu Jul 6 06:34:54 2023] evm: security.SMACK64EXEC [Thu Jul 6 06:34:54 2023] evm: security.SMACK64TRANSMUTE [Thu Jul 6 06:34:54 2023] evm: security.SMACK64MMAP [Thu Jul 6 06:34:54 2023] evm: security.apparmor [Thu Jul 6 06:34:54 2023] evm: security.ima [Thu Jul 6 06:34:54 2023] evm: security.capability [Thu Jul 6 06:34:54 2023] evm: HMAC attrs: 0x1 [Thu Jul 6 06:34:54 2023] PM: Magic number: 15:120:569 [Thu Jul 6 06:34:54 2023] PM: hash matches drivers/base/power/main.c:658 [Thu Jul 6 06:34:54 2023] RAS: Correctable Errors collector initialized. [Thu Jul 6 06:34:54 2023] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2 [Thu Jul 6 06:34:54 2023] md: Waiting for all devices to be available before autodetect [Thu Jul 6 06:34:54 2023] md: If you don't use raid, use raid=noautodetect [Thu Jul 6 06:34:54 2023] md: Autodetecting RAID arrays. [Thu Jul 6 06:34:54 2023] md: autorun ... [Thu Jul 6 06:34:54 2023] md: ... autorun DONE. [Thu Jul 6 06:34:54 2023] EXT4-fs (nvme0n1p1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. [Thu Jul 6 06:34:54 2023] VFS: Mounted root (ext4 filesystem) readonly on device 259:2. [Thu Jul 6 06:34:54 2023] devtmpfs: mounted [Thu Jul 6 06:34:54 2023] Freeing unused decrypted memory: 2036K [Thu Jul 6 06:34:54 2023] Freeing unused kernel image (initmem) memory: 3248K [Thu Jul 6 06:34:54 2023] Write protecting the kernel read-only data: 30720k [Thu Jul 6 06:34:54 2023] Freeing unused kernel image (text/rodata gap) memory: 2036K [Thu Jul 6 06:34:54 2023] Freeing unused kernel image (rodata/data gap) memory: 1412K [Thu Jul 6 06:34:54 2023] x86/mm: Checked W+X mappings: passed, no W+X pages found. [Thu Jul 6 06:34:54 2023] Run /sbin/init as init process [Thu Jul 6 06:34:54 2023] with arguments: [Thu Jul 6 06:34:54 2023] /sbin/init [Thu Jul 6 06:34:54 2023] with environment: [Thu Jul 6 06:34:54 2023] HOME=/ [Thu Jul 6 06:34:54 2023] TERM=linux [Thu Jul 6 06:34:54 2023] BOOT_IMAGE=/boot/vmlinuz-5.15.0-1039-aws [Thu Jul 6 06:34:54 2023] systemd[1]: Inserted module 'autofs4' [Thu Jul 6 06:34:54 2023] systemd[1]: systemd 245.4-4ubuntu3.21 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [Thu Jul 6 06:34:54 2023] systemd[1]: Detected virtualization kvm. [Thu Jul 6 06:34:54 2023] systemd[1]: Detected architecture x86-64. [Thu Jul 6 06:34:54 2023] systemd[1]: Set hostname to . [Thu Jul 6 06:34:54 2023] systemd[1]: Created slice system-modprobe.slice. [Thu Jul 6 06:34:54 2023] systemd[1]: Created slice system-serial\x2dgetty.slice. [Thu Jul 6 06:34:54 2023] systemd[1]: Created slice system-systemd\x2dfsck.slice. [Thu Jul 6 06:34:54 2023] systemd[1]: Created slice User and Session Slice. [Thu Jul 6 06:34:54 2023] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [Thu Jul 6 06:34:54 2023] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [Thu Jul 6 06:34:54 2023] systemd[1]: Reached target User and Group Name Lookups. [Thu Jul 6 06:34:54 2023] systemd[1]: Reached target Slices. [Thu Jul 6 06:34:54 2023] systemd[1]: Reached target Mounting snaps. [Thu Jul 6 06:34:54 2023] systemd[1]: Reached target Swap. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on Device-mapper event daemon FIFOs. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on LVM2 poll daemon socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on multipathd control socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on Syslog Socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on fsck to fsckd communication Socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on initctl Compatibility Named Pipe. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on Journal Audit Socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on Journal Socket (/dev/log). [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on Journal Socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on Network Service Netlink Socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on udev Control Socket. [Thu Jul 6 06:34:54 2023] systemd[1]: Listening on udev Kernel Socket. [Thu Jul 6 06:34:55 2023] systemd[1]: Mounting Huge Pages File System... [Thu Jul 6 06:34:55 2023] systemd[1]: Mounting POSIX Message Queue File System... [Thu Jul 6 06:34:55 2023] systemd[1]: Mounting Kernel Debug File System... [Thu Jul 6 06:34:55 2023] systemd[1]: Mounting Kernel Trace File System... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Journal Service... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Set the console keyboard layout... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Create list of static device nodes for the current kernel... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Module chromeos_pstore... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Module drm... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Module efi_pstore... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Module pstore_blk... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Module pstore_zone... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Module ramoops... [Thu Jul 6 06:34:55 2023] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [Thu Jul 6 06:34:55 2023] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [Thu Jul 6 06:34:55 2023] systemd[1]: Starting File System Check on Root Device... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Load Kernel Modules... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting udev Coldplug all Devices... [Thu Jul 6 06:34:55 2023] systemd[1]: Starting Uncomplicated firewall... [Thu Jul 6 06:34:55 2023] systemd[1]: Started Journal Service. [Thu Jul 6 06:34:55 2023] EXT4-fs (nvme0n1p1): re-mounted. Opts: discard. Quota mode: none. [Thu Jul 6 06:34:55 2023] systemd-journald[269]: Received client request to flush runtime journal. [Thu Jul 6 06:34:55 2023] cryptd: max_cpu_qlen set to 1000 [Thu Jul 6 06:34:55 2023] ena 0000:00:05.0: ENA device version: 0.10 [Thu Jul 6 06:34:55 2023] ena 0000:00:05.0: ENA controller version: 0.0.1 implementation version 1 [Thu Jul 6 06:34:55 2023] AVX2 version of gcm_enc/dec engaged. [Thu Jul 6 06:34:55 2023] AES CTR mode by8 optimization enabled [Thu Jul 6 06:34:55 2023] parport_pc 00:03: reported by Plug and Play ACPI [Thu Jul 6 06:34:55 2023] ena 0000:00:05.0: Elastic Network Adapter (ENA) found at mem febf8000, mac addr 0a:d0:7a:5e:51:56 [Thu Jul 6 06:34:55 2023] ena 0000:00:05.0 ens5: renamed from eth0 [Thu Jul 6 06:34:55 2023] ppdev: user-space parallel port driver [Thu Jul 6 06:34:55 2023] alua: device handler registered [Thu Jul 6 06:34:55 2023] emc: device handler registered [Thu Jul 6 06:34:55 2023] rdac: device handler registered [Thu Jul 6 06:34:55 2023] loop0: detected capacity change from 0 to 49944 [Thu Jul 6 06:34:55 2023] loop1: detected capacity change from 0 to 50816 [Thu Jul 6 06:34:55 2023] loop2: detected capacity change from 0 to 113944 [Thu Jul 6 06:34:56 2023] SGI XFS with ACLs, security attributes, realtime, quota, no debug enabled [Thu Jul 6 06:34:56 2023] XFS (nvme1n1): Mounting V5 Filesystem [Thu Jul 6 06:34:56 2023] loop3: detected capacity change from 0 to 188072 [Thu Jul 6 06:34:56 2023] XFS (nvme1n1): Ending clean mount [Thu Jul 6 06:34:56 2023] loop4: detected capacity change from 0 to 129936 [Thu Jul 6 06:34:56 2023] xfs filesystem being mounted at /data supports timestamps until 2038 (0x7fffffff) [Thu Jul 6 06:34:56 2023] loop5: detected capacity change from 0 to 109072 [Thu Jul 6 06:34:56 2023] loop6: detected capacity change from 0 to 109032 [Thu Jul 6 06:34:56 2023] loop7: detected capacity change from 0 to 114000 [Thu Jul 6 06:34:56 2023] input: ImPS/2 Generic Wheel Mouse as /devices/platform/i8042/serio1/input/input4 [Thu Jul 6 06:34:56 2023] loop8: detected capacity change from 0 to 129944 [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.840:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=545 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.840:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=546 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.840:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=546 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.840:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=547 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.840:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=547 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.840:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=547 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.844:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=542 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.844:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=542 comm="apparmor_parser" [Thu Jul 6 06:34:56 2023] audit: type=1400 audit(1688625294.844:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" pid=543 comm="apparmor_parser" [Thu Jul 6 06:34:58 2023] IPv6: ADDRCONF(NETDEV_CHANGE): ens5: link becomes ready [Thu Jul 6 06:35:08 2023] loop9: detected capacity change from 0 to 8

danny-adu commented 1 year ago

I think re-node should fix this, but it's not an optimal solution

giskook commented 1 year ago

I am running under screen, because I need to switch back and forth between the running of the monitoring node service, does it have something to do with this?

It seems the node is not killed by system. Could you share your start command?

giskook commented 1 year ago

I think re-node should fix this, but it's not an optimal solution

@danny-dudu Yes,and how long the node has been running

danny-adu commented 1 year ago

It seems the node is not killed by system. Could you share your start command?

1.first create screen like this screen -S okc

2.enter the screen and run start cmd like this exchaind start --home /data/exchaind

danny-adu commented 1 year ago

I think re-node should fix this, but it's not an optimal solution

@danny-dudu Yes,and how long the node has been running

root 2031 2022 34 Jul06 pts/2 4-18:54:14 exchaind start --home /data/exchaind

it look like a long time

giskook commented 1 year ago

E[2023-07-20|03:58:00.139][2031] Failed to read request. module=rpc-server protocol=websocket remote=157.245.40.246:56390 err="websocket: close 1006 (abnormal closure): unexpected EOF"

Could you show more logs like this?

giskook commented 1 year ago

Is there any panic logs? or stack logs?

danny-adu commented 1 year ago

Is there any panic logs? or stack logs?

The node is running normally, but the RPC communication interaction cannot be performed. very strange

danny-adu commented 1 year ago

E[2023-07-20|03:58:00.139][2031] Failed to read request. module=rpc-server protocol=websocket remote=157.245.40.246:56390 err="websocket: close 1006 (abnormal closure): unexpected EOF"

Could you show more logs like this?

There is almost no error log or stack information, I can reproduce some for you, like this

I[2023-07-20|04:57:50.470][2031] Height<20939033>, Tx<5>, BlockSize<6189>, BTInterval<3925ms>, LastBlockTime<3800ms>, GasUsed<484847>, InvalidTxs<0>, lastRun<8ms>, ApplyBlock<ApplyBlock<14ms>, abci<0ms>, persist<12ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<12>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<8ms>, flushCache<2ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<2267>, rdb<12>, rdbTs<7ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<3ms>, refund<0ms>]. module=main I[2023-07-20|04:57:54.271][2031] Height<20939034>, Tx<12>, BlockSize<4384>, BTInterval<3780ms>, LastBlockTime<3800ms>, GasUsed<743450>, InvalidTxs<0>, lastRun<8ms>, ApplyBlock<ApplyBlock<15ms>, abci<0ms>, persist<14ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<25>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<9ms>, flushCache<2ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<3606>, rdb<16>, rdbTs<9ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<3ms>, refund<0ms>]. module=main I[2023-07-20|04:57:58.072][2031] Height<20939035>, Tx<25>, BlockSize<6576>, BTInterval<3873ms>, LastBlockTime<3800ms>, GasUsed<2623273>, InvalidTxs<0>, lastRun<14ms>, ApplyBlock<ApplyBlock<29ms>, abci<0ms>, persist<27ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<10>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<18ms>, flushCache<4ms>, commitStores<3ms>, flushMeta<0ms>>, Iavl[getnode<9723>, rdb<166>, rdbTs<87ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<6ms>, refund<0ms>]. module=main I[2023-07-20|04:58:01.872][2031] Height<20939036>, Tx<10>, BlockSize<5537>, BTInterval<3707ms>, LastBlockTime<3800ms>, GasUsed<2687813>, InvalidTxs<0>, lastRun<15ms>, ApplyBlock<ApplyBlock<22ms>, abci<0ms>, persist<20ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<2>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<12ms>, flushCache<4ms>, commitStores<3ms>, flushMeta<0ms>>, Iavl[getnode<6542>, rdb<32>, rdbTs<16ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<9ms>, refund<1ms>]. module=main I[2023-07-20|04:58:05.673][2031] Height<20939037>, Tx<2>, BlockSize<2501>, BTInterval<3754ms>, LastBlockTime<3800ms>, GasUsed<114688>, InvalidTxs<0>, lastRun<6ms>, ApplyBlock<ApplyBlock<12ms>, abci<0ms>, persist<11ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<3>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<8ms>, flushCache<1ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<1878>, rdb<25>, rdbTs<13ms>, savenode<0>], DeliverTxs[RunAnte<1ms>, RunMsg<0ms>, refund<0ms>]. module=main I[2023-07-20|04:58:09.473][2031] Height<20939038>, Tx<3>, BlockSize<2562>, BTInterval<3938ms>, LastBlockTime<3800ms>, GasUsed<1532810>, InvalidTxs<0>, lastRun<11ms>, ApplyBlock<ApplyBlock<11ms>, abci<0ms>, persist<10ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<3>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<4ms>, flushCache<2ms>, commitStores<2ms>, flushMeta<0ms>>, Iavl[getnode<2882>, rdb<8>, rdbTs<3ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<5ms>, refund<0ms>]. module=main I[2023-07-20|04:58:13.274][2031] Height<20939039>, Tx<3>, BlockSize<2719>, BTInterval<3703ms>, LastBlockTime<3800ms>, GasUsed<173016>, InvalidTxs<0>, lastRun<6ms>, ApplyBlock<ApplyBlock<24ms>, abci<0ms>, persist<22ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<3>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<19ms>, flushCache<1ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<2023>, rdb<58>, rdbTs<31ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<1ms>, refund<0ms>]. module=main I[2023-07-20|04:58:17.074][2031] Height<20939040>, Tx<3>, BlockSize<2682>, BTInterval<3782ms>, LastBlockTime<3800ms>, GasUsed<163701>, InvalidTxs<0>, lastRun<7ms>, ApplyBlock<ApplyBlock<12ms>, abci<0ms>, persist<11ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<3>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<8ms>, flushCache<1ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<1938>, rdb<22>, rdbTs<11ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<0ms>, refund<0ms>]. module=main I[2023-07-20|04:58:20.875][2031] Height<20939041>, Tx<3>, BlockSize<5539>, BTInterval<3825ms>, LastBlockTime<3801ms>, GasUsed<420076>, InvalidTxs<0>, lastRun<8ms>, ApplyBlock<ApplyBlock<11ms>, abci<0ms>, persist<10ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<4>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<6ms>, flushCache<2ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<2154>, rdb<10>, rdbTs<5ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<2ms>, refund<0ms>]. module=main I[2023-07-20|04:58:24.676][2031] Height<20939042>, Tx<4>, BlockSize<3387>, BTInterval<3749ms>, LastBlockTime<3800ms>, GasUsed<208353>, InvalidTxs<0>, lastRun<8ms>, ApplyBlock<ApplyBlock<20ms>, abci<0ms>, persist<19ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<1>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<15ms>, flushCache<1ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<2107>, rdb<38>, rdbTs<22ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<2ms>, refund<0ms>]. module=main I[2023-07-20|04:58:28.477][2031] Height<20939043>, Tx<1>, BlockSize<2220>, BTInterval<3865ms>, LastBlockTime<3800ms>, GasUsed<57224>, InvalidTxs<0>, lastRun<6ms>, ApplyBlock<ApplyBlock<9ms>, abci<0ms>, persist<8ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<1>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<5ms>, flushCache<1ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<1808>, rdb<10>, rdbTs<4ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<0ms>, refund<0ms>]. module=main I[2023-07-20|04:58:32.277][2031] Height<20939044>, Tx<1>, BlockSize<2430>, BTInterval<4024ms>, LastBlockTime<3800ms>, GasUsed<52174>, InvalidTxs<0>, lastRun<5ms>, ApplyBlock<ApplyBlock<8ms>, abci<0ms>, persist<7ms>, mpUpdate<0ms>, SaveState<0ms>>, Prerun<1>, MempoolTxs<18>, Workload<0.01|0.01|0.01|0.01>, persistDetails<preChange<4ms>, flushCache<1ms>, commitStores<1ms>, flushMeta<0ms>>, Iavl[getnode<1608>, rdb<8>, rdbTs<3ms>, savenode<0>], DeliverTxs[RunAnte<0ms>, RunMsg<1ms>, refund<0ms>]. module=main

giskook commented 1 year ago

Is there any panic logs? or stack logs?

The node is running normally, but the RPC communication interaction cannot be performed. very strange

I got the point, I will try to reproduce this situation. and If the node is still running with invalid RPC, could you please run curl http://127.0.0.1:6060/debug/pprof/goroutine?debug=1 > g1.log and curl http://127.0.0.1:6060/debug/pprof/profile?seconds=60 > prof.bin

then send the file to me? Thanks in advance.

danny-adu commented 1 year ago

Is there any panic logs? or stack logs?

The node is running normally, but the RPC communication interaction cannot be performed. very strange

I got the point, I will try to reproduce this situation. and If the node is still running with invalid RPC, could you please run curl http://127.0.0.1:6060/debug/pprof/goroutine?debug=1 > g1.log and curl http://127.0.0.1:6060/debug/pprof/profile?seconds=60 > prof.bin

then send the file to me? Thanks in advance.

give email, thanks, i send to u file

danny-adu commented 1 year ago

Is there any panic logs? or stack logs?

The node is running normally, but the RPC communication interaction cannot be performed. very strange

I got the point, I will try to reproduce this situation. and If the node is still running with invalid RPC, could you please run curl http://127.0.0.1:6060/debug/pprof/goroutine?debug=1 > g1.log and curl http://127.0.0.1:6060/debug/pprof/profile?seconds=60 > prof.bin then send the file to me? Thanks in advance.

give email, thanks, i send to u file

i sent to u already, zhangkai.gis@163.com

giskook commented 1 year ago

Is there any panic logs? or stack logs?

The node is running normally, but the RPC communication interaction cannot be performed. very strange

Hi @danny-dudu , What‘s the error message from the user side? the port is invalid? / timeout or something else? BTW which port do you use?