celestiaorg / celestia-node

Celestia Data Availability Nodes
Apache License 2.0
927 stars 925 forks source link

High disk reads / peering issue #3263

Open trader-payne opened 7 months ago

trader-payne commented 7 months ago

Celestia Node version

v0.12.4

OS

Ubuntu 22.04.4 LTS

Install tools

No response

Others

No response

Steps to reproduce it

Run the bridge, sometimes it starts to read upwards of 1GB/s from the disk. We suspect that it's peering related, maybe someone syncing their bridge node against ours, or something like that. If you stop it and leave it down for 1-2 mins, after a restart it most often stops doing this.

Expected result

It shouldn't kill the disks this much.

Actual result

image

Relevant log output

https://pastebin.com/raw/Gte21Edx

Notes

System specs: OS: Ubuntu 22.04.4 LTS x86_64 Host: KVM/QEMU (Standard PC (i440FX + PIIX, 1996) pc-i440fx-8.1) Kernel: 5.15.0-97-generic Uptime: 20 days, 21 hours, 2 mins Packages: 933 (dpkg), 4 (snap) Shell: zsh 5.8.1 Resolution: 1280x800 CPU: AMD EPYC 9474F (96) @ 3.599GHz GPU: 00:02.0 Vendor 1234 Device 1111 Memory: 10976MiB / 32056MiB image

easy2stake commented 7 months ago

Is the same issue as the one here: https://github.com/celestiaorg/celestia-node/issues/3216

trader-payne commented 7 months ago

Didn't see that, my bad! 🙌🏻