migalabs / armiarma

Armiarma is a Libp2p open-network crawler with a current focus on Ethereum's CL network
https://monitoreth.io
MIT License
36 stars 13 forks source link

Profile the CPU usage #60

Closed cortze closed 8 months ago

cortze commented 11 months ago

Description

Our 2 core and 4GB of RAM prod machine was getting busy handling the Crawler + DB in a single machine. The CPU was constantly at 100%, affecting the overall performance of the crawler and the query time to the DB.

It would be nice to profile the CPU usage and make sure that the workload comes from the peering workers and the low peering latency to ~22k peers every ~2mins and not from a wrongly handled loop that eats CPU

cortze commented 8 months ago

CPU usage was linked to heavy usage of the DB from an external tool. Closing this Issue