search

ElixirProtocol / testnet-3-issue-tracker

0 stars 0 forks source link

Possible memory leak in validator #14

Open Nakochi-crypto opened 2 months ago

Nakochi-crypto commented 2 months ago

My monitoring tools show a gradual increase in memory usage. This can cause memory shortages over long periods of validator operation.

Restarting the validator shows a decrease in memory usage.

Validator version: 3.4.0

スクリーンショット 2024-09-11 18 04 13
Nakochi-crypto commented 2 months ago

Looks good with 3.4.2. Closing.

Nakochi-crypto commented 2 months ago

The problem recurs with 3.4.3.

chris-gilbert commented 1 month ago

GM @Nakochi-crypto, thank you for submitting this issue. In the latest release, 3.4.6 real memory usage is stable for testnet workloads around 312 MB. In your screenshot, it looks like your numbers are similar, ~275 MB.

I am closing this ticket for the time being, but happy to revisit the potential problem.

Are you still seeing memory leaks? If so, please reopen with newer charts and I'm happy to investigate.

chris-gilbert commented 1 month ago

Further testing has shown rapid increases in memory footprint for the running processes in the validator node. More investigation is warranted.