openethereum / parity-ethereum

The fast, light, and robust client for Ethereum-like networks.
Other
6.81k stars 1.68k forks source link

Increasing memory fragmentation while syncing for extended periods of time? #11886

Open elliottdehn opened 3 years ago

elliottdehn commented 3 years ago

Note: I'm not 100% certain this is a defect, but I've observed it multiple times and wanted to report it.

Expected: Memory/Cache performance and efficiency remains the same over time.

Actual: Immediately after launching, Committed Memory and Working Memory are roughly equal in the Resource Monitor. After syncing for 24-48 hours, up to 2GB worth of Committed Memory remains unused even when observed for extended periods of time.

For reference, I'm using an about 12 GB cache and leaving my computer to run untouched for the period of time.

My theory is that over time, the allocated memory is becoming fragmented and unusable. Restarting fixes the problem and results in a small performance increase, but babysitting the process like this isn't ideal.

adria0 commented 3 years ago

Hi @elliottdehn, please read https://github.com/openethereum/openethereum/issues/11858 and https://github.com/openethereum/openethereum/issues/11881