Quickfix need help investigating memory consumption (eats 2-3Gb a day) - anybody seen similar

quickfix / quickfix

QuickFIX C++ Fix Engine Library

Other

1.58k stars 756 forks source link

Quickfix need help investigating memory consumption (eats 2-3Gb a day) - anybody seen similar #283

Open giclo opened 4 years ago

giclo commented 4 years ago

Running on centos 7.6, build with gcc 7.4, using master branch, simple market data proxy, receiving ~2000 quotes a sec, sending ~2000 quotes a sec. Release build - Initial app memory 100m. In one day, memory usage grow by 2-3Gb.

Vagrant and jemalloc tests do not show any memory leak. Simple restart can cause application to eat up to 1Gb.

Ambal commented 4 years ago

Hi, @giclo . I'm pretty sure that this issue is caused by message queue used to store messages for ResendRequests (e.g. MemoryStore class). It was already discussed some time ago that we need a mechanism to limit the amount of messages stored to reduce RAM consumption.

orenmnero commented 1 year ago

While I think we do need such a mechanism, in this case I wonder why not use a NullStore. Doesn't seem that resends would be needed for this use case.

tomerpeled commented 4 months ago

Is there some configuration for workaround this?