Java EMA/ETA ReactorFactory possible memory leak

[xanddol]

Hello everyone!

We are using the EMA client library version rtsdk.version = 3.8.0.0 in our application along with the Spring Boot framework, and the application is further packaged in Docker. During operation, we discovered that over time, the application starts to consume more and more memory, which eventually leads to Out of memory errors and application restarts in kubernetes. The basic scenario for working with the application is as follows:

1)User logs in to the application 2)User subscribes to several hundred instruments 3)User receives updates on these instruments in streaming mode for a certain period, for example, for several minutes or hours 4)Then the user logs out 5)Several hundred such users work simultaneously 6)For each user, an OmmConsumer is created upon login, and consumer.uninitialize() is called after the work is finished 7)After the operation, we performed a full GC and took a heap dump. It was discovered that some objects are still in the heap. See picture

Analysis and debugging tell us that the class com.refinitiv.eta.valueadd.reactor.ReactorFactory contains many static fields like static VaPool _wlStreamPool = new VaPool(true) or static VaPool _wlRequestPool = new VaPool(true), which easily survive Java GC. At the same time (at the picture), in the heap dump, we see that for each user, a WatchList object was created, which, when calling consumer.uninitialize(), ends up in _watchlistPool here: com.refinitiv.eta.valueadd.reactor.Watchlist#returnToPool. There can be several hundred such WatchList objects, each occupying 2Mb of heap memory. It turns out that after the end of the trading day, there are no connected users anymore, but objects remain in memory. Over time, the objects in com.refinitiv.eta.valueadd.reactor.ReactorFactory will increase in size and occupy > 1Gb of heap, which will eventually lead to an Out of memory error for the application.

The problem is reproducible in the latest version rtsdk.version = 3.8.2.0 as well.

[ViktorYelizarov]

@xanddol Thank you for bringing this issue to our attention! We created an internal Jira to investigate it.