reactor / reactor-kafka

Reactive Kafka Driver with Reactor
http://projectreactor.io
613 stars 229 forks source link

Kafka Consumer memory Leak #339

Open jilsonjoseph opened 1 year ago

jilsonjoseph commented 1 year ago

I get a memory leak when my consumers work on dev enviroments, without any load

Expected Behavior memory not leak

Actual Behavior memory leak

Steps to reproduce Our Consumer creation code is below

        .createReceiveRecord(
            new TypeReference<OrderEventRetryDTO>() {
            },
            kafkaConsumerConfigProperties)
        .doOnNext(this::process)
        .onErrorContinue(this::onError)
        .doOnError(exception ->
            log.error(String.format(
                "Exception while consuming message on topic=%s with error = ", topic), exception))
        .subscribe();

In dynatrace we are seeing this below.

Screenshot 2023-04-19 at 1 09 45 PM

Our Environment Java version: 17 Reactor version(s) used: io.projectreactor.kafka:reactor-kafka: 1.3.8

garyrussell commented 1 year ago

Have you looked at the heap to see what the leak consists of?