Using kafka Library in my environment.I am reading the kafka messages and inserting into DB. Here our environment receives error message from kafka library
Inserting more than 1 lakh of kafka records into mysql.
I am getting OOM error from kafka library
Error Details
Fetch reconnect due to Exception Message: Exception of type 'System.OutOfMemoryException' was thrown.
Source: KafkaNET.Library
Stack Trace:
at Kafka.Client.Responses.FetchResponse.Parser.ParseFrom(KafkaBinaryReader reader)
at Kafka.Client.KafkaConnection.HandleT
at Kafka.Client.KafkaConnection.Send(FetchRequest request)
at Kafka.Client.Consumers.Consumer.Fetch(FetchRequest request)
Full Stack of exception: at Kafka.Client.Responses.FetchResponse.Parser.ParseFrom(KafkaBinaryReader reader)
This Kafka library is perfectly working in Dev Environment where number of records is less.When i deploy it in Production environment I am facing this OOM error issues.
Using kafka Library in my environment.I am reading the kafka messages and inserting into DB. Here our environment receives error message from kafka library Inserting more than 1 lakh of kafka records into mysql. I am getting OOM error from kafka library
Error Details
Fetch reconnect due to Exception Message: Exception of type 'System.OutOfMemoryException' was thrown. Source: KafkaNET.Library Stack Trace: at Kafka.Client.Responses.FetchResponse.Parser.ParseFrom(KafkaBinaryReader reader) at Kafka.Client.KafkaConnection.HandleT at Kafka.Client.KafkaConnection.Send(FetchRequest request)
at Kafka.Client.Consumers.Consumer.Fetch(FetchRequest request)
OOM Error. Data values were: size: 1668048194, correlationId: 1635021925, dataCound: 1920553071.
Full Stack of exception: at Kafka.Client.Responses.FetchResponse.Parser.ParseFrom(KafkaBinaryReader reader)
This Kafka library is perfectly working in Dev Environment where number of records is less.When i deploy it in Production environment I am facing this OOM error issues.