search

SumoLogic / sumologic-kubernetes-collection

Sumo Logic collection solution for Kubernetes
Apache License 2.0
147 stars 184 forks source link

Several OOMs for OTC #2210

Open sumo-drosiek opened 2 years ago

sumo-drosiek commented 2 years ago

Describe the bug

OTC easily gets OOM for high values of batch_size and num_consumers. When all consumers are working, OTC keeps in memory a lot of space which is multiplication of those values, number of exporters and some data processing ratio.

This is an issue especially when for some reason OTC was unable to send data to Sumo. This implicates putting data into queue and involves all of OTC consumers.

This is more like misconfiguration than bug and as the result of the issue, the documentation should be updated

sumo-drosiek commented 2 years ago

In order to figure out the optimal values, adding metrics to OTC is required: https://github.com/SumoLogic/sumologic-otel-collector/pull/495