search

resmoio / kubernetes-event-exporter

Export Kubernetes events to multiple destinations with routing and filtering
Apache License 2.0
789 stars 158 forks source link

Issue regarding CPU utilization and events discard. #118

Open punnujaat opened 1 year ago

punnujaat commented 1 year ago

I am using the latest version 1.3 and I have tuned the KubeQPS, kubethrottle and maxEventAgeSeconds as well but stiil facing these following issues .

  1. KEE pods still discarding the logs because of the events age is more than the threshold.
  2. I am seeing a lot of lag in the opensearch while pushing the events.
  3. My pods are scaling consistently, HPA is hitting the maximum limits even though the events are not coming. Seems like the older processes are not getting terminated.

My resources requests and limits.

        resources:
          limits:
            cpu: "2"
            memory: 1536Mi
          requests:
            cpu: 1500m
            memory: 1Gi
punnujaat commented 1 year ago
Screenshot 2023-08-04 at 10 50 51 PM Screenshot 2023-08-04 at 10 50 59 PM
mustafaakin commented 1 year ago

What's the sink? I'm working on buffering of events which would address many issues.

punnujaat commented 1 year ago

@mustafaakin Opensearch is the sink.

yantsa commented 1 year ago

facing the same issue with stdout sink .