search

cloudfoundry / cf-k8s-logging

Apache License 2.0
5 stars 11 forks source link

Log Cache should allow operators to set a fixed memory limit #36

Closed KesavanKing closed 4 years ago

KesavanKing commented 4 years ago

We did a scalability tests on cf-for-k8s version 0.6.0. We were succeeded in deploying 1600 apps. To simulate real workload scenario we deploy apps which generate 1 log/sec and 1 req/sec. During the tests we could observe log-cache consumes > 10Gi of memory . We tried by scaling to two replicas, even with that it memory spikes up.

Below graph show you the number of apps deployed vs log-cache memory.

image

Just a note: Fluentd was consuming an average of 2.5Gi

cf-gitbot commented 4 years ago

We have created an issue in Pivotal Tracker to manage this. Unfortunately, the Pivotal Tracker project is private so you may be unable to view the contents of the story.

The labels on this github issue will be updated when the story is started.

pianohacker commented 4 years ago

This should be fixed in version 0.5.0.