grafana / grafana-app-sdk

An SDK for developing apps for grafana using kubernetes-like storage and operators
Apache License 2.0
44 stars 8 forks source link

Improve Informer Memory Performance #263

Closed IfSentient closed 1 month ago

IfSentient commented 4 months ago

Currently, memory usage by an informer scales linearly with total objects, as watched objects are stored in an in-memory cache for use in determining changes. To improve the performance and resource usage of informers for large volumes of objects, we should allow caching to be pushed to an external source (such as memcached or redis), or allow for no caching at all (most useful with the reconciler pattern, which does not receive prior state information).