search

iter8-tools / iter8

Kubernetes release optimizer
https://iter8.tools
Apache License 2.0
252 stars 34 forks source link

Enable horizontal scaling of metrics collection #1648

Closed kalantar closed 7 months ago

kalantar commented 8 months ago

The basic implementation used today to record metrics (A/B/n and performance) is an in memory key-value store implemented by badgerdb. This implementation should be replaced with a persistent data store that scales horizontally. There is not need that it be a key-value store. Another form of database is possible. The requirements are multiple writers with high write throughput. Multiple readers with low read throughput (once per 30 seconds by grafana per test).

Related to https://github.com/iter8-tools/iter8/issues/1480

kalantar commented 7 months ago

Support for Redis added by https://github.com/iter8-tools/iter8/pull/1653