search

keycloak / keycloak-benchmark

Keycloak Benchmark
https://www.keycloak.org/keycloak-benchmark/
Apache License 2.0
130 stars 72 forks source link

[SPIKE] Chaos testing tool #377

Open kami619 opened 1 year ago

kami619 commented 1 year ago
ahus1 commented 1 year ago

Adding krkn to the list: https://github.com/redhat-chaos/krkn

Even if it might not support as many chaos modes as other tools, it shines with OpenShift support in its README

ahus1 commented 1 year ago

Adding chaos-mesh to the list: https://chaos-mesh.org/

It seems to have more chaos modes then krkn. It is also a CNCF project, but we'll need to see how it supports OpenShift. Looking at the docs, it seems to have a dashboard.

ahus1 commented 1 year ago

Adding lithmuschaos to the list: https://litmuschaos.io/

There is a self-hosted version available. Seems to have several component that need to be installed via helm. Might be more complex than others, but also more powerful. And yes, there is a dashboard.

kami619 commented 12 months ago

In the meantime, krkn framework seems to have gain a cool utility to analyze and recommend chaos test cases from a k8s cluster - https://github.com/redhat-chaos/krkn/tree/main/utils/chaos_recommender#how-it-works

After obtaining telemetry data, sourced either locally or from Prometheus, the tool conducts a comprehensive data analysis to detect anomalies. Employing the Z-score method and heatmaps, it identifies outliers by evaluating CPU, memory, and network usage against established limits. Services with Z-scores surpassing a specified threshold are categorized as outliers. This categorization classifies services as network, CPU, or memory-sensitive, consequently leading to the recommendation of relevant test cases.

This might be a good starting point for this spike. Also Litmus Chaos would be at KubeCon Chicago, so hopefully we will get first hand insights on where we can use it.