Litmus is a toolset to do chaos engineering in a kubernetes native way. Litmus provides chaos CRDs for Cloud-Native developers and SREs to inject, orchestrate and monitor chaos to find weaknesses in Kubernetes deployments. Community notes is at https://hackmd.io/a4Zu_sH4TZGeih-xCimi3Q
What happened:
I'm just trying to run a vanilla k8sProbe. I've done the simplest tests possible (checking for the presence/absence of a pod etc.), as well as just tried the "create" k8sProbe from the example docs. Please see error logs & yaml logs below:
ime="2023-04-06T16:06:31Z" level=info msg="[Status]: The Container status are as follows" Readiness=true container=small-interactive-ads Pod=small-interactive-ads-1
time="2023-04-06T16:06:33Z" level=info msg="[Status]: Checking whether application pods are in running state"
time="2023-04-06T16:06:33Z" level=info msg="[Status]: The status of Pods are as follows" Status=Running Pod=small-interactive-ads-1
time="2023-04-06T16:06:37Z" level=info msg="[Info]: The chaos tunables are:" CPU Core=0 CPU Load Percentage=10 Sequence=parallel PodsAffectedPerc=100
time="2023-04-06T16:06:37Z" level=info msg="[Chaos]:Number of pods targeted: 1"
time="2023-04-06T16:06:37Z" level=info msg="Target pods list for chaos, [small-interactive-ads-1]"
time="2023-04-06T16:06:39Z" level=info msg="[Probe]: The k8s probe information is as follows" Mode=OnChaos Phase=DuringChaos Name=small-interactive-ads-1 Inputs="{ v1 small-interactive-ads-1 scenario-ns present}" Run Properties="{5 5 10 0 0 0 false}"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: the server could not find the requested resource"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: {\"errorCode\":\"K8S_PROBE_ERROR\",\"reason\":\"unable to list the resources with matching selector, err: the server could not find the requested resource\",\"target\":\"{name: small-interactive-ads-1}\"}"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: the server could not find the requested resource"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: {\"errorCode\":\"K8S_PROBE_ERROR\",\"reason\":\"unable to list the resources with matching selector, err: the server could not find the requested resource\",\"target\":\"{name: small-interactive-ads-1}\"}"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: the server could not find the requested resource"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: {\"errorCode\":\"K8S_PROBE_ERROR\",\"reason\":\"unable to list the resources with matching selector, err: the server could not find the requested resource\",\"target\":\"{name: small-interactive-ads-1}\"}"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: the server could not find the requested resource"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: {\"errorCode\":\"K8S_PROBE_ERROR\",\"reason\":\"unable to list the resources with matching selector, err: the server could not find the requested resource\",\"target\":\"{name: small-interactive-ads-1}\"}"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: the server could not find the requested resource"
time="2023-04-06T16:06:39Z" level=error msg="the small-interactive-ads-1 k8s probe has Failed, err: {\"errorCode\":\"K8S_PROBE_ERROR\",\"reason\":\"unable to list the resources with matching selector, err: the server could not find the requested resource\",\"target\":\"{name: small-interactive-ads-1}\"}"
What you expected to happen:
I just want to get a k8sProbe working without failure. As from the logs, the chaosengine is able to correctly see the small-interactive-ads-1 pod from the logs below. But then, the k8sProbe within the chaosengine is unable to recognize the same pod.
time="2023-04-06T16:06:33Z" level=info msg="[Status]: The status of Pods are as follows" Status=Running Pod=small-interactive-ads-1
time="2023-04-06T16:06:37Z" level=info msg="[Info]: The chaos tunables are:" CPU Core=0 CPU Load Percentage=10 Sequence=parallel PodsAffectedPerc=100
time="2023-04-06T16:06:37Z" level=info msg="[Chaos]:Number of pods targeted: 1"
time="2023-04-06T16:06:37Z" level=info msg="Target pods list for chaos, [small-interactive-ads-1]"
Where can this issue be corrected? (optional)
How to reproduce it (as minimally and precisely as possible):
Run above chaos engine (but entire litmus setup will change the actual scenario).
What happened: I'm just trying to run a vanilla k8sProbe. I've done the simplest tests possible (checking for the presence/absence of a pod etc.), as well as just tried the "create" k8sProbe from the example docs. Please see error logs & yaml logs below:
CHAOSENGINE TEMPLATE
ERROR LOGS
What you expected to happen:
I just want to get a k8sProbe working without failure. As from the logs, the chaosengine is able to correctly see the small-interactive-ads-1 pod from the logs below. But then, the k8sProbe within the chaosengine is unable to recognize the same pod.
Where can this issue be corrected? (optional)
How to reproduce it (as minimally and precisely as possible): Run above chaos engine (but entire litmus setup will change the actual scenario).
Anything else we need to know?: