yodatak
commented
1 year ago It can be
| gitjob-56744895c-f2b6j | cattle-fleet-system | rancher/gitjob:v0.1.54 | 1/1 | 11 (3m17s ago) | IP | XXXX | 6 days |
|---|
Closed yodatak closed 1 year ago
yodatak
commented
1 year ago It can be
| gitjob-56744895c-f2b6j | cattle-fleet-system | rancher/gitjob:v0.1.54 | 1/1 | 11 (3m17s ago) | IP | XXXX | 6 days |
|---|
yodatak
commented
1 year ago Jul 10 18:28:44 XXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3120126633.mount: Succeeded. Jul 10 18:28:44 XXXX systemd[1]: Started libcontainer container cab33eb8a19e31dde6ffdc5a74cac1e081e780aee3d66fb1d470079a08118eb6. Jul 10 18:28:44 XXXX systemd[1]: Started Process Core Dump (PID 525903/UID 0). Jul 10 18:28:44 XXXX systemd[1]: cri-containerd-cab33eb8a19e31dde6ffdc5a74cac1e081e780aee3d66fb1d470079a08118eb6.scope: Succeeded. Jul 10 18:28:44 XXXX systemd[1]: cri-containerd-cab33eb8a19e31dde6ffdc5a74cac1e081e780aee3d66fb1d470079a08118eb6.scope: Consumed 26ms CPU time Jul 10 18:28:45 XXXX systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cab33eb8a19e31dde6ffdc5a74cac1e081e780aee3d66fb1d470079a08118eb6-rootfs.mount: Succeeded. Jul 10 18:28:45 XXXX k3s[524811]: I0710 18:28:45.683359 524811 scope.go:115] "RemoveContainer" containerID="49300778750d2f8bdd6610d502cfa93e6d147153b80bc5ce116d05e15d27f6b0" Jul 10 18:28:45 XXXX k3s[524811]: I0710 18:28:45.683688 524811 scope.go:115] "RemoveContainer" containerID="49300778750d2f8bdd6610d502cfa93e6d147153b80bc5ce116d05e15d27f6b0" Jul 10 18:28:45 XXXX k3s[524811]: E0710 18:28:45.685538 524811 remote_runtime.go:368] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to set removing state for container \"49300778750d2f8bdd6610d502cfa93e6d147153b80bc5ce116d05e15d27f6b0\": container is already in removing state" containerID="49300778750d2f8bdd6610d502cfa93e6d147153b80bc5ce116d05e15d27f6b0" Jul 10 18:28:45 XXXX k3s[524811]: E0710 18:28:45.685574 524811 kuberuntime_container.go:784] failed to remove pod init container "configure": rpc error: code = Unknown desc = failed to set removing state for container "49300778750d2f8bdd6610d502cfa93e6d147153b80bc5ce116d05e15d27f6b0": container is already in removing state; Skipping pod "gitlab-gitlab-shell-55654998fd-dtttf_gitlab(59d8d191-a0ca-4f7b-a6a2-7928b1cce453)" Jul 10 18:28:45 XXXX k3s[524811]: E0710 18:28:45.685736 524811 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"configure\" with CrashLoopBackOff: \"back-off 10s restarting failed container=configure pod=gitlab-gitlab-shell-55654998fd-dtttf_gitlab(59d8d191-a0ca-4f7b-a6a2-7928b1cce453)\"" pod="gitlab/gitlab-gitlab-shell-55654998fd-dtttf" podUID=59d8d191-a0ca-4f7b-a6a2-7928b1cce453 Jul 10 18:28:46 XXXX k3s[524811]: time="2023-07-10T18:28:46+02:00" level=info msg="Tunnel authorizer set Kubelet Port 10250" Jul 10 18:28:46 XXXX systemd-coredump[525910]: Process 525886 (ctr) of user 0 dumped core.
Stack trace of thread 525886:
#0 0x0000000000403d0e n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#1 0x000000000048faa8 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#2 0x0000000000deb107 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#3 0x0000000000deafa5 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#4 0x000000000044da66 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#5 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#6 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#7 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#8 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#9 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#10 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#11 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#12 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#13 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#14 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#15 0x00000000004404b3 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#16 0x00000000004740c1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)Jul 10 18:28:46 XXXX systemd[1]: systemd-coredump@7766-525903-0.service: Succeeded.
Jul 10 18:28:46 XXXX systemd[1]: Started Process Core Dump (PID 525960/UID 0).
Jul 10 18:28:46 XXXX k3s[524811]: I0710 18:28:46.266240 524811 trace.go:219] Trace[245988862]: "Reflector ListAndWatch" name:object-"gitlab"/"kube-root-ca.crt" (10-Jul-2023 18:28:36.111) (total time: 10154ms):
Jul 10 18:28:46 XXXX k3s[524811]: Trace[245988862]: ---"Objects listed" error:
yodatak
commented
1 year ago coredumpctl -1 debug Program terminated with signal SIGSYS, Bad system call.
[Current thread is 1 (LWP 572814)]
yodatak
commented
1 year ago How can I help you to debug this?
brandond
commented
1 year ago Can you share the actual core file? It looks like the stack dump analysis of the core file you're getting fromsystemd-coredump doesn't provide any of the info you would get from proper golang stack analysis.
If you also had the full journald log from the node around that time, that would probably also be helplful. It looks like there are a lot of weird things going on before the k3s ctr process crashes?
yodatak
commented
1 year ago Jul 27 17:02:26 XXXXXX k3s[843670]: E0727 17:02:26.552903 843670 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sidekiq\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=sidekiq pod=gitlab-sidekiq-all-in-1-v2-64d9c8578b-srr4s_gitlab(d31c6b81-8123-4cda-a32a-4c0554086646)\"" pod="gitlab/gitlab-sidekiq-all-in-1-v2-64d9c8578b-srr4s" podUID=d31c6b81-8123-4cda-a32a-4c0554086646
Jul 27 17:02:27 XXXXXX systemd[1]: run-containerd-runc-k8s.io-0f0af6486f8c40a1e2d339073fb1f7c3cf38fe522101cb9ea471b1bfd82e2620-runc.ijejga.mount: Succeeded.
Jul 27 17:02:27 XXXXXX systemd[1]: run-containerd-runc-k8s.io-0f0af6486f8c40a1e2d339073fb1f7c3cf38fe522101cb9ea471b1bfd82e2620-runc.FaEllb.mount: Succeeded.
Jul 27 17:02:28 XXXXXX systemd[1]: run-containerd-runc-k8s.io-df87e989d7cddf5f0d98aa46aa473dee97268fb34608747c86b916eb69b779ab-runc.BOPAme.mount: Succeeded.
Jul 27 17:02:31 XXXXXX systemd[1]: run-containerd-runc-k8s.io-2df746b8fdc9ddb9834ef527a88c272dde57cd631d0835533f5835599008d1e6-runc.dNaneP.mount: Succeeded.
Jul 27 17:02:31 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:31.952+0200","caller":"etcdserver/server.go:1395","msg":"triggering snapshot","local-member-id":"4b18f4cca0da3f43","local-member-applied-index":10831094,"local-member-snapshot-index":10821093,"local-member-snapshot-count":10000}
Jul 27 17:02:31 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:31.956+0200","caller":"etcdserver/server.go:2415","msg":"saved snapshot","snapshot-index":10831094}
Jul 27 17:02:31 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:31.956+0200","caller":"etcdserver/server.go:2445","msg":"compacted Raft logs","compact-index":10826094}
Jul 27 17:02:32 XXXXXX k3s[843670]: I0727 17:02:32.554458 843670 scope.go:115] "RemoveContainer" containerID="157354962da3f6eae262aa592b66d51b00a80a9c79e794bb6a7da37850f5610e"
Jul 27 17:02:32 XXXXXX systemd[1]: tmp-ctd\x2dvolume1775380269.mount: Succeeded.
Jul 27 17:02:32 XXXXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2350865009.mount: Succeeded.
Jul 27 17:02:32 XXXXXX systemd[1]: Started libcontainer container 3833b867af7ee4512b70780b43efadc82e7bfa93e0a918c256102f61e7a51ea4.
Jul 27 17:02:32 XXXXXX systemd[1]: Started Process Core Dump (PID 1104579/UID 0).
Jul 27 17:02:33 XXXXXX systemd-coredump[1104589]: Process 1104555 (ctr) of user 0 dumped core.
Stack trace of thread 1104555:
#0 0x0000000000403d0e n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#1 0x000000000048faa8 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#2 0x0000000000deb107 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#3 0x0000000000deafa5 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#4 0x000000000044da66 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#5 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#6 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#7 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#8 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#9 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#10 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#11 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#12 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#13 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#14 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#15 0x00000000004404b3 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#16 0x00000000004740c1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
Jul 27 17:02:33 XXXXXX systemd[1]: systemd-coredump@1906-1104579-0.service: Succeeded.
Jul 27 17:02:33 XXXXXX systemd[1]: Started Process Core Dump (PID 1104749/UID 0).
Jul 27 17:02:33 XXXXXX systemd[1]: run-containerd-runc-k8s.io-8f882a96b230ef929817d1405f97edef0be4e4498276abb2053f0bbb3e9803d5-runc.aioACn.mount: Succeeded.
Jul 27 17:02:34 XXXXXX systemd-coredump[1104750]: Process 1104735 (ctr) of user 0 dumped core.
Stack trace of thread 1104735:
#0 0x0000000000403d0e n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#1 0x000000000048faa8 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#2 0x0000000000deb107 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#3 0x0000000000deafa5 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#4 0x000000000044da66 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#5 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#6 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#7 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#8 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#9 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#10 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#11 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#12 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#13 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#14 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#15 0x00000000004404b3 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#16 0x00000000004740c1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
Jul 27 17:02:34 XXXXXX systemd[1]: systemd-coredump@1907-1104749-0.service: Succeeded.
Jul 27 17:02:35 XXXXXX systemd[1]: run-containerd-runc-k8s.io-16606a30696561a8844f802d6fd27f1dca850ce5af3e246e4fbf6c8c0a7c8b71-runc.ApaFCJ.mount: Succeeded.
Jul 27 17:02:35 XXXXXX systemd[1]: run-containerd-runc-k8s.io-f0354d9db3f4a242a4d087bce84b6fd26d9559b0f27af731e7c6a0d340b97bf9-runc.hbkkMa.mount: Succeeded.
Jul 27 17:02:35 XXXXXX systemd[1]: run-containerd-runc-k8s.io-f0354d9db3f4a242a4d087bce84b6fd26d9559b0f27af731e7c6a0d340b97bf9-runc.CGcjdb.mount: Succeeded.
Jul 27 17:02:37 XXXXXX k3s[843670]: I0727 17:02:37.552277 843670 scope.go:115] "RemoveContainer" containerID="daee35596f04f9241d683fa506967f5fe1d46943bd3a439f05c7407c686d56f1"
Jul 27 17:02:37 XXXXXX k3s[843670]: E0727 17:02:37.553046 843670 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"sidekiq\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=sidekiq pod=gitlab-sidekiq-all-in-1-v2-64d9c8578b-srr4s_gitlab(d31c6b81-8123-4cda-a32a-4c0554086646)\"" pod="gitlab/gitlab-sidekiq-all-in-1-v2-64d9c8578b-srr4s" podUID=d31c6b81-8123-4cda-a32a-4c0554086646
Jul 27 17:02:38 XXXXXX k3s[843670]: I0727 17:02:38.049138 843670 event.go:294] "Event occurred" object="gitlab/gitlab-webservice-default" fieldPath="" kind="HorizontalPodAutoscaler" apiVersion="autoscaling/v2" type="Warning" reason="FailedGetResourceMetric" message="failed to get cpu usage: unable to get metrics for resource cpu: no metrics returned from resource metrics API"
Jul 27 17:02:38 XXXXXX k3s[843670]: E0727 17:02:38.052805 843670 horizontal.go:254] failed to compute desired number of replicas based on listed metrics for Deployment/gitlab/gitlab-webservice-default: invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu usage: unable to get metrics for resource cpu: no metrics returned from resource metrics API
Jul 27 17:02:38 XXXXXX k3s[843670]: I0727 17:02:38.052862 843670 event.go:294] "Event occurred" object="gitlab/gitlab-webservice-default" fieldPath="" kind="HorizontalPodAutoscaler" apiVersion="autoscaling/v2" type="Warning" reason="FailedComputeMetricsReplicas" message="invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu usage: unable to get metrics for resource cpu: no metrics returned from resource metrics API"
Jul 27 17:02:38 XXXXXX k3s[843670]: E0727 17:02:38.144412 843670 horizontal.go:254] failed to compute desired number of replicas based on listed metrics for Deployment/gitlab/gitlab-sidekiq-all-in-1-v2: invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu usage: unable to get metrics for resource cpu: no metrics returned from resource metrics API
Jul 27 17:02:38 XXXXXX k3s[843670]: I0727 17:02:38.144600 843670 event.go:294] "Event occurred" object="gitlab/gitlab-sidekiq-all-in-1-v2" fieldPath="" kind="HorizontalPodAutoscaler" apiVersion="autoscaling/v2" type="Warning" reason="FailedGetResourceMetric" message="failed to get cpu usage: unable to get metrics for resource cpu: no metrics returned from resource metrics API"
Jul 27 17:02:38 XXXXXX k3s[843670]: I0727 17:02:38.144620 843670 event.go:294] "Event occurred" object="gitlab/gitlab-sidekiq-all-in-1-v2" fieldPath="" kind="HorizontalPodAutoscaler" apiVersion="autoscaling/v2" type="Warning" reason="FailedComputeMetricsReplicas" message="invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu usage: unable to get metrics for resource cpu: no metrics returned from resource metrics API"
Jul 27 17:02:38 XXXXXX systemd[1]: run-containerd-runc-k8s.io-555aa0cd3ffdeaef342c311b51ee957a54d93f29f86a5a1a58810ac9836303fd-runc.hCflbn.mount: Succeeded.
Jul 27 17:02:39 XXXXXX systemd[1]: run-containerd-runc-k8s.io-555aa0cd3ffdeaef342c311b51ee957a54d93f29f86a5a1a58810ac9836303fd-runc.LEJldo.mount: Succeeded.
Jul 27 17:02:40 XXXXXX systemd[1]: cri-containerd-3833b867af7ee4512b70780b43efadc82e7bfa93e0a918c256102f61e7a51ea4.scope: Succeeded.
Jul 27 17:02:40 XXXXXX systemd[1]: cri-containerd-3833b867af7ee4512b70780b43efadc82e7bfa93e0a918c256102f61e7a51ea4.scope: Consumed 7.177s CPU time
Jul 27 17:02:40 XXXXXX systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3833b867af7ee4512b70780b43efadc82e7bfa93e0a918c256102f61e7a51ea4-rootfs.mount: Succeeded.
Jul 27 17:02:41 XXXXXX k3s[843670]: I0727 17:02:41.159629 843670 scope.go:115] "RemoveContainer" containerID="157354962da3f6eae262aa592b66d51b00a80a9c79e794bb6a7da37850f5610e"
Jul 27 17:02:41 XXXXXX k3s[843670]: I0727 17:02:41.160062 843670 scope.go:115] "RemoveContainer" containerID="3833b867af7ee4512b70780b43efadc82e7bfa93e0a918c256102f61e7a51ea4"
Jul 27 17:02:41 XXXXXX k3s[843670]: E0727 17:02:41.160612 843670 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"webservice\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=webservice pod=gitlab-webservice-default-6d6d9ffc65-8srzb_gitlab(675ee0c8-ca80-4f2f-87fa-ef510f492473)\"" pod="gitlab/gitlab-webservice-default-6d6d9ffc65-8srzb" podUID=675ee0c8-ca80-4f2f-87fa-ef510f492473
Jul 27 17:02:41 XXXXXX systemd[1]: run-containerd-runc-k8s.io-2df746b8fdc9ddb9834ef527a88c272dde57cd631d0835533f5835599008d1e6-runc.hLKpFb.mount: Succeeded.
Jul 27 17:02:41 XXXXXX systemd[1]: run-containerd-runc-k8s.io-2df746b8fdc9ddb9834ef527a88c272dde57cd631d0835533f5835599008d1e6-runc.mBFnLc.mount: Succeeded.
Jul 27 17:02:42 XXXXXX k3s[843670]: I0727 17:02:42.166497 843670 scope.go:115] "RemoveContainer" containerID="3833b867af7ee4512b70780b43efadc82e7bfa93e0a918c256102f61e7a51ea4"
Jul 27 17:02:42 XXXXXX k3s[843670]: E0727 17:02:42.167262 843670 pod_workers.go:965] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"webservice\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=webservice pod=gitlab-webservice-default-6d6d9ffc65-8srzb_gitlab(675ee0c8-ca80-4f2f-87fa-ef510f492473)\"" pod="gitlab/gitlab-webservice-default-6d6d9ffc65-8srzb" podUID=675ee0c8-ca80-4f2f-87fa-ef510f492473
Jul 27 17:02:42 XXXXXX systemd[1]: run-containerd-runc-k8s.io-658d7ac2c30279eaa7f11ff5b463a38aecc3bdb5ab9c513455eb6fb7fe22850b-runc.OAbdAj.mount: Succeeded.
Jul 27 17:02:42 XXXXXX systemd[1]: run-containerd-runc-k8s.io-ce65baf6d8bcc4d6403239bb9e3efb14ddbfbb24fd67dabc06197d7bc0afef7a-runc.jLbNJc.mount: Succeeded.
Jul 27 17:02:43 XXXXXX systemd[1]: run-containerd-runc-k8s.io-cf71d13ca805f6b18d42474fc72766255bff0a04846b6edcc4f47d401d24cfdc-runc.llChGj.mount: Succeeded.
Jul 27 17:02:44 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:44.520+0200","caller":"fileutil/purge.go:85","msg":"purged","path":"/var/lib/rancher/k3s/server/db/etcd/member/snap/0000000000000016-0000000000a481a1.snap"}
Jul 27 17:02:44 XXXXXX systemd[1]: run-containerd-runc-k8s.io-99fd79611c0824dbb58cd738f5b293588b6e902aa7038d2e078eaef0b1a46821-runc.FCnDgm.mount: Succeeded.
Jul 27 17:02:45 XXXXXX systemd[1]: run-containerd-runc-k8s.io-16606a30696561a8844f802d6fd27f1dca850ce5af3e246e4fbf6c8c0a7c8b71-runc.ncBoOK.mount: Succeeded.
Jul 27 17:02:45 XXXXXX systemd[1]: run-containerd-runc-k8s.io-16606a30696561a8844f802d6fd27f1dca850ce5af3e246e4fbf6c8c0a7c8b71-runc.DCDOAM.mount: Succeeded.
Jul 27 17:02:47 XXXXXX systemd[1]: run-containerd-runc-k8s.io-0f0af6486f8c40a1e2d339073fb1f7c3cf38fe522101cb9ea471b1bfd82e2620-runc.OecGbd.mount: Succeeded.
Jul 27 17:02:48 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:48.273+0200","caller":"mvcc/index.go:214","msg":"compact tree index","revision":199457758}
Jul 27 17:02:48 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:48.358+0200","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":199457758,"took":"83.830071ms","hash":2231067822}
Jul 27 17:02:48 XXXXXX k3s[843670]: {"level":"info","ts":"2023-07-27T17:02:48.358+0200","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2231067822,"revision":199457758,"compact-revision":199454718}
Jul 27 17:02:48 XXXXXX k3s[843670]: I0727 17:02:48.553236 843670 scope.go:115] "RemoveContainer" containerID="daee35596f04f9241d683fa506967f5fe1d46943bd3a439f05c7407c686d56f1"
Jul 27 17:02:48 XXXXXX systemd[1]: tmp-ctd\x2dvolume2795884564.mount: Succeeded.
Jul 27 17:02:48 XXXXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1615266082.mount: Succeeded.
Jul 27 17:02:48 XXXXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1999425302.mount: Succeeded.
Jul 27 17:02:48 XXXXXX systemd[1]: Started libcontainer container e1325afb77ef4a47066e19aee3e5291dc9964acd0c32ac9dc867254c0dec6330.
Jul 27 17:02:48 XXXXXX systemd[1]: Started Process Core Dump (PID 1105818/UID 0).
Jul 27 17:02:49 XXXXXX systemd-coredump[1105819]: Process 1105797 (ctr) of user 0 dumped core.
Stack trace of thread 1105797:
#0 0x0000000000403d0e n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#1 0x000000000048faa8 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#2 0x0000000000deb107 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#3 0x0000000000deafa5 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#4 0x000000000044da66 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#5 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#6 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#7 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#8 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#9 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#10 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#11 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#12 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#13 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#14 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#15 0x00000000004404b3 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#16 0x00000000004740c1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
Jul 27 17:02:49 XXXXXX systemd[1]: systemd-coredump@1908-1105818-0.service: Succeeded.
Jul 27 17:02:49 XXXXXX systemd[1]: Started Process Core Dump (PID 1105932/UID 0).
Jul 27 17:02:50 XXXXXX systemd-coredump[1105933]: Process 1105919 (ctr) of user 0 dumped core.
Stack trace of thread 1105919:
#0 0x0000000000403d0e n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#1 0x000000000048faa8 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#2 0x0000000000deb107 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#3 0x0000000000deafa5 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#4 0x000000000044da66 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#5 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#6 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#7 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#8 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#9 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#10 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#11 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#12 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#13 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#14 0x000000000044d9b1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#15 0x00000000004404b3 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
#16 0x00000000004740c1 n/a (/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s)
Jul 27 17:02:50 XXXXXX systemd[1]: systemd-coredump@1909-1105932-0.service: Succeeded.audit.log
type=SECCOMP msg=audit(1690470469.641:19112): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:container_runtime_t:s0 pid=1126182 comm="ctr" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s" sig=31 arch=c000003e syscall=72 compat=0 ip=0x403d0e code=0x80000000AUID="unset" UID="root" GID="root" ARCH=x86_64 SYSCALL=fcntl
type=ANOM_ABEND msg=audit(1690470469.641:19113): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:container_runtime_t:s0 pid=1126182 comm="ctr" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s" sig=31 res=1AUID="unset" UID="root" GID="root"
type=SERVICE_START msg=audit(1690470469.662:19114): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-coredump@1914-1126198-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'UID="root" AUID="unset"
type=BPF msg=audit(1690470469.699:19115): prog-id=2562 op=LOAD
type=SYSCALL msg=audit(1690470469.699:19115): arch=c000003e syscall=321 success=yes exit=16 a0=5 a1=c00018d7f8 a2=78 a3=0 items=0 ppid=1071521 pid=1126181 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="runc" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/runc" subj=system_u:system_r:container_runtime_t:s0 key=(null)ARCH=x86_64 SYSCALL=bpf AUID="unset" UID="root" GID="root" EUID="root" SUID="root" FSUID="root" EGID="root" SGID="root" FSGID="root"
type=PROCTITLE msg=audit(1690470469.699:19115): proctitle=72756E63002D2D726F6F74002F72756E2F636F6E7461696E6572642F72756E632F6B38732E696F002D2D6C6F67002F72756E2F6B33732F636F6E7461696E6572642F696F2E636F6E7461696E6572642E72756E74696D652E76322E7461736B2F6B38732E696F2F33353164353331373239396531323930623461376639336563
type=BPF msg=audit(1690470469.700:19116): prog-id=2563 op=LOAD
type=SYSCALL msg=audit(1690470469.700:19116): arch=c000003e syscall=321 success=yes exit=18 a0=5 a1=c00018d590 a2=78 a3=0 items=0 ppid=1071521 pid=1126181 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="runc" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/runc" subj=system_u:system_r:container_runtime_t:s0 key=(null)ARCH=x86_64 SYSCALL=bpf AUID="unset" UID="root" GID="root" EUID="root" SUID="root" FSUID="root" EGID="root" SGID="root" FSGID="root"
type=PROCTITLE msg=audit(1690470469.700:19116): proctitle=72756E63002D2D726F6F74002F72756E2F636F6E7461696E6572642F72756E632F6B38732E696F002D2D6C6F67002F72756E2F6B33732F636F6E7461696E6572642F696F2E636F6E7461696E6572642E72756E74696D652E76322E7461736B2F6B38732E696F2F33353164353331373239396531323930623461376639336563
type=BPF msg=audit(1690470469.700:19117): prog-id=2563 op=UNLOAD
type=BPF msg=audit(1690470469.700:19118): prog-id=2562 op=UNLOAD
type=BPF msg=audit(1690470469.700:19119): prog-id=2564 op=LOAD
type=SYSCALL msg=audit(1690470469.700:19119): arch=c000003e syscall=321 success=yes exit=16 a0=5 a1=c00018da50 a2=78 a3=0 items=0 ppid=1071521 pid=1126181 auid=4294967295 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=4294967295 comm="runc" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/runc" subj=system_u:system_r:container_runtime_t:s0 key=(null)ARCH=x86_64 SYSCALL=bpf AUID="unset" UID="root" GID="root" EUID="root" SUID="root" FSUID="root" EGID="root" SGID="root" FSGID="root"
type=PROCTITLE msg=audit(1690470469.700:19119): proctitle=72756E63002D2D726F6F74002F72756E2F636F6E7461696E6572642F72756E632F6B38732E696F002D2D6C6F67002F72756E2F6B33732F636F6E7461696E6572642F696F2E636F6E7461696E6572642E72756E74696D652E76322E7461736B2F6B38732E696F2F33353164353331373239396531323930623461376639336563
type=SERVICE_STOP msg=audit(1690470470.290:19120): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-coredump@1914-1126198-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'UID="root" AUID="unset"
type=SECCOMP msg=audit(1690470470.305:19121): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:container_runtime_t:s0 pid=1126232 comm="ctr" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s" sig=31 arch=c000003e syscall=72 compat=0 ip=0x403d0e code=0x80000000AUID="unset" UID="root" GID="root" ARCH=x86_64 SYSCALL=fcntl
type=ANOM_ABEND msg=audit(1690470470.305:19122): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:container_runtime_t:s0 pid=1126232 comm="ctr" exe="/var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s" sig=31 res=1AUID="unset" UID="root" GID="root"
type=SERVICE_START msg=audit(1690470470.316:19123): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-coredump@1915-1126246-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'UID="root" AUID="unset"
type=SERVICE_STOP msg=audit(1690470471.039:19124): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-coredump@1915-1126246-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'UID="root" AUID="unset"Maybe some secomp problem with the SYSCALL=fcntl https://github.com/golang/go/issues/36211
yodatak
commented
1 year ago some coredumps k3sdebug.zip
yodatak
commented
1 year ago Maybe its CrowdStrike
==> /var/log/falcon-libbpf.log <==
libbpf: prog 'iter_task_rundown': insn #94 relocated, imm 1464 points to subprog 'rb_get_seqno' (now at 1559 offset)
libbpf: prog 'iter_task_rundown': added 12 insns from sub-prog 'rb_get_process_ringbuf'
libbpf: prog 'iter_task_rundown': insn #97 relocated, imm 1466 points to subprog 'rb_get_process_ringbuf' (now at 1564 offset)
libbpf: prog 'iter_task_rundown': insn #132 relocated, imm 95 points to subprog 'send_error' (now at 228 offset)
libbpf: prog 'handle_sysenter_unshare_kprobe': skipped loading
libbpf: prog 'handle_sysexit_unshare_kretprobe': skipped loading
libbpf: prog 'handle_sysenter_setns_kprobe': skipped loading
libbpf: prog 'handle_sysexit_setns_kretprobe': skipped loading
libbpf: prog 'security_bprm_check_kprobe': skipped loading
libbpf: prog 'security_sb_free_kprobe': skipped loading
some more error with perf trace -G k3s.service
This part seem interesting:
6231.564 ( 0.001 ms): :1294013/1294013 seccomp(flags: TSYNC) = -1 EINVAL (Invalid argument)
6231.565 ( 0.003 ms): :1294013/1294013 seccomp(op: FILTER, flags: TSYNC) = -1 EFAULT (Bad address)
6231.570 ( 0.002 ms): :1294013/1294013 seccomp(op: FILTER, flags: 0x2) = -1 EFAULT (Bad address)
6231.572 ( 0.001 ms): :1294013/1294013 seccomp(op: 0x2, uargs: 0x7ffdc8847bec) = 0
6231.574 ( 0.001 ms): :1294013/1294013 seccomp(op: 0x2, uargs: 0x7ffdc8847bec) = 0
6231.575 ( 0.001 ms): :1294013/1294013 seccomp(op: FILTER, flags: 0x4) = -1 EFAULT (Bad address)
6231.578 ( 0.001 ms): :1294013/1294013 seccomp(op: FILTER, flags: 0x8) = -1 EINVAL (Invalid argument)
6230.603 ( 1.253 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6231.849 ( ): :1294013/1294013 futex(uaddr: 0xc80188, op: WAIT|PRIVATE_FLAG, utime: 0x7ffdc8847b78) ...
? ( ): :1294017/1294017 ... [continued]: clone()) = 0
6231.859 ( ): :1294014/1294014 futex(uaddr: 0xc80198, op: WAIT|PRIVATE_FLAG, utime: 0x7f0ce74cdd28) ...
epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 15, event: 0xc040bd1acc) = -1 EPERM (Operation not permitted)
168.892 ( 0.001 ms): gitlab-logger/1128217 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 11, event: 0xc00006c9b4) = -1 EPERM (Operation not permitted)
177.590 ( 0.004 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 ENOENT (No such file or directory)
177.596 ( 0.001 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.598 ( 0.001 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.601 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.603 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.606 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.608 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.611 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.614 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.617 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.620 ( 0.002 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 EINVAL (Invalid argument)
177.623 ( 0.003 ms): jf-access-task/2649455 readlink(path: 0x178fbfc0, buf: 0x7fd3178fbb60, bufsiz: 1023) = -1 ENOENT (No such file or directory)
6212.754 ( 0.001 ms): iptables/1294004 read(fd: 4, buf: 0x7ffdecf40da0, count: 32) = 32
6212.756 ( 0.002 ms): iptables/1294004 mmap(len: 2225000, prot: READ|EXEC, flags: PRIVATE|DENYWRITE, fd: 4) = 0x7fa9c176e000
6212.759 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c178d000, len: 2093056) = 0
6212.763 ( 0.003 ms): iptables/1294004 mmap(addr: 0x7fa9c198c000, len: 8192, prot: READ|WRITE, flags: PRIVATE|FIXED|DENYWRITE, fd: 4, off: 0x1e000) = 0x7fa9c198c000
6212.772 ( 0.003 ms): iptables/1294004 close(fd: 4) = 0
6212.781 ( 0.005 ms): iptables/1294004 openat(dfd: CWD, filename: 0xc31b85d0, flags: RDONLY|CLOEXEC) = 4
6212.787 ( 0.001 ms): iptables/1294004 read(fd: 4, buf: 0x7ffdecf411a8, count: 832) = 832
6212.789 ( 0.001 ms): iptables/1294004 lseek(fd: 4, offset: 551424, whence: SET) = 551424
6212.791 ( 0.001 ms): iptables/1294004 read(fd: 4, buf: 0x7ffdecf41080, count: 32) = 32
6212.793 ( 0.001 ms): iptables/1294004 fstat(fd: 4, statbuf: 0x7ffdecf41030) = 0
6212.795 ( 0.001 ms): iptables/1294004 lseek(fd: 4, offset: 551424, whence: SET) = 551424
6212.796 ( 0.001 ms): iptables/1294004 read(fd: 4, buf: 0x7ffdecf40d80, count: 32) = 32
LOST 11 events!
6212.798 ( 0.024 ms): iptables/1294004 mmap(len: 2694176, prot: READ|EXEC, flags: PRIVATE|DENYWRITE, fd: 4) = 4
LOST 21 events!
6212.843 ( 0.007 ms): iptables/1294004 openat(dfd: CWD, filename: 0xc31b8fc0, flags: RDONLY|CLOEXEC) = 4
LOST 10 events!
6212.843 ( 0.017 ms): iptables/1294004 ... [continued]: mprotect()) = 0
LOST 4 events!
6212.862 ( 0.011 ms): iptables/1294004 mmap(addr: 0x7fa9c12b3000, len: 8192, prot: READ|WRITE, flags: PRIVATE|FIXED|DENYWRITE, fd: 4, off: 0x1a000) = 0
LOST 3 events!
6212.862 ( 0.023 ms): iptables/1294004 ... [continued]: read()) = 832
LOST 16 events!
6212.886 ( ): iptables/1294004 lseek(fd: 4, offset: 92624, whence: SET) ...
LOST 1 events!
6212.901 ( ): iptables/1294004 close(fd: 4) ...
6212.923 ( 0.002 ms): iptables/1294004 mmap(len: 8192, prot: READ|WRITE, flags: PRIVATE|ANONYMOUS) = 0x7fa9c31b3000
LOST 2 events!
6212.987 ( 0.004 ms): iptables/1294004 mprotect(start: 0x7fa9c1d49000, len: 16384, prot: READ) = 0
6213.003 ( 0.004 ms): iptables/1294004 mprotect(start: 0x7fa9c1097000, len: 4096, prot: READ) = 0
6213.029 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c12b3000, len: 4096, prot: READ) = 0
6213.070 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c14d9000, len: 8192, prot: READ) = 0
6213.177 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c1763000, len: 16384, prot: READ) = 0
6213.185 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c2522000, len: 4096, prot: READ) = 0
6213.219 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c198c000, len: 4096, prot: READ) = 0
6213.247 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c1f9b000, len: 8192, prot: READ) = 0
6213.263 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c231e000, len: 4096, prot: READ) = 0
6213.282 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c2731000, len: 4096, prot: READ) = 0
6213.291 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c293c000, len: 4096, prot: READ) = 0
6213.299 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c2f91000, len: 4096, prot: READ) = 0
6213.320 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c2b5a000, len: 8192, prot: READ) = 0
6213.342 ( 0.002 ms): iptables/1294004 mprotect(start: 0x7fa9c2d89000, len: 12288, prot: READ) = 0
6213.388 ( 0.003 ms): iptables/1294004 mprotect(start: 0x561b5108d000, len: 12288, prot: READ) = 0
6213.394 ( 0.004 ms): iptables/1294004 mprotect(start: 0x7fa9c31c1000, len: 4096, prot: READ) = 0
6213.401 ( 0.004 ms): iptables/1294004 munmap(addr: 0x7fa9c31b9000, len: 22215) = 0
LOST 11 events!
6213.409 ( ): iptables/1294004 set_tid_address(tidptr: 0x7fa9c31b4350) ...
LOST 1 events!
6213.451 ( ): iptables/1294004 getrandom(buf: 0x7fa9c1d50060, count: 8, flags: NONBLOCK) ...
6213.474 ( 0.001 ms): iptables/1294004 brk() = 0x561b51515000
LOST 2 events!
LOST 4 events!
6213.485 ( 0.020 ms): iptables/1294004 stat(filename: 0x51515310, statbuf: 0x7ffdecf41e50) = 0
LOST 5 events!
6213.508 ( ): iptables/1294004 read(fd: 4, buf: 0x561b51515520, count: 4096) ...
6213.540 ( 0.017 ms): iptables/1294004 socket(family: NETLINK, type: RAW, protocol: 12) = 4
LOST 18 events!
6213.559 ( 0.023 ms): iptables/1294004 bind(fd: 4, umyaddr: 0x561b51515824, addrlen: 12) = 3360
LOST 11 events!
6213.616 ( 0.003 ms): iptables/1294004 mprotect(start: 0x7fa9c0e7f000, len: 4096, prot: READ) = 0
LOST 7 events!
6213.616 ( 0.037 ms): iptables/1294004 ... [continued]: sendto()) = 48
LOST 8 events!
LOST 10 events!
6213.682 ( 0.027 ms): iptables/1294004 sendto(fd: 4, buff: 0x7ffdecf409f0, len: 20, addr: 0x7fa9c2d90480, addr_len: 0xc) = 48
LOST 15 events!
6213.682 ( 0.042 ms): iptables/1294004 ... [continued]: recvmsg()) = 36
LOST 7 events!
6213.682 ( 0.062 ms): iptables/1294004 ... [continued]: recvmsg()) = 1448
LOST 15 events!
6213.753 ( ): iptables/1294004 recvmsg(fd: 4, msg: 0x7ffdecf35970) ...
6213.825 ( ): iptables/1294004 exit_group() = ?
6211.513 ( 2.437 ms): tuned/1587 ... [continued]: poll()) = 2
6213.979 ( 0.173 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8d70, flags: RDONLY|CLOEXEC) = 16
6214.154 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6214.157 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6214.163 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6214.167 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6214.183 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6214.193 ( 0.002 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80aac90, count: 8192) = 0
6214.207 ( 0.002 ms): tuned/1587 close(fd: 16) = 0
6214.220 ( 0.006 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8fd8, flags: RDONLY|CLOEXEC) = 16
6214.227 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6214.229 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6214.232 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6214.234 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
LOST 4 events!
6214.254 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6205.397 ( 8.910 ms): k3s-server/845090 ... [continued]: clone()) = 1294004 (iptables)
LOST 5 events!
6205.397 ( 8.919 ms): k3s-server/845090 ... [continued]: close()) = 0
6214.301 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
LOST 11 events!
6214.318 ( ): k3s-server/845090 read(fd: 249, buf: 0xc053447708, count: 8) ...
LOST 5 events!
6214.343 ( ): k3s-server/845090 futex(uaddr: 0xc0109b1d48, op: WAKE|PRIVATE_FLAG, val: 1) ...
LOST 6 events!
6214.361 ( 0.020 ms): k3s-server/845090 read(fd: 242, buf: 0xc0514a5400, count: 512) = 15
LOST 27 events!
6214.384 ( ): k3s-server/845090 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 15, event: 0xc053447764) ...
LOST 5 events!
? ( ): k3s-server/848316 ... [continued]: futex()) = -1 (unknown) (INTERNAL ERROR: strerror_r(512, [buf], 128)=22)
LOST 2 events!
6214.408 ( ): k3s-server/845090 rt_sigprocmask(how: SETMASK, oset: 0xc00ea82080, sigsetsize: 8) ...
6211.181 ( 3.285 ms): runc/1293997 ... [continued]: futex()) = 0
6214.462 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6214.470 ( 0.001 ms): runc/1293997 rt_sigprocmask(how: SETMASK, nset: 0xc00004af98, sigsetsize: 8) = 0
LOST 9 events!
6214.470 ( 0.011 ms): runc/1293997 ... [continued]: rt_sigprocmask()) = 0
LOST 63 events!
? ( ): runc/1294005 ... [continued]: futex()) = 0
LOST 22 events!
LOST 66 events!
6214.470 ( 0.076 ms): runc/1293997 ... [continued]: futex()) = 0
LOST 27 events!
6214.519 ( 0.038 ms): runc/1294005 rt_sigaction(sig: CONT, act: 0x7ffa4e1f7bf0, sigsetsize: 8) = 1
LOST 26 events!
6214.559 ( 0.012 ms): runc/1294005 futex(uaddr: 0xc000200148, op: WAIT|PRIVATE_FLAG) = 0
LOST 40 events!
LOST 20 events!
6214.588 ( 0.010 ms): runc/1294005 futex(uaddr: 0xc7eb88, op: WAKE|PRIVATE_FLAG, val: 1) = 1
LOST 68 events!
LOST 26 events!
6214.470 ( 0.168 ms): runc/1293997 ... [continued]: futex()) = 1
LOST 36 events!
6214.626 ( ): runc/1294005 futex(uaddr: 0xc7eb88, op: WAKE|PRIVATE_FLAG, val: 1) ...
LOST 47 events!
6214.654 ( ): runc/1293997 rt_sigprocmask(how: SETMASK, nset: 0xc00004af98, sigsetsize: 8) ...
6214.654 ( 0.021 ms): runc/1293997 ... [continued]: futex()) = 0
LOST 39 events!
6214.654 ( 0.038 ms): runc/1293997 ... [continued]: futex()) = 0
LOST 7 events!
6214.674 ( 0.037 ms): runc/1294005 futex(uaddr: 0xc000200148, op: WAIT|PRIVATE_FLAG) = 0
LOST 18 events!
6214.744 ( 0.007 ms): runc/1294005 newfstatat(dfd: CWD, filename: 0x29e0f0, statbuf: 0xc0002a8108, flag: 256) = 0
LOST 3 events!
6214.753 ( ): runc/1294005 newfstatat(dfd: CWD, filename: 0x29e120, statbuf: 0xc0002a81d8, flag: 256) ...
LOST 5 events!
6214.758 ( ): runc/1294005 newfstatat(dfd: CWD, filename: 0x29e180, statbuf: 0xc0002a8378, flag: 256) ...
6214.784 ( 0.011 ms): runc/1294005 openat2(dfd: 9, filename: 0x2b20d0, how: 0xc00010e010, usize: 24) = 14
6214.796 ( 0.001 ms): runc/1294005 fcntl(fd: 14, cmd: GETFL) = RDONLY|LARGEFILE
6214.799 ( 0.003 ms): runc/1294005 read(fd: 14, buf: 0xc0002b6000, count: 512) = 36
LOST 9 events!
6214.799 ( 0.024 ms): runc/1294005 ... [continued]: pipe2()) = 0
LOST 7 events!
6214.462 ( 0.392 ms): tuned/1587 ... [continued]: poll()) = 1
LOST 4 events!
? ( ): :1294006/1294006 ... [continued]: munmap()) = 0
LOST 10 events!
6214.863 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
LOST 8 events!
6214.886 ( 0.023 ms): :1294006/1294006 rt_sigprocmask(how: SETMASK, nset: 0x7ffa4e1d4b80, oset: 0x7ffa4e1d4c00, sigsetsize: 8) = 1294009
6214.911 ( 0.001 ms): :1294006/1294006 rt_sigprocmask(how: SETMASK, nset: 0x7ffa4e1d4a10, sigsetsize: 8) = 0
LOST 6 events!
6214.654 ( 0.269 ms): runc/1293997 ... [continued]: futex()) = 0
LOST 55 events!
? ( ): runc/1294008 ... [continued]: rt_sigaction()) = 0
LOST 67 events!
? ( ): runc/1294008 ... [continued]: chdir()) = 0
LOST 11 events!
6205.151 (10.063 ms): kube-rbac-prox/8566 ... [continued]: nanosleep()) = 0
6214.921 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6205.176 (10.047 ms): rancher/846385 ... [continued]: nanosleep()) = 0
6215.219 ( ): kube-rbac-prox/8566 nanosleep(rqtp: 0xc000085f18) ...
6214.408 ( 1.013 ms): k3s-server/845090 ... [continued]: clone()) =
6215.226 ( ): rancher/846385 nanosleep(rqtp: 0xc0000b3f10) ...
6215.423 ( 0.001 ms): k3s-server/845090 rt_sigprocmask(how: SETMASK, nset: 0xc0534475e0, sigsetsize: 8) = 0
6215.426 ( 0.002 ms): k3s-server/845090 close(fd: 545) = 0
6215.431 ( 0.002 ms): k3s-server/845090 read(fd: 249, buf: 0xc053447730, count: 8) = 0
6215.434 ( 0.001 ms): k3s-server/845090 close(fd: 249) = 0
6215.444 ( 0.001 ms): k3s-server/845090 close(fd: 15) = 0
6215.447 ( 0.001 ms): k3s-server/845090 close(fd: 211) = 0
6215.449 ( 0.003 ms): k3s-server/845090 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: DEL, fd: 245, event: 0xc05344780c) = 0
6215.453 ( 0.001 ms): k3s-server/845090 close(fd: 245) = 0
6215.458 ( 0.003 ms): k3s-server/845090 futex(uaddr: 0xc0109b1d48, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6214.921 ( 0.545 ms): tuned/1587 ... [continued]: poll()) = 1
6215.463 ( ): k3s-server/845090 waitid(which: 1, upid: 1294007, infop: 0xc053447958, options: 0x1000004) ...
6215.489 ( 0.011 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8bb0, flags: RDONLY|CLOEXEC) = 16
6215.501 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6215.504 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6215.509 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6215.512 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6215.524 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6215.532 ( 0.004 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a7f60, count: 8192) = 54
6215.542 ( 0.001 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a7fc0, count: 8192) = 0
6215.552 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6215.567 ( 0.006 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8e88, flags: RDONLY|CLOEXEC) = 16
6215.574 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6215.576 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6215.579 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6215.581 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6215.586 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6215.590 ( 0.005 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a7ff0, count: 8192) = 314
6215.602 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6205.450 (10.195 ms): k3s-server/847824 ... [continued]: futex()) = 0
6215.640 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
? ( ): exe/1294008 ... [continued]: execve()) = 0
6215.649 ( ): k3s-server/847824 futex(uaddr: 0xc0109b1d48, op: WAIT|PRIVATE_FLAG) ...
6216.165 ( 0.001 ms): exe/1294008 arch_prctl(option: SET_FS, arg2: 0xcae860) = 0
6216.167 ( 0.001 ms): exe/1294008 set_tid_address(tidptr: 0xcae990) = 1294008 (exe)
6216.181 ( 0.011 ms): exe/1294008 open(filename: 0x9be9a7, flags: RDONLY|CLOEXEC|LARGEFILE) = 5
6216.192 ( 0.001 ms): exe/1294008 fcntl(fd: 5, cmd: SETFD, arg: 0) = 0
6216.194 ( 0.001 ms): exe/1294008 fcntl(fd: 5, cmd: GET_SEALS) = -1 EINVAL (Invalid argument)
6216.196 ( 0.002 ms): exe/1294008 close(fd: 5) = 0
6216.202 ( 0.005 ms): exe/1294008 open(filename: 0x9be988, flags: RDONLY|CLOEXEC|LARGEFILE) = 5
6216.208 ( 0.001 ms): exe/1294008 fcntl(fd: 5, cmd: SETFD, arg: 0) = 0
6216.209 ( 0.003 ms): exe/1294008 read(fd: 5, buf: 0x7ffeb0212d90, count: 4096) = 10
6216.213 ( 0.001 ms): exe/1294008 brk() = 0x2a9d000
6216.215 ( 0.001 ms): exe/1294008 brk(brk: 0x2a9f000) = 0x2a9f000
6216.217 ( 0.004 ms): exe/1294008 mmap(addr: 0x2a9d000, len: 4096, flags: PRIVATE|FIXED|ANONYMOUS) = 0x2a9d000
6216.224 ( 0.002 ms): exe/1294008 mmap(len: 4096, prot: READ|WRITE, flags: PRIVATE|ANONYMOUS) = 0x7fba927e1000
6216.229 ( 0.001 ms): exe/1294008 read(fd: 5, buf: 0x7ffeb0212d90, count: 4096) = 0
6216.231 ( 0.001 ms): exe/1294008 close(fd: 5) = 0
6216.243 ( 0.019 ms): exe/1294008 open(filename: 0xb0212db0, flags: RDWR|CREAT|EXCL|LARGEFILE, mode: IRUSR|IWUSR) = 5
6216.263 ( 0.002 ms): exe/1294008 close(fd: 5) = 0
6216.266 ( 0.113 ms): exe/1294008 mount(dev_name: 0x9be9a7, dir_name: 0x7ffeb0212db0, type: 0x9c16b6, flags: BIND, data: 0x9c16b6) = 0
6216.380 ( 0.054 ms): exe/1294008 mount(dev_name: 0x9c16b6, dir_name: 0x7ffeb0212db0, type: 0x9c16b6, flags: RDONLY|REMOUNT|BIND, data: 0x9c16b6) = 0
6216.434 ( 0.002 ms): exe/1294008 open(filename: 0xb0212db0, flags: RDONLY|CLOEXEC|LARGEFILE|PATH) = 5
6216.437 ( 0.001 ms): exe/1294008 fcntl(fd: 5, cmd: SETFD, arg: 0) = 0
6214.799 ( 4.334 ms): runc/1294005 ... [continued]: clone()) = 1294008 (exe)
6216.439 ( ): exe/1294008 umount2(name: 0xb0212db0, flags: 2) ...
6219.135 ( 0.001 ms): runc/1294005 rt_sigprocmask(how: SETMASK, nset: 0xc00010ddb8, sigsetsize: 8) = 0
6219.138 ( 0.002 ms): runc/1294005 close(fd: 15) = 0
6219.142 ( 0.002 ms): runc/1294005 read(fd: 14, buf: 0xc00010df08, count: 8) = 0
6219.144 ( 0.001 ms): runc/1294005 close(fd: 14) = 0
6219.152 ( 0.001 ms): runc/1294005 close(fd: 10) = 0
6219.155 ( 0.002 ms): runc/1294005 epoll_ctl(epfd: 6, op: DEL, fd: 13, event: 0xc00010e1c4) = 0
6219.158 ( 0.001 ms): runc/1294005 close(fd: 13) = 0
6219.165 ( 0.004 ms): runc/1294005 mmap(len: 262144, prot: READ|WRITE, flags: PRIVATE|ANONYMOUS) = 0x7ffa4e14f000
6219.173 ( 0.005 ms): runc/1294005 write(fd: 11, buf: 0xc0002b2000, count: 200) = 200
6215.640 ( 3.545 ms): tuned/1587 ... [continued]: poll()) = 2
6219.181 ( ): runc/1294005 read(fd: 11, buf: 0xc0002920a8, count: 1) ...
6219.211 ( 0.006 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8d38, flags: RDONLY|CLOEXEC) = 16
6219.218 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6219.221 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6219.225 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6219.229 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6219.239 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6219.246 ( 0.004 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a7ff0, count: 8192) = 10
6219.255 ( 0.001 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8030, count: 8192) = 0
6219.264 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6219.276 ( 0.007 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8910, flags: RDONLY|CLOEXEC) = 16
6219.283 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6219.286 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6219.288 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6219.291 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6219.296 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6219.300 ( 0.005 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8060, count: 8192) = 274
6219.311 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6215.463 ( 3.890 ms): k3s-server/845090 ... [continued]: waitid()) = 0
6219.347 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6219.356 ( ): k3s-server/845090 rt_sigreturn() ...
6219.360 ( 0.010 ms): k3s-server/845090 wait4(upid: 1294007, stat_addr: 0xc0534479e4, ru: 0xc03efb5290) = 1294007
6219.380 ( 0.006 ms): k3s-server/845090 openat(dfd: CWD, filename: 0x531a4850, flags: RDONLY|CLOEXEC) = 15
6219.387 ( 0.001 ms): k3s-server/845090 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 15, event: 0xc05344773c) = -1 EPERM (Operation not permitted)
6219.390 ( 0.002 ms): k3s-server/845090 openat(dfd: CWD, filename: 0x531a4860, flags: CLOEXEC|WRONLY) = 211
6219.394 ( 0.001 ms): k3s-server/845090 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 211, event: 0xc053447714) = -1 EPERM (Operation not permitted)
6219.396 ( 0.003 ms): k3s-server/845090 pipe2(fildes: 0xc0534477c0, flags: CLOEXEC) = 0
6219.401 ( 0.003 ms): k3s-server/845090 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 242, event: 0xc053447734) = 0
6219.405 ( 0.001 ms): k3s-server/845090 fcntl(fd: 242, cmd: GETFL) = RDONLY
6219.407 ( 0.001 ms): k3s-server/845090 fcntl(fd: 242, cmd: SETFL, arg: RDONLY|NONBLOCK) = 0
6219.409 ( 0.004 ms): k3s-server/845090 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 245, event: 0xc053447734) = 0
6219.414 ( 0.001 ms): k3s-server/845090 fcntl(fd: 245, cmd: GETFL) = WRONLY
6219.416 ( 0.001 ms): k3s-server/845090 fcntl(fd: 245, cmd: SETFL, arg: NONBLOCK|WRONLY) = 0
6219.422 ( 0.001 ms): k3s-server/845090 fcntl(fd: 245, cmd: GETFL) = NONBLOCK|WRONLY
6219.424 ( 0.001 ms): k3s-server/845090 fcntl(fd: 245, cmd: SETFL, arg: WRONLY) = 0
6219.428 ( 0.003 ms): k3s-server/845090 pipe2(fildes: 0xc053447680, flags: CLOEXEC) = 0
6219.433 ( 0.001 ms): k3s-server/845090 getpid() = 843670
6219.435 ( 0.001 ms): k3s-server/845090 rt_sigprocmask(how: SETMASK, oset: 0xc00ea82080, sigsetsize: 8) = 0
6219.436 ( 0.001 ms): k3s-server/845090 rt_sigprocmask(how: SETMASK, nset: 0x8d799d0, sigsetsize: 8) = 0
? ( ): :1294009/1294009 ... [continued]: clone()) = 0
6219.438 ( ): k3s-server/845090 clone(clone_flags: VM|VFORK|0x11) ...
6219.531 ( 0.001 ms): :1294009/1294009 rt_sigprocmask(how: SETMASK, nset: 0x7ffa4e1b1f10, sigsetsize: 8) = 0
6219.534 ( 0.006 ms): :1294009/1294009 munmap(addr: 0x7ffa4e304000, len: 4096) = 0
6219.542 ( 0.001 ms): :1294009/1294009 sigaltstack(uoss: 0x7ffa4e1b1dc8) = 0
6219.543 ( 0.001 ms): :1294009/1294009 sigaltstack(uss: 0x7ffa4e1b1d88) = 0
6219.546 ( 0.001 ms): :1294009/1294009 rt_sigprocmask(how: SETMASK, nset: 0x7ffa4e1b1dd8, sigsetsize: 8) = 0
6219.547 ( 0.001 ms): :1294009/1294009 gettid() = 1294009
6219.553 ( 0.004 ms): :1294009/1294009 mmap(len: 262144, prot: READ|WRITE, flags: PRIVATE|ANONYMOUS) = 0x7ffa4e10f000
6219.566 ( 0.003 ms): :1294009/1294009 read(fd: 12, buf: 0xc000300000, count: 4096) = -1 EAGAIN (Resource temporarily unavailable)
6219.570 ( 0.001 ms): :1294009/1294009 epoll_pwait(epfd: 6, events: 0x7ffa4e1b16d0, maxevents: 128, sigsetsize: 2) = 0
6219.347 ( 0.975 ms): tuned/1587 ... [continued]: poll()) = 1
6219.573 ( ): :1294009/1294009 epoll_pwait(epfd: 6, events: 0x7ffa4e1b16d0, maxevents: 128, timeout: 4294967295, sigsetsize: 1471912546) ...
6220.348 ( 0.013 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8c58, flags: RDONLY|CLOEXEC) = 16
6220.362 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6220.365 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6220.369 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6220.373 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6220.382 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6220.389 ( 0.010 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8060, count: 8192) = 126
6220.406 ( 0.001 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8110, count: 8192) = 0
6220.415 ( 0.002 ms): tuned/1587 close(fd: 16) = 0
6220.432 ( 0.006 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8cc8, flags: RDONLY|CLOEXEC) = 16
6220.439 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6220.442 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6220.444 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6220.447 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6220.452 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6220.455 ( 0.005 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8140, count: 8192) = 312
6220.467 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
? ( ): k3s-server/848316 ... [continued]: futex()) = -1 (unknown) (INTERNAL ERROR: strerror_r(512, [buf], 128)=22)
6220.504 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6220.504 ( 1.598 ms): tuned/1587 ... [continued]: poll()) = 1
6222.090 ( ): k3s-server/848316 futex(uaddr: 0xc04aeb1548, op: WAIT|PRIVATE_FLAG) ...
5820.492 (402.035 ms): jf-router-linu/2741064 ... [continued]: futex()) = -1 ETIMEDOUT (Connection timed out)
6222.120 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6222.532 ( 0.076 ms): jf-router-linu/2741064 nanosleep(rqtp: 0x7fa016526d18) = 0
2767.004 (3455.760 ms): jf-router-linu/2757353 ... [continued]: futex()) = 0
6222.610 ( ): jf-router-linu/2741064 nanosleep(rqtp: 0x7fa016526d18) ...
6222.770 ( 0.010 ms): jf-router-linu/2757353 write(fd: 7<pipe:[256583347]>, buf: 0x7fa00512dc43, count: 1) = 1
5013.371 (1209.948 ms): gitlab-logger/880926 ... [continued]: epoll_pwait()) = 0
6222.781 ( ): jf-router-linu/2757353 futex(uaddr: 0xc0023f5548, op: WAIT|PRIVATE_FLAG) ...
6223.329 ( 1.057 ms): gitlab-logger/880926 epoll_pwait(epfd: 4<anon_inode:[eventpoll]>, events: 0xc00004f840, maxevents: 128, timeout: 1) = 0
6224.392 ( 0.005 ms): gitlab-logger/880926 futex(uaddr: 0xc00003e948, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6224.407 ( 0.010 ms): gitlab-logger/880926 newfstatat(dfd: CWD, filename: 0x256e60, statbuf: 0xc000310928, flag: 256) = 0
6224.420 ( 0.011 ms): gitlab-logger/880926 openat(dfd: CWD, filename: 0x256e70, flags: RDONLY|CLOEXEC) = 11
6224.432 ( 0.001 ms): gitlab-logger/880926 fcntl(fd: 11, cmd: GETFL) = RDONLY|LARGEFILE
6224.434 ( 0.001 ms): gitlab-logger/880926 fcntl(fd: 11, cmd: SETFL, arg: RDONLY|LARGEFILE|NONBLOCK) = 0
6224.437 ( 0.001 ms): gitlab-logger/880926 epoll_ctl(epfd: 4<anon_inode:[eventpoll]>, op: ADD, fd: 11, event: 0xc00006e9c4) = -1 EPERM (Operation not permitted)
6224.439 ( 0.001 ms): gitlab-logger/880926 fcntl(fd: 11, cmd: GETFL) = RDONLY|LARGEFILE|NONBLOCK
6224.441 ( 0.001 ms): gitlab-logger/880926 fcntl(fd: 11, cmd: SETFL, arg: RDONLY|LARGEFILE) = 0
6224.446 ( 0.004 ms): gitlab-logger/880926 getdents64(fd: 11, dirent: 0xc00026e000, count: 8192) = 120
6224.452 ( 0.001 ms): gitlab-logger/880926 getdents64(fd: 11, dirent: 0xc00026e000, count: 8192) = 0
6224.455 ( 0.002 ms): gitlab-logger/880926 close(fd: 11) = 0
6224.463 ( 0.048 ms): gitlab-logger/880926 newfstatat(dfd: CWD, filename: 0x2536c0, statbuf: 0xc0003109f8, flag: 256) = 0
6224.515 ( 0.003 ms): gitlab-logger/880926 newfstatat(dfd: CWD, filename: 0x171b00, statbuf: 0xc000310ac8, flag: 256) = 0
6224.523 ( 0.004 ms): gitlab-logger/880926 futex(uaddr: 0xc00003e948, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6224.534 ( 0.004 ms): gitlab-logger/880926 futex(uaddr: 0xc00003e948, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6215.219 (10.061 ms): kube-rbac-prox/8566 ... [continued]: nanosleep()) = 0
6224.541 ( ): gitlab-logger/880926 epoll_pwait(epfd: 4<anon_inode:[eventpoll]>, events: 0xc00004f840, maxevents: 128, timeout: 99) ...
6215.226 (10.062 ms): rancher/846385 ... [continued]: nanosleep()) = 0
6225.284 ( ): kube-rbac-prox/8566 nanosleep(rqtp: 0xc000085f18) ...
6222.610 ( 3.370 ms): jf-router-linu/2741064 ... [continued]: nanosleep()) = 0
6225.291 ( ): rancher/846385 futex(uaddr: 0x6eef798, op: WAIT|PRIVATE_FLAG, utime: 0xc0000b3eb0) ...
6216.439 (11.680 ms): exe/1294008 ... [continued]: umount2()) = 0
6225.983 ( ): jf-router-linu/2741064 futex(uaddr: 0x70d4080, op: WAIT|PRIVATE_FLAG, utime: 0x7fa016526cb8) ...
6228.123 ( 0.016 ms): exe/1294008 unlink(pathname: 0xb0212db0) = 0
6228.141 ( 0.679 ms): 5/1294008 execveat(fd: 5, filename: 0x9c16b6, argv: 0x7fba927e1230, envp: 0x7fba927e1440, flags: 4096) = 0
6228.833 ( 0.001 ms): 5/1294008 arch_prctl(option: SET_FS, arg2: 0xcae860) = 0
6228.835 ( 0.001 ms): 5/1294008 set_tid_address(tidptr: 0xcae990) = 1294008 (5)
6228.845 ( 0.012 ms): 5/1294008 open(filename: 0x9be9a7, flags: RDONLY|CLOEXEC|LARGEFILE) = 5
6228.858 ( 0.001 ms): 5/1294008 fcntl(fd: 5, cmd: SETFD, arg: 0) = 0
6228.860 ( 0.001 ms): 5/1294008 fcntl(fd: 5, cmd: GET_SEALS) = -1 EINVAL (Invalid argument)
6228.862 ( 0.004 ms): 5/1294008 fstatfs(fd: 5, buf: 0x7ffdc8847830) = 0
6228.867 ( 0.001 ms): 5/1294008 fstat(fd: 5, statbuf: 0x7ffdc8847780) = 0
6228.869 ( 0.002 ms): 5/1294008 close(fd: 5) = 0
6228.873 ( 0.007 ms): 5/1294008 write(fd: 3, buf: 0x9c16b6, count: 1) = 1
6228.881 ( 0.002 ms): 5/1294008 read(fd: 3, buf: 0x7ffdc8847b20, count: 16) = 16
6228.884 ( 0.001 ms): 5/1294008 brk() = 0x1399000
6228.885 ( 0.001 ms): 5/1294008 brk(brk: 0x139b000) = 0x139b000
6228.888 ( 0.004 ms): 5/1294008 mmap(addr: 0x1399000, len: 4096, flags: PRIVATE|FIXED|ANONYMOUS) = 0x1399000
6228.894 ( 0.002 ms): 5/1294008 mmap(len: 4096, prot: READ|WRITE, flags: PRIVATE|ANONYMOUS) = 0x7f0d0e95f000
6228.899 ( 0.002 ms): 5/1294008 read(fd: 3, buf: 0x7f0d0e95f050, count: 184) = 184
6228.905 ( 0.006 ms): 5/1294008 open(filename: 0xc88469a0, flags: RDWR|LARGEFILE) = 5
6228.912 ( 0.003 ms): 5/1294008 write(fd: 5, buf: 0x7f0d0e95f0fc, count: 4) = 4
6228.916 ( 0.001 ms): 5/1294008 close(fd: 5) = 0
6228.920 ( 0.001 ms): 5/1294008 prctl(option: SET_DUMPABLE) = 0
6228.922 ( 0.011 ms): 5/1294008 socketpair(family: LOCAL, type: STREAM, usockvec: 0x7ffdc8847bc0) = 0
6228.934 ( 0.006 ms): 5/1294008 socketpair(family: LOCAL, type: STREAM, usockvec: 0x7ffdc8847bc8) = 0
6228.941 ( 0.002 ms): runc:[0:PARENT/1294008 prctl(option: SET_NAME, arg2: 0x9becff) = 0
6228.944 ( 0.038 ms): runc:[0:PARENT/1294008 clone(clone_flags: PARENT|0x11, newsp: 0x7ffdc8847a48) = 1294012 (runc:[0:PARENT])
6228.988 ( 0.002 ms): runc:[0:PARENT/1294008 close(fd: 5) = 0
6219.181 ( 9.815 ms): runc/1294005 ... [continued]: read()) = 1
6228.991 ( ): runc:[0:PARENT/1294008 read(fd: 6, buf: 0x7ffdc8847b0c, count: 4) ...
6229.001 ( 0.003 ms): runc/1294005 futex(uaddr: 0xc00004cd48, op: WAKE|PRIVATE_FLAG, val: 1) = 1
? ( ): runc/1294000 ... [continued]: futex()) = 0
6229.009 ( ): runc/1294005 waitid(which: 1, upid: 1294008 (runc:[0:PARENT]), infop: 0xc00010e128, options: 0x1000004) ...
6222.120 ( 6.898 ms): tuned/1587 ... [continued]: poll()) = 2
6229.014 ( ): runc/1294000 futex(uaddr: 0xc00004cd48, op: WAIT|PRIVATE_FLAG) ...
6229.041 ( 0.010 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8fa0, flags: RDONLY|CLOEXEC) = 16
6229.052 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6229.056 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6229.060 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.064 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6229.074 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.082 ( 0.217 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8140, count: 8192) = 10
6229.310 ( 0.002 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8180, count: 8192) = 0
6229.322 ( 0.002 ms): tuned/1587 close(fd: 16) = 0
6229.338 ( 0.008 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8fd8, flags: RDONLY|CLOEXEC) = 16
6229.347 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6229.350 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6229.353 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.356 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6229.364 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.369 ( 0.006 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a81b0, count: 8192) = 287
6229.381 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.421 ( 0.005 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8948, flags: RDONLY|CLOEXEC) = 16
6229.426 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6229.429 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6229.432 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.434 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6229.439 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.443 ( 0.003 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a81b0, count: 8192) = 10
6229.449 ( 0.001 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a81f0, count: 8192) = 0
6229.455 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.463 ( 0.004 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8be8, flags: RDONLY|CLOEXEC) = 16
6229.468 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6229.470 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6229.473 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.475 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6229.479 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.482 ( 0.004 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8220, count: 8192) = 289
6229.491 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.521 ( 0.003 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8b08, flags: RDONLY|CLOEXEC) = 16
6229.525 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6229.527 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6229.529 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.531 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6229.536 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.539 ( 0.002 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8220, count: 8192) = 10
6229.544 ( 0.001 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8260, count: 8192) = 0
6229.550 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.557 ( 0.003 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8f30, flags: RDONLY|CLOEXEC) = 16
6229.561 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6229.563 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6229.566 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.568 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6229.572 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.575 ( 0.003 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8290, count: 8192) = 289
6229.583 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.611 ( 0.008 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8c20, flags: RDONLY|CLOEXEC) = 16
6229.620 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6229.622 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6229.624 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.627 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6229.631 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.634 ( 0.006 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8290, count: 8192) = 10
6229.643 ( 0.002 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a82d0, count: 8192) = 0
6229.649 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.657 ( 0.005 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8d38, flags: RDONLY|CLOEXEC) = 16
6229.663 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6229.665 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6229.668 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.671 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6229.675 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6229.678 ( 0.004 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8300, count: 8192) = 287
6229.687 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6229.713 ( 0.002 ms): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) = 1
6228.991 ( 0.736 ms): runc:[0:PARENT/1294008 ... [continued]: read()) = 4
6229.718 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6229.728 ( 0.002 ms): runc:[0:PARENT/1294008 read(fd: 6, buf: 0x7ffdc8847b08, count: 4) = 4
6229.731 ( 0.005 ms): runc:[0:PARENT/1294008 write(fd: 6, buf: 0x7ffdc8847b0c, count: 4) = 4
6229.739 ( 0.004 ms): runc:[0:PARENT/1294008 writev(fd: 3, vec: 0x7ffdc88476b0, vlen: 2) = 44
? ( ): runc:[0:PARENT/1294012 ... [continued]: read()) = 4
6229.744 ( ): runc:[0:PARENT/1294008 read(fd: 6, buf: 0x7ffdc8847b0c, count: 4) ...
6229.757 ( 0.003 ms): runc:[0:PARENT/1294012 write(fd: 5, buf: 0x7ffdc8847b18, count: 4) = 4
6229.770 ( ): runc:[0:PARENT/1294012 exit_group() = ?
6229.009 ( 0.803 ms): runc/1294005 ... [continued]: waitid()) = -1 (unknown) (INTERNAL ERROR: strerror_r(512, [buf], 128)=22)
6229.817 ( 0.003 ms): runc/1294005 futex(uaddr: 0xcaf240, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6229.821 ( ): runc/1294005 rt_sigreturn() ...
6211.489 (18.337 ms): runc/1293999 ... [continued]: futex()) = 0
6229.823 ( ): runc/1294005 waitid(which: 1, upid: 1294008 (runc:[0:PARENT]), infop: 0xc00010e128, options: 0x1000004) ...
6229.718 ( 0.117 ms): tuned/1587 ... [continued]: poll()) = 1
6229.832 ( ): runc/1293999 futex(uaddr: 0xcaf240, op: WAIT|PRIVATE_FLAG) ...
6229.848 ( 0.603 ms): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) = 1
? ( ): :1294014/1294014 ... [continued]: clone()) = 0
6230.457 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6230.463 ( 0.001 ms): :1294014/1294014 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74cdf10, sigsetsize: 8) = 0
6230.466 ( 0.009 ms): :1294014/1294014 munmap(addr: 0x7f0ce74ce000, len: 4096) = 0
6230.476 ( 0.001 ms): :1294014/1294014 sigaltstack(uoss: 0x7f0ce74cddc8) = 0
6230.478 ( 0.001 ms): :1294014/1294014 sigaltstack(uss: 0x7f0ce74cdd88) = 0
6230.480 ( 0.001 ms): :1294014/1294014 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74cddd8, sigsetsize: 8) = 0
6230.482 ( 0.001 ms): :1294014/1294014 gettid() =
6230.457 ( 0.052 ms): tuned/1587 ... [continued]: poll()) = 1
6230.484 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
? ( ): :1294015/1294015 ... [continued]: clone()) = 0
6230.514 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6230.519 ( 0.001 ms): :1294015/1294015 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74aaf10, sigsetsize: 8) = 0
6230.521 ( 0.001 ms): :1294015/1294015 sigaltstack(uoss: 0x7f0ce74aadc8) = 0
6230.523 ( 0.001 ms): :1294015/1294015 sigaltstack(uss: 0x7f0ce74aad88) = 0
6230.524 ( 0.001 ms): :1294015/1294015 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74aadd8, sigsetsize: 8) = 0
6230.526 ( 0.001 ms): :1294015/1294015 gettid() =
6230.533 ( 0.005 ms): :1294015/1294015 mmap(len: 262144, prot: READ|WRITE, flags: PRIVATE|ANONYMOUS) = 0x7f0ce7425000
6230.548 ( 0.001 ms): :1294015/1294015 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74aab80, oset: 0x7f0ce74aac00, sigsetsize: 8) = 0
6230.550 ( 0.002 ms): :1294015/1294015 mmap(len: 143360, flags: PRIVATE|ANONYMOUS) = 0x7f0ce7402000
6230.552 ( 0.002 ms): :1294015/1294015 mprotect(start: 0x7f0ce7404000, len: 135168, prot: READ|WRITE) = 0
6230.560 ( 0.001 ms): :1294015/1294015 rt_sigprocmask(how: BLOCK, nset: 0x9cd0a8, oset: 0x7f0ce74aaa10, sigsetsize: 8) = 0
6230.562 ( 0.015 ms): :1294015/1294015 clone(clone_flags: VM|FS|FILES|SIGHAND|THREAD|SYSVSEM|SETTLS|PARENT_SETTID|CHILD_CLEARTID|DETACHED, newsp: 0x7f0ce7424ee8, parent_tidptr: 0x7f0ce7424f68, child_tidptr: 0xcae990, tls: 0x7f0ce7424f38) =
6230.579 ( 0.001 ms): :1294015/1294015 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74aaa10, sigsetsize: 8) = 0
6230.580 ( 0.001 ms): :1294015/1294015 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce74aac00, sigsetsize: 8) = 0
6230.584 ( 0.003 ms): :1294015/1294015 futex(uaddr: 0xc7eb88, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6230.514 ( 0.077 ms): tuned/1587 ... [continued]: poll()) = 2
6230.588 ( ): :1294015/1294015 futex(uaddr: 0xc000046948, op: WAIT|PRIVATE_FLAG) ...
6230.484 ( 0.118 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6230.599 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6229.823 ( 0.784 ms): runc/1294005 ... [continued]: waitid()) = 0
6230.603 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6230.611 ( 0.002 ms): runc/1294005 futex(uaddr: 0xcaf240, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6230.613 ( ): runc/1294005 rt_sigreturn() ...
6230.617 ( 0.011 ms): runc/1294005 wait4(upid: 1294008 (runc:[0:PARENT]), stat_addr: 0xc00010e1b4, ru: 0xc0002c0090) = 1294008 (runc:[0:PARENT])
6230.634 ( 0.004 ms): runc/1294005 read(fd: 11, buf: 0xc0002b6200, count: 512) = 44
6230.660 ( 0.001 ms): runc/1294005 waitid(which: 1, upid: 1294012 (runc:[0:PARENT]), infop: 0xc00010e128, options: 0x1000004) = 0
6230.662 ( 0.005 ms): runc/1294005 wait4(upid: 1294012 (runc:[0:PARENT]), stat_addr: 0xc00010e1b4, ru: 0xc0002c0120) = 1294012 (runc:[0:PARENT])
6230.671 ( 0.015 ms): runc/1294005 openat2(dfd: 9, filename: 0x2b21a0, how: 0xc00010e0f8, usize: 24) = 10
6230.688 ( 0.001 ms): runc/1294005 fcntl(fd: 10, cmd: GETFL) = LARGEFILE|WRONLY
6230.691 ( 0.028 ms): runc/1294005 write(fd: 10, buf: 0xc000292190, count: 7) = 7
6230.721 ( 0.001 ms): runc/1294005 close(fd: 10) = 0
6230.940 ( 0.011 ms): runc/1294005 write(fd: 11, buf: 0xc0002ee000, count: 32698) = 32698
6229.832 ( 1.126 ms): runc/1293999 ... [continued]: futex()) = 0
6230.954 ( ): runc/1294005 read(fd: 11, buf: 0xc0002b6600, count: 512) ...
? ( ): :1294013/1294013 ... [continued]: futex()) = 0
6230.961 ( ): runc/1293999 futex(uaddr: 0xcaf240, op: WAIT|PRIVATE_FLAG) ...
6230.983 ( 0.001 ms): :1294013/1294013 rt_sigprocmask(how: SETMASK, nset: 0x7ffdc8847b20, oset: 0x7ffdc8847ba0, sigsetsize: 8) = 0
6230.985 ( 0.003 ms): :1294013/1294013 mmap(len: 143360, flags: PRIVATE|ANONYMOUS) = 0x7f0ce73df000
6230.989 ( 0.003 ms): :1294013/1294013 mprotect(start: 0x7f0ce73e1000, len: 135168, prot: READ|WRITE) = 0
6230.995 ( 0.001 ms): :1294013/1294013 rt_sigprocmask(how: BLOCK, nset: 0x9cd0a8, oset: 0x7ffdc88479b0, sigsetsize: 8) = 0
6230.997 ( 0.028 ms): :1294013/1294013 clone(clone_flags: VM|FS|FILES|SIGHAND|THREAD|SYSVSEM|SETTLS|PARENT_SETTID|CHILD_CLEARTID|DETACHED, newsp: 0x7f0ce7401ee8, parent_tidptr: 0x7f0ce7401f68, child_tidptr: 0xcae990, tls: 0x7f0ce7401f38) =
6231.026 ( 0.001 ms): :1294013/1294013 rt_sigprocmask(how: SETMASK, nset: 0x7ffdc88479b0, sigsetsize: 8) = 0
6231.027 ( 0.001 ms): :1294013/1294013 rt_sigprocmask(how: SETMASK, nset: 0x7ffdc8847ba0, sigsetsize: 8) = 0
6231.088 ( 0.001 ms): :1294013/1294013 getrlimit(resource: NOFILE, rlim: 0xc000050830) = 0
6231.107 ( 0.002 ms): :1294013/1294013 fcntl(cmd: GETFL) = RDONLY|LARGEFILE
6231.115 ( 0.001 ms): :1294013/1294013 fcntl(fd: 1, cmd: GETFL) = WRONLY
6231.117 ( 0.001 ms): :1294013/1294013 fcntl(fd: 2, cmd: GETFL) = WRONLY
6231.161 ( 0.015 ms): :1294013/1294013 readlinkat(dfd: CWD, pathname: 0xae210, buf: 0xc0000b4000, bufsiz: 128) = 1
6231.180 ( 0.011 ms): :1294013/1294013 openat(dfd: CWD, filename: 0xae20c, flags: RDONLY|CLOEXEC) = 5
6231.192 ( 0.004 ms): :1294013/1294013 epoll_create1(flags: 524288) = 6
6231.196 ( 0.004 ms): :1294013/1294013 pipe2(fildes: 0xc0000505b0, flags: CLOEXEC|NONBLOCK) = 0
6231.201 ( 0.002 ms): :1294013/1294013 epoll_ctl(epfd: 6, op: ADD, fd: 7, event: 0xc0000505e4) = 0
6231.206 ( 0.001 ms): :1294013/1294013 epoll_ctl(epfd: 6, op: ADD, fd: 5, event: 0xc000050664) = -1 EPERM (Operation not permitted)
6231.208 ( 0.002 ms): :1294013/1294013 fstat(fd: 5, statbuf: 0xc0000a4788) = 0
6231.212 ( 0.002 ms): :1294013/1294013 pread64(fd: 5, buf: 0xc0000507d8, count: 64) = -1 EISDIR (Is a directory)
6231.214 ( 0.002 ms): :1294013/1294013 close(fd: 5) = 0
6231.407 ( 0.009 ms): :1294013/1294013 statfs(pathname: 0xb8030, buf: 0xc0000c9948) = -1 ENOENT (No such file or directory)
6231.518 ( 0.001 ms): :1294013/1294013 capget(header: 824634849944) = 0
6231.520 ( 0.010 ms): :1294013/1294013 openat(dfd: CWD, filename: 0xbc220, flags: RDONLY|CLOEXEC) = 5
6231.532 ( 0.002 ms): :1294013/1294013 epoll_ctl(epfd: 6, op: ADD, fd: 5, event: 0xc0001138bc) = 0
6231.534 ( 0.001 ms): :1294013/1294013 fcntl(fd: 5, cmd: GETFL) = RDONLY|LARGEFILE
6231.536 ( 0.001 ms): :1294013/1294013 fcntl(fd: 5, cmd: SETFL, arg: RDONLY|LARGEFILE|NONBLOCK) = 0
6231.539 ( 0.002 ms): :1294013/1294013 read(fd: 5, buf: 0xc000113a1d, count: 11) = 3
6231.544 ( 0.001 ms): :1294013/1294013 epoll_ctl(epfd: 6, op: DEL, fd: 5, event: 0xc0001138cc) = 0
6231.546 ( 0.001 ms): :1294013/1294013 close(fd: 5) = 0
6231.564 ( 0.001 ms): :1294013/1294013 seccomp(flags: TSYNC) = -1 EINVAL (Invalid argument)
6231.565 ( 0.003 ms): :1294013/1294013 seccomp(op: FILTER, flags: TSYNC) = -1 EFAULT (Bad address)
6231.570 ( 0.002 ms): :1294013/1294013 seccomp(op: FILTER, flags: 0x2) = -1 EFAULT (Bad address)
6231.572 ( 0.001 ms): :1294013/1294013 seccomp(op: 0x2, uargs: 0x7ffdc8847bec) = 0
6231.574 ( 0.001 ms): :1294013/1294013 seccomp(op: 0x2, uargs: 0x7ffdc8847bec) = 0
6231.575 ( 0.001 ms): :1294013/1294013 seccomp(op: FILTER, flags: 0x4) = -1 EFAULT (Bad address)
6231.578 ( 0.001 ms): :1294013/1294013 seccomp(op: FILTER, flags: 0x8) = -1 EINVAL (Invalid argument)
6230.603 ( 1.253 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6231.849 ( ): :1294013/1294013 futex(uaddr: 0xc80188, op: WAIT|PRIVATE_FLAG, utime: 0x7ffdc8847b78) ...
? ( ): :1294017/1294017 ... [continued]: clone()) = 0
6231.859 ( ): :1294014/1294014 futex(uaddr: 0xc80198, op: WAIT|PRIVATE_FLAG, utime: 0x7f0ce74cdd28) ...
6231.864 ( 0.001 ms): :1294017/1294017 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce7424f10, sigsetsize: 8) = 0
6231.867 ( 0.006 ms): :1294017/1294017 munmap(addr: 0x7f0ce74ce000, len: 4096) = 0
6231.874 ( 0.001 ms): :1294017/1294017 sigaltstack(uoss: 0x7f0ce7424dc8) = 0
6231.876 ( 0.001 ms): :1294017/1294017 sigaltstack(uss: 0x7f0ce7424d88) = 0
6231.878 ( 0.001 ms): :1294017/1294017 rt_sigprocmask(how: SETMASK, nset: 0x7f0ce7424dd8, sigsetsize: 8) = 0
6231.880 ( 0.001 ms): :1294017/1294017 gettid() =
6231.882 ( 0.007 ms): :1294017/1294017 futex(uaddr: 0xc80188, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6230.599 ( 1.298 ms): tuned/1587 ... [continued]: poll()) = 1
6231.891 ( ): :1294017/1294017 futex(uaddr: 0xc000080148, op: WAIT|PRIVATE_FLAG) ...
6231.923 ( 0.014 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8910, flags: RDONLY|CLOEXEC) = 16
6231.938 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6231.942 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6231.946 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6231.950 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6231.960 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6231.967 ( 0.004 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8300, count: 8192) = 54
6231.977 ( 0.001 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8360, count: 8192) = 0
6231.986 ( 0.002 ms): tuned/1587 close(fd: 16) = 0
6232.001 ( 0.010 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b89b8, flags: RDONLY|CLOEXEC) = 16
6232.012 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6232.014 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6232.017 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6232.020 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6232.025 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6232.028 ( 0.006 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8390, count: 8192) = 311
6232.040 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6232.077 ( 0.002 ms): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) = 1
6231.859 ( 0.228 ms): :1294014/1294014 ... [continued]: futex()) = 0
6232.082 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6232.089 ( 0.001 ms): :1294014/1294014 getpid() = 75547
6232.107 ( 0.005 ms): :1294014/1294014 tgkill(tgid: 75547, pid: 75547, sig: URG) = 0
6231.891 ( 0.227 ms): :1294017/1294017 ... [continued]: futex()) = 0
6232.113 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6232.121 ( 0.002 ms): :1294017/1294017 futex(uaddr: 0xc7eb88, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6232.113 ( 0.083 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6232.123 ( ): :1294017/1294017 futex(uaddr: 0xc000080148, op: WAIT|PRIVATE_FLAG) ...
6232.197 ( 0.078 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.276 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.355 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.433 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.511 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.590 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.669 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.747 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.826 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.903 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.981 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.059 ( 0.052 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.112 ( 0.078 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.191 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.270 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.348 ( 0.370 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.720 ( 0.106 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6232.082 ( 1.751 ms): tuned/1587 ... [continued]: poll()) = 1
6233.828 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6233.850 ( 0.048 ms): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) = 1
6233.828 ( 0.080 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6233.906 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6233.910 ( 0.079 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.990 ( 0.077 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6234.069 ( 0.030 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6234.101 ( 0.078 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
5735.198 (499.064 ms): prometheus/1062049 ... [continued]: epoll_pwait()) = 0
6234.180 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6234.269 ( 0.001 ms): prometheus/1062049 epoll_pwait(epfd: 4<anon_inode:[eventpoll]>, events: 0xc00097b848, maxevents: 128, sigsetsize: 1471912576) = 0
6234.276 ( 0.005 ms): prometheus/1062049 futex(uaddr: 0xc000072548, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6234.287 ( 0.001 ms): prometheus/1062049 epoll_pwait(epfd: 4<anon_inode:[eventpoll]>, events: 0xc00097b848, maxevents: 128, sigsetsize: 1471912576) = 0
6234.180 ( 0.113 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6234.289 ( ): prometheus/1062049 epoll_pwait(epfd: 4<anon_inode:[eventpoll]>, events: 0xc00097b848, maxevents: 128, timeout: 1, sigsetsize: 4) ...
6234.294 ( 0.078 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6234.374 ( 0.075 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6234.451 ( 0.157 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
6233.906 ( 0.748 ms): tuned/1587 ... [continued]: poll()) = 1
6234.610 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6234.673 ( 0.017 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8ad0, flags: RDONLY|CLOEXEC) = 16
6234.692 ( 0.002 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288f450) = 0
6234.696 ( 0.002 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f410) = -1 ENOTTY (Inappropriate ioctl for device)
6234.701 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6234.705 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288f3f0) = -1 ENOTTY (Inappropriate ioctl for device)
6234.715 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6234.610 ( 0.119 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6234.722 ( ): tuned/1587 read(fd: 16, buf: 0x7f74e80a8390, count: 8192) ...
6234.722 ( 0.014 ms): tuned/1587 ... [continued]: read()) = 129
6234.731 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6234.744 ( 0.056 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8440, count: 8192) = 0
6234.815 ( 0.002 ms): tuned/1587 close(fd: 16) = 0
6234.833 ( 0.008 ms): tuned/1587 openat(dfd: CWD, filename: 0xf28b8b78, flags: RDONLY|CLOEXEC) = 16
6234.842 ( 0.001 ms): tuned/1587 fstat(fd: 16, statbuf: 0x7f74f288edd0) = 0
6234.846 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed90) = -1 ENOTTY (Inappropriate ioctl for device)
6234.849 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6234.852 ( 0.001 ms): tuned/1587 ioctl(fd: 16, cmd: TCGETS, arg: 0x7f74f288ed70) = -1 ENOTTY (Inappropriate ioctl for device)
6234.859 ( 0.001 ms): tuned/1587 lseek(fd: 16, whence: CUR) = 0
6234.863 ( 0.005 ms): tuned/1587 read(fd: 16, buf: 0x7f74e80a8470, count: 8192) = 312
6234.875 ( 0.001 ms): tuned/1587 close(fd: 16) = 0
6234.731 ( 0.253 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6234.915 ( ): tuned/1587 poll(ufds: 0x7f74f473bf90, nfds: 4, timeout_msecs: 1000) ...
6234.986 ( 0.081 ms): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) = 0
5735.227 (499.912 ms): prometheus/1061951 ... [continued]: futex()) = 0
6235.068 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6235.146 ( 0.004 ms): prometheus/1061951 futex(uaddr: 0xc0083cc548, op: WAKE|PRIVATE_FLAG, val: 1) = 1
2735.263 (3499.895 ms): prometheus/1152826 ... [continued]: futex()) = 0
6235.155 ( ): prometheus/1061951 futex(uaddr: 0xc000072548, op: WAIT|PRIVATE_FLAG) ...
6235.162 ( 0.002 ms): prometheus/1152826 futex(uaddr: 0xc000072548, op: WAKE|PRIVATE_FLAG, val: 1) = 1
6235.155 ( 0.014 ms): prometheus/1061951 ... [continued]: futex()) = 0
6235.167 ( ): prometheus/1152826 futex(uaddr: 0xc0083cc548, op: WAIT|PRIVATE_FLAG) ...
6235.068 ( 0.104 ms): :1294014/1294014 ... [continued]: nanosleep()) = 0
6235.171 ( ): prometheus/1061951 futex(uaddr: 0xc000072548, op: WAIT|PRIVATE_FLAG) ...
5801.077 (434.102 ms): OrientDB Write/50710 ... [continued]: futex()) = -1 ETIMEDOUT (Connection timed out)
6235.174 ( ): :1294014/1294014 nanosleep(rqtp: 0x7f0ce74cdd88) ...
6235.183 ( 0.001 ms): OrientDB Write/50710 futex(uaddr: 0x7f547d5d91a8, op: WAKE|PRIVATE_FLAG, val: 1) = 0
6235.174 ( 0.079 ms): :1294014/1294014 ... [continued]: nanosleep()) ^C)
And some posibility of crowd strike
Cyber Fusion Center
Dear Apicil team,
A new incident has been created by the Cyber Fusion Center. The details for the incident are below:
Case reference XXXX
Date created XXXX
Category
Security Incident
Threat Category
Suspicious User activity
Priority Moderate
Incident Details Summary The Cyber Fusion Center has determined that the host XXXX The suspicious activity observed was the usage of container with a lightweight distribution of Kubernetes. One of the container used the process "wait-shutdown" which have been killed by Crowdstrike.
We can not check the hash to validate if this is malicious or not.
XXXX
Kudelski Security MSS Kill Chain Analysis The Cyber Fusion Center assesses the attack is in the Installation stage.
Potential Impact Attackers compromise hosts for a multitude of reasons. The intent of a compromise could be for further lateral movement throughout the network, network credential theft, the destruction of security or system logs, to hold valuable information for ransom, reputational damage such as web defacement or the theft of Protected Health Information (PHI), Personally Identifiable Information (PII), or Intellectual Property (IP). Recommendations • Remind the user of applicable security rules or policies If this is a legitimate activity or is due to a misconfiguration: • Perform remediation or inform the CFC in order to whitelist this behavior from our rules. • If you deem it necessary, inform the CFC of the compromise for further investigation and hunt activities. • Have affected users change their passwords on an accounts that use the same or similar passwords. Event references CFC Event Reference • Event reference: XXXX • Event timestamp:XXX Client Event Reference • Device that triggered the rule: crowdstrike • Event: [Sensor-based ML - Machine Learning - Falcon Detection Method] • Security device event timestamp: TXXXXXXX • Security device alert link: XXXXXX Alert Impact • Hostname: XXXX • IP address: XXXXX • Related account(s): root • Action taken: killed Suspicious Activity Observed (<24H) • None
Would you need further assistance, please ask the Cyber Fusion Center by using the MSS Portal or by phone:
XXXXX
Kind regards, The Cyber Fusion Center
brandond
commented
1 year ago Sure sounds like it.
yodatak
commented
1 year ago Maybe its because of my usage of the nginx ingress https://github.com/kubernetes/ingress-nginx/issues/6287 ? @brandond or https://gitlab.com/gitlab-org/charts/gitlab/-/issues/2404
yodatak
commented
1 year ago i try with a fresh install and it does the same
ctr
root@XXX/tmp [SIGINT]# coredumpctl -1 info PID: 1010688 (ctr) UID: 0 (root) GID: 0 (root) Signal: 31 (SYS) Timestamp: Mon 2023-07-31 13:37:42 CEST (1min 20s ago) Command Line: ctr Executable: /var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s Control Group: /system.slice/falcon-sensor.service Unit: Slice: system.slice Boot ID: XXXX Machine ID: XXX Hostname: XXX Storage: /var/lib/systemd/coredump/core.ctr.0.446c24c60ed642b18442eace5c2f33cf.1010688.1690803462000000.lz4 Message: Process 1010688 (ctr) of user 0 dumped core.
Stack trace of thread 1010688:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)Jul 31 13:37:38 XXXX kernel: cni0: port 5(vethee5664a3) entered blocking state
Jul 31 13:37:38 XXXX kernel: cni0: port 5(vethee5664a3) entered disabled state
Jul 31 13:37:38 XXXX kernel: device vethee5664a3 entered promiscuous mode
Jul 31 13:37:38 XXXX kernel: cni0: port 5(vethee5664a3) entered blocking state
Jul 31 13:37:38 XXXX kernel: cni0: port 5(vethee5664a3) entered forwarding state
Jul 31 13:37:38 XXXX NetworkManager[1163]: <info> [1690803458.7499] manager: (vethee5664a3): new Veth device (/org/freedesktop/NetworkManager/Devices/252)
Jul 31 13:37:38 XXXX systemd-udevd[1009991]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jul 31 13:37:38 XXXX systemd-udevd[1009991]: Could not generate persistent MAC address for vethee5664a3: No such file or directory
Jul 31 13:37:38 XXXX NetworkManager[1163]: <info> [1690803458.7542] device (vethee5664a3): carrier: link connected
Jul 31 13:37:38 XXXX k3s[1007836]: I0731 13:37:38.893535 1007836 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b6a46ba4-c00e-433d-ab17-9523273b54c0-data\") pod \"traefik-57c84cf78d-vlsgn\" (UID: \"b6a46ba4-c00e-433d-ab17-9523273b54c0\") " pod="kube-system/traefik-57c84cf78d-vlsgn"
Jul 31 13:37:38 XXXX k3s[1007836]: I0731 13:37:38.893573 1007836 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6a46ba4-c00e-433d-ab17-9523273b54c0-tmp\") pod \"traefik-57c84cf78d-vlsgn\" (UID: \"b6a46ba4-c00e-433d-ab17-9523273b54c0\") " pod="kube-system/traefik-57c84cf78d-vlsgn"
Jul 31 13:37:38 XXXX k3s[1007836]: I0731 13:37:38.893592 1007836 reconciler_common.go:253] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-848kl\" (UniqueName: \"kubernetes.io/projected/b6a46ba4-c00e-433d-ab17-9523273b54c0-kube-api-access-848kl\") pod \"traefik-57c84cf78d-vlsgn\" (UID: \"b6a46ba4-c00e-433d-ab17-9523273b54c0\") " pod="kube-system/traefik-57c84cf78d-vlsgn"
Jul 31 13:37:38 XXXX systemd[1]: Started libcontainer container e929326c340d2171f31b7d43a46fe8717686fcfd2d939fffb2c01f4a66e5a132.
Jul 31 13:37:38 XXXX systemd[1]: Started Process Core Dump (PID 1010149/UID 0).
Jul 31 13:37:39 XXXX kernel: cni0: port 6(veth9dac105d) entered blocking state
Jul 31 13:37:39 XXXX kernel: cni0: port 6(veth9dac105d) entered disabled state
Jul 31 13:37:39 XXXX kernel: device veth9dac105d entered promiscuous mode
Jul 31 13:37:39 XXXX kernel: cni0: port 6(veth9dac105d) entered blocking state
Jul 31 13:37:39 XXXX kernel: cni0: port 6(veth9dac105d) entered forwarding state
Jul 31 13:37:39 XXXX systemd-udevd[1010182]: link_config: autonegotiation is unset or enabled, the speed and duplex are not writable.
Jul 31 13:37:39 XXXX systemd-udevd[1010182]: Could not generate persistent MAC address for veth9dac105d: No such file or directory
Jul 31 13:37:39 XXXX NetworkManager[1163]: <info> [1690803459.0360] manager: (veth9dac105d): new Veth device (/org/freedesktop/NetworkManager/Devices/253)
Jul 31 13:37:39 XXXX NetworkManager[1163]: <info> [1690803459.0427] device (veth9dac105d): carrier: link connected
Jul 31 13:37:39 XXXX systemd[1]: Started libcontainer container d77d7e7024c6062d04b814fe026a054c5d3d9aaa8e638dc56e785d09bbe985f6.
Jul 31 13:37:39 XXXX systemd-coredump[1010158]: Process 1010122 (ctr) of user 0 dumped core.
Stack trace of thread 1010122:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:39 XXXX systemd[1]: systemd-coredump@7494-1010149-0.service: Succeeded.
Jul 31 13:37:39 XXXX systemd[1]: Started Process Core Dump (PID 1010258/UID 0).
Jul 31 13:37:39 XXXX systemd[1]: var-lib-kubelet-pods-2b235c3c\x2d464e\x2d492c\x2d847f\x2d3be104aecfad-volumes-kubernetes.io\x7esecret-values.mount: Succeeded.
Jul 31 13:37:39 XXXX systemd-coredump[1010259]: Process 1010244 (ctr) of user 0 dumped core.
Stack trace of thread 1010244:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:39 XXXX systemd[1]: systemd-coredump@7495-1010258-0.service: Succeeded.
Jul 31 13:37:39 XXXX k3s[1007836]: I0731 13:37:39.388291 1007836 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b92294311f58728711195a515c196103aa2cc5f43b0a7d194e859b3e7d5b6169"
Jul 31 13:37:39 XXXX systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod2b235c3c_464e_492c_847f_3be104aecfad.slice.
Jul 31 13:37:39 XXXX systemd[1]: kubepods-besteffort-pod2b235c3c_464e_492c_847f_3be104aecfad.slice: Consumed 1.092s CPU time
Jul 31 13:37:39 XXXX systemd[1]: Started Process Core Dump (PID 1010280/UID 0).
Jul 31 13:37:39 XXXX k3s[1007836]: I0731 13:37:39.401003 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik-crd
Jul 31 13:37:39 XXXX systemd-coredump[1010281]: Process 1010266 (ctr) of user 0 dumped core.
Stack trace of thread 1010266:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:39 XXXX systemd[1]: systemd-coredump@7496-1010280-0.service: Succeeded.
Jul 31 13:37:39 XXXX systemd[1]: Started Process Core Dump (PID 1010317/UID 0).
Jul 31 13:37:39 XXXX systemd-coredump[1010318]: Process 1010303 (ctr) of user 0 dumped core.
Stack trace of thread 1010303:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:39 XXXX systemd[1]: systemd-coredump@7497-1010317-0.service: Succeeded.
Jul 31 13:37:40 XXXX k3s[1007836]: I0731 13:37:40.404997 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik-crd
Jul 31 13:37:40 XXXX k3s[1007836]: I0731 13:37:40.408414 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik-crd
Jul 31 13:37:40 XXXX k3s[1007836]: I0731 13:37:40.411183 1007836 event.go:294] "Event occurred" object="kube-system/helm-install-traefik-crd" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"
Jul 31 13:37:40 XXXX k3s[1007836]: I0731 13:37:40.411376 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik-crd
Jul 31 13:37:40 XXXX k3s[1007836]: I0731 13:37:40.413323 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik-crd
Jul 31 13:37:40 XXXX systemd[1]: NetworkManager-dispatcher.service: Succeeded.
Jul 31 13:37:40 XXXX k3s[1007836]: I0731 13:37:40.687136 1007836 controller.go:615] quota admission added evaluator for: ingressroutes.traefik.containo.us
Jul 31 13:37:40 XXXX systemd[1]: cri-containerd-216841945bf60e689df39acee4abab91700a73c663c44dccfd854cbc4bc24be6.scope: Succeeded.
Jul 31 13:37:40 XXXX systemd[1]: cri-containerd-216841945bf60e689df39acee4abab91700a73c663c44dccfd854cbc4bc24be6.scope: Consumed 1.037s CPU time
Jul 31 13:37:40 XXXX systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-216841945bf60e689df39acee4abab91700a73c663c44dccfd854cbc4bc24be6-rootfs.mount: Succeeded.
Jul 31 13:37:41 XXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3935654293.mount: Succeeded.
Jul 31 13:37:41 XXXX k3s[1007836]: I0731 13:37:41.395885 1007836 scope.go:115] "RemoveContainer" containerID="990fd29bebbd6d9f79d315fd5436530a19cfc3a8eac6ec86bf38b6c4884e6c9f"
Jul 31 13:37:41 XXXX k3s[1007836]: I0731 13:37:41.401908 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:41 XXXX systemd[1]: Started libcontainer container d15eb85cdcfa29a3a7766d80d0a2ba23e553a057b2b1d816c0a048cdf1e0fb4b.
Jul 31 13:37:41 XXXX systemd[1]: Started Process Core Dump (PID 1010404/UID 0).
Jul 31 13:37:41 XXXX systemd[1]: Started libcontainer container fb2b1f71c327507b6864cac83cbab0fe288192c980852dff5d1fb63390b287b1.
Jul 31 13:37:41 XXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1125621657.mount: Succeeded.
Jul 31 13:37:41 XXXX systemd-coredump[1010405]: Process 1010390 (ctr) of user 0 dumped core.
Stack trace of thread 1010390:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:41 XXXX systemd[1]: systemd-coredump@7498-1010404-0.service: Succeeded.
Jul 31 13:37:41 XXXX systemd[1]: Started Process Core Dump (PID 1010480/UID 0).
Jul 31 13:37:41 XXXX systemd-coredump[1010483]: Process 1010459 (ctr) of user 0 dumped core.
Stack trace of thread 1010459:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:41 XXXX systemd[1]: systemd-coredump@7499-1010480-0.service: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: Started Process Core Dump (PID 1010514/UID 0).
Jul 31 13:37:42 XXXX systemd-coredump[1010515]: Process 1010502 (ctr) of user 0 dumped core.
Stack trace of thread 1010502:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:42 XXXX systemd[1]: systemd-coredump@7500-1010514-0.service: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: Started Process Core Dump (PID 1010528/UID 0).
Jul 31 13:37:42 XXXX systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount264228534.mount: Succeeded.
Jul 31 13:37:42 XXXX systemd-coredump[1010529]: Process 1010516 (ctr) of user 0 dumped core.
Stack trace of thread 1010516:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:42 XXXX systemd[1]: systemd-coredump@7501-1010528-0.service: Succeeded.
Jul 31 13:37:42 XXXX k3s[1007836]: I0731 13:37:42.417349 1007836 event.go:294] "Event occurred" object="kube-system/traefik" fieldPath="" kind="Service" apiVersion="v1" type="Normal" reason="UpdatedLoadBalancer" message="Updated LoadBalancer with new IPs: [] -> [10.2.101.206]"
Jul 31 13:37:42 XXXX k3s[1007836]: I0731 13:37:42.429061 1007836 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/svclb-traefik-6923a0ba-gmhh8" podStartSLOduration=-9.223372032425741e+09 pod.CreationTimestamp="2023-07-31 13:37:38 +0200 CEST" firstStartedPulling="2023-07-31 13:37:39.03514514 +0200 CEST m=+28.362943941" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-07-31 13:37:42.414371689 +0200 CEST m=+31.742170498" watchObservedRunningTime="2023-07-31 13:37:42.429035447 +0200 CEST m=+31.756834262"
Jul 31 13:37:42 XXXX k3s[1007836]: I0731 13:37:42.429275 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:42 XXXX k3s[1007836]: I0731 13:37:42.429634 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:42 XXXX systemd[1]: Started libcontainer container 3ac003866b4f2c28037b6e89b9f7a2d68aada7967005775ede0347cc09f8e163.
Jul 31 13:37:42 XXXX systemd[1]: Started Process Core Dump (PID 1010567/UID 0).
Jul 31 13:37:42 XXXX systemd[1]: cri-containerd-8c5cc5fcdb0ed5d441464f4d2d1a29d928c579adf8438ad67d8e6572f8f9bc62.scope: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: cri-containerd-8c5cc5fcdb0ed5d441464f4d2d1a29d928c579adf8438ad67d8e6572f8f9bc62.scope: Consumed 28ms CPU time
Jul 31 13:37:42 XXXX kernel: cni0: port 2(veth2f6c109d) entered disabled state
Jul 31 13:37:42 XXXX kernel: device veth2f6c109d left promiscuous mode
Jul 31 13:37:42 XXXX kernel: cni0: port 2(veth2f6c109d) entered disabled state
Jul 31 13:37:42 XXXX systemd-coredump[1010583]: Process 1010550 (ctr) of user 0 dumped core.
Stack trace of thread 1010550:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:42 XXXX systemd[1]: run-containerd-runc-k8s.io-3ac003866b4f2c28037b6e89b9f7a2d68aada7967005775ede0347cc09f8e163-runc.pmLFMe.mount: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8c5cc5fcdb0ed5d441464f4d2d1a29d928c579adf8438ad67d8e6572f8f9bc62-rootfs.mount: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-8c5cc5fcdb0ed5d441464f4d2d1a29d928c579adf8438ad67d8e6572f8f9bc62-shm.mount: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: Started Process Core Dump (PID 1010698/UID 0).
Jul 31 13:37:42 XXXX systemd[1]: systemd-coredump@7502-1010567-0.service: Succeeded.
Jul 31 13:37:42 XXXX systemd[1]: run-netns-cni\x2d37e565a6\x2d86fd\x2d605e\x2d503f\x2d13db900befc0.mount: Succeeded.
Jul 31 13:37:43 XXXX systemd-coredump[1010699]: Process 1010688 (ctr) of user 0 dumped core.
Stack trace of thread 1010688:
#0 0x0000000000403e6e n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#1 0x0000000000492e28 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#2 0x0000000000e018a7 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#3 0x0000000000e01745 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#4 0x000000000044d506 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#5 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#6 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#7 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#8 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#9 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#10 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#11 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#12 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#13 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#14 0x000000000044d451 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#15 0x000000000043fb86 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
#16 0x00000000004761e1 n/a (/var/lib/rancher/k3s/data/62ff59e22710b2974e2c9c7bbbcbe57405154a38008884688c322a5723136bd3/bin/k3s)
Jul 31 13:37:43 XXXX systemd[1]: systemd-coredump@7503-1010698-0.service: Succeeded.
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.126873 1007836 reconciler_common.go:169] "operationExecutor.UnmountVolume started for volume \"values\" (UniqueName: \"kubernetes.io/secret/a9b3198d-dedd-403d-a0fc-fec73eec9b49-values\") pod \"a9b3198d-dedd-403d-a0fc-fec73eec9b49\" (UID: \"a9b3198d-dedd-403d-a0fc-fec73eec9b49\") "
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.127122 1007836 reconciler_common.go:169] "operationExecutor.UnmountVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/a9b3198d-dedd-403d-a0fc-fec73eec9b49-content\") pod \"a9b3198d-dedd-403d-a0fc-fec73eec9b49\" (UID: \"a9b3198d-dedd-403d-a0fc-fec73eec9b49\") "
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.127141 1007836 reconciler_common.go:169] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fr9w\" (UniqueName: \"kubernetes.io/projected/a9b3198d-dedd-403d-a0fc-fec73eec9b49-kube-api-access-6fr9w\") pod \"a9b3198d-dedd-403d-a0fc-fec73eec9b49\" (UID: \"a9b3198d-dedd-403d-a0fc-fec73eec9b49\") "
Jul 31 13:37:43 XXXX k3s[1007836]: W0731 13:37:43.127542 1007836 empty_dir.go:525] Warning: Failed to clear quota on /var/lib/kubelet/pods/a9b3198d-dedd-403d-a0fc-fec73eec9b49/volumes/kubernetes.io~configmap/content: clearQuota called, but quotas disabled
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.127652 1007836 operation_generator.go:900] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9b3198d-dedd-403d-a0fc-fec73eec9b49-content" (OuterVolumeSpecName: "content") pod "a9b3198d-dedd-403d-a0fc-fec73eec9b49" (UID: "a9b3198d-dedd-403d-a0fc-fec73eec9b49"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGidValue ""
Jul 31 13:37:43 XXXX systemd[1]: var-lib-kubelet-pods-a9b3198d\x2ddedd\x2d403d\x2da0fc\x2dfec73eec9b49-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d6fr9w.mount: Succeeded.
Jul 31 13:37:43 XXXX systemd[1]: var-lib-kubelet-pods-a9b3198d\x2ddedd\x2d403d\x2da0fc\x2dfec73eec9b49-volumes-kubernetes.io\x7esecret-values.mount: Succeeded.
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.139144 1007836 operation_generator.go:900] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9b3198d-dedd-403d-a0fc-fec73eec9b49-kube-api-access-6fr9w" (OuterVolumeSpecName: "kube-api-access-6fr9w") pod "a9b3198d-dedd-403d-a0fc-fec73eec9b49" (UID: "a9b3198d-dedd-403d-a0fc-fec73eec9b49"). InnerVolumeSpecName "kube-api-access-6fr9w". PluginName "kubernetes.io/projected", VolumeGidValue ""
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.139148 1007836 operation_generator.go:900] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9b3198d-dedd-403d-a0fc-fec73eec9b49-values" (OuterVolumeSpecName: "values") pod "a9b3198d-dedd-403d-a0fc-fec73eec9b49" (UID: "a9b3198d-dedd-403d-a0fc-fec73eec9b49"). InnerVolumeSpecName "values". PluginName "kubernetes.io/secret", VolumeGidValue ""
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.227258 1007836 reconciler_common.go:295] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/secret/a9b3198d-dedd-403d-a0fc-fec73eec9b49-values\") on node \"XXXX\" DevicePath \"\""
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.227281 1007836 reconciler_common.go:295] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/a9b3198d-dedd-403d-a0fc-fec73eec9b49-content\") on node \"XXXX\" DevicePath \"\""
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.227290 1007836 reconciler_common.go:295] "Volume detached for volume \"kube-api-access-6fr9w\" (UniqueName: \"kubernetes.io/projected/a9b3198d-dedd-403d-a0fc-fec73eec9b49-kube-api-access-6fr9w\") on node \"XXXX\" DevicePath \"\""
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.428365 1007836 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c5cc5fcdb0ed5d441464f4d2d1a29d928c579adf8438ad67d8e6572f8f9bc62"
Jul 31 13:37:43 XXXX systemd[1]: Removed slice libcontainer container kubepods-besteffort-poda9b3198d_dedd_403d_a0fc_fec73eec9b49.slice.
Jul 31 13:37:43 XXXX systemd[1]: kubepods-besteffort-poda9b3198d_dedd_403d_a0fc_fec73eec9b49.slice: Consumed 1.862s CPU time
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.435997 1007836 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="kube-system/traefik-57c84cf78d-vlsgn" podStartSLOduration=-9.223372031418804e+09 pod.CreationTimestamp="2023-07-31 13:37:38 +0200 CEST" firstStartedPulling="2023-07-31 13:37:39.201209663 +0200 CEST m=+28.529008464" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2023-07-31 13:37:43.435402757 +0200 CEST m=+32.763201573" watchObservedRunningTime="2023-07-31 13:37:43.435972458 +0200 CEST m=+32.763771274"
Jul 31 13:37:43 XXXX k3s[1007836]: I0731 13:37:43.443878 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:44 XXXX k3s[1007836]: I0731 13:37:44.447858 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:44 XXXX k3s[1007836]: I0731 13:37:44.451363 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:44 XXXX k3s[1007836]: I0731 13:37:44.454351 1007836 job_controller.go:514] enqueueing job kube-system/helm-install-traefik
Jul 31 13:37:44 XXXX k3s[1007836]: I0731 13:37:44.454609 1007836 event.go:294] "Event occurred" object="kube-system/helm-install-traefik" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628140 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for ingressroutetcps.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628388 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for tlsstores.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628407 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for serverstransports.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628428 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for ingressroutes.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628443 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for middlewares.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628457 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for traefikservices.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628470 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for ingressrouteudps.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628484 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for tlsoptions.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628505 1007836 resource_quota_monitor.go:218] QuotaMonitor created object count evaluator for middlewaretcps.traefik.containo.us
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.628562 1007836 shared_informer.go:270] Waiting for caches to sync for resource quota
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.729264 1007836 shared_informer.go:277] Caches are synced for resource quota
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.946573 1007836 shared_informer.go:270] Waiting for caches to sync for garbage collector
Jul 31 13:37:57 XXXX k3s[1007836]: I0731 13:37:57.946619 1007836 shared_informer.go:277] Caches are synced for garbage collector
Jul 31 13:38:14 XXXX k3s[1007836]: E0731 13:38:14.221497 1007836 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"73b8c2617700ee1ce5c0a5607d5e908864e14ed724355ce4dae67504512ad01f\": not found" containerID="73b8c2617700ee1ce5c0a5607d5e908864e14ed724355ce4dae67504512ad01f"
Jul 31 13:38:14 XXXX k3s[1007836]: I0731 13:38:14.221525 1007836 kuberuntime_gc.go:362] "Error getting ContainerStatus for containerID" containerID="73b8c2617700ee1ce5c0a5607d5e908864e14ed724355ce4dae67504512ad01f" err="rpc error: code = NotFound desc = an error occurred when try to find container \"73b8c2617700ee1ce5c0a5607d5e908864e14ed724355ce4dae67504512ad01f\": not found"
Jul 31 13:38:14 XXXX k3s[1007836]: E0731 13:38:14.221816 1007836 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"1ee61810d26d6ce8499478d20879ddada506c43a40d62addfea5aa1a34e5f06d\": not found" containerID="1ee61810d26d6ce8499478d20879ddada506c43a40d62addfea5aa1a34e5f06d"
Jul 31 13:38:14 XXXX k3s[1007836]: I0731 13:38:14.221841 1007836 kuberuntime_gc.go:362] "Error getting ContainerStatus for containerID" containerID="1ee61810d26d6ce8499478d20879ddada506c43a40d62addfea5aa1a34e5f06d" err="rpc error: code = NotFound desc = an error occurred when try to find container \"1ee61810d26d6ce8499478d20879ddada506c43a40d62addfea5aa1a34e5f06d\": not found"
Jul 31 13:38:14 XXXX k3s[1007836]: E0731 13:38:14.222090 1007836 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"6f19de75844d00f875a521e4ed1f63f79e09446bb06432b812f89191835edef5\": not found" containerID="6f19de75844d00f875a521e4ed1f63f79e09446bb06432b812f89191835edef5"
Jul 31 13:38:14 XXXX k3s[1007836]: I0731 13:38:14.222112 1007836 kuberuntime_gc.go:362] "Error getting ContainerStatus for containerID" containerID="6f19de75844d00f875a521e4ed1f63f79e09446bb06432b812f89191835edef5" err="rpc error: code = NotFound desc = an error occurred when try to find container \"6f19de75844d00f875a521e4ed1f63f79e09446bb06432b812f89191835edef5\": not found"
Jul 31 13:38:14 XXXX k3s[1007836]: E0731 13:38:14.222385 1007836 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"83b92e22f94d489ca9b6246f413169f4ef211b3edd5aee86ef00321912c1ce36\": not found" containerID="83b92e22f94d489ca9b6246f413169f4ef211b3edd5aee86ef00321912c1ce36"
Jul 31 13:38:14 XXXX k3s[1007836]: I0731 13:38:14.222406 1007836 kuberuntime_gc.go:362] "Error getting ContainerStatus for containerID" containerID="83b92e22f94d489ca9b6246f413169f4ef211b3edd5aee86ef00321912c1ce36" err="rpc error: code = NotFound desc = an error occurred when try to find container \"83b92e22f94d489ca9b6246f413169f4ef211b3edd5aee86ef00321912c1ce36\": not found"
Jul 31 13:38:14 XXXX k3s[1007836]: E0731 13:38:14.222643 1007836 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"e1f16e29d4c91bcc394d8718122521b92d90dc22b1c042d43a23c1346b7efc1d\": not found" containerID="e1f16e29d4c91bcc394d8718122521b92d90dc22b1c042d43a23c1346b7efc1d"
Jul 31 13:38:14 XXXX k3s[1007836]: I0731 13:38:14.222668 1007836 kuberuntime_gc.go:362] "Error getting ContainerStatus for containerID" containerID="e1f16e29d4c91bcc394d8718122521b92d90dc22b1c042d43a23c1346b7efc1d" err="rpc error: code = NotFound desc = an error occurred when try to find container \"e1f16e29d4c91bcc394d8718122521b92d90dc22b1c042d43a23c1346b7efc1d\": not found"
Jul 31 13:38:14 XXXX k3s[1007836]: E0731 13:38:14.222887 1007836 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"aa2e4d92741fc1d60038b0b8dec4c177c78419bbf001a36ceb57326e1b1d33db\": not found" containerID="aa2e4d92741fc1d60038b0b8dec4c177c78419bbf001a36ceb57326e1b1d33db"
Jul 31 13:38:14 XXXX k3s[1007836]: I0731 13:38:14.222904 1007836 kuberuntime_gc.go:362] "Error getting ContainerStatus for containerID" containerID="aa2e4d92741fc1d60038b0b8dec4c177c78419bbf001a36ceb57326e1b1d33db" err="rpc error: code = NotFound desc = an error occurred when try to find container \"aa2e4d92741fc1d60038b0b8dec4c177c78419bbf001a36ceb57326e1b1d33db\": not found"Can i have a way to test developement build with containerd ?
brandond
commented
1 year ago Are you still running Crowdstrike on these nodes? Is it still reporting that it's killing the processes?
yodatak
commented
1 year ago Are you still running Crowdstrike on these nodes? Is it still reporting that it's killing the processes?
I must have crowdstrike but it don't kill anything since months so maybe it's a bad idea
It core dump with secomp so I think it's because of changes in contained that are not upstream yet in k3s
brandond
commented
1 year ago You can always install your own version of containerd and point k3s at it with the --container-runtime-endpoint option.
We are looking at updating containerd in the next release: https://github.com/k3s-io/k3s/issues/7986
caroline-suse-rancher
commented
1 year ago Converting this to a discussion as this doesn't seem directly related to a bug in k3s
Environmental Info: k3s version v1.26.6+k3s1 (3b1919b0) go version go1.19.10
Node(s) CPU architecture, OS, and Version: Red Hat Enterprise Linux release 8.8 (Ootpa) Linux 4.18.0-477.13.1.el8_8.x86_64 #1 SMP Thu May 18 10:27:05 EDT 2023 x86_64 x86_64 x86_64 GNU/Linux
Cluster Configuration: single node with etcd without traefik root@XXXX~# kubectl get nodes NAME STATUS ROLES AGE VERSION XXXXXReady control-plane,etcd,master 118d v1.26.6+k3s1
Describe the bug: Some time i got the ctr process that goes to coredump /var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s /var/lib/systemd/coredump/core.ctr.0.218dc6d6d4a341d5b11ce9608403af8c.82070.1689001743000000.lz4
coredumpctl -1 info PID: 81681 (ctr) UID: 0 (root) GID: 0 (root) Signal: 31 (SYS) Timestamp: Mon 2023-07-10 17:08:59 CEST (1s ago) Command Line: ctr Executable: /var/lib/rancher/k3s/data/0e6681f4002cdce946827bee7229eb1641dde5036b17cc7dcec1241294a3c52a/bin/k3s Control Group: /system.slice/falcon-sensor.service Unit: Slice: system.slice Boot ID: 218dc6d6d4a341d5b11ce9608403af8c Machine ID: XXXX Hostname: XXXX Storage: /var/lib/systemd/coredump/core.ctr.0.218dc6d6d4a341d5b11ce9608403af8c.81681.1689001739000000.lz4 Message: Process 81681 (ctr) of user 0 dumped core.
Steps To Reproduce: No idea :/