search

kubevirt / web-ui-operator

Operator for web-ui
Apache License 2.0
12 stars 16 forks source link

OutOfcpu console-XXXXX pods Issue #93

Closed jparrill closed 4 years ago

jparrill commented 5 years ago

In a rhhi.next environment using dev-scripts when we disconnect a master from the OCP cluster, many pods moves to the others nodes, the thing is when we reach the CPU limit of the nodes, the operator starts to create console-XXXXX pods first at Pending state and then that finishes on OutOfcpu state. 

...
kubevirt-web-ui                                         console-6578bf6d77-ktj2w                                          0/1     OutOfcpu    0          5m10s
kubevirt-web-ui                                         console-6578bf6d77-kvs7k                                          0/1     OutOfcpu    0          19m
kubevirt-web-ui                          +               console-6578bf6d77-kwlsj                                          0/1     OutOfcpu    0          5m11s
kubevirt-web-ui                                         console-6578bf6d77-kxjfw                                          0/1     OutOfcpu    0          23m
kubevirt-web-ui                                         console-6578bf6d77-l8xrv                                          0/1     OutOfcpu    0          11m
kubevirt-web-ui                                         console-6578bf6d77-lb5xb                                          0/1     OutOfcpu    0          18m
kubevirt-web-ui                                         console-6578bf6d77-lbcwd                                          0/1     OutOfcpu    0          21m
kubevirt-web-ui                                         console-6578bf6d77-lbnhm                                          0/1     OutOfcpu    0          6m5s
...

It happens every 10s (I guess) and the pods generated does not stop growing. (381 pods in ~30m)

jparrill commented 5 years ago

The CR:

apiVersion: v1
items:
- apiVersion: kubevirt.io/v1alpha1
  kind: KWebUI
  metadata:
    creationTimestamp: "2019-09-10T10:15:44Z"
    generation: 3
    labels:
      app: hyperconverged-cluster
    name: kubevirt-web-ui-hyperconverged-cluster
    ownerReferences:
    - apiVersion: hco.kubevirt.io/v1alpha1
      blockOwnerDeletion: true
      controller: true
      kind: HyperConverged
      name: hyperconverged-cluster
      uid: 5ae674e7-d3a1-11e9-8920-0096454fddca
    resourceVersion: "119440"
    selfLink: /apis/kubevirt.io/v1alpha1/kwebuis/kubevirt-web-ui-hyperconverged-cluster
    uid: f342f818-d3b3-11e9-8920-0096454fddca
  spec:
    version: v2.0.0-14.8
  status:
    message: 'Existing version conforms the requested one: v2.0.0-14.8. Nothing to
      do.'
    phase: PROVISIONED
kind: List
metadata:
  resourceVersion: ""
  selfLink: ""
kubevirt-bot commented 4 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

/lifecycle stale

kubevirt-bot commented 4 years ago

Stale issues rot after 30d of inactivity. Mark the issue as fresh with /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

/lifecycle rotten

kubevirt-bot commented 4 years ago

Rotten issues close after 30d of inactivity. Reopen the issue with /reopen. Mark the issue as fresh with /remove-lifecycle rotten.

/close

kubevirt-bot commented 4 years ago

@kubevirt-bot: Closing this issue.

In response to [this](https://github.com/kubevirt/web-ui-operator/issues/93#issuecomment-583386636): >Rotten issues close after 30d of inactivity. >Reopen the issue with `/reopen`. >Mark the issue as fresh with `/remove-lifecycle rotten`. > >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.