I see that on various notebook reconciliations, the reconcile handler reports the same error
However the error is not critical, since it eventually reconciles it ok.
This red herring in the logs messes with the alerts from JupyterControllerRuntimeReconciliationErrorsExceedThreshold which results in it almost always firing.
2024-10-01T13:07:25.847Z [jupyter-controller] 1.7277880458479142e+09 ERROR controller.notebook Reconciler error {"reconciler group": "kubeflow.org", "reconciler kind": "Notebook", "name": "mini-notebook-gpu", "namespace": "<REDACTED>", "error": "Operation cannot be fulfilled on notebooks.kubeflow.org \"mini-notebook-gpu\": the object has been modified; please apply your changes to the latest version and try again"}
Bug Description
I see that on various notebook reconciliations, the reconcile handler reports the same error
However the error is not critical, since it eventually reconciles it ok. This red herring in the logs messes with the alerts from
JupyterControllerRuntimeReconciliationErrorsExceedThreshold
which results in it almost always firing.I filed an issue upstream https://github.com/kubeflow/notebooks/issues/62
To Reproduce
N/A
Environment
ckf 1.9/stable jupyter controller
1.9/stable 1038
Relevant Log Output
Additional Context
No response