F5Networks / k8s-bigip-ctlr

Repository for F5 Container Ingress Services for Kubernetes & OpenShift.
Apache License 2.0
362 stars 195 forks source link

F5 BIGIP controller -CIS 2.16.1 - errors during pushing data #3432

Closed wheestermans31 closed 2 months ago

wheestermans31 commented 5 months ago

Setup Details

CIS Version : 2.16.1

Build: f5networks/k8s-bigip-ctlr:2.16.1 BIGIP Version: BIG-IP 14.1.4.6 Build 0.0.8 Point Release 6 AS3 Version: 3.24.0 (f5-appsvcs)
Agent Mode: AS3 Orchestration: OpenShift Pool Mode: Cluster

Description

When the F5 BIGIP controller is pushing changes to the F5 we see regularly the following ERROR logging:

The first two can indicate some performance issue on the F5 BIGIP, but to be confirmed.

2024/05/23 06:31:06 [ERROR] [2024-05-23 06:31:06,498 f5_cccl.bigip ERROR] F5 SDK Error: HTTPSConnectionPool(host='150.45.88.251', port=443): Read timed out. (read timeout=30) 2024/05/23 06:31:06 [ERROR] [2024-05-23 06:31:06,498 main ERROR] CCCL Error: The requested partition OpenShift-ocp-behoi-01 was not found

2024/05/23 06:32:43 [ERROR] [2024-05-23 06:32:43,760 f5_cccl.bigip ERROR] F5 SDK Error: 503 Unexpected Error: Service Unavailable for uri: https://150.45.88.251:443/mgmt/tm/auth/partition/OpenShift-ocp-behoi-01 Text: '{"code":503,"message":"There is an active asynchronous task executing.","errorStack":[],"apiError":32964609}'

These lines, no clue where they are coming from:

2024/05/23 07:46:47 [ERROR] [2024-05-23 07:46:47,808 main ERROR] Unexpected error 2024/05/23 07:46:47 [ERROR] [2024-05-23 07:46:47,809 main ERROR] Error applying config, will try again in 1 seconds 2024/05/23 07:47:27 [ERROR] [2024-05-23 07:47:27,097 main ERROR] Unexpected error 2024/05/23 07:47:27 [ERROR] [2024-05-23 07:47:27,098 main ERROR] Error applying config, will try again in 1 seconds 2024/05/23 07:47:35 [ERROR] [2024-05-23 07:47:35,095 main ERROR] Unexpected error 2024/05/23 07:47:35 [ERROR] [2024-05-23 07:47:35,095 main ERROR] Error applying config, will try again in 2 seconds

What additional information you need for the above errors?

trinaths commented 5 months ago

Created [CONTCNTR-4743] for internal tracking.

trinaths commented 4 months ago

@wheestermans31 Please share CIS config, Resource manifests to reproduce this issue to automation_toolchain_pm automation_toolchain_pm@f5.com

mdditt2000 commented 2 months ago

Resolved in CIS 2.18 - https://clouddocs.f5.com/containers/latest/reference/release-notes.html