spotify / flink-on-k8s-operator

Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
Apache License 2.0
188 stars 68 forks source link

maxConcurrentReconciles not work #827

Open lppsuixn opened 1 month ago

lppsuixn commented 1 month ago

We have over 400 tasks running, and we've noticed that each task submission takes about 5 minutes. We checked the relevant metrics, and the workqueue_queue_duration_seconds_sum/workqueue_queue_duration_seconds_count is at 60 seconds. We set MaxConcurrentReconciles to 60, but it hasn't made a significant difference. Looking at the logs, we didn't see whether the processing is parallel or sequential. image image