k8snetworkplumbingwg / whereabouts

A CNI IPAM plugin that assigns IP addresses cluster-wide
Apache License 2.0
273 stars 120 forks source link

[BUG] Failed to create the reconcile looper: failed to list all OverLappingIPs: client rate limiter Wait returned an error: context deadline exceeded #388

Closed pallavi-mandole closed 7 months ago

pallavi-mandole commented 7 months ago

Describe the bug reconciler failure was reported when we tried to scale in/out during this reconciler job schedule but failed to run with the given error - [error] failed to list all OverLappingIPs: client rate limiter Wait returned an error: context deadline exceeded. [error] failed to create the reconcile looper: failed to list all OverLappingIPs: client rate limiter Wait returned an error: context deadline exceeded [verbose] reconciler failure: failed to list all OverLappingIPs: client rate limiter Wait returned an error: context deadline exceeded.

Current Behavior the deployment of pod replicas to 500, the same for ippam podreferences. But when we scale in replicas to 1, pods are scaled successfully but 130 podreferences are left. I did 2 series of scale in/out and then release uninstall and redeployment - the same issue every time: 130 podreferences left undeleted after scale in.

Expected behavior A clear and concise description of what you expected to happen.

To Reproduce Steps to reproduce the behavior:

  1. the deployment of pod replicas to 500, the same for ippam podreferences.
  2. But when we scale in replicas to 1, pods are scaled successfully but 130 podreferences are left.
  3. Do these 2 series of scale in/out and then release uninstall and redeployment - the same issue every time: 130 podreferences left undeleted after a scale in.

Environment:

Additional info / context Add any other information / context about the problem here.