Spikes seen in Source Transformer when auto scaling - Githubissues

numaproj / numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

https://numaflow.numaproj.io/

Apache License 2.0

1.1k stars 112 forks source link

Spikes seen in Source Transformer when auto scaling #859

Closed RohanAshar closed 3 months ago

RohanAshar commented 1 year ago

Describe the bug During stead traffic we see there are spikes in the source transformer read messages when auto scaling is enabled. The following behavior was observed with min and max set to 1 and 5 respectively. The issue resolved itself when both the min and max were set to 5.

Expected behavior The read messages should follow the same behavior irrespective of auto scaling.

Screenshots

Environment (please complete the following information):

Numaflow: v0.9.0-rc1

Message from the maintainers:

Impacted by this bug? Give it a 👍. We often sort issues this way to know what to prioritize.

vigith commented 1 year ago

Please try out 0.9.0-rc2, which includes #846, which should alleviate this issue.

RohanAshar commented 1 year ago

Upgrading to 0.9.0-rc2 did not work. It still has the same behavior.

kohlisid commented 3 months ago

Closing as issue not seen, will reopen if observed again.