knative / serving

Kubernetes-based, scale-to-zero, request-driven compute
https://knative.dev/docs/serving/
Apache License 2.0
5.56k stars 1.16k forks source link

Load balancing is not working as expected, and one pod receives all traffic #11113

Closed daganida88 closed 2 years ago

daganida88 commented 3 years ago

Ask your question here:

I have a revision with two pods running, where one pod receives all traffic and the other is not. When I look at the queue proxu container I see the following errors:│ queue-proxy aggressive probe error: dial tcp 127.0.0.1:9000: connect: connection refused
I am not sure if it is related or not, but I can't figure this out. I am using KFServing version 0.5 with istio 1.7. │

vagababov commented 3 years ago

It's strange you're trying to probe port 9000, usually relegated to metrics. I think you should start with KFServing github/slack first?

daganida88 commented 3 years ago

My triton server is listening on port 9000 (grpc)

github-actions[bot] commented 3 years ago

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Reopen the issue with /reopen. Mark the issue as fresh by adding the comment /remove-lifecycle stale.

markusthoemmes commented 3 years ago

@daganida88 is this still an issue? If so, could you please specify the Knative version in use?

github-actions[bot] commented 3 years ago

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Reopen the issue with /reopen. Mark the issue as fresh by adding the comment /remove-lifecycle stale.