search

ucbrise / clipper

A low-latency prediction-serving system
http://clipper.ai
Apache License 2.0
1.4k stars 280 forks source link

[Performance] Performance Degradation on Kubernetes #590

Open simon-mo opened 6 years ago

simon-mo commented 6 years ago

User is reporting:

I set up clipper on a Kubernetes cluster and tried to see how models perform. I found that the response time of models (even the helloworld example on clipper homepage) kept increasing as I submitted more queries.

simon-mo commented 6 years ago

I will try to re-produce this.

ZhuozhaoLi commented 6 years ago

I will try to re-produce this.

Thanks. I tried on both minikube and a dedicated Kubernetes cluster, and the issue happened on both case.

I used the tutorial model (sum-list), With the following data input in every query: data = [random.uniform(0, 500) for _ in range(2)]

rkooo567 commented 5 years ago

Hi, @simon-mo How's the status for this?