kube-HPC / hkube

🐟 High Performance Computing over Kubernetes - Core Repo 🎣
http://hkube.io
MIT License
305 stars 20 forks source link

API server response time for exec pipeline deteriorate over time #1556

Closed tamir321 closed 1 year ago

tamir321 commented 2 years ago

HKube micro-service API Server

Describe the bug API server response time for exec pipeline deteriorate over time

when executing the following bash

for xxx in {1..300}; do time for i in {1..25}; do curl -X POST -H 'content-type: application/json' https://test.hkube.io/hkube/api-server/api/v1/exec/stored -d '{"name": "bundel1"}'; done; for i in {1..25}; do curl -X POST -H 'content-type: application/json' https://test.hkube.io/hkube/api-server/api/v1/exec/stored -d '{"name": "bundel2"}'; done; done

sending the first 50 pipelines takes ~3 seconds overtime it deteriorate and can get to up to 18 sec

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.