Manager service locks when uploading model

Hydrospheredata / hydro-serving

MLOps Platform

http://docs.hydrosphere.io

Apache License 2.0

271 stars 42 forks source link

Manager service locks when uploading model #345

Closed KineticCookie closed 3 years ago

KineticCookie commented 3 years ago

since 2.4.0 release (maybe even earlier?) Happens mostly on k8s deployment When user uploads a single model, HTTP endpoints become unresponsive Also, connection-pool leaks detector freaks out

KineticCookie commented 3 years ago

We implemented JMX export with hikari telemetry to identify if issue is indeed with some specific DB setup.

KineticCookie commented 3 years ago

Need to investigate used thread pool configuration. Could it be that some methods just starve threadpool?

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.