apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
https://kyuubi.apache.org/
Apache License 2.0
2.07k stars 902 forks source link

Server hangs after too many connections in USER isolation level [Bug] #5033

Open hanna-liashchuk opened 1 year ago

hanna-liashchuk commented 1 year ago

Code of Conduct

Search before asking

Describe the bug

If you run too many queries in parallel from one user in engine share level USER, the Kyuubi server gets stuck and does not release connections. The jobs just hang without finishing

Affects Version(s)

1.7.0/1.7.1

Kyuubi Server Log Output

No response

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

kyuubi.engine.share.level=USER;

Kyuubi Engine Configurations

No response

Additional context

I can reproduce this issue by running a test plan in Jmeter with 30 threads(users) and ramp-up period - 600. Server restart helps

Screenshot 2023-07-07 at 14 14 21

Are you willing to submit PR?

pan3793 commented 1 year ago

Have you looked at the jstack output?