apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
https://kyuubi.apache.org/
Apache License 2.0
2.09k stars 914 forks source link

[Bug] JsonLoggingEventHandler writers may leading to memory leaks #5207

Open cs-lpc opened 1 year ago

cs-lpc commented 1 year ago

Code of Conduct

Search before asking

Describe the bug

In org.apache.kyuubi.events.handler.JsonLoggingEventHandler. When there are too many partitions, a large number of unclosed writers will be created, leading to memory leaks.

image

Affects Version(s)

master

Kyuubi Server Log Output

No response

Kyuubi Engine Log Output

No response

Kyuubi Server Configurations

No response

Kyuubi Engine Configurations

No response

Additional context

No response

Are you willing to submit PR?

github-actions[bot] commented 1 year ago

Hello @cs-lpc, Thanks for finding the time to report the issue! We really appreciate the community's efforts to improve Apache Kyuubi.