apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

https://kyuubi.apache.org/

Apache License 2.0

2.11k stars 914 forks source link

[KYUUBI #6637] Python worker process pooling #6684

Open yoock opened 2 months ago

yoock commented 2 months ago

:mag: Description

Issue References 🔗

This pull request fixes #6637

Describe Your Solution 🔧

Design a Python process pool, pre create Python processes to avoid the creation of Python processes affecting code execution speed

Types of changes :bookmark:

[ ] Bugfix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

Behavior Without This Pull Request :coffin:

Behavior With This Pull Request :tada:

Related Unit Tests

Checklist 📝

[x] This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.