oap-project / gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
Apache License 2.0
256 stars 77 forks source link

Performance problem with get_json_object #1155

Open jackylee-ch opened 1 year ago

jackylee-ch commented 1 year ago

Describe the bug We meet this problem in a long running application. When the queries, which contains get_json_object in Project or Filter, has been run multiple times, we find the performance is severely degraded. The flame graph shows that there is a problem of multi-threaded contention for locks, and the problem disappears when there is only one thread in executor.

image