Native-sql-engine of OAP-1.1.1 has lower performance benefit comparing with OAP-1.1.

oap-project / gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

Apache License 2.0

256 stars 77 forks source link

Native-sql-engine of OAP-1.1.1 has lower performance benefit comparing with OAP-1.1. #348

Open haojinIntel opened 3 years ago

haojinIntel commented 3 years ago

The performance of native-sql-engine has no regression from OAP-1.1 to OAP-1.1.1 while vanilla spark has 10% performance improvement from spark-3.0.0 to spark-3.1.1. So the advantage of native SQL Engine has been reduced when using spark-3.1.1.

haojinIntel commented 3 years ago

@zhouyuan @weiting-chen @zhixingheyi-tian Please help to track the issue. Thanks！