Native-sql-engine of oap-1.1-spark-3.1.1 cannot pass stability test.

oap-project / gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

Apache License 2.0

256 stars 77 forks source link

Native-sql-engine of oap-1.1-spark-3.1.1 cannot pass stability test. #339

Open haojinIntel opened 3 years ago

haojinIntel commented 3 years ago

We using the latest code of oap-1.1-spark-3.1.1 to run TPC-DS all queries for 10 rounds. The data scale is 1.5TB and the cluster contains 1 master and 3 workers. Each worker contains 512GB DRAM. The configuration of spark is showed below:

Q23b.sql cannot pass on the first round and error message is like:

haojinIntel commented 3 years ago

@zhouyuan @zhixingheyi-tian Please help to track the issue. Thanks!