[NSE-610] improve SHJ hashmap build

oap-project / gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

Apache License 2.0

256 stars 77 forks source link

Closed zhouyuan closed 1 year ago

zhouyuan commented 2 years ago

This patch improves SHJ hashmap build by using std::unordered_multimap

The original unsafeHashmap is kept for BHJ code path

this patch adds one new config to use the new hashmap spark.oap.sql.columnar.shuffledhashjoinNewMap

Signed-off-by: Yuan Zhou yuan.zhou@intel.com

pass jenkins

github-actions[bot] commented 2 years ago

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

Then could you also rename commit message and pull request title in the following format?

[NSE-${ISSUES_ID}] ${detailed message}