Shims to support multiple Spark versions

oap-project / gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

Apache License 2.0

256 stars 77 forks source link

Shims to support multiple Spark versions #359

Open jerrychenhf opened 3 years ago

jerrychenhf commented 3 years ago

We will need to support multiple Spark versions on a single code base.

The ideal solution is to use Shims to separate version specific code into a Shim layer specific to that version and load the Shim layer at runtime based on the runtime version.

zhouyuan commented 3 years ago

@jerrychenhf https://github.com/oap-project/native-sql-engine/issues/273

jerrychenhf commented 3 years ago

@zhouyuan Thanks for linking to the previous issue. I have implemented a shim layer as a template to all OAP projects. I will first submit to Native SQL Engine repository today. Other component can follow this same approach and add their own.