Remove ArrowColumnarBatchDeSerializer, as it is no longer used
Implement NativeCodeCompiler and NativeFunction traits, to allow for higher-level compilation and caching of code at the function-semantic level. Rather than caching compiled code based on the hash value of the code lines, we will cache compiled code base on an arbitrary hash code that will be mapped to the semantic value of the function being compiled
Implement CachingNativeCodeCompiler and OnDemandVeCodeCompiler based on the new NativeCodeCompiler
Remove spark.com.nec.spark.kernel.precompiled config option from the plugin, as it has not been useful
Add unit tests for OnDemandVeCodeCompiler and CachingNativeCodeCompiler
Rename VeKernelCompiler to VeKernelCompilation to avoid confusion with VeCodeCompiler
Integrate the new NativeCodeCompiler into the codebase
Summary:
ArrowColumnarBatchDeSerializer, as it is no longer usedNativeCodeCompilerandNativeFunctiontraits, to allow for higher-level compilation and caching of code at the function-semantic level. Rather than caching compiled code based on the hash value of the code lines, we will cache compiled code base on an arbitrary hash code that will be mapped to the semantic value of the function being compiledCachingNativeCodeCompilerandOnDemandVeCodeCompilerbased on the newNativeCodeCompilerspark.com.nec.spark.kernel.precompiledconfig option from the plugin, as it has not been usefulOnDemandVeCodeCompilerandCachingNativeCodeCompilerVeKernelCompilertoVeKernelCompilationto avoid confusion withVeCodeCompilerNativeCodeCompilerinto the codebaseNativeCompiler