Port the TransferDescriptor-based data transfer feature over from the old VeProcess to the new VectorEngine implementation
Add histogram-based metrics to the new VeProcess implementation
Add support for registering and unregistering memory allocations, which is useful for tracking memory allocations made on the VE side during function calls
Add functional tests for TransferDescriptor-based data transfer support in the new VectorEngine implementation
Add LibCyclone object to hold souce of truth information about libcyclone.so
Add test cases with concrete example inputs to highlight failing test cases with TransferDescriptor-based bulk data transfer
Update existing BytePointerColVector conversion tests to be more strict with verifying the content of the validity buffers
Bugfix: Correctly specify offset for varchar vectors.
There is an outstanding issue with the TransferDescriptor-based data transfer feature where the validity buffer transfer does not maintain fidelity between transfers to the VE via TransferDescriptor and back via VeColVector. This issue is still under investigation.
Summary:
TransferDescriptor
-based data transfer feature over from the oldVeProcess
to the newVectorEngine
implementationVeProcess
implementationTransferDescriptor
-based data transfer support in the newVectorEngine
implementationLibCyclone
object to hold souce of truth information aboutlibcyclone.so
TransferDescriptor
-based bulk data transferBytePointerColVector
conversion tests to be more strict with verifying the content of the validity buffersThere is an outstanding issue with the
TransferDescriptor
-based data transfer feature where the validity buffer transfer does not maintain fidelity between transfers to the VE viaTransferDescriptor
and back viaVeColVector
. This issue is still under investigation.