Error when `COPY`ing `STRING[]` from Parquet file (hashtag2703)

[vikramsubramanian]

When I run the following command, I get a segmentation fault:

COPY Release FROM 'output/nodes_releases.parquet';

This is an excerpt from the coredump:

Core was generated by `kuzu_shell ./graph/'.
Program terminated with signal SIGSEGV, Segmentation fault.
hashtag0  0x0000000000b35dce in kuzu::storage::VarListColumnChunk::append(kuzu::common::ValueVector*) ()
[Current thread is 1 (LWP 7231)]

[This]( seems to be the relevant code.

When I remove the STRING[] property from the schema, everything works. )

[mayil-ai[bot]]

Summary: Segmentation fault occurs when using COPY command with STRING[] property from Parquet file in Cypher.

Possible Solution

Based on the provided information, the segmentation fault issue occurs when using the COPY command with a Parquet file containing a STRING[] property. The issue is related to appending data to a VarListColumnChunk, and removing STRING[] from the schema resolves the issue, indicating a problem with array handling.

To address this issue:

• Review the implementation of VarListColumnChunk::append method to ensure it correctly handles STRING[] data types, especially when reading from Parquet files.
• Check for proper memory allocation and boundary checks within the append method to prevent buffer overflows or access to uninitialized memory.
• Verify that the ValueVector class used in the append method is correctly managing the lifetime of its elements, particularly for complex types like STRING[].
• Ensure that the COPY command implementation correctly translates STRING[] properties from Parquet files into the internal representation expected by VarListColumnChunk::append.
• Add tests specifically for the COPY command with STRING[] properties to catch similar issues in the future.
• If the issue persists, use debugging tools to trace the exact location of the segmentation fault within the append method or related code paths.

Code snippets to check

• src/parser/transform/transform_copy.cpp

  This file contains the transformation logic for the COPY FROM command, which is directly related to the issue.

• test/copy/e2e_copy_transaction_test.cpp

  This file contains end-to-end tests for the COPY command, which may need to be updated or used to reproduce the issue.