apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.45k stars 3.52k forks source link

[C++] Check nullability when validating fields on batches or struct arrays #31387

Open asfimport opened 2 years ago

asfimport commented 2 years ago

According to ARROW-15899, it is possible to declare a field non-nullable, associate with data that has nulls, and still pass validation.

Validation should instead fail in such a situation (at least full validation, since computing the null count can be O(n)).

Reporter: Antoine Pitrou / @pitrou Assignee: Kaouther Abrougui

Related issues:

Note: This issue was originally created as ARROW-15961. Please see the migration documentation for further details.

asfimport commented 2 years ago

Antoine Pitrou / @pitrou: cc @AlvinJ15

asfimport commented 2 years ago

Krisztian Szucs / @kszucs: Postponing to 9.0 based on the PR comments.

asfimport commented 2 years ago

Krisztian Szucs / @kszucs: Moving to 10.0 since the PR is in progress.

asfimport commented 1 year ago

Apache Arrow JIRA Bot: This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned per project policy. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.

asfimport commented 1 year ago

Kaouther Abrougui: I'll continue work on this.