search

apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
https://arrow.apache.org/
Apache License 2.0
14.5k stars 3.53k forks source link

[Java] Test fuzzer inputs #16808

Open asfimport opened 5 years ago

asfimport commented 5 years ago

We are developing a fuzzer-based corpus of malformed IPC inputs

https://github.com/apache/arrow-testing/tree/master/data/arrow-ipc

The Java implementation should also test against these to verify that the correct kind of exception is raised

Reporter: Wes McKinney / @wesm

PRs and other links:

Note: This issue was originally created as ARROW-5926. Please see the migration documentation for further details.

asfimport commented 4 years ago

Antoine Pitrou / @pitrou: cc @emkornfield [~jacques@dremio.com]

Note the current paths to the malformed inputs are:

asfimport commented 4 years ago

Micah Kornfield / @emkornfield: I think before we can include this we should probably have a "ValidateFull" method similar to the one that exists in C++.  CC [~liyafan] @tianchen92

asfimport commented 4 years ago

Liya Fan / @liyafan82: [~emkornfield@gmail.com] Sounds good. I have opened ARROW-8402 to track it.

asfimport commented 4 years ago

Ji Liu / @tianchen92: I have already opened ARROW-8020 before to port validate functionality which should include validate and validateFull, but it doesn‘t matter to separate them :)

asfimport commented 4 years ago

Liya Fan / @liyafan82: @tianchen92 I see. Thank you. If the change is not too big, maybe there is no need to separate them.

asfimport commented 3 years ago

Liya Fan / @liyafan82: As the validation feature is available now, I will check our current implementation against the IPC inputs. If it works as expected, this issue can be closed.

asfimport commented 3 years ago

Micah Kornfield / @emkornfield: I think this issue should actually integrate java into test fuzzer test runs.  New inputs are generated all the time that exercise C++ code.  But existing fuzz files would be a good place to start.

asfimport commented 3 years ago

Liya Fan / @liyafan82: @emkornfield Sounds reasonable.

asfimport commented 2 years ago

Liya Fan / @liyafan82: A PR is submitted to oss-fuzz (https://github.com/google/oss-fuzz/pull/7171). May I add your emails to the contact list? @emkornfield @jacques-n @wesm

asfimport commented 2 years ago

Todd Farmer / @toddfarmer: This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.