StarRocks / starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
https://starrocks.io
Apache License 2.0
8.74k stars 1.75k forks source link

[Enhancement] Make ORC writer compatible with hive reader #47777

Closed letian-jiang closed 2 months ago

letian-jiang commented 3 months ago

Why I'm doing:

What I'm doing:

For old hive reader, reading orc file written by high version writer leads to a out-of-bound exception.

image

This is a bug of hive reader. Refer to https://issues.apache.org/jira/browse/ORC-125 for more detailed information.

This PR provides a workaround from SR side.

What type of PR is this:

Does this PR entail a change in behavior?

If yes, please specify the type of change:

Checklist:

Bugfix cherry-pick branch check:

github-actions[bot] commented 3 months ago

[FE Incremental Coverage Report]

:white_check_mark: pass : 0 / 0 (0%)

github-actions[bot] commented 3 months ago

[BE Incremental Coverage Report]

:white_check_mark: pass : 0 / 0 (0%)

github-actions[bot] commented 2 months ago

@Mergifyio backport branch-3.3

mergify[bot] commented 2 months ago

backport branch-3.3

✅ Backports have been created

* [#48620 [Enhancement] Make ORC writer compatible with hive reader (backport #47777)](https://github.com/StarRocks/starrocks/pull/48620) has been created for branch `branch-3.3`