The change is a clean cherry-pick except for the jackson test version, that doesn't exist in upstream and we had to update to have it compatible with scala module 2.12
What changes were proposed in this pull request?
Bump version of avro to 1.10.2
Why are the changes needed?
The old Avro versions contain a critical bug fixed in this version.
Original PR description
Update the Avro version to 1.10.2
To stay up to date with upstream and catch compatibility issues with zstd
No
Unit tests
Closes #31866 from iemejia/SPARK-27733-upgrade-avro-1.10.2.
Authored-by: Ismaël Mejía iemejia@gmail.com Signed-off-by: Yuming Wang yumwang@ebay.com
Upstream SPARK-XXXXX ticket and PR link (if not applicable, explain)
Upstream spark PR: https://github.com/apache/spark/pull/31866 Upstream spark commit: https://github.com/apache/spark/commit/8a552bfc767dff987be41f7f463db17395b74e6f
The change is a clean cherry-pick except for the
jacksontest version, that doesn't exist in upstream and we had to update to have it compatible with scala module 2.12What changes were proposed in this pull request?
Bump version of avro to 1.10.2
Why are the changes needed?
The old Avro versions contain a critical bug fixed in this version.
Does this PR introduce any user-facing change?
How was this patch tested?
Unit tests