apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

https://kyuubi.apache.org/

Apache License 2.0

2.11k stars 914 forks source link

Bump Spark to 3.5.3 #6761

Closed bowenliang123 closed 1 month ago

bowenliang123 commented 1 month ago

:mag: Description

Issue References 🔗

This pull request fixes #

Describe Your Solution 🔧

Spark 3.5.3 release notes: https://spark.apache.org/releases/spark-release-3-5-3.html

Types of changes :bookmark:

[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

Behavior Without This Pull Request :coffin:

Behavior With This Pull Request :tada:

Related Unit Tests

Checklist 📝

[x] This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.

pan3793 commented 1 month ago

Spark 3.5.3 breaks Iceberg compatibility https://www.mail-archive.com/dev@iceberg.apache.org/msg07730.html

bowenliang123 commented 1 month ago

OK, let's suspend this bump, until the required satisfaction both on Spark 3.5.x+ and Iceberg 1.6.x+