search

stackabletech / issues

This repository is only for issues that concern multiple repositories or don't fit into any specific repository
2 stars 0 forks source link

Test Spark 4.0.0-preview1 #622

Closed lfrancke closed 3 months ago

lfrancke commented 3 months ago

[!NOTE]
Timeboxed: Maximum 2 days

This issue covers trying to get a Docker image including Spark 4.0.0 (preview) built so we can include it as an experimental component.

We already know that Iceberg will probably not work without extra effort: https://github.com/apache/iceberg/issues/10497

The result of this timeboxed issue should be (in this order)

Please ensure that you spend a maximum of 2 days on this and make sure that this includes writing down the results.

sbernauer commented 3 months ago

We talked about this in the daily and decided to propably skip it for now (no crazy new features)

sbernauer commented 3 months ago

We decided to not ship this in 24.11, closing this. We can re-visit once 4.0.0 is officially released