Upgrade to latest Spark

kamu-data / kamu-engine-spark

Spark application for streaming transactional transformations between datasets

Apache License 2.0

6 stars 0 forks source link

Closed sergiimk closed 8 months ago

sergiimk commented 10 months ago

[x] Upgrade to Spark and Sedona
- [x] #3
[x] Upgrade Livy
[x] Build multi-arch image to support arm64
[x] Test with kamu-cli
- [x] Integration
- [x] Jupyter + sparkmagic
- [x] See if parquet integer logical types issue is fixed

sergiimk commented 8 months ago

Resolved by #11