locationtech / rasterframes

Geospatial Raster support for Spark DataFrames
http://rasterframes.io
Apache License 2.0
240 stars 46 forks source link

Support for Spark 3.0 #593

Closed DragonEnergy closed 1 year ago

DragonEnergy commented 1 year ago

Need support for Spark 3.0+ integrations. Currently All Databricks Runtimes are now using 3.0

assembly.jar is only compatible for deprecated versions of spark from the databricks runtimes sub 3.0 versions of spark https://github.com/locationtech/rasterframes/releases/tag/databricks-spark2.4-python3 https://github.com/locationtech/rasterframes/commit/eb40b6068557321657e0b15fe65e61fb7e7c55a6

echeipesh commented 1 year ago

Spark 3.1.2 is supported as of release 0.10.0