elastacloud / spark-excel

A Spark data source for reading Microsoft Excel files
https://www.elastacloud.com
Apache License 2.0
13 stars 5 forks source link

Spark 3.4 update #29

Closed dazfuller closed 1 year ago

dazfuller commented 1 year ago

Brings in changes for Spark 3.4. Along with a couple of minor changes the largest this time is the introduction of the FileSourceOptions type in Spark 3.4 which is required by the FilePartitionReaderFactory implementation. To make this work the Excel options class has been rewritten to fully support it, and the FileSourceOptions class has been backported to versions below Spark 3.4.0.

In addition, Spark now uses the SparkPath type, which works really nicely, but has required some minor changes to make it work.

The build action has also been updated to remove deprecation warnings