Brings in changes for Spark 3.4. Along with a couple of minor changes the largest this time is the introduction of the FileSourceOptions type in Spark 3.4 which is required by the FilePartitionReaderFactory implementation. To make this work the Excel options class has been rewritten to fully support it, and the FileSourceOptions class has been backported to versions below Spark 3.4.0.
In addition, Spark now uses the SparkPath type, which works really nicely, but has required some minor changes to make it work.
The build action has also been updated to remove deprecation warnings
Brings in changes for Spark 3.4. Along with a couple of minor changes the largest this time is the introduction of the
FileSourceOptions
type in Spark 3.4 which is required by theFilePartitionReaderFactory
implementation. To make this work the Excel options class has been rewritten to fully support it, and theFileSourceOptions
class has been backported to versions below Spark 3.4.0.In addition, Spark now uses the
SparkPath
type, which works really nicely, but has required some minor changes to make it work.The build action has also been updated to remove deprecation warnings