java.lang.classcastException: org.apache.hadoop.fs.RawLocalFilesystem$DeprecaedRawLocalFilestatus cannot be cast to org.apache.spark.sq1.execution.datasources.FilestatuswithMetadata

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.62k stars 1.71k forks source link

java.lang.classcastException: org.apache.hadoop.fs.RawLocalFilesystem$DeprecaedRawLocalFilestatus cannot be cast to org.apache.spark.sq1.execution.datasources.FilestatuswithMetadata #3887

Open smileyboy2019 opened 3 days ago

smileyboy2019 commented 3 days ago

java.lang.classcastException: org.apache.hadoop.fs.RawLocalFilesystem$DeprecaedRawLocalFilestatus cannot be cast to org.apache.spark.sq1.execution.datasources.FilestatuswithMetadata c8d1f88344a0282e6b4b00a08759d9c

Hadoop 3.3 Spark 3.4.2 and Delta 3.0 are used for the components It seems that the version is incompatible

smileyboy2019 commented 2 days ago

d568ce5353757d033832468bf5b10ac