Revert "Skip getFileStatus call during iceberg to delta clone"

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.62k stars 1.71k forks source link

Revert "Skip getFileStatus call during iceberg to delta clone" #3855

Closed lzlfred closed 1 week ago

lzlfred commented 2 weeks ago

This reverts commit a2ba9e9159725b44be08a7319d7159cb0cb78d88. The approach needs to be revisited and prepared in separate PR later.

Which Delta project/connector is this regarding?

[x] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[ ] Other (fill in here)

delta-io / delta

Revert "Skip getFileStatus call during iceberg to delta clone" #3855

Which Delta project/connector is this regarding?

Description

How was this patch tested?

Does this PR introduce any user-facing changes?