search

apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
6.49k stars 2.24k forks source link

Spark 3.5: Refactor scanning changelog table with timestamps #11612

Open manuzhang opened 1 day ago

manuzhang commented 22 hours ago

Submit https://github.com/apache/iceberg/pull/11616 to fix test failure.

Acehaidrey commented 17 hours ago

Hi Manu can you explain to me why the end snapshot matters here , sorry I may have missed your point (new to the codebase as well so getting familiar)

manuzhang commented 15 hours ago

@Acehaidrey When end snapshot is set with endTimestamp but is null, it means no valid end snapshot can be found and hence the scan is empty.