search

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.56k stars 1.7k forks source link

[Kernel] [TODO] Assert that log files belong to the table #1968

Open scottsand-db opened 1 year ago

scottsand-db commented 1 year ago

Complete the below TODO.

/**
 * Verifies that a set of delta or checkpoint files to be read actually belongs to this table.
 */
private void assertLogFilesBelongToTable(Path logPath, Stream<FileStatus> allFiles) {
    // TODO:
}

https://github.com/delta-io/delta/blob/efa566fc24af0b2c65b08c2a7ad81e9c865e0e83/kernel/kernel-api/src/main/java/io/delta/kernel/internal/replay/LogReplay.java#L158

zeotuan commented 6 months ago

I would like to take on this

zeotuan commented 6 months ago

Hi, This seem to be resolved already in https://github.com/delta-io/delta/issues/2150

raveeram-db commented 2 months ago

@scottsand-db should we go ahead and close this issue?