search

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.62k stars 1.71k forks source link

[Kernel] [CC Refactor #2] Add new Kernel CommitCoordinatorClient interface #3782

Closed scottsand-db closed 1 month ago

scottsand-db commented 1 month ago

NOTE: I won't be merging any of these PRs until the entire e2e implementation is complete and all PRs are approved

This is part of some stacked PRs:

  1. https://github.com/delta-io/delta/pull/3781
  2. https://github.com/delta-io/delta/pull/3782

To see the diff of only this PR: click here

Which Delta project/connector is this regarding?

Description

This PR adds the new CommitCoordinatorClient interface into delta-kernel-api. Notably I use #getUnbackfilledCommits instead of #getCommits.

This PR does NOT delete the existing CommitCoordinatorClientHandler interface in delta-kernel-api.

That will come in the next PR.

How was this patch tested?

N/A

Does this PR introduce any user-facing changes?

New CommitCoordinatorClient interface into.