An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Add new InMemoryCommitCoordinatorClient used for testing. Note: this is not yet tested. That will come later. This is the exact same client test implementation as in delta-storage, but this doesn't use hadoop or logstore and instead uses the engine APIs. Note that the underlying engine of course needs to correctly implement those APIs.
Adds new FileSystemClient APIs, like getFileStatus, exists, copy
This is a stacked PR. Please view this PR's diff here:
Which Delta project/connector is this regarding?
Description
Add new
InMemoryCommitCoordinatorClientused for testing. Note: this is not yet tested. That will come later. This is the exact same client test implementation as in delta-storage, but this doesn't use hadoop or logstore and instead uses the engine APIs. Note that the underlying engine of course needs to correctly implement those APIs.Adds new
FileSystemClientAPIs, likegetFileStatus,exists,copyHow was this patch tested?
Coming later.
Does this PR introduce any user-facing changes?
Yes. See above.