An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
adds a new ConfigurationProvider interface, that will let kernel get per-session configurations in the future
adds a new TableIdentifier class, that kernel will pass on to Commit Coordinator services
adds a new TableBuilder interface, that that constructs kernel Table instances, with optional config and tableId params
Cleanup
Remove unecessary test references to code like TableImpl.forPath(engine, tablePath, () => System.currentTimeMillis) --> the System.currentTimeMilis is the default clock, anyways. No need to point to an internal API for that, too.
How was this patch tested?
Existing UTs.
Does this PR introduce any user-facing changes?
Yes. New ConfigurationProvider interface, new TableIdentifier class, new TableBuilder interface
NOTE: I won't be merging any of these PRs until the entire e2e implementation is complete and all PRs are approved
This is part of some stacked PRs:
Which Delta project/connector is this regarding?
Description
New Interfaces/Classes
ConfigurationProviderinterface, that will let kernel get per-session configurations in the futureTableIdentifierclass, that kernel will pass on to Commit Coordinator servicesTableBuilderinterface, that that constructs kernelTableinstances, with optionalconfigandtableIdparamsCleanup
TableImpl.forPath(engine, tablePath, () => System.currentTimeMillis)--> the System.currentTimeMilis is the default clock, anyways. No need to point to an internal API for that, too.How was this patch tested?
Existing UTs.
Does this PR introduce any user-facing changes?
Yes. New
ConfigurationProviderinterface, newTableIdentifierclass, newTableBuilderinterface