[Spark] Pass table identifiers/table catalogs to DeltaLog API call sites - Githubissues

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.63k stars 1.71k forks source link

[Spark] Pass table identifiers/table catalogs to DeltaLog API call sites #3788

Closed ctringdb closed 1 month ago

ctringdb commented 1 month ago

Which Delta project/connector is this regarding?

[x] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[ ] Other (fill in here)

Description

Added forTable(SparkSession, CatalogTable, Map[String, String])
Added forTableWithSnapshot(SparkSession, CatalogTable, Map[String, String])
Modified withFreshSnapshot to take in a table identifier.
Passed table identifier or table catalog to call sites of DeltaLog API so that the table identifier becomes available and eventually passed to the commit coordinator.
Does this PR introduce any user-facing changes?

No