Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
Pass in a Map<String, String> of client properties when initializing the source client (can be done for target client's as well if there is need) which may contain other parameters required by a specific client that are not common to multiple formats.
Split out PerTableConfig into a SourceTable, TargetTable, and TableSyncConfig to decouple the sync specifics from the table configurations
HudiSourceConfig is now derived from the client properties Map<String, String>
daragu
commented
4 months ago
What is the purpose of the pull request
Aims to address #297
Brief change log
Map<String, String>of client properties when initializing the source client (can be done for target client's as well if there is need) which may contain other parameters required by a specific client that are not common to multiple formats.PerTableConfiginto aSourceTable,TargetTable, andTableSyncConfigto decouple the sync specifics from the table configurationsHudiSourceConfigis now derived from the client propertiesMap<String, String>Verify this pull request