Ability to sync new partitions while copying large tables

cloudera-labs / hms-mirror

"hms-mirror" is a utility used to bridge the gap between two clusters and migrate hive metadata.

Apache License 2.0

14 stars 8 forks source link

Ability to sync new partitions while copying large tables #31

Open hpasumarthi opened 1 year ago

hpasumarthi commented 1 year ago

Hi David, We are planning to copy a large table from Left to Right environment using HMS mirror tool. Large table gets a new partition every day and old partitions do not change. Can you please find a way to compare table and sync to the right environment. Regards, Hemanth