For SCHEMA_ONLY and DUMP strategies, add option to build out partition ALTERS for non-standard locations

cloudera-labs / hms-mirror

"hms-mirror" is a utility used to bridge the gap between two clusters and migrate hive metadata.

Apache License 2.0

13 stars 8 forks source link

For SCHEMA_ONLY and DUMP strategies, add option to build out partition ALTERS for non-standard locations #61

Closed dstreev closed 1 year ago

dstreev commented 1 year ago

When the flag -epl|--evaluate-partition-location is added when requesting SCHEMA_ONLY or DUMP strategies, evaluate the partition location and if it doesn't match the root tables location OR it doesn't follow a standard partition naming convention that can be located with "MSCK REPAIR", construct the ALTER TABLE ... ADD PARTITION ... SQL to add it.

dstreev commented 1 year ago

See docs: https://github.com/cloudera-labs/hms-mirror/blob/main/README.md#non-standard-partition-locations