search

cloudera-labs / hms-mirror

"hms-mirror" is a utility used to bridge the gap between two clusters and migrate hive metadata.
Apache License 2.0
13 stars 8 forks source link

Restrict stats collection when appropriate and have option to skip. #68

Closed dstreev closed 1 year ago

dstreev commented 1 year ago

Using the flag: -ssc you can specifically skip stats collection. Helpful for filesystems that do not do well with hdfs dfs -count ...

Will also not collect stats for operations that don't need it. Like: SCHEMA_ONLY, DUMP, and STORAGE_MIGRATION (w/ -dc).