search

cloudera-labs / hms-mirror

"hms-mirror" is a utility used to bridge the gap between two clusters and migrate hive metadata.
Apache License 2.0
13 stars 8 forks source link

`hms-mirror` script parameter `--hadoop-classpath` not getting recognized when more the 3-4 db's included in `-db` option #89

Closed dstreev closed 11 months ago

VenkataNU commented 12 months ago

customer tried running 6 db's at once like and it is throwing below error, with everything remaining same, when the number of db's are split it into 3/3, it is working without any issues. hms-mirror -d SCHEMA_ONLY -db test1_dgreb,test_llkiirrter_com,test_llkiirrter_com,test_llkiirrter_com,test_llkiirrter_com,test_llkiirrter_com --hadoop-classpath -dc

2023-10-03 15:58:31,517 [main] DEBUG MetricsSystemImpl.register(231):UgiMetrics, User and group related metrics 2023-10-03 15:58:31,600 [main] DEBUG SecurityUtil.setTokenServiceUseIp(122):Setting hadoop.security.token.service.use_ip to true 2023-10-03 15:58:31,611 [main] DEBUG Shell.(520):Failed to detect a valid hadoop home directory java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. at org.apache.hadoop.util.Shell.checkHadoopHomeInner(Shell.java:468)

VenkataNU commented 12 months ago

Above bug does not exist, the first DB provided in the list of DB's provided for migration does not exist in the LEFT side cluster, so the execution is failing. The only issue is the error displayed to the user is not explicit.