search

nexr / RHive

RHive is an R extension facilitating distributed computing via Apache Hive.
http://nexr.github.io/RHive
122 stars 63 forks source link

Unable to view MR jobs associated with Rhive query in ResourceManager WebUI #104

Open Phoncy opened 7 years ago

Phoncy commented 7 years ago

Hi,

I have an HDP2.3 cluster with Tez version 0.7 and Hive 1.2 . I'm using the below configurations to connect to Hive from R(3.3).

Sys.setenv(HIVE_HOME="/usr/hdp/2.3.4.7-4/hive/") Sys.setenv(RHIVE_DATA="/rhive_data") Sys.setenv(HADOOP_HOME="/usr/hdp/2.3.4.7-4/hadoop") Sys.setenv(RHIVE_FS_HOME="/RHive") library(RHive) rhive.init() rhive.connect(host="xx.xxx.xx.xx", port=10000, hiveServer2=TRUE,defaultFS="hdfs://mycluster1")

I'm able to get the results of aggregate query correctly, but the MR jobs are not listed in the Resource Manager Web UI. Any suggestions are greatly appreciated.

Thanks