search

nexr / RHive

RHive is an R extension facilitating distributed computing via Apache Hive.
http://nexr.github.io/RHive
122 stars 63 forks source link

Prevent or enable modification of mapred.child.env at runtime #85

Open coatless opened 9 years ago

coatless commented 9 years ago

Hi,

I'm trying to use RHive to connect with Hive offered on Hortonwork's Data Platform 2.2 (HDP 2.2) virtual box image.

Here is my current setup:

install.packages("RHive")

Sys.setenv(HIVE_HOME="/usr/hdp/2.2.0.0-2041/hive")
Sys.setenv(HADOOP_HOME="/usr/hdp/2.2.0.0-2041/hadoop")
Sys.setenv(HADOOP_CONF_DIR="/etc/hadoop")
Sys.setenv(RHIVE_FS_HOME="/rhive")
library("RHive")

rhive.init()
rhive.connect()

The connect statement errors with:

Error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: Cannot modify mapred.child.env at runtime. It is not in list of params that are allowed to be modified at runtime

I've tried installing the package into just the sitewide library and then just user libraries to no avail. I've also tried to install the package using the instructions listed in the README file. That is, not downloading and installing the package from CRAN, but instead using the source from GitHub. With this being said, I still receive the same error while following these instructions.

On HDFS I have /rhive autocreated

[rstudio@sandbox ~]$ hdfs dfs -ls /rhive/lib/2.0-0.2 Found 1 items -rwxrwxrwx 1 rstudio hdfs 135049 2015-03-19 22:38 /rhive/lib/2.0-0.2/rhive_udf.jar

On the local dir I have:

[rstudio@sandbox ~]$ ls -l /rhive/lib/2.0-0.2/ total 132 -rwxrwxrwx 1 root root 135049 2015-03-19 21:53 rhive_udf.jar

Here is my environment information:

rhive.env(TRUE) hadoop home: /usr/hdp/2.2.0.0-2041/hadoop hadoop conf: /etc/hadoop/conf fs home: /rhive hive home: /usr/hdp/2.2.0.0-2041/hive classpath: /home/rstudio/R/x86_64-redhat-linux-gnu-library/3.1/RHive/java/rhive_udf.jar /usr/hdp/2.2.0.0-2041/hadoop/client/activation-1.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/activation.jar /usr/hdp/2.2.0.0-2041/hadoop/client/apacheds-i18n-2.0.0-M15.jar /usr/hdp/2.2.0.0-2041/hadoop/client/apacheds-i18n.jar /usr/hdp/2.2.0.0-2041/hadoop/client/apacheds-kerberos-codec-2.0.0-M15.jar /usr/hdp/2.2.0.0-2041/hadoop/client/apacheds-kerberos-codec.jar /usr/hdp/2.2.0.0-2041/hadoop/client/api-asn1-api-1.0.0-M20.jar /usr/hdp/2.2.0.0-2041/hadoop/client/api-asn1-api.jar /usr/hdp/2.2.0.0-2041/hadoop/client/api-util-1.0.0-M20.jar /usr/hdp/2.2.0.0-2041/hadoop/client/api-util.jar /usr/hdp/2.2.0.0-2041/hadoop/client/avro-1.7.4.jar /usr/hdp/2.2.0.0-2041/hadoop/client/avro.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-beanutils-1.7.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-beanutils-core-1.8.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-beanutils-core.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-beanutils.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-cli-1.2.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-cli.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-codec-1.4.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-codec.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-collections-3.2.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-collections.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-compress-1.4.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-compress.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-configuration-1.6.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-configuration.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-digester-1.8.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-digester.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-httpclient-3.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-httpclient.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-io-2.4.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-io.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-lang-2.6.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-lang.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-logging-1.1.3.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-logging.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-math3-3.1.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-math3.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-net-3.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/commons-net.jar /usr/hdp/2.2.0.0-2041/hadoop/client/curator-client-2.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/curator-client.jar /usr/hdp/2.2.0.0-2041/hadoop/client/curator-framework-2.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/curator-framework.jar /usr/hdp/2.2.0.0-2041/hadoop/client/curator-recipes-2.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/curator-recipes.jar /usr/hdp/2.2.0.0-2041/hadoop/client/gson-2.2.4.jar /usr/hdp/2.2.0.0-2041/hadoop/client/gson.jar /usr/hdp/2.2.0.0-2041/hadoop/client/guava-11.0.2.jar /usr/hdp/2.2.0.0-2041/hadoop/client/guava.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-annotations-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-annotations.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-auth-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-auth.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-common-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-common.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-hdfs-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-hdfs.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-app-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-app.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-common-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-common.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-core-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-core.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-jobclient-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-jobclient.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-shuffle-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-mapreduce-client-shuffle.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-api-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-api.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-client-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-client.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-common-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-common.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-registry-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-registry.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-server-common-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/client/hadoop-yarn-server-common.jar /usr/hdp/2.2.0.0-2041/hadoop/client/htrace-core-3.0.4.jar /usr/hdp/2.2.0.0-2041/hadoop/client/htrace-core.jar /usr/hdp/2.2.0.0-2041/hadoop/client/httpclient-4.2.5.jar /usr/hdp/2.2.0.0-2041/hadoop/client/httpclient.jar /usr/hdp/2.2.0.0-2041/hadoop/client/httpcore-4.2.5.jar /usr/hdp/2.2.0.0-2041/hadoop/client/httpcore.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-core-2.2.3.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-core-asl-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-core-asl.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-core.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-jaxrs-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-jaxrs.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-mapper-asl-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-mapper-asl.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-xc-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jackson-xc.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jaxb-api-2.2.2.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jaxb-api.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jersey-client-1.9.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jersey-client.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jersey-core-1.9.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jersey-core.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jetty-util-6.1.26.hwx.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jetty-util.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jsr305-1.3.9.jar /usr/hdp/2.2.0.0-2041/hadoop/client/jsr305.jar /usr/hdp/2.2.0.0-2041/hadoop/client/leveldbjni-all-1.8.jar /usr/hdp/2.2.0.0-2041/hadoop/client/leveldbjni-all.jar /usr/hdp/2.2.0.0-2041/hadoop/client/log4j-1.2.17.jar /usr/hdp/2.2.0.0-2041/hadoop/client/log4j.jar /usr/hdp/2.2.0.0-2041/hadoop/client/microsoft-windowsazure-storage-sdk-0.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/microsoft-windowsazure-storage-sdk.jar /usr/hdp/2.2.0.0-2041/hadoop/client/netty-3.6.2.Final.jar /usr/hdp/2.2.0.0-2041/hadoop/client/netty.jar /usr/hdp/2.2.0.0-2041/hadoop/client/paranamer-2.3.jar /usr/hdp/2.2.0.0-2041/hadoop/client/paranamer.jar /usr/hdp/2.2.0.0-2041/hadoop/client/protobuf-java-2.5.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/protobuf-java.jar /usr/hdp/2.2.0.0-2041/hadoop/client/servlet-api-2.5.jar /usr/hdp/2.2.0.0-2041/hadoop/client/servlet-api.jar /usr/hdp/2.2.0.0-2041/hadoop/client/slf4j-api-1.7.5.jar /usr/hdp/2.2.0.0-2041/hadoop/client/slf4j-api.jar /usr/hdp/2.2.0.0-2041/hadoop/client/slf4j-log4j12-1.7.5.jar /usr/hdp/2.2.0.0-2041/hadoop/client/slf4j-log4j12.jar /usr/hdp/2.2.0.0-2041/hadoop/client/snappy-java-1.0.4.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/snappy-java.jar /usr/hdp/2.2.0.0-2041/hadoop/client/stax-api-1.0-2.jar /usr/hdp/2.2.0.0-2041/hadoop/client/stax-api.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xercesImpl-2.9.1.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xercesImpl.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xml-apis-1.3.04.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xml-apis.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xmlenc-0.52.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xmlenc.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xz-1.0.jar /usr/hdp/2.2.0.0-2041/hadoop/client/xz.jar /usr/hdp/2.2.0.0-2041/hadoop/client/zookeeper-3.4.6.jar /usr/hdp/2.2.0.0-2041/hadoop/client/zookeeper.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-annotations-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-annotations.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-auth-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-auth.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-common-2.6.0.2.2.0.0-2041-tests.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-common-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-common-tests.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-common.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-nfs-2.6.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/hadoop-nfs.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/activation-1.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/apacheds-i18n-2.0.0-M15.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/api-asn1-api-1.0.0-M20.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/api-util-1.0.0-M20.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/asm-3.2.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/avro-1.7.4.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-beanutils-1.7.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-beanutils-core-1.8.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-cli-1.2.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-codec-1.4.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-collections-3.2.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-compress-1.4.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-configuration-1.6.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-digester-1.8.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-el-1.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-httpclient-3.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-io-2.4.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-lang-2.6.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-logging-1.1.3.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-math3-3.1.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/commons-net-3.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/curator-client-2.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/curator-framework-2.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/curator-recipes-2.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/eclipselink-2.5.2-M1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/gson-2.2.4.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/guava-11.0.2.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/hamcrest-core-1.3.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/htrace-core-3.0.4.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/httpclient-4.2.5.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/httpcore-4.2.5.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jackson-core-2.2.3.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jackson-core-asl-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jackson-jaxrs-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jackson-mapper-asl-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jackson-xc-1.9.13.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jasper-compiler-5.5.23.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jasper-runtime-5.5.23.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/java-xmlbuilder-0.4.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/javax.persistence-2.1.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jaxb-api-2.2.2.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jaxb-impl-2.2.3-1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jersey-core-1.9.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jersey-json-1.9.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jersey-server-1.9.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jets3t-0.9.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jettison-1.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jetty-6.1.26.hwx.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jetty-util-6.1.26.hwx.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jsch-0.1.42.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jsp-api-2.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/jsr305-1.3.9.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/junit-4.11.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/log4j-1.2.17.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/microsoft-windowsazure-storage-sdk-0.6.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/mockito-all-1.8.5.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/mysql-connector-java.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/netty-3.6.2.Final.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/ojdbc6.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/paranamer-2.3.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/protobuf-java-2.5.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/ranger-hdfs-plugin-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/ranger-plugins-audit-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/ranger-plugins-common-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/ranger-plugins-cred-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/ranger-plugins-impl-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/servlet-api-2.5.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/slf4j-api-1.7.5.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/slf4j-log4j12-1.7.5.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/snappy-java-1.0.4.1.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/stax-api-1.0-2.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/xmlenc-0.52.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/xz-1.0.jar /usr/hdp/2.2.0.0-2041/hadoop/lib/zookeeper-3.4.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/accumulo-core-1.6.1.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/accumulo-fate-1.6.1.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/accumulo-start-1.6.1.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/accumulo-trace-1.6.1.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/activation-1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/ant-1.9.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/ant-launcher-1.9.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/antlr-2.7.7.jar /usr/hdp/2.2.0.0-2041/hive/lib/antlr-runtime-3.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/asm-commons-3.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/asm-tree-3.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/avro-1.7.5.jar /usr/hdp/2.2.0.0-2041/hive/lib/bonecp-0.8.0.RELEASE.jar /usr/hdp/2.2.0.0-2041/hive/lib/calcite-avatica-0.9.1.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/calcite-core-0.9.1.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-beanutils-1.7.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-beanutils-core-1.8.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-cli-1.2.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-codec-1.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-collections-3.2.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-compiler-2.7.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-compress-1.4.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-configuration-1.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-dbcp-1.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-digester-1.8.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-httpclient-3.0.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-io-2.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-lang-2.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-logging-1.1.3.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-math-2.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-pool-1.5.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/commons-vfs2-2.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/curator-client-2.6.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/curator-framework-2.6.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/curator-recipes-2.6.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/datanucleus-api-jdo-3.2.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/datanucleus-core-3.2.10.jar /usr/hdp/2.2.0.0-2041/hive/lib/datanucleus-rdbms-3.2.9.jar /usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/derbynet-10.11.1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/eclipselink-2.5.2-M1.jar /usr/hdp/2.2.0.0-2041/hive/lib/eigenbase-properties-1.1.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/groovy-all-2.1.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/guava-11.0.2.jar /usr/hdp/2.2.0.0-2041/hive/lib/hamcrest-core-1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-accumulo-handler-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-accumulo-handler.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-ant-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-ant.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-beeline-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-beeline.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-cli-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-cli.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-common-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-common.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-contrib-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-contrib.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-exec-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-exec.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-hbase-handler-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-hbase-handler.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-hwi-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-hwi.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-jdbc-0.14.0.2.2.0.0-2041-standalone.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-jdbc-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-jdbc.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-metastore-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-metastore.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-serde-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-serde.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-service-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-service.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-0.20-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-0.20S-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-0.23-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-common-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-common-secure-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-common-secure.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims-common.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-shims.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-testutils-0.14.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/hive-testutils.jar /usr/hdp/2.2.0.0-2041/hive/lib/httpclient-4.2.5.jar /usr/hdp/2.2.0.0-2041/hive/lib/httpcore-4.2.5.jar /usr/hdp/2.2.0.0-2041/hive/lib/janino-2.7.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/jansi-1.11.jar /usr/hdp/2.2.0.0-2041/hive/lib/javax.persistence-2.1.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/jcommander-1.32.jar /usr/hdp/2.2.0.0-2041/hive/lib/jdo-api-3.0.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/jetty-all-7.6.0.v20120127.jar /usr/hdp/2.2.0.0-2041/hive/lib/jetty-all-server-7.6.0.v20120127.jar /usr/hdp/2.2.0.0-2041/hive/lib/jline-0.9.94.jar /usr/hdp/2.2.0.0-2041/hive/lib/jpam-1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/jsr305-1.3.9.jar /usr/hdp/2.2.0.0-2041/hive/lib/jta-1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/junit-4.11.jar /usr/hdp/2.2.0.0-2041/hive/lib/libfb303-0.9.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/libthrift-0.9.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/linq4j-0.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/log4j-1.2.16.jar /usr/hdp/2.2.0.0-2041/hive/lib/mail-1.4.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/maven-scm-api-1.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/maven-scm-provider-svn-commons-1.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/maven-scm-provider-svnexe-1.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/mysql-connector-java.jar /usr/hdp/2.2.0.0-2041/hive/lib/netty-3.4.0.Final.jar /usr/hdp/2.2.0.0-2041/hive/lib/ojdbc6.jar /usr/hdp/2.2.0.0-2041/hive/lib/opencsv-2.3.jar /usr/hdp/2.2.0.0-2041/hive/lib/oro-2.0.8.jar /usr/hdp/2.2.0.0-2041/hive/lib/paranamer-2.3.jar /usr/hdp/2.2.0.0-2041/hive/lib/pentaho-aggdesigner-algorithm-5.1.3-jhyde.jar /usr/hdp/2.2.0.0-2041/hive/lib/plexus-utils-1.5.6.jar /usr/hdp/2.2.0.0-2041/hive/lib/protobuf-java-2.5.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/quidem-0.1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/ranger-hive-plugin-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/ranger-plugins-audit-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/ranger-plugins-common-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/ranger-plugins-cred-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/ranger-plugins-impl-0.4.0.2.2.0.0-2041.jar /usr/hdp/2.2.0.0-2041/hive/lib/regexp-1.3.jar /usr/hdp/2.2.0.0-2041/hive/lib/servlet-api-2.5.jar /usr/hdp/2.2.0.0-2041/hive/lib/snappy-java-1.0.5.jar /usr/hdp/2.2.0.0-2041/hive/lib/ST4-4.0.4.jar /usr/hdp/2.2.0.0-2041/hive/lib/stax-api-1.0.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/stringtemplate-3.2.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/super-csv-2.2.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/tempus-fugit-1.1.jar /usr/hdp/2.2.0.0-2041/hive/lib/velocity-1.5.jar /usr/hdp/2.2.0.0-2041/hive/lib/xz-1.0.jar /usr/hdp/2.2.0.0-2041/hive/lib/zookeeper-3.4.6.2.2.0.0-2041.jar /etc/hadoop

asraj commented 9 years ago

coatless, did you find a solution for "Cannot modify mapred.child.env at runtime. It is not in list of params that are allowed to be modified at runtime". I am having the same problem

coatless commented 9 years ago

Modify etc/hive/conf/hive-site.xml with:

  <property>
      <name>hive.security.authorization.sqlstd.confwhitelist.append</name>
      <value>mapred.child.env</value>
    </property>

@asraj

This removes the mapred error. I still haven't been able to make rhive connect with the hive database in HDP 2.2.

Now, I receive a false return on using

rhive.connect()