search

KylinOLAP / Kylin

This code base is retained for historical interest only, please visit Apache Incubator Repo for latest one
https://github.com/apache/incubator-kylin
Apache License 2.0
562 stars 225 forks source link

run `kylin.sh start` find_hive_dependency.sh can‘t get hive_warehouse_dir when the hive install TEZ #519

Open lastYoueven opened 8 months ago

lastYoueven commented 8 months ago

ENV:

kylin 3.1.3 hadoop 2.5.0 hive 2.3.9

ECHO INFO:

Using hadoop conf cached dependency...
...................................................[PASS]
KYLIN_HOME is set to /***/apache-kylin
Checking HBase
...................................................[PASS]
Checking hive
...................................................[PASS]
Checking hadoop shell
...................................................[PASS]
Checking hdfs working dir
...................................................[PASS]
Using spark cached dependency...
...................................................[PASS]
Using flink cached dependency...
...................................................[PASS]
Using kafka cached dependency...
...................................................[PASS]

Checking environment finished successfully. To check again, run 'bin/check-env.sh' manually.
Retrieving hive dependency...
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hive/tez/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

Logging initialized using configuration in jar:file:/home/hive/lib/hive-common-2.3.9.jar!/hive-log4j2.properties Async: true
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
export hive_warehouse_dir="/***/apache-kylin/lib"
"/home/flink"
"/***/flume"
"/home/hadoop"
"/home/hadoop/lib/native"
"/home/hadoop/etc/hadoop"
"256"
"/home/hadoop"
"-Djava.library.path
"/home/hbase/lib/hbase-common-2.5.0.jar"
"/***/hbase"
"ignoredups"
"1000"
""
"/home/hive/conf"
"/home/hive"
"/***"
"hadoop012"
"/usr/java8"
":/home/hadoop/lib/native:/home/hadoop/lib/native"
"/home/kafka"
"/***/apache-kylin"
"en_US.UTF-8"
":/home/hadoop/lib/native:/home/hadoop/lib/native"
"||/usr/bin/lesspipe.sh %s"
"root"
"rs
"/var/spool/mail/***"

"/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/***/anaconda3/bin:/usr/local/apache-zookeeper-3.6.1-bin/bin/:/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin:/usr/java8/bin:/home/sqoop/bin:/home/hadoop/bin:/home/hadoop/sbin:/home/hive/bin:/home/hive/lib:/lib:/***/bin:/***/.local/share/coursier/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin"
"/***"
"/bin/bash"
"3"
"/home/spark"
"JAVA_LIBRARY_PATH
"/home/sqoop"
"172.19.216.199 43710 22"
"172.19.216.199 43710 172.19.216.198 22"
"/dev/pts/0"
"xterm"
"/home/hive/tez"
":/home/hive/tez/hadoop-shim-0.9.2.jar:/home/hive/tez/hadoop-shim-2.7-0.9.2.jar:/home/hive/tez/tez-api-0.9.2.jar:/home/hive/tez/tez-build-tools-0.9.2.jar:/home/hive/tez/tez-common-0.9.2.jar:/home/hive/tez/tez-dag-0.9.2.jar:/home/hive/tez/tez-examples-0.9.2.jar:/home/hive/tez/tez-ext-service-tests-0.9.2.jar:/home/hive/tez/tez-history-parser-0.9.2.jar:/home/hive/tez/tez-javadoc-tools-0.9.2.jar:/home/hive/tez/tez-job-analyzer-0.9.2.jar:/home/hive/tez/tez-mapreduce-0.9.2.jar:/home/hive/tez/tez-protobuf-history-plugin-0.9.2.jar:/home/hive/tez/tez-runtime-internals-0.9.2.jar:/home/hive/tez/tez-runtime-library-0.9.2.jar:/home/hive/tez/tez-tests-0.9.2.jar:/home/hive/tez/tez-yarn-timeline-history-0.9.2.jar:/home/hive/tez/tez-yarn-timeline-history-with-acls-0.9.2.jar:/home/hive/tez/lib/async-http-client-1.8.16.jar:/home/hive/tez/lib/commons-cli-1.2.jar:/home/hive/tez/lib/commons-codec-1.4.jar:/home/hive/tez/lib/commons-collections-3.2.2.jar:/home/hive/tez/lib/commons-collections4-4.1.jar:/home/hive/tez/lib/commons-io-2.4.jar:/home/hive/tez/lib/commons-lang-2.6.jar:/home/hive/tez/lib/commons-math3-3.1.1.jar:/home/hive/tez/lib/guava-11.0.2.jar:/home/hive/tez/lib/hadoop-mapreduce-client-common-2.7.2.jar:/home/hive/tez/lib/hadoop-mapreduce-client-core-2.7.2.jar:/home/hive/tez/lib/jersey-client-1.9.jar:/home/hive/tez/lib/jersey-json-1.9.jar:/home/hive/tez/lib/jettison-1.3.4.jar:/home/hive/tez/lib/jetty-server-9.3.24.v20180605.jar:/home/hive/tez/lib/jetty-util-9.3.24.v20180605.jar:/home/hive/tez/lib/jsr305-3.0.0.jar:/home/hive/tez/lib/metrics-core-3.1.0.jar:/home/hive/tez/lib/netty-3.6.2.Final.jar:/home/hive/tez/lib/protobuf-java-2.5.0.jar:/home/hive/tez/lib/RoaringBitmap-0.5.21.jar:/home/hive/tez/lib/servlet-api-2.5.jar:/home/hive/tez/lib/slf4j-api-1.7.10.jar:/home/hive/tez/lib/slf4j-log4j12-1.7.10.jar"
"root"
"/run/user/0"
"275864"
"/usr/local/zookeeper"
"/home/flink/lib/flink-cep-1.15.3.jar:/home/flink/lib/flink-table-api-java-uber-1.15.3.jar:/home/flink/lib/flink-dist-1.15.3.jar:/home/flink/lib/flink-json-1.15.3.jar:/home/flink/lib/flink-table-runtime-1.15.3.jar:/home/flink/lib/flink-table-planner-loader-1.15.3.jar:/home/flink/lib/flink-csv-1.15.3.jar:/home/flink/lib/flink-scala_2.12-1.15.3.jar:/home/flink/lib/commons-cli-1.6.0.jar:/home/flink/lib/flink-connector-files-1.15.3.jar:/home/flink/lib/flink-shaded-zookeeper-3.5.9.jar"
"/home/hive/conf"
"/home/hive/conf:/home/hive/lib/hbase-client-1.1.1.jar:/home/hive/lib/jetty-io-9.2.5.v20141112.jar:/home/hive/lib/jetty-util-9.2.5.v20141112.jar:/home/hive/lib/javolution-5.5.1.jar:/home/hive/lib/orc-tools-1.3.4.jar:/home/hive/lib/spark-core_2.11-2.0.0.jar:/home/hive/lib/curator-client-2.7.1.jar:/home/hive/lib/curator-recipes-2.7.1.jar:/home/hive/lib/htrace-core-3.1.0-incubating.jar:/home/hive/lib/hive-service-rpc-2.3.9.jar:/home/hive/lib/zookeeper-3.4.6.jar:/home/hive/lib/hive-testutils-2.3.9.jar:/home/hive/lib/netty-3.6.2.Final.jar:/home/hive/lib/hive-hbase-handler-2.3.9.jar:/home/hive/lib/accumulo-start-1.7.3.jar:/home/hive/lib/HikariCP-2.5.1.jar:/home/hive/lib/aether-util-0.9.0.M2.jar:/home/hive/lib/commons-httpclient-3.1.jar:/home/hive/lib/hbase-hadoop2-compat-1.1.1.jar:/home/hive/lib/mysql-metadata-storage-0.9.2.jar:/home/hive/lib/metrics-core-2.2.0.jar:/home/hive/lib/hive-llap-common-2.3.9.jar:/home/hive/lib/commons-el-1.0.jar:/home/hive/lib/jasper-runtime-5.5.23.jar:/home/hive/lib/disruptor-3.3.0.jar:/home/hive/lib/hive-vector-code-gen-2.3.9.jar:/home/hive/lib/jetty-http-9.2.5.v20141112.jar:/home/hive/lib/hive-llap-client-2.3.9.jar:/home/hive/lib/jdo-api-3.0.1.jar:/home/hive/lib/postgresql-metadata-storage-0.9.2.jar:/home/hive/lib/bytebuffer-collections-0.2.5.jar:/home/hive/lib/groovy-all-2.4.4.jar:/home/hive/lib/hive-hplsql-2.3.9.jar:/home/hive/lib/xz-1.5.jar:/home/hive/lib/hive-shims-0.23-2.3.9.jar:/home/hive/lib/metrics-graphite-3.1.2.jar:/home/hive/lib/guava-14.0.1.jar:/home/hive/lib/jsp-api-2.1-6.1.14.jar:/home/hive/lib/hive-llap-common-2.3.9-tests.jar:/home/hive/lib/scala-parser-combinators_2.11-1.0.1.jar:/home/hive/lib/maven-model-3.1.1.jar:/home/hive/lib/postgresql-9.4.1208.jre7.jar:/home/hive/lib/ant-launcher-1.9.1.jar:/home/hive/lib/hive-contrib-2.3.9.jar:/home/hive/lib/jackson-datatype-guava-2.4.6.jar:/home/hive/lib/kryo-shaded-3.0.3.jar:/home/hive/lib/jcodings-1.0.8.jar:/home/hive/lib/py4j-0.10.1.jar:/home/hive/lib/guice-servlet-4.1.0.jar:/home/hive/lib/jackson-jaxrs-1.9.13.jar:/home/hive/lib/scala-library-2.11.8.jar:/home/hive/lib/httpcore-4.4.jar:/home/hive/lib/bonecp-0.8.0.RELEASE.jar:/home/hive/lib/spark-tags_2.11-2.0.0.jar:/home/hive/lib/httpclient-4.4.jar:/home/hive/lib/hive-shims-common-2.3.9.jar:/home/hive/lib/scala-compiler-2.11.0.jar:/home/hive/lib/maven-repository-metadata-3.1.1.jar:/home/hive/lib/asm-commons-3.1.jar:/home/hive/lib/jersey-server-1.14.jar:/home/hive/lib/netty-all-4.0.52.Final.jar:/home/hive/lib/log4j-jul-2.5.jar:/home/hive/lib/hive-serde-2.3.9.jar:/home/hive/lib/icu4j-4.8.1.jar:/home/hive/lib/jol-core-0.2.jar:/home/hive/lib/hbase-prefix-tree-1.1.1.jar:/home/hive/lib/jdbi-2.63.1.jar:/home/hive/lib/snappy-java-1.1.1.3.jar:/home/hive/lib/jline-2.12.jar:/home/hive/lib/JavaEWAH-0.3.2.jar:/home/hive/lib/chill-java-0.8.0.jar:/home/hive/lib/json4s-core_2.11-3.2.11.jar:/home/hive/lib/irc-api-1.0-0014.jar:/home/hive/lib/jersey-client-1.9.jar:/home/hive/lib/jetty-sslengine-6.1.26.jar:/home/hive/lib/jersey-guice-1.19.jar:/home/hive/lib/javax.servlet-3.0.0.v201112011016.jar:/home/hive/lib/ant-1.6.5.jar:/home/hive/lib/guice-multibindings-4.1.0.jar:/home/hive/lib/commons-compress-1.9.jar:/home/hive/lib/hibernate-validator-5.1.3.Final.jar:/home/hive/lib/slider-core-0.90.2-incubating.jar:/home/hive/lib/jamon-runtime-2.3.1.jar:/home/hive/lib/jackson-jaxrs-base-2.4.6.jar:/home/hive/lib/jcommander-1.32.jar:/home/hive/lib/spark-launcher_2.11-2.0.0.jar:/home/hive/lib/hbase-procedure-1.1.1.jar:/home/hive/lib/jetty-util-6.1.26.jar:/home/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/home/hive/lib/hive-hcatalog-server-extensions-2.3.9.jar:/home/hive/lib/avro-1.8.2.jar:/home/hive/lib/jackson-databind-2.6.5.jar:/home/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/home/hive/lib/metrics-core-3.1.0.jar:/home/hive/lib/hbase-server-1.1.1.jar:/home/hive/lib/aether-impl-0.9.0.M2.jar:/home/hive/lib/javax.servlet-api-3.1.0.jar:/home/hive/lib/java-util-0.27.10.jar:/home/hive/lib/jackson-module-scala_2.11-2.6.5.jar:/home/hive/lib/emitter-0.3.6.jar:/home/hive/lib/libthrift-0.9.3.jar:/home/hive/lib/aircompressor-0.8.jar:/home/hive/lib/aether-connector-file-0.9.0.M2.jar:/home/hive/lib/maxminddb-0.2.0.jar:/home/hive/lib/paranamer-2.7.jar:/home/hive/lib/slice-0.29.jar:/home/hive/lib/javax.inject-1.jar:/home/hive/lib/antlr-runtime-3.5.2.jar:/home/hive/lib/metrics-json-3.1.0.jar:/home/hive/lib/jackson-core-asl-1.9.13.jar:/home/hive/lib/commons-logging-1.2.jar:/home/hive/lib/asm-tree-3.1.jar:/home/hive/lib/commons-collections-3.2.2.jar:/home/hive/lib/jetty-server-9.2.5.v20141112.jar:/home/hive/lib/jetty-6.1.26.jar:/home/hive/lib/jodd-core-3.5.2.jar:/home/hive/lib/mesos-0.21.1-shaded-protobuf.jar:/home/hive/lib/pyrolite-4.9.jar:/home/hive/lib/jetty-all-7.6.0.v20120127.jar:/home/hive/lib/accumulo-core-1.7.3.jar:/home/hive/lib/commons-pool-1.5.4.jar:/home/hive/lib/hbase-common-1.1.1-tests.jar:/home/hive/lib/validation-api-1.1.0.Final.jar:/home/hive/lib/hbase-hadoop-compat-1.1.1.jar:/home/hive/lib/velocity-1.5.jar:/home/hive/lib/xbean-asm5-shaded-4.4.jar:/home/hive/lib/tesla-aether-0.0.5.jar:/home/hive/lib/avro-mapred-1.8.2-hadoop2.jar:/home/hive/lib/hive-jdbc-handler-2.3.9.jar:/home/hive/lib/jasper-compiler-5.5.23.jar:/home/hive/lib/activation-1.1.jar:/home/hive/lib/compress-lzf-1.0.3.jar:/home/hive/lib/hive-jdbc-2.3.9.jar:/home/hive/lib/hive-beeline-2.3.9.jar:/home/hive/lib/transaction-api-1.1.jar:/home/hive/lib/jackson-jaxrs-json-provider-2.4.6.jar:/home/hive/lib/classmate-1.0.0.jar:/home/hive/lib/jetty-continuation-9.2.5.v20141112.jar:/home/hive/lib/commons-io-2.4.jar:/home/hive/lib/spymemcached-2.11.7.jar:/home/hive/lib/log4j-api-2.6.2.jar:/home/hive/lib/mapdb-1.0.8.jar:/home/hive/lib/jetty-client-9.2.5.v20141112.jar:/home/hive/lib/joni-2.1.2.jar:/home/hive/lib/janino-2.7.6.jar:/home/hive/lib/commons-dbcp2-2.0.1.jar:/home/hive/lib/commons-lang-2.6.jar:/home/hive/lib/hbase-annotations-1.1.1.jar:/home/hive/lib/protobuf-java-2.5.0.jar:/home/hive/lib/json4s-jackson_2.11-3.2.11.jar:/home/hive/lib/hive-llap-tez-2.3.9.jar:/home/hive/lib/aether-spi-0.9.0.M2.jar:/home/hive/lib/eigenbase-properties-1.1.5.jar:/home/hive/lib/commons-pool2-2.2.jar:/home/hive/lib/curator-framework-2.7.1.jar:/home/hive/lib/airline-0.7.jar:/home/hive/lib/lz4-1.3.0.jar:/home/hive/lib/libfb303-0.9.3.jar:/home/hive/lib/google-http-client-jackson2-1.15.0-rc.jar:/home/hive/lib/hive-exec-2.3.9.jar:/home/hive/lib/hiveAuth.jar:/home/hive/lib/http-client-1.0.4.jar:/home/hive/lib/mail-1.4.1.jar:/home/hive/lib/jetty-servlets-9.2.5.v20141112.jar:/home/hive/lib/jackson-module-paranamer-2.6.5.jar:/home/hive/lib/rhino-1.7R5.jar:/home/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/home/hive/lib/hive-llap-server-2.3.9.jar:/home/hive/lib/aether-connector-okhttp-0.0.9.jar:/home/hive/lib/hive-metastore-2.3.9.jar:/home/hive/lib/curator-x-discovery-2.11.0.jar:/home/hive/lib/hive-llap-ext-client-2.3.9.jar:/home/hive/lib/chill_2.11-0.8.0.jar:/home/hive/lib/accumulo-trace-1.7.3.jar:/home/hive/lib/asm-3.1.jar:/home/hive/lib/hive-shims-2.3.9.jar:/home/hive/lib/okhttp-1.0.2.jar:/home/hive/lib/scalatest_2.11-2.2.6.jar:/home/hive/lib/config-magic-0.9.jar:/home/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/home/hive/lib/spark-network-common_2.11-2.0.0.jar:/home/hive/lib/hive-storage-api-2.4.0.jar:/home/hive/lib/aether-api-0.9.0.M2.jar:/home/hive/lib/jetty-proxy-9.2.5.v20141112.jar:/home/hive/lib/commons-compiler-2.7.6.jar:/home/hive/lib/jboss-logging-3.1.3.GA.jar:/home/hive/lib/hive-shims-scheduler-2.3.9.jar:/home/hive/lib/RoaringBitmap-0.5.11.jar:/home/hive/lib/maven-settings-builder-3.1.1.jar:/home/hive/lib/wagon-provider-api-2.4.jar:/home/hive/lib/commons-math-2.2.jar:/home/hive/lib/hive-common-2.3.9.jar:/home/hive/lib/opencsv-2.3.jar:/home/hive/lib/extendedset-1.3.10.jar:/home/hive/lib/objenesis-2.1.jar:/home/hive/lib/maven-settings-3.1.1.jar:/home/hive/lib/spark-network-shuffle_2.11-2.0.0.jar:/home/hive/lib/commons-vfs2-2.1.jar:/home/hive/lib/tempus-fugit-1.1.jar:/home/hive/lib/jackson-core-2.6.5.jar:/home/hive/lib/hbase-common-1.1.1.jar:/home/hive/lib/jta-1.1.jar:/home/hive/lib/hive-cli-2.3.9.jar:/home/hive/lib/commons-lang3-3.1.jar:/home/hive/lib/findbugs-annotations-1.3.9-1.jar:/home/hive/lib/scalap-2.11.0.jar:/home/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/home/hive/lib/org.abego.treelayout.core-1.0.1.jar:/home/hive/lib/commons-codec-1.4.jar:/home/hive/lib/ant-1.9.1.jar:/home/hive/lib/commons-cli-1.2.jar:/home/hive/lib/spark-unsafe_2.11-2.0.0.jar:/home/hive/lib/joda-time-2.8.1.jar:/home/hive/lib/maven-aether-provider-3.1.1.jar:/home/hive/lib/spark-client-2.3.9.jar:/home/hive/lib/javax.jdo-3.2.0-m3.jar:/home/hive/lib/ST4-4.0.4.jar:/home/hive/lib/javax.el-api-3.0.0.jar:/home/hive/lib/server-metrics-0.2.8.jar:/home/hive/lib/commons-dbcp-1.4.jar:/home/hive/lib/mysql-connector-java-8.0.16.jar:/home/hive/lib/jackson-xc-1.9.13.jar:/home/hive/lib/jackson-module-jaxb-annotations-2.4.6.jar:/home/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/home/hive/lib/jackson-dataformat-smile-2.4.6.jar:/home/hive/lib/jettison-1.1.jar:/home/hive/lib/metrics-jvm-3.1.0.jar:/home/hive/lib/commons-math3-3.6.1.jar:/home/hive/lib/scala-reflect-2.11.7.jar:/home/hive/lib/antlr4-runtime-4.5.jar:/home/hive/lib/avro-ipc-1.8.2.jar:/home/hive/lib/datanucleus-api-jdo-4.2.4.jar:/home/hive/lib/hive-accumulo-handler-2.3.9.jar:/home/hive/lib/brack_hive-hcatelog-core-2.3.9.jar:/home/hive/lib/unused-1.0.0.jar:/home/hive/lib/ivy-2.4.0.jar:/home/hive/lib/jetty-security-9.2.5.v20141112.jar:/home/hive/lib/datanucleus-core-4.1.17.jar:/home/hive/lib/json-path-2.1.0.jar:/home/hive/lib/log4j-1.2-api-2.6.2.jar:/home/hive/lib/hive-service-2.3.9.jar:/home/hive/lib/geoip2-0.4.0.jar:/home/hive/lib/scala-xml_2.11-1.0.2.jar:/home/hive/lib/accumulo-fate-1.7.3.jar:/home/hive/lib/orc-core-1.3.4.jar:/home/hive/lib/jetty-servlet-9.2.5.v20141112.jar:/home/hive/lib/servlet-api-2.5-6.1.14.jar:/home/hive/lib/datanucleus-rdbms-4.1.19.jar:/home/hive/lib/jackson-jaxrs-smile-provider-2.4.6.jar:/home/hive/lib/plexus-utils-3.0.15.jar:/home/hive/lib/javax.el-3.0.0.jar:/home/hive/lib/stax-api-1.0.1.jar:/home/hive/lib/super-csv-2.2.0.jar:/home/hive/lib/jsr305-3.0.0.jar:/home/hive/lib/hbase-hadoop2-compat-1.1.1-tests.jar:/home/hive/lib/json-1.8.jar:/home/hive/lib/jsp-api-2.1.jar:/home/hive/lib/log4j-web-2.6.2.jar:/home/hive/lib/hive-hcatalog-core-3.1.2.jar:/home/hive/lib/json4s-ast_2.11-3.2.11.jar:/home/hive/lib/jackson-mapper-asl-1.9.13.jar:/home/hive/lib/log4j-core-2.6.2.jar:/home/hive/lib/minlog-1.3.0.jar:/home/hive/lib/plexus-interpolation-1.19.jar:/home/hive/lib/gson-2.2.4.jar:/home/hive/lib/stream-2.7.0.jar:/home/hive/lib/jsp-2.1-6.1.14.jar:/home/hive/lib/servlet-api-2.4.jar:/home/hive/lib/jpam-1.1.jar:/home/hive/lib/jsp-api-2.0.jar:/home/hive/lib/hbase-protocol-1.1.1.jar:/home/hive/lib/maven-model-builder-3.1.1.jar:/home/hive/lib/jackson-annotations-2.6.0.jar:/home/hive/hcatalog/share/hcatalog/hive-hcatalog-core-3.1.2.jar"
"/home/kafka/libs/kafka-clients-2.8.2.jar"
"/home/hadoop/etc/hadoop"
"/home/spark/jars/spark-core_2.12-3.3.2.jar:/home/spark/jars/jakarta.xml.bind-api-2.3.2.jar:/home/spark/jars/spire_2.12-0.17.0.jar:/home/spark/jars/okhttp-3.12.12.jar:/home/spark/jars/hk2-utils-2.6.1.jar:/home/spark/jars/javolution-5.5.1.jar:/home/spark/jars/spark-mllib-local_2.12-3.3.2.jar:/home/spark/jars/breeze-macros_2.12-1.2.jar:/home/spark/jars/okio-1.14.0.jar:/home/spark/jars/scala-parser-combinators_2.12-1.1.2.jar:/home/spark/jars/cats-kernel_2.12-2.1.1.jar:/home/spark/jars/spark-repl_2.12-3.3.2.jar:/home/spark/jars/kubernetes-model-apiextensions-5.12.2.jar:/home/spark/jars/netty-transport-native-epoll-4.1.74.Final-linux-aarch_64.jar:/home/spark/jars/jersey-common-2.36.jar:/home/spark/jars/univocity-parsers-2.9.1.jar:/home/spark/jars/netty-resolver-4.1.74.Final.jar:/home/spark/jars/threeten-extra-1.5.0.jar:/home/spark/jars/zookeeper-jute-3.6.2.jar:/home/spark/jars/HikariCP-2.5.1.jar:/home/spark/jars/py4j-0.10.9.5.jar:/home/spark/jars/jackson-annotations-2.13.4.jar:/home/spark/jars/hive-llap-common-2.3.9.jar:/home/spark/jars/commons-lang3-3.12.0.jar:/home/spark/jars/log4j-api-2.17.2.jar:/home/spark/jars/hive-vector-code-gen-2.3.9.jar:/home/spark/jars/jdo-api-3.0.1.jar:/home/spark/jars/parquet-hadoop-1.12.2.jar:/home/spark/jars/shims-0.9.25.jar:/home/spark/jars/hive-shims-0.23-2.3.9.jar:/home/spark/jars/compress-lzf-1.1.jar:/home/spark/jars/guava-14.0.1.jar:/home/spark/jars/annotations-17.0.0.jar:/home/spark/jars/kubernetes-model-core-5.12.2.jar:/home/spark/jars/netty-codec-4.1.74.Final.jar:/home/spark/jars/jakarta.validation-api-2.0.2.jar:/home/spark/jars/kubernetes-model-certificates-5.12.2.jar:/home/spark/jars/bonecp-0.8.0.RELEASE.jar:/home/spark/jars/zookeeper-3.6.2.jar:/home/spark/jars/oro-2.0.8.jar:/home/spark/jars/lapack-2.2.1.jar:/home/spark/jars/hive-shims-common-2.3.9.jar:/home/spark/jars/json4s-scalap_2.12-3.7.0-M11.jar:/home/spark/jars/netty-transport-native-kqueue-4.1.74.Final-osx-x86_64.jar:/home/spark/jars/zjsonpatch-0.3.0.jar:/home/spark/jars/chill-java-0.10.0.jar:/home/spark/jars/avro-1.11.0.jar:/home/spark/jars/hive-serde-2.3.9.jar:/home/spark/jars/spire-macros_2.12-0.17.0.jar:/home/spark/jars/kubernetes-model-batch-5.12.2.jar:/home/spark/jars/spark-mllib_2.12-3.3.2.jar:/home/spark/jars/jaxb-runtime-2.3.2.jar:/home/spark/jars/ivy-2.5.1.jar:/home/spark/jars/pickle-1.2.jar:/home/spark/jars/mesos-1.4.3-shaded-protobuf.jar:/home/spark/jars/spark-unsafe_2.12-3.3.2.jar:/home/spark/jars/kubernetes-model-autoscaling-5.12.2.jar:/home/spark/jars/spire-platform_2.12-0.17.0.jar:/home/spark/jars/spark-sketch_2.12-3.3.2.jar:/home/spark/jars/netty-transport-native-unix-common-4.1.74.Final.jar:/home/spark/jars/scala-reflect-2.12.15.jar:/home/spark/jars/kubernetes-model-discovery-5.12.2.jar:/home/spark/jars/spark-streaming_2.12-3.3.2.jar:/home/spark/jars/spark-yarn_2.12-3.3.2.jar:/home/spark/jars/derby-10.14.2.0.jar:/home/spark/jars/osgi-resource-locator-1.0.3.jar:/home/spark/jars/arpack-2.2.1.jar:/home/spark/jars/blas-2.2.1.jar:/home/spark/jars/json4s-ast_2.12-3.7.0-M11.jar:/home/spark/jars/kubernetes-model-coordination-5.12.2.jar:/home/spark/jars/spire-util_2.12-0.17.0.jar:/home/spark/jars/shapeless_2.12-2.3.7.jar:/home/spark/jars/hive-service-rpc-3.1.2.jar:/home/spark/jars/kubernetes-model-apps-5.12.2.jar:/home/spark/jars/commons-text-1.10.0.jar:/home/spark/jars/lz4-java-1.8.0.jar:/home/spark/jars/commons-cli-1.5.0.jar:/home/spark/jars/netty-transport-native-kqueue-4.1.74.Final-osx-aarch_64.jar:/home/spark/jars/generex-1.0.2.jar:/home/spark/jars/logging-interceptor-3.12.12.jar:/home/spark/jars/parquet-encoding-1.12.2.jar:/home/spark/jars/scala-collection-compat_2.12-2.1.1.jar:/home/spark/jars/paranamer-2.8.jar:/home/spark/jars/commons-codec-1.15.jar:/home/spark/jars/jackson-dataformat-yaml-2.13.4.jar:/home/spark/jars/spark-sql_2.12-3.3.2.jar:/home/spark/jars/antlr-runtime-3.5.2.jar:/home/spark/jars/netty-tcnative-classes-2.0.48.Final.jar:/home/spark/jars/jackson-core-asl-1.9.13.jar:/home/spark/jars/commons-collections-3.2.2.jar:/home/spark/jars/kubernetes-model-scheduling-5.12.2.jar:/home/spark/jars/kubernetes-model-metrics-5.12.2.jar:/home/spark/jars/hadoop-shaded-guava-1.1.1.jar:/home/spark/jars/netty-transport-4.1.74.Final.jar:/home/spark/jars/scala-xml_2.12-1.2.0.jar:/home/spark/jars/avro-ipc-1.11.0.jar:/home/spark/jars/jakarta.servlet-api-4.0.3.jar:/home/spark/jars/jodd-core-3.5.2.jar:/home/spark/jars/hive-exec-2.3.9-core.jar:/home/spark/jars/orc-shims-1.7.8.jar:/home/spark/jars/scala-library-2.12.15.jar:/home/spark/jars/commons-pool-1.5.4.jar:/home/spark/jars/spark-network-common_2.12-3.3.2.jar:/home/spark/jars/breeze_2.12-1.2.jar:/home/spark/jars/kubernetes-model-networking-5.12.2.jar:/home/spark/jars/metrics-jvm-4.2.7.jar:/home/spark/jars/httpcore-4.4.14.jar:/home/spark/jars/curator-recipes-2.13.0.jar:/home/spark/jars/orc-mapreduce-1.7.8.jar:/home/spark/jars/velocity-1.5.jar:/home/spark/jars/avro-mapred-1.11.0.jar:/home/spark/jars/jackson-module-scala_2.12-2.13.4.jar:/home/spark/jars/json4s-jackson_2.12-3.7.0-M11.jar:/home/spark/jars/commons-compress-1.21.jar:/home/spark/jars/kubernetes-model-common-5.12.2.jar:/home/spark/jars/kubernetes-client-5.12.2.jar:/home/spark/jars/netty-transport-native-epoll-4.1.74.Final-linux-x86_64.jar:/home/spark/jars/javassist-3.25.0-GA.jar:/home/spark/jars/hive-jdbc-2.3.9.jar:/home/spark/jars/hive-beeline-2.3.9.jar:/home/spark/jars/transaction-api-1.1.jar:/home/spark/jars/rocksdbjni-6.20.3.jar:/home/spark/jars/commons-io-2.11.0.jar:/home/spark/jars/objenesis-3.2.jar:/home/spark/jars/jakarta.annotation-api-1.3.5.jar:/home/spark/jars/libthrift-0.12.0.jar:/home/spark/jars/stream-2.9.6.jar:/home/spark/jars/commons-lang-2.6.jar:/home/spark/jars/audience-annotations-0.5.0.jar:/home/spark/jars/kubernetes-model-events-5.12.2.jar:/home/spark/jars/netty-transport-classes-kqueue-4.1.74.Final.jar:/home/spark/jars/protobuf-java-2.5.0.jar:/home/spark/jars/algebra_2.12-2.0.1.jar:/home/spark/jars/log4j-core-2.17.2.jar:/home/spark/jars/spark-graphx_2.12-3.3.2.jar:/home/spark/jars/libfb303-0.9.3.jar:/home/spark/jars/xz-1.9.jar:/home/spark/jars/tink-1.6.1.jar:/home/spark/jars/arrow-vector-7.0.0.jar:/home/spark/jars/kubernetes-model-node-5.12.2.jar:/home/spark/jars/jersey-client-2.36.jar:/home/spark/jars/netty-transport-classes-epoll-4.1.74.Final.jar:/home/spark/jars/activation-1.1.1.jar:/home/spark/jars/jersey-hk2-2.36.jar:/home/spark/jars/commons-compiler-3.0.16.jar:/home/spark/jars/hive-metastore-2.3.9.jar:/home/spark/jars/JLargeArrays-1.5.jar:/home/spark/jars/kubernetes-model-rbac-5.12.2.jar:/home/spark/jars/jakarta.ws.rs-api-2.1.6.jar:/home/spark/jars/parquet-common-1.12.2.jar:/home/spark/jars/spark-hive_2.12-3.3.2.jar:/home/spark/jars/RoaringBitmap-0.9.25.jar:/home/spark/jars/janino-3.0.16.jar:/home/spark/jars/hive-shims-2.3.9.jar:/home/spark/jars/netty-common-4.1.74.Final.jar:/home/spark/jars/metrics-core-4.2.7.jar:/home/spark/jars/log4j-1.2-api-2.17.2.jar:/home/spark/jars/flatbuffers-java-1.12.0.jar:/home/spark/jars/commons-collections4-4.4.jar:/home/spark/jars/jakarta.inject-2.6.1.jar:/home/spark/jars/hadoop-client-runtime-3.3.2.jar:/home/spark/jars/hk2-api-2.6.1.jar:/home/spark/jars/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/home/spark/jars/kubernetes-model-admissionregistration-5.12.2.jar:/home/spark/jars/spark-catalyst_2.12-3.3.2.jar:/home/spark/jars/zstd-jni-1.5.2-1.jar:/home/spark/jars/hadoop-client-api-3.3.2.jar:/home/spark/jars/hive-shims-scheduler-2.3.9.jar:/home/spark/jars/kubernetes-model-extensions-5.12.2.jar:/home/spark/jars/core-1.1.2.jar:/home/spark/jars/arrow-memory-netty-7.0.0.jar:/home/spark/jars/hive-common-2.3.9.jar:/home/spark/jars/snakeyaml-1.31.jar:/home/spark/jars/commons-logging-1.1.3.jar:/home/spark/jars/opencsv-2.3.jar:/home/spark/jars/arrow-memory-core-7.0.0.jar:/home/spark/jars/jersey-container-servlet-2.36.jar:/home/spark/jars/hadoop-yarn-server-web-proxy-3.3.2.jar:/home/spark/jars/chill_2.12-0.10.0.jar:/home/spark/jars/automaton-1.11-8.jar:/home/spark/jars/leveldbjni-all-1.8.jar:/home/spark/jars/kryo-shaded-4.0.2.jar:/home/spark/jars/jersey-container-servlet-core-2.36.jar:/home/spark/jars/jta-1.1.jar:/home/spark/jars/hive-cli-2.3.9.jar:/home/spark/jars/spark-network-shuffle_2.12-3.3.2.jar:/home/spark/jars/netty-handler-4.1.74.Final.jar:/home/spark/jars/arpack_combined_all-0.1.jar:/home/spark/jars/curator-framework-2.13.0.jar:/home/spark/jars/xbean-asm9-shaded-4.20.jar:/home/spark/jars/aircompressor-0.21.jar:/home/spark/jars/kubernetes-model-policy-5.12.2.jar:/home/spark/jars/javax.jdo-3.2.0-m3.jar:/home/spark/jars/ST4-4.0.4.jar:/home/spark/jars/commons-dbcp-1.4.jar:/home/spark/jars/spark-mesos_2.12-3.3.2.jar:/home/spark/jars/kubernetes-model-flowcontrol-5.12.2.jar:/home/spark/jars/orc-core-1.7.8.jar:/home/spark/jars/commons-crypto-1.1.0.jar:/home/spark/jars/jersey-server-2.36.jar:/home/spark/jars/netty-buffer-4.1.74.Final.jar:/home/spark/jars/metrics-json-4.2.7.jar:/home/spark/jars/commons-math3-3.6.1.jar:/home/spark/jars/spark-kubernetes_2.12-3.3.2.jar:/home/spark/jars/JTransforms-3.1.jar:/home/spark/jars/arrow-format-7.0.0.jar:/home/spark/jars/datanucleus-api-jdo-4.2.4.jar:/home/spark/jars/jackson-core-2.13.4.jar:/home/spark/jars/datanucleus-core-4.1.17.jar:/home/spark/jars/jackson-databind-2.13.4.2.jar:/home/spark/jars/parquet-column-1.12.2.jar:/home/spark/jars/aopalliance-repackaged-2.6.1.jar:/home/spark/jars/antlr4-runtime-4.8.jar:/home/spark/jars/hk2-locator-2.6.1.jar:/home/spark/jars/spark-launcher_2.12-3.3.2.jar:/home/spark/jars/jackson-datatype-jsr310-2.13.4.jar:/home/spark/jars/parquet-format-structures-1.12.2.jar:/home/spark/jars/datanucleus-rdbms-4.1.19.jar:/home/spark/jars/scala-compiler-2.12.15.jar:/home/spark/jars/spark-hive-thriftserver_2.12-3.3.2.jar:/home/spark/jars/kubernetes-model-storageclass-5.12.2.jar:/home/spark/jars/json4s-core_2.12-3.7.0-M11.jar:/home/spark/jars/stax-api-1.0.1.jar:/home/spark/jars/httpclient-4.5.13.jar:/home/spark/jars/joda-time-2.10.13.jar:/home/spark/jars/parquet-jackson-1.12.2.jar:/home/spark/jars/super-csv-2.2.0.jar:/home/spark/jars/jsr305-3.0.0.jar:/home/spark/jars/metrics-graphite-4.2.7.jar:/home/spark/jars/json-1.8.jar:/home/spark/jars/hive-storage-api-2.7.2.jar:/home/spark/jars/spark-kvstore_2.12-3.3.2.jar:/home/spark/jars/jackson-mapper-asl-1.9.13.jar:/home/spark/jars/metrics-jmx-4.2.7.jar:/home/spark/jars/minlog-1.3.0.jar:/home/spark/jars/gson-2.2.4.jar:/home/spark/jars/snappy-java-1.1.8.4.jar:/home/spark/jars/netty-all-4.1.74.Final.jar:/home/spark/jars/istack-commons-runtime-3.0.8.jar:/home/spark/jars/jpam-1.1.jar:/home/spark/jars/curator-client-2.13.0.jar:/home/spark/jars/spark-tags_2.12-3.3.2.jar:/home/spark/jars/jline-2.14.6.jar"
"/***/apache-kylin/bin/../tomcat"
/home/hive/warehouse
Using hbase cached dependency...
Using hadoop conf cached dependency...
Using kafka cached dependency...
Using spark cached dependency...
Using flink cached dependency...
Start to check whether we need to migrate acl tables
/***/apache-kylin/bin/cached-hive-dependency.sh: line 2: /home/flink: Is a directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 3: /***/flume: No such file or directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 4: /home/hadoop: Is a directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 5: /home/hadoop/lib/native: Is a directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 6: /home/hadoop/etc/hadoop: Is a directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 7: 256: command not found
/***/apache-kylin/bin/cached-hive-dependency.sh: line 8: /home/hadoop: Is a directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 25: -Djava.library.path
/home/hbase/lib/hbase-common-2.5.0.jar
/***/hbase
ignoredups
1000

/home/hive/conf
/home/hive
/***
hadoop012
/usr/java8
:/home/hadoop/lib/native:/home/hadoop/lib/native
/home/kafka
/***/apache-kylin
en_US.UTF-8
:/home/hadoop/lib/native:/home/hadoop/lib/native
: No such file or directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 28: /var/spool/mail/***: No such file or directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 30: /usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/***/anaconda3/bin:/usr/local/apache-zookeeper-3.6.1-bin/bin/:/usr/local/zookeeper/bin/:/home/hive/bin:/home/sqoop/bin:/usr/java8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin:/usr/java8/bin:/home/sqoop/bin:/home/hadoop/bin:/home/hadoop/sbin:/home/hive/bin:/home/hive/lib:/lib:/***/bin:/***/.local/share/coursier/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin:/home/spark/bin:/usr/java8/bin:/usr/java8/bin:/home/hadoop/bin:/home/hadoop/sbin:/***/flume/bin:/home/kafka/bin:/home/flink/bin:/home/spark/bin:/home/hbase/bin:/home/kafka/bin:/home/kafka/bin: No such file or directory
/***/apache-kylin/bin/cached-hive-dependency.sh: line 31: /***: Is a directory

ERROR：

the HTTP ://server:7070 is not work

lastYoueven commented 8 months ago

the find-hive-dependency.sh cant find the right hive warehouse path when hive install TEZ ; I make ${KYLIN_HOME}/bin/find-hive-dependency.sh ```export hive_warehouse_dir=hive -e 'set hive.metastore.warehouse.dir;' | awk '{split($0,a,"="); print a[2]}'``` fix to：```export hive_warehouse_dir=hive -e 'set hive.metastore.warehouse.dir;' | tail -n 1 | awk -F '=' '{print $2}'` ``` kylin is working