big-data-europe / docker-hive

1.03k stars 551 forks source link

not listening on 10000/10002 when i upgrade to 3.1.2 #34

Closed 2qif49lt closed 4 years ago

2qif49lt commented 4 years ago

with bde2020/hadoop 3.2.1, postgres is : bde2020/hive-metastore-postgresql:3.1.0

dockerfile:

FROM bde2020/hadoop-base:2.0.0-hadoop3.2.1-java8

ARG HIVE_VERSION=3.1.2

ENV HIVE_VERSION=${HIVE_VERSION:-3.1.2}

ENV HIVE_HOME /opt/hive
ENV PATH $HIVE_HOME/bin:$PATH
ENV HADOOP_HOME /opt/hadoop-$HADOOP_VERSION

WORKDIR /opt

COPY apache-hive-${HIVE_VERSION}-bin.tar.gz /opt
COPY sources.list /etc/apt/

RUN apt-get update && apt-get install -y  procps && \
    tar -xzf apache-hive-$HIVE_VERSION-bin.tar.gz && \
    mv apache-hive-$HIVE_VERSION-bin hive && \
    rm apache-hive-$HIVE_VERSION-bin.tar.gz && \
    rm  -f ./hive/lib/guava-19.0.jar && \
    cp ./hadoop-${HADOOP_VERSION}/share/hadoop/hdfs/lib/guava-27.0-jre.jar ./hive/lib/ && \
    apt-get clean && \
    rm -rf /var/lib/apt/lists/*

COPY postgresql-42.2.14.jar $HIVE_HOME/lib/postgresql-jdbc.jar

#Custom configuration goes here
ADD conf/hive-site.xml $HIVE_HOME/conf
ADD conf/beeline-log4j2.properties $HIVE_HOME/conf
ADD conf/hive-env.sh $HIVE_HOME/conf
ADD conf/hive-exec-log4j2.properties $HIVE_HOME/conf
ADD conf/hive-log4j2.properties $HIVE_HOME/conf
ADD conf/ivysettings.xml $HIVE_HOME/conf
ADD conf/llap-daemon-log4j2.properties $HIVE_HOME/conf

COPY startup.sh /usr/local/bin/
RUN chmod +x /usr/local/bin/startup.sh

COPY entrypoint.sh /usr/local/bin/
RUN chmod +x /usr/local/bin/entrypoint.sh

EXPOSE 10000
EXPOSE 10002

ENTRYPOINT ["entrypoint.sh"]
CMD startup.sh

hive server logs are

Configuring hive
 - Setting datanucleus.autoCreateSchema=false
 - Setting javax.jdo.option.ConnectionPassword=hive
 - Setting hive.metastore.uris=thrift://metastore:9083
 - Setting javax.jdo.option.ConnectionURL=jdbc:postgresql://metastore/metastore
 - Setting javax.jdo.option.ConnectionUserName=hive
 - Setting javax.jdo.option.ConnectionDriverName=org.postgresql.Driver
Configuring for multihomed network
[1/100] check for metastore:9083...
[1/100] metastore:9083 is not available yet
[1/100] try in 5s once again ...
[2/100] check for metastore:9083...
[2/100] metastore:9083 is not available yet
[2/100] try in 5s once again ...
[3/100] check for metastore:9083...
[3/100] metastore:9083 is not available yet
[3/100] try in 5s once again ...
[4/100] check for metastore:9083...
[4/100] metastore:9083 is not available yet
[4/100] try in 5s once again ...
[5/100] metastore:9083 is available.
mkdir: `/tmp': File exists
2020-07-22 07:15:33: Starting HiveServer2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-3.2.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Hive Session ID = c86e1a7f-e18c-4c04-a8ba-1179c235fdce
Hive Session ID = 6f036ed3-5041-4479-ad99-eebc193a110a
...
...
...
Hive Session ID = xxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxxxxxxx
# quit after print about 20 lines 

command netstat show nothing on 10000/10002.

2qif49lt commented 4 years ago

fixed

jessequinn commented 3 years ago

fixed? What was fixed? You were getting connection refused on remote commands?

brunobastosg commented 2 years ago

@2qif49lt how did you solve this? I have the same problem.