big-data-europe / docker-hive

1.02k stars 544 forks source link

Spark not able to connect to hive metastore #40

Open cynthiavincent opened 3 years ago

cynthiavincent commented 3 years ago

Hi,

I have spark running on anothe container and I have copied the hive-site.xml to the spark/conf folder, However, I am not able to connect to hive-metastore using thrift://hive-metastore:9083.

Docker containers are here CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES c3cdade997d1 shawnzhu/prestodb:0.181 "./bin/launcher run" 4 hours ago Up 4 hours 8080/tcp, 0.0.0.0:8089->8089/tcp docker-hive-master2_presto-coordinator_1 31d31e19936b bde2020/hadoop-datanode:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 4 hours ago Up 4 hours (healthy) 0.0.0.0:50075->50075/tcp docker-hive-master2_datanode_1 67a3f25604df bde2020/hive:2.3.2-postgresql-metastore "entrypoint.sh /opt/…" 4 hours ago Up 4 hours 10000/tcp, 0.0.0.0:9083->9083/tcp, 10002/tcp docker-hive-master2_hive-metastore_1 23f8ff772a49 bde2020/hive-metastore-postgresql:2.3.0 "/docker-entrypoint.…" 4 hours ago Up 4 hours 5432/tcp docker-hive-master2_hive-metastore-postgresql_1 495d5aa65d46 bde2020/hadoop-namenode:2.0.0-hadoop2.7.4-java8 "/entrypoint.sh /run…" 4 hours ago Up 4 hours (healthy) 0.0.0.0:50070->50070/tcp docker-hive-master2_namenode_1

lucassant95 commented 2 years ago

Same here

DAYceng commented 2 years ago

Maybe this will help:https://github.com/big-data-europe/docker-hadoop/issues/124