[EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser.
689
stars
374
forks
source link
Unable to query the hive table in container from spark-shell running in Windows #68
I was able to start the hive server and metastore service using this project(bde2020/hive)
in windows machine. And Spark shell which is running in Windows is able to connect this Hive metastore and display the hive tables.
spark.sharedState.externalCatalog.listTables("default")
I was unable to display the hive table content usingspark.table("demo_sales97").show , due to Caused by: java.net.UnknownHostException: namenode
I tried adding hostname to the compose file.Unfortuantely , it seems not working.
I could find couple of threads related to java.net.UnknownHostException: namenode, but nothing specific to
connecting spark-shell running in Windows.
I was able to start the hive server and metastore service using this project(bde2020/hive) in windows machine. And Spark shell which is running in Windows is able to connect this Hive metastore and display the hive tables.
spark.sharedState.externalCatalog.listTables("default")I was unable to display the hive table content using
spark.table("demo_sales97").show, due to Caused by: java.net.UnknownHostException: namenodeI tried adding hostname to the compose file.Unfortuantely , it seems not working.
I could find couple of threads related to java.net.UnknownHostException: namenode, but nothing specific to connecting spark-shell running in Windows.
Please help on this.