search

Esri / gis-tools-for-hadoop

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.
http://esri.github.io/gis-tools-for-hadoop/
Apache License 2.0
521 stars 254 forks source link

Connection attempt failed in "Copy FROM HDFS" tool #78

Closed TayyabMir56 closed 6 years ago

TayyabMir56 commented 6 years ago

Hi

I am following the following tutorial: Move Data from Hive -> ArcGIS

I have added the counties and earthquake data and created the agg_samp table from it as instructed and I can query it in the hive as well.

using the descibe command, I can see that my datanode is sandbox-hdp.hortonworks.com image

I have added this in the hosts file as well so I can access the HDFS as well as Ambari from the web portal

image

But when I try using the "Copy from HDFS" tool in the GIS Tools for Hadoop Toolbox:

image

I get the following connection error.

image

Now the thing that I cannot understand is that if I can access the same machine with the web portal, Why does the connection not respond when I do it from ArcGIS.

Note: I have tried using my IP instead of the full name, It gives the same result. Note 2: I have also tried to ping sandbox-hdp.hortonworks.com and it also times out

image

Please tell me what am I doing wrong here.

Best regards Tayyab

randallwhitman commented 6 years ago

Is there a firewall?

TayyabMir56 commented 6 years ago

I get the same result even after turning off the firewall. Another thing i have noticed is that I can not download the data from the hdfs web portal image

It works good so far but when I press "Download". It gives an error. Maybe that is a hint?

image

randallwhitman commented 6 years ago

If the ping times out, my first guess is there is an issue with the network, rather than an issue perse with GIS Tools for Hadoop.

TayyabMir56 commented 6 years ago

I solved the issue by opening access to all ports (0 to 65535) on my HDP Server. Apparently ArcGIS was using a port other than 80 as well, which i could not identify which one exactly. I know this is a bad practice but oh well. Works for me for now :)

climbage commented 6 years ago

@TayyabMir56 the port is most likely 50070 which is configurable in the GP tool. Glad you got it sorted.

TayyabMir56 commented 6 years ago

@climbage No sir 50070 was already open. Its some other.