search

Esri / gis-tools-for-hadoop

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.
http://esri.github.io/gis-tools-for-hadoop/
Apache License 2.0
521 stars 254 forks source link

Copy from HDFS not working #22

Open mayur7789 opened 9 years ago

mayur7789 commented 9 years ago

Here is the error details model

I have Windows 7 as Host machine and Cloudera VM (Linux) as guest machine. Arcmap is installed on Host machine please find the screen shot below while accessing. clouderavmnamenode http://quickstart.cloudera:50070/dfshealth.html#tab-overview (192.168.126.128:50070/) through browser on the same machine as ArcMap.

Also tried solving the problem with the help of "Copy to HDFS not working #16" But still I am facing the same problem. clouderavm ss

Please point me to right direction.

GISDev01 commented 8 years ago

@amitabh74 that is actually a different error than the original issue here. Please open a new issue, as this one can be closed. We want to avoid the common problem of github issues turning into forum threads. I can help you troubleshoot in a new issue.

Cess-Zhu commented 8 years ago

@ymzzx @amitabh74 I met the same problem just as you did, but finally I figure out a solution. Hope that may help you.

First of all, the IP of my VM is 192.168.233.130: hdp_2 3 2_vmare-2016-03-11-16-33-52

Change my OS host file to: 192.168.233.130 sandbox.hortonworks.com 1

Then, fill the "HDFS host name" box with "sandbox.hortonworks.com" in "Copy From HDFS" tool: 2

and success: 3

This solution is pretty different, however it works. And I was inspired by @GISDev01 @JamesMilnerUK and @climbage . When I change http://sandbox.hortonworks.com:50075/webhdfs/v1/apps/hive/warehouse/taxi_agg/000000_0?op=OPEN&namenoderpcaddress=sandbox.hortonworks.com:8020&offset=0 to http://192.168.233.130:50075/webhdfs/v1/apps/hive/warehouse/taxi_agg/000000_0?op=OPEN&namenoderpcaddress=sandbox.hortonworks.com:8020&offset=0 I can get the json file.

But I am still wondering the reason why the error appears, and why I cannot use "localhost" as "HDFS server name" while my host file has already edited as 127.0.0.1 sandbox.hortonworks.com. .

BTW, I'm using VMware and my physical machine's OS is Windows 10. And the VM shares the IP of the host.

MjHow912 commented 6 years ago

Has anyone tried connecting to a Kerberized cluster from ArcMap to make this work? What was your workaround if so? I would like to just copy the table to a my local desktop and then import it from there to turn into a FEATURE but my trouble is exporting it.

wangbingzhang123 commented 6 years ago

@ymzzx @amitabh74 @Cess-Zhu I met one of the same questions Error 10061 Have you solved it？Please help me.Thank you very much.

1512380452 1