Esri / gis-tools-for-hadoop

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.
http://esri.github.io/gis-tools-for-hadoop/
Apache License 2.0
521 stars 254 forks source link

GP tools point-in-polygon-aggregation-mr not working #19

Open trumboosahil opened 10 years ago

trumboosahil commented 10 years ago

I followed your tutorial at gis-tools-for-hadoop / samples / point-in-polygon-aggregation-mr / gp / README.md but not Tool is not working and shows red X's on the GP Tools from the Hadoop Tools toolbox. However as suggested at same location to double click rectangle in the model and reset the location of the tool.

I acted accordingly after my double click it shows error dialog with "Unable to execute the selected tool." I tried to right click->edit on the "Run Sample Application" but nothing happens.

I'm using ArcGIS desktop 10.2 with Advances ArcInfo licenses

climbage commented 10 years ago

The sample model requires the GP tools from https://github.com/Esri/geoprocessing-tools-for-hadoop. Put the model in the same folder as the tools.

trumboosahil commented 10 years ago

I did this already and as a matter of fact the documentation of this subject is good but needs lot of improvement

climbage commented 10 years ago

I agree that the documentation on the GP tools can be improved.

smambrose commented 10 years ago

What error do you get when you view the toolbox in the Catalog window? (right click the toolbox, "check syntax") image

trumboosahil commented 10 years ago

Please check the screen shot in catalog window as under

catalog

Please see the screen shot in ArctoolBox and also when I double - click on "Run Sample Application"

arctool

smambrose commented 10 years ago

Did you delete the files requests or webhdfs?

If not - are you able to view your model at all? (right click on model, edit).

trumboosahil commented 10 years ago

I didn't delete the file from requests or webhdfs when I right click on model at select edit option nothing happens

smambrose commented 10 years ago

I am not able to reproduce this yet.

  1. Were you at any point able to edit and see the model? (like in image 1)
  2. Did you try and verify and/or run your model while you still had model builder open?
  3. Was the model coloured in when you tried to run it - like : image ?
  4. Did you save any settings in the ArcToolbox (either to file or default)?
  5. Have you been able to run the tools not in the model builder (just standalone)?
trumboosahil commented 10 years ago

Thanks for your help I got it working

trumboosahil commented 9 years ago

After running the Oozei Job in armap the Job runs and goes on running:

image

And in oozei Dashboard I found please check bold text

2014-11-30 02:27:14,481 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] Start action [0000000-141130021902027-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2014-11-30 02:27:14,482 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] [_0000000-141130021902027-oozie-oozi-W@:start:_]Action status=DONE 2014-11-30 02:27:14,482 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@:start:] [_0000000-141130021902027-oozie-oozi-W@:start:_]Action updated in DB! 2014-11-30 02:27:15,846 INFO ActionStartXCommand:541 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W@eq-node] Start action [0000000-141130021902027-oozie-oozi-W@eq-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2014-11-30 02:47:30,833 WARN ActionStartXCommand:544 - SERVER[quickstart.cloudera] USER[hdfs] GROUP[-] TOKEN[] APP[earthquake-aggregation] JOB[0000000-141130021902027-oozie-oozi-W] ACTION[0000000-141130021902027-oozie-oozi-W " @eq-node] Error starting action [eq-node]. ErrorType [TRANSIENT], ErrorCode [ JA006], Message [ JA006: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused] org.apache.oozie.action.ActionExecutorException: JA006: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412) at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:392) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:980) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1135) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63) at org.apache.oozie.command.XCommand.call(XCommand.java:281) at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323) at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.ConnectException: Call From quickstart.cloudera/127.0.0.1 to quickstart.cloudera:8021 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused"

trumboosahil commented 9 years ago

And in continuation of above comment in oozei web console

image

climbage commented 9 years ago

Have you had any luck with this? This seems like an issue with the Oozie setup on your Cloudera VM.