search

etsy / jading

cascading.jruby build and execution tool
https://github.com/etsy/jading/wiki
16 stars 8 forks source link

error running example #3

Open adsummos opened 11 years ago

adsummos commented 11 years ago

after a successful build I still can't run in local mode

Buildfile: /Users/bjohnson/Documents/workspace/cascading-test/jading/build.xml [echo] Resolved?: ${resolved}

download-ivy: [mkdir] Created dir: /tmp/jading/build/ivy/lib [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar [get] To: /tmp/jading/build/ivy/lib/ivy.jar

init-ivy:

retrieve-ivy: [ivy:resolve] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ :: [ivy:resolve] :: loading settings :: file = /Users/bjohnson/Documents/workspace/cascading-test/jading/ivysettings.xml [ivy:resolve] :: resolving dependencies :: com.etsy#jading;0.0.1 [ivy:resolve] confs: [default, master, compile, provided, runtime, test, system, sources, javadoc, optional] [ivy:resolve] found cascading#cascading-core;2.0.0 in conjars [ivy:resolve] found riffle#riffle;0.1-dev in conjars [ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in public [ivy:resolve] found thirdparty#jgrapht-jdk1.6;0.8.1 in conjars [ivy:resolve] found org.codehaus.janino#janino;2.5.16 in public [ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in public [ivy:resolve] found log4j#log4j;1.2.16 in apache [ivy:resolve] found cascading#cascading-local;2.0.0 in conjars [ivy:resolve] found com.google.guava#guava;10.0.1 in public [ivy:resolve] found com.google.code.findbugs#jsr305;1.3.9 in public [ivy:resolve] found cascading#cascading-hadoop;2.0.0 in conjars [ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.2 in apache [ivy:resolve] found commons-cli#commons-cli;1.2 in apache [ivy:resolve] found xmlenc#xmlenc;0.52 in public [ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in public [ivy:resolve] found junit#junit;3.8.1 in public [ivy:resolve] found commons-logging#commons-logging;1.0.3 in apache [ivy:resolve] found commons-codec#commons-codec;1.4 in apache [ivy:resolve] found org.apache.commons#commons-math;2.1 in apache [ivy:resolve] found commons-configuration#commons-configuration;1.6 in apache [ivy:resolve] found commons-collections#commons-collections;3.2.1 in apache [ivy:resolve] found commons-lang#commons-lang;2.4 in apache [ivy:resolve] found commons-logging#commons-logging;1.1.1 in apache [ivy:resolve] found commons-digester#commons-digester;1.8 in apache [ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in apache [ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in apache [ivy:resolve] found commons-net#commons-net;1.4.1 in apache [ivy:resolve] found oro#oro;2.0.8 in public [ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in public [ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in public [ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in public [ivy:resolve] found tomcat#jasper-runtime;5.5.12 in public [ivy:resolve] found tomcat#jasper-compiler;5.5.12 in public [ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in public [ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in public [ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in public [ivy:resolve] found org.eclipse.jdt#core;3.1.1 in public [ivy:resolve] found ant#ant;1.6.5 in public [ivy:resolve] found commons-el#commons-el;1.0 in public [ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in public [ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in public [ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in public [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in public [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in public [ivy:resolve] found org.jruby#jruby-complete;1.6.5 in public [ivy:resolve] found junit#junit;4.8.1 in public [ivy:resolve] downloading http://conjars.org/repo/cascading/cascading-core/2.0.0/cascading-core-2.0.0.jar ... [ivy:resolve] ............................................................................................................................................................................................................................................................................. (481kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] cascading#cascading-core;2.0.0!cascading-core.jar (1495ms) [ivy:resolve] downloading http://conjars.org/repo/cascading/cascading-local/2.0.0/cascading-local-2.0.0.jar ... [ivy:resolve] ................. (34kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] cascading#cascading-local;2.0.0!cascading-local.jar (332ms) [ivy:resolve] downloading http://conjars.org/repo/cascading/cascading-hadoop/2.0.0/cascading-hadoop-2.0.0.jar ... [ivy:resolve] ......................................................................................................................... (200kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] cascading#cascading-hadoop;2.0.0!cascading-hadoop.jar (570ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/jruby/jruby-complete/1.6.5/jruby-complete-1.6.5.jar ... [ivy:resolve] [SUCCESSFUL ] org.jruby#jruby-complete;1.6.5!jruby-complete.jar (13509ms) [ivy:resolve] downloading http://conjars.org/repo/riffle/riffle/0.1-dev/riffle-0.1-dev.jar ... [ivy:resolve] ......... (11kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] riffle#riffle;0.1-dev!riffle.jar (488ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar ... [ivy:resolve] [SUCCESSFUL ] org.slf4j#slf4j-api;1.6.1!slf4j-api.jar (255ms) [ivy:resolve] downloading http://conjars.org/repo/thirdparty/jgrapht-jdk1.6/0.8.1/jgrapht-jdk1.6-0.8.1.jar ... [ivy:resolve] ...................................................................................................................... (229kB) [ivy:resolve] .. (0kB) [ivy:resolve] [SUCCESSFUL ] thirdparty#jgrapht-jdk1.6;0.8.1!jgrapht-jdk1.6.jar (1403ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/codehaus/janino/janino/2.5.16/janino-2.5.16.jar ... [ivy:resolve] [SUCCESSFUL ] org.codehaus.janino#janino;2.5.16!janino.jar (856ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/slf4j/slf4j-log4j12/1.6.1/slf4j-log4j12-1.6.1.jar ... [ivy:resolve] [SUCCESSFUL ] org.slf4j#slf4j-log4j12;1.6.1!slf4j-log4j12.jar (260ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/log4j/log4j/1.2.16/log4j-1.2.16.jar ... [ivy:resolve] .............................................................. (470kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] log4j#log4j;1.2.16!log4j.jar(bundle) (1322ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/com/google/guava/guava/10.0.1/guava-10.0.1.jar ... [ivy:resolve] [SUCCESSFUL ] com.google.guava#guava;10.0.1!guava.jar (1657ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar ... [ivy:resolve] [SUCCESSFUL ] com.google.code.findbugs#jsr305;1.3.9!jsr305.jar (260ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/org/apache/hadoop/hadoop-core/1.0.2/hadoop-core-1.0.2.jar ... [ivy:resolve] .......................................................................................................................................... [ivy:resolve] ......................................................................................................... [ivy:resolve] ..................................................................................................................................................................... [ivy:resolve] ..................................................................................... (3832kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] org.apache.hadoop#hadoop-core;1.0.2!hadoop-core.jar (5840ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-cli/commons-cli/1.2/commons-cli-1.2.jar ... [ivy:resolve] ....... (40kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-cli#commons-cli;1.2!commons-cli.jar (530ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/xmlenc/xmlenc/0.52/xmlenc-0.52.jar ... [ivy:resolve] [SUCCESSFUL ] xmlenc#xmlenc;0.52!xmlenc.jar (866ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-httpclient/commons-httpclient/3.0.1/commons-httpclient-3.0.1.jar ... [ivy:resolve] [SUCCESSFUL ] commons-httpclient#commons-httpclient;3.0.1!commons-httpclient.jar (822ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-codec/commons-codec/1.4/commons-codec-1.4.jar ... [ivy:resolve] ......... (56kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-codec#commons-codec;1.4!commons-codec.jar (588ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/org/apache/commons/commons-math/2.1/commons-math-2.1.jar ... [ivy:resolve] .............................................. [ivy:resolve] .......................................................................... (812kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] org.apache.commons#commons-math;2.1!commons-math.jar (2892ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar ... [ivy:resolve] ....................................... (291kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-configuration#commons-configuration;1.6!commons-configuration.jar (974ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar ... [ivy:resolve] ......................... (176kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-net#commons-net;1.4.1!commons-net.jar (800ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar ... [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jetty;6.1.26!jetty.jar (1136ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar ... [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jetty-util;6.1.26!jetty-util.jar (393ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/tomcat/jasper-runtime/5.5.12/jasper-runtime-5.5.12.jar ... [ivy:resolve] [SUCCESSFUL ] tomcat#jasper-runtime;5.5.12!jasper-runtime.jar (347ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/tomcat/jasper-compiler/5.5.12/jasper-compiler-5.5.12.jar ... [ivy:resolve] [SUCCESSFUL ] tomcat#jasper-compiler;5.5.12!jasper-compiler.jar (621ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar ... [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jsp-api-2.1;6.1.14!jsp-api-2.1.jar (389ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar ... [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#jsp-2.1;6.1.14!jsp-2.1.jar (1293ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/commons-el/commons-el/1.0/commons-el-1.0.jar ... [ivy:resolve] [SUCCESSFUL ] commons-el#commons-el;1.0!commons-el.jar (332ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar ... [ivy:resolve] [SUCCESSFUL ] net.java.dev.jets3t#jets3t;0.7.1!jets3t.jar (622ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/net/sf/kosmosfs/kfs/0.3/kfs-0.3.jar ... [ivy:resolve] [SUCCESSFUL ] net.sf.kosmosfs#kfs;0.3!kfs.jar (261ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/hsqldb/hsqldb/1.8.0.10/hsqldb-1.8.0.10.jar ... [ivy:resolve] [SUCCESSFUL ] hsqldb#hsqldb;1.8.0.10!hsqldb.jar (901ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/oro/oro/2.0.8/oro-2.0.8.jar ... [ivy:resolve] [SUCCESSFUL ] oro#oro;2.0.8!oro.jar (250ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar ... [ivy:resolve] [SUCCESSFUL ] org.eclipse.jdt#core;3.1.1!core.jar (3559ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar ... [ivy:resolve] [SUCCESSFUL ] org.codehaus.jackson#jackson-mapper-asl;1.0.1!jackson-mapper-asl.jar (526ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar ... [ivy:resolve] [SUCCESSFUL ] junit#junit;3.8.1!junit.jar (333ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar ... [ivy:resolve] .......................................................................... (561kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-collections#commons-collections;3.2.1!commons-collections.jar (1265ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-lang/commons-lang/2.4/commons-lang-2.4.jar ... [ivy:resolve] ................................... (255kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-lang#commons-lang;2.4!commons-lang.jar (962ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar ... [ivy:resolve] ........... (59kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-logging#commons-logging;1.1.1!commons-logging.jar (547ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-digester/commons-digester/1.8/commons-digester-1.8.jar ... [ivy:resolve] ..................... (140kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-digester#commons-digester;1.8!commons-digester.jar (784ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar ... [ivy:resolve] ............................ (201kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-beanutils#commons-beanutils-core;1.8.0!commons-beanutils-core.jar (841ms) [ivy:resolve] downloading https://repository.apache.org/content/repositories/releases/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar ... [ivy:resolve] .......................... (184kB) [ivy:resolve] ... (0kB) [ivy:resolve] [SUCCESSFUL ] commons-beanutils#commons-beanutils;1.7.0!commons-beanutils.jar (853ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.jar ... [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#servlet-api;2.5-20081211!servlet-api.jar (467ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar ... [ivy:resolve] [SUCCESSFUL ] org.mortbay.jetty#servlet-api-2.5;6.1.14!servlet-api-2.5.jar (317ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/ant/ant/1.6.5/ant-1.6.5.jar ... [ivy:resolve] [SUCCESSFUL ] ant#ant;1.6.5!ant.jar (896ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar ... [ivy:resolve] [SUCCESSFUL ] org.codehaus.jackson#jackson-core-asl;1.0.1!jackson-core-asl.jar (277ms) [ivy:resolve] downloading http://repo1.maven.org/maven2/junit/junit/4.8.1/junit-4.8.1.jar ... [ivy:resolve] [SUCCESSFUL ] junit#junit;4.8.1!junit.jar (328ms) [ivy:resolve] :: resolution report :: resolve 70772ms :: artifacts dl 54286ms [ivy:resolve] :: evicted modules: [ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [default] [ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [default] [ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [default] [ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [default] [ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [default]

|                  |            modules            ||   artifacts   |
|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
|      default     |   49  |   45  |   45  |   5   ||   44  |   44  |
|      master      |   0   |   0   |   0   |   0   ||   0   |   0   |
|      compile     |   0   |   0   |   0   |   0   ||   0   |   0   |
|     provided     |   0   |   0   |   0   |   0   ||   0   |   0   |
|      runtime     |   0   |   0   |   0   |   0   ||   0   |   0   |
|       test       |   1   |   1   |   1   |   0   ||   1   |   1   |
|      system      |   0   |   0   |   0   |   0   ||   0   |   0   |
|      sources     |   0   |   0   |   0   |   0   ||   0   |   0   |
|      javadoc     |   0   |   0   |   0   |   0   ||   0   |   0   |
|     optional     |   0   |   0   |   0   |   0   ||   0   |   0   |
---------------------------------------------------------------------

[ivy:retrieve] :: retrieving :: com.etsy#jading [ivy:retrieve] confs: [default, master, compile, provided, runtime, test, system, sources, javadoc, optional] [ivy:retrieve] 45 artifacts copied, 0 already retrieved (32511kB/349ms)

BUILD SUCCESSFUL Total time: 2 minutes 8 seconds Buildfile: /Users/bjohnson/Documents/workspace/cascading-test/jading/build.xml [echo] Resolved?: true

download-ivy:

init-ivy:

retrieve-ivy:

compile: [javac] Compiling 2 source files to /tmp/jading/build/classes

BUILD SUCCESSFUL Total time: 1 second Fetching: cascading.jruby-0.0.10.gem (100%) Buildfile: /Users/bjohnson/Documents/workspace/cascading-test/jading/build.xml [echo] Resolved?: true

jade-jar: [jar] Building jar: /Users/bjohnson/Documents/workspace/cascading-test/jade.jar

BUILD SUCCESSFUL Total time: 2 seconds bjohnson@Brian:~/Documents/workspace/cascading-test $ export CASCADING_HOME=/tmp/jading/build/lib bjohnson@Brian:~/Documents/workspace/cascading-test $ jruby jading/examples/wordcount.rb jading/README.md local Args: input_path=jading/README.md, mode=local NameError: cannot load Java class cascading.flow.planner.Scope for_name at org/jruby/javasupport/JavaClass.java:1205 get_proxy_class at org/jruby/javasupport/JavaUtilities.java:34 const_missing at /Users/bjohnson/.rvm/rubies/jruby-1.6.8/lib/ruby/site_ruby/shared/builtin/javasupport/java.rb:45 flow_scope at /Users/bjohnson/.rvm/gems/jruby-1.6.8@cascading-test/gems/cascading.jruby-1.0.0/lib/cascading/scope.rb:23 initialize at /Users/bjohnson/.rvm/gems/jruby-1.6.8@cascading-test/gems/cascading.jruby-1.0.0/lib/cascading/flow.rb:31 flow at /Users/bjohnson/.rvm/gems/jruby-1.6.8@cascading-test/gems/cascading.jruby-1.0.0/lib/cascading/cascade.rb:60 file at jading/examples/wordcount.rb:11 instance_eval at org/jruby/RubyBasicObject.java:1730 cascade at /Users/bjohnson/.rvm/gems/jruby-1.6.8@cascading-test/gems/cascading.jruby-1.0.0/lib/cascading/cascading.rb:77 (root) at jading/examples/wordcount.rb:10

mrwalker commented 10 years ago

Apologies for missing this! I'll take a look later today.

mrwalker commented 10 years ago

Hey @adsummos , you can see the error you get:

NameError: cannot load Java class cascading.flow.planner.Scope

Is the same one mentioned in the Getting Started guide. That document's intent was to get you to set your CLASSPATH, like this:

export CLASSPATH="$CLASSPATH:/tmp/jading/build/lib/*"

But it was operating against an outdated version of cascading.jruby that required setting CASCADING_HOME instead. I've corrected the document, and updated jading to pull in the latest cascading.jruby version (1.0.0). You'll have to wait on Etsy to merge my PR for the update, so I'd recommend using mrwalker/jading in the meantime.

Let me know if you have any other issues!

mrwalker commented 10 years ago

@adsummos issue #4 is merged, so you should be good to go with the latest wiki instructions. Let me know if you run into anything else.