rjurney
commented
9 years ago Try downloading Pig 12 or 13 and report back.
Open dbl001 opened 10 years ago
rjurney
commented
9 years ago Try downloading Pig 12 or 13 and report back.
dbl001
commented
9 years ago I downloaded pig 14 source and built it:
$ svn co http://svn.apache.org/repos/asf/pig/trunk $ ant $ cd contrib/piggybank/java $ ant $ ./pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig 14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream at org.apache.pig.Main.run(Main.java:414) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 7 more
Details also at logfile: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms) (virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log
On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:
Try downloading Pig 12 or 13 and report back.
— Reply to this email directly or view it on GitHub.
dbl001
commented
9 years ago David-Laxers-MacBook-Pro:~ davidlaxer$ !e echo $PATH /opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin: David-Laxers-MacBook-Pro:~ davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again David-Laxers-MacBook-Pro:~ davidlaxer$ which pig /usr/local/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms) David-Laxers-MacBook-Pro:~ davidlaxer$
On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:
I downloaded pig 14 source and built it:
$ svn co http://svn.apache.org/repos/asf/pig/trunk $ ant $ cd contrib/piggybank/java $ ant $ ./pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig 14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream at org.apache.pig.Main.run(Main.java:414) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 7 more
Details also at logfile: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms) (virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log
On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:
Try downloading Pig 12 or 13 and report back.
Reply to this email directly or view it on GitHub.
dbl001
commented
9 years ago David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf
On Oct 9, 2014, at 1:37 AM, David Laxer davidl@softintel.com wrote:
David-Laxers-MacBook-Pro:~ davidlaxer$ !e echo $PATH /opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin: David-Laxers-MacBook-Pro:~ davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again David-Laxers-MacBook-Pro:~ davidlaxer$ which pig /usr/local/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms) David-Laxers-MacBook-Pro:~ davidlaxer$
On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:
I downloaded pig 14 source and built it:
$ svn co http://svn.apache.org/repos/asf/pig/trunk $ ant $ cd contrib/piggybank/java $ ant $ ./pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig 14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream at org.apache.pig.Main.run(Main.java:414) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 7 more
Details also at logfile: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms) (virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log
On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:
Try downloading Pig 12 or 13 and report back.
Reply to this email directly or view it on GitHub.
dbl001
commented
9 years ago The requirements for the virtual environment finally completed:
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy
Password:
---> Computing dependencies for snappy
---> Cleaning snappy
---> Scanning binaries for linking errors
---> No broken files found.
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install python-snappy
Error: Port python-snappy not found
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pip install python-snappy
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages
Cleaning up...
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pwd
/users/davidlaxer/hadoop-2.3.0-src
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ dirs
/users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pushd ~/Agile_Data_Code/
~/Agile_Data_Code /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ history | grep pip
146 pip install -r python/requirements.txt
175 pip install --upgrade --no-deps git+git://github.com/Theano/Theano.git
441 pip freeze
442 sudo pip install virtualenv
448 sudo pip install virtualenv
451 pip install graphlab-create==0.9.1
502 pip install virtualenv
508 pip install -r requirements.txt
509 pip install snappy
510 pip install python-snappy
512 pip install python-snappy
513 pip install -r requirements.txt
514 pip install -r requirements.txt
529 pip install python-snappy
551 pip install python-snappy
555 history | grep pip
(virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo !513
sudo pip install -r requirements.txt
Requirement already satisfied (use --upgrade to upgrade): BareNecessities==0.2.8 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 1))
Requirement already satisfied (use --upgrade to upgrade): ESClient==0.5.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 2))
Requirement already satisfied (use --upgrade to upgrade): Flask==0.9 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 3))
Requirement already satisfied (use --upgrade to upgrade): Jinja2==2.6 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 4))
Requirement already satisfied (use --upgrade to upgrade): LEPL==5.1.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 5))
Requirement already satisfied (use --upgrade to upgrade): Mail==2.1.0 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 6))
Requirement already satisfied (use --upgrade to upgrade): Werkzeug==0.8.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 7))
Requirement already satisfied (use --upgrade to upgrade): distribute==0.6.31 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 8))
Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 9))
Requirement already satisfied (use --upgrade to upgrade): avro==1.7.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 10))
Obtaining pyelasticsearch from git+https://github.com/rhec/pyelasticsearch.git#egg=pyelasticsearch (from -r requirements.txt (line 11))
Updating ./src/pyelasticsearch clone
Running setup.py (path:/Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch/setup.py) egg_info for package pyelasticsearch
Installing extra requirements: 'egg' Requirement already satisfied (use --upgrade to upgrade): pymongo==2.4.1 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 12)) Downloading/unpacking requests==1.0.4 (from -r requirements.txt (line 13)) Downloading requests-1.0.4.tar.gz (336kB): 336kB downloaded Running setup.py (path:/private/tmp/pip_build_root/requests/setup.py) egg_info for package requests
Requirement already satisfied (use --upgrade to upgrade): simplejson==2.6.2 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 14)) Requirement already satisfied (use --upgrade to upgrade): wsgiref==0.1.2 in /Users/davidlaxer/anaconda/lib/python2.7 (from -r requirements.txt (line 15)) Requirement already satisfied (use --upgrade to upgrade): numpy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 16)) Requirement already satisfied (use --upgrade to upgrade): honcho in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 17)) Requirement already satisfied (use --upgrade to upgrade): scipy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 18)) Requirement already satisfied (use --upgrade to upgrade): dotcloud in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 19)) Requirement already satisfied (use --upgrade to upgrade): python-dateutil in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 20)) Requirement already satisfied (use --upgrade to upgrade): nltk in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 21)) Requirement already satisfied (use --upgrade to upgrade): six in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from pyelasticsearch->-r requirements.txt (line 11)) Requirement already satisfied (use --upgrade to upgrade): argparse in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19)) Requirement already satisfied (use --upgrade to upgrade): colorama in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19)) Installing collected packages: pyelasticsearch, requests Running setup.py develop for pyelasticsearch
Creating /Users/davidlaxer/anaconda/lib/python2.7/site-packages/pyelasticsearch.egg-link (link to .)
pyelasticsearch 0.6.1 is already the active version in easy-install.pth
Installed /Users/davidlaxer/Agile_Data_Code/src/pyelasticsearchFound existing installation: requests 2.3.0 Uninstalling requests: Successfully uninstalled requests Running setup.py install for requests
Successfully installed pyelasticsearch requests Cleaning up... (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo pip install avro Requirement already satisfied (use --upgrade to upgrade): avro in /Users/davidlaxer/anaconda/lib/python2.7/site-packages Cleaning up... (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$
On Oct 9, 2014, at 7:29 AM, David Laxer davidl@softintel.com wrote:
David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf
On Oct 9, 2014, at 1:37 AM, David Laxer davidl@softintel.com wrote:
David-Laxers-MacBook-Pro:~ davidlaxer$ !e echo $PATH /opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin: David-Laxers-MacBook-Pro:~ davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again David-Laxers-MacBook-Pro:~ davidlaxer$ which pig /usr/local/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms) David-Laxers-MacBook-Pro:~ davidlaxer$
On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:
I downloaded pig 14 source and built it:
$ svn co http://svn.apache.org/repos/asf/pig/trunk $ ant $ cd contrib/piggybank/java $ ant $ ./pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig 14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream at org.apache.pig.Main.run(Main.java:414) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 7 more
Details also at logfile: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms) (virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log
On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:
Try downloading Pig 12 or 13 and report back.
Reply to this email directly or view it on GitHub.
dbl001
commented
9 years ago Here’s what happened with Pig 0.13
(virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig -x
Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ./bin/pig 14/10/09 11:36:34 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/09 11:36:34 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 14/10/09 11:36:34 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2014-10-09 11:36:34,366 [main] INFO org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58 2014-10-09 11:36:34,366 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/davidlaxer/pig-0.13.0/pig_1412872594365.log 2014-10-09 11:36:34,421 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream Details at logfile: /Users/davidlaxer/pig-0.13.0/pig_1412872594365.log (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ !v vi RELEASE_NOTES.txt (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ ant Buildfile: /Users/davidlaxer/pig-0.13.0/build.xml
ivy-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar [get] To: /Users/davidlaxer/pig-0.13.0/ivy/ivy-2.2.0.jar [get] Not modified - so not downloaded
ivy-init-dirs:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init: [ivy:configure] :: Apache Ivy ${target.ivy.version}-local-20140820125617 - 20140820125617 :: http://ant.apache.org/ivy/ :: [ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.13.0/ivy/ivysettings.xml
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| compile | 109 | 55 | 0 | 17 || 95 | 0 |
---------------------------------------------------------------------ivy-compile: [ivy:retrieve] :: retrieving :: org.apache.pig#pig [ivy:retrieve] confs: [compile] [ivy:retrieve] 95 artifacts copied, 0 already retrieved (81667kB/3564ms) [ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:cachepath] :: loading settings :: file = /Users/davidlaxer/pig-0.13.0/ivy/ivysettings.xml
init: [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/impl/logicalLayer/parser [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/tools/pigscript/parser [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/tools/parameters [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/build/classes [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/build/test/classes [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/data/parser [move] Moving 1 file to /Users/davidlaxer/pig-0.13.0/build/ivy/lib/Pig
cc-compile: [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "JavaCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/parameters/PigFileParser.jj . . . [javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "JavaCharStream.java" does not exist. Will create one. [javacc] Parser generated with 0 errors and 1 warnings. [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.13.0/src/org/apache/pig/tools/parameters/ParamLoader.jj . . . [javacc] File "TokenMgrError.java" is being rebuilt. [javacc] File "ParseException.java" is being rebuilt. [javacc] File "Token.java" is being rebuilt. [javacc] File "JavaCharStream.java" is being rebuilt. [javacc] Parser generated successfully. [jjtree] Java Compiler Compiler Version 4.2 (Tree Builder) [jjtree](type "jjtree" with no arguments for help) [jjtree] Reading from file /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt . . . [jjtree] File "Node.java" is being rebuilt. [jjtree] File "SimpleNode.java" is being rebuilt. [jjtree] File "DOTParserTreeConstants.java" is being rebuilt. [jjtree] File "JJTDOTParserState.java" is being rebuilt. [jjtree] Annotated grammar generated successfully in /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.13.0/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj . . . [javacc] File "TokenMgrError.java" is being rebuilt. [javacc] File "ParseException.java" is being rebuilt. [javacc] File "Token.java" is being rebuilt. [javacc] File "SimpleCharStream.java" is being rebuilt. [javacc] Parser generated successfully.
prepare: [mkdir] Created dir: /Users/davidlaxer/pig-0.13.0/src-gen/org/apache/pig/parser
genLexer:
genParser:
genTreeParser:
gen:
compile: [echo] * Building Main Sources * [echo] * To compile with all warnings enabled, supply -Dall.warnings=1 on command line * [echo] * Else, you will only be warned about deprecations * [javac] Compiling 887 source files to /Users/davidlaxer/pig-0.13.0/build/classes [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. [copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0/build/classes/org/apache/pig/tools/grunt [copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0/build/classes/org/apache/pig/tools/grunt [copy] Copying 2 files to /Users/davidlaxer/pig-0.13.0/build/classes/python [copy] Copying 2 files to /Users/davidlaxer/pig-0.13.0/build/classes/META-INF
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| buildJar | 123 | 63 | 2 | 19 || 107 | 0 |
---------------------------------------------------------------------[ivy:retrieve] :: retrieving :: org.apache.pig#pig [ivy:retrieve] confs: [buildJar] [ivy:retrieve] 14 artifacts copied, 93 already retrieved (10371kB/493ms)
jar: [echo] svnString Unversioned directory [jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT.jar [echo] svnString Unversioned directory [jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT-withdependencies.jar [jar] META-INF/DEPENDENCIES already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] org/apache/commons/beanutils/BasicDynaBean.class already added, skipping [jar] org/apache/commons/beanutils/BasicDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/BeanAccessLanguageException.class already added, skipping [jar] org/apache/commons/beanutils/BeanUtils.class already added, skipping [jar] org/apache/commons/beanutils/BeanUtilsBean$1.class already added, skipping [jar] org/apache/commons/beanutils/BeanUtilsBean.class already added, skipping [jar] org/apache/commons/beanutils/ConstructorUtils.class already added, skipping [jar] org/apache/commons/beanutils/ContextClassLoaderLocal.class already added, skipping [jar] org/apache/commons/beanutils/ConversionException.class already added, skipping [jar] org/apache/commons/beanutils/ConvertUtils.class already added, skipping [jar] org/apache/commons/beanutils/ConvertUtilsBean.class already added, skipping [jar] org/apache/commons/beanutils/Converter.class already added, skipping [jar] org/apache/commons/beanutils/ConvertingWrapDynaBean.class already added, skipping [jar] org/apache/commons/beanutils/DynaBean.class already added, skipping [jar] org/apache/commons/beanutils/DynaClass.class already added, skipping [jar] org/apache/commons/beanutils/DynaProperty.class already added, skipping [jar] org/apache/commons/beanutils/JDBCDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/LazyDynaBean.class already added, skipping [jar] org/apache/commons/beanutils/LazyDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/LazyDynaMap.class already added, skipping [jar] org/apache/commons/beanutils/MappedPropertyDescriptor.class already added, skipping [jar] org/apache/commons/beanutils/MethodUtils$MethodDescriptor.class already added, skipping [jar] org/apache/commons/beanutils/MethodUtils.class already added, skipping [jar] org/apache/commons/beanutils/MutableDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/NestedNullException.class already added, skipping [jar] org/apache/commons/beanutils/PropertyUtils.class already added, skipping [jar] org/apache/commons/beanutils/PropertyUtilsBean.class already added, skipping [jar] org/apache/commons/beanutils/ResultSetDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/ResultSetIterator.class already added, skipping [jar] org/apache/commons/beanutils/RowSetDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/WrapDynaBean.class already added, skipping [jar] org/apache/commons/beanutils/WrapDynaClass.class already added, skipping [jar] org/apache/commons/beanutils/converters/AbstractArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/BigDecimalConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/BigIntegerConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/BooleanArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/BooleanConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/ByteArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/ByteConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/CharacterArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/CharacterConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/ClassConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/DoubleArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/DoubleConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/FileConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/FloatArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/FloatConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/IntegerArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/IntegerConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/LongArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/LongConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/ShortArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/ShortConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/SqlDateConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/SqlTimeConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/SqlTimestampConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/StringArrayConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/StringConverter.class already added, skipping [jar] org/apache/commons/beanutils/converters/URLConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/BaseLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleBeanUtils$Descriptor.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleBeanUtils.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$1.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean$Descriptor.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleBeanUtilsBean.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleConvertUtils.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleConvertUtilsBean.class already added, skipping [jar] org/apache/commons/beanutils/locale/LocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/BigDecimalLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/BigIntegerLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/ByteLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/DateLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/DecimalLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/DoubleLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/FloatLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/IntegerLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/LongLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/ShortLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/SqlDateLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/SqlTimeLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/SqlTimestampLocaleConverter.class already added, skipping [jar] org/apache/commons/beanutils/locale/converters/StringLocaleConverter.class already added, skipping [jar] org/apache/commons/collections/ArrayStack.class already added, skipping [jar] org/apache/commons/collections/Buffer.class already added, skipping [jar] org/apache/commons/collections/BufferUnderflowException.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$1.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$CollectionView.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$EntrySet.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$KeySet.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$Values.class already added, skipping [jar] org/apache/commons/collections/FastHashMap.class already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] org/apache/commons/collections/ArrayStack.class already added, skipping [jar] org/apache/commons/collections/Buffer.class already added, skipping [jar] org/apache/commons/collections/BufferUnderflowException.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$1.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$CollectionView$CollectionViewIterator.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$CollectionView.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$EntrySet.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$KeySet.class already added, skipping [jar] org/apache/commons/collections/FastHashMap$Values.class already added, skipping [jar] org/apache/commons/collections/FastHashMap.class already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/ASL2.0 already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/LICENSE.txt already added, skipping [jar] META-INF/NOTICE.txt already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/DEPENDENCIES already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/DEPENDENCIES already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping
copyHadoop1: [copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0
copyHadoop2:
jar-withouthadoop: [echo] svnString Unversioned directory [echo] svnString Unversioned directory [jar] Building jar: /Users/davidlaxer/pig-0.13.0/build/pig-0.13.1-SNAPSHOT-withouthadoop.jar [jar] META-INF/DEPENDENCIES already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/ASL2.0 already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/DEPENDENCIES already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping [jar] META-INF/DEPENDENCIES already added, skipping [jar] META-INF/LICENSE already added, skipping [jar] META-INF/NOTICE already added, skipping
copyHadoop1: [copy] Copying 1 file to /Users/davidlaxer/pig-0.13.0
copyHadoop2:
jar-all:
BUILD SUCCESSFUL Total time: 3 minutes 6 seconds (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ env | grep HADOOP HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ export PIG_CLASSPATH=/users/davidlaxer/hadoop-2.3.0-src/src/conf (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$ bin/pig 14/10/09 11:43:26 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/09 11:43:26 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 14/10/09 11:43:26 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2014-10-09 11:43:27,477 [main] INFO org.apache.pig.Main - Apache Pig version 0.13.0 (r1606446) compiled Jun 29 2014, 02:27:58 2014-10-09 11:43:27,478 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/davidlaxer/pig-0.13.0/pig_1412873007475.log 2014-10-09 11:43:27,737 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream Details at logfile: /Users/davidlaxer/pig-0.13.0/pig_1412873007475.log (virtualenv)David-Laxers-MacBook-Pro:pig-0.13.0 davidlaxer$
On Oct 9, 2014, at 11:07 AM, David Laxer davidl@softintel.com wrote:
The requirements for the virtual environment finally completed:
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install snappy Password: ---> Computing dependencies for snappy ---> Cleaning snappy ---> Scanning binaries for linking errors ---> No broken files found.
(virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ sudo port install python-snappy Error: Port python-snappy not found (virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pip install python-snappy Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages Cleaning up... (virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pwd /users/davidlaxer/hadoop-2.3.0-src (virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ dirs /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig (virtualenv)David-Laxers-MacBook-Pro:hadoop-2.3.0-src davidlaxer$ pushd ~/Agile_Data_Code/ ~/Agile_Data_Code /users/davidlaxer/hadoop-2.3.0-src ~/Agile_Data_Code/ch03/pig (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ history | grep pip 146 pip install -r python/requirements.txt 175 pip install --upgrade --no-deps git+git://github.com/Theano/Theano.git 441 pip freeze 442 sudo pip install virtualenv 448 sudo pip install virtualenv 451 pip install graphlab-create==0.9.1 502 pip install virtualenv 508 pip install -r requirements.txt 509 pip install snappy 510 pip install python-snappy 512 pip install python-snappy 513 pip install -r requirements.txt 514 pip install -r requirements.txt 529 pip install python-snappy 551 pip install python-snappy 555 history | grep pip (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo !513 sudo pip install -r requirements.txt Requirement already satisfied (use --upgrade to upgrade): BareNecessities==0.2.8 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 1)) Requirement already satisfied (use --upgrade to upgrade): ESClient==0.5.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 2)) Requirement already satisfied (use --upgrade to upgrade): Flask==0.9 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 3)) Requirement already satisfied (use --upgrade to upgrade): Jinja2==2.6 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 4)) Requirement already satisfied (use --upgrade to upgrade): LEPL==5.1.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 5)) Requirement already satisfied (use --upgrade to upgrade): Mail==2.1.0 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 6)) Requirement already satisfied (use --upgrade to upgrade): Werkzeug==0.8.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 7)) Requirement already satisfied (use --upgrade to upgrade): distribute==0.6.31 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 8)) Requirement already satisfied (use --upgrade to upgrade): python-snappy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 9)) Requirement already satisfied (use --upgrade to upgrade): avro==1.7.3 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 10)) Obtaining pyelasticsearch from git+https://github.com/rhec/pyelasticsearch.git#egg=pyelasticsearch (from -r requirements.txt (line 11)) Updating ./src/pyelasticsearch clone Running setup.py (path:/Users/davidlaxer/Agile_Data_Code/src/pyelasticsearch/setup.py) egg_info for package pyelasticsearchInstalling extra requirements: 'egg' Requirement already satisfied (use --upgrade to upgrade): pymongo==2.4.1 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 12)) Downloading/unpacking requests==1.0.4 (from -r requirements.txt (line 13)) Downloading requests-1.0.4.tar.gz (336kB): 336kB downloaded Running setup.py (path:/private/tmp/pip_build_root/requests/setup.py) egg_info for package requests
Requirement already satisfied (use --upgrade to upgrade): simplejson==2.6.2 in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 14)) Requirement already satisfied (use --upgrade to upgrade): wsgiref==0.1.2 in /Users/davidlaxer/anaconda/lib/python2.7 (from -r requirements.txt (line 15)) Requirement already satisfied (use --upgrade to upgrade): numpy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 16)) Requirement already satisfied (use --upgrade to upgrade): honcho in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 17)) Requirement already satisfied (use --upgrade to upgrade): scipy in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 18)) Requirement already satisfied (use --upgrade to upgrade): dotcloud in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 19)) Requirement already satisfied (use --upgrade to upgrade): python-dateutil in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 20)) Requirement already satisfied (use --upgrade to upgrade): nltk in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from -r requirements.txt (line 21)) Requirement already satisfied (use --upgrade to upgrade): six in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from pyelasticsearch->-r requirements.txt (line 11)) Requirement already satisfied (use --upgrade to upgrade): argparse in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19)) Requirement already satisfied (use --upgrade to upgrade): colorama in /Users/davidlaxer/anaconda/lib/python2.7/site-packages (from dotcloud->-r requirements.txt (line 19)) Installing collected packages: pyelasticsearch, requests Running setup.py develop for pyelasticsearch
Creating /Users/davidlaxer/anaconda/lib/python2.7/site-packages/pyelasticsearch.egg-link (link to .) pyelasticsearch 0.6.1 is already the active version in easy-install.pth Installed /Users/davidlaxer/Agile_Data_Code/src/pyelasticsearchFound existing installation: requests 2.3.0 Uninstalling requests: Successfully uninstalled requests Running setup.py install for requests
Successfully installed pyelasticsearch requests Cleaning up... (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$ sudo pip install avro Requirement already satisfied (use --upgrade to upgrade): avro in /Users/davidlaxer/anaconda/lib/python2.7/site-packages Cleaning up... (virtualenv)David-Laxers-MacBook-Pro:Agile_Data_Code davidlaxer$
On Oct 9, 2014, at 7:29 AM, David Laxer davidl@softintel.com wrote:
David-Laxers-MacBook-Pro:~ davidlaxer$ env | grep HADOOP HADOOP_HOME=/users/davidlaxer/hadoop-2.3.0-src HADOOP_CONF_DIR=/users/davidlaxer/hadoop-2.3.0-src/src/conf
On Oct 9, 2014, at 1:37 AM, David Laxer davidl@softintel.com wrote:
David-Laxers-MacBook-Pro:~ davidlaxer$ !e echo $PATH /opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/opt/local/bin:/opt/local/sbin:/opt/local/bin:/opt/local/sbin:/Users/davidlaxer/anaconda/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/Library/Frameworks/Python.framework/Versions/2.7/bin:/opt/local/bin:/opt/local/sbin:/opt/local/Library/Frameworks/Python.framework/Versions/2.7/bin:/Users/davidlaxer/sbt/bin:/usr/local/lib/erlang/erts-5.9.1/bin:/users/davidlaxer/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/opt/X11/bin:/usr/local/CrossPack-AVR/bin:/usr/local/git/bin:/usr/texbin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin::/bin:/sbin:/Users/davidlaxer/.rvm/bin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/Users/davidlaxer/scala/bin:/usr/local/hadoop/bin:/usr/local/hadoop/sbin:/Users/davidlaxer/Downloads/apache-maven-3.2.1/bin::/bin:/sbin:/Library/Frameworks/JRuby.framework/Versions/Current/bin:/usr/local/mysql/bin:/Users/davidlaxer/pig/trunk/bin: David-Laxers-MacBook-Pro:~ davidlaxer$ pig Cannot locate pig-core-h2.jar. do 'ant -Dhadoopversion=23 jar', and try again David-Laxers-MacBook-Pro:~ davidlaxer$ which pig /usr/local/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ ls -l /usr/local/bin/pig lrwxr-xr-x 1 root wheel 35 Oct 8 21:29 /usr/local/bin/pig -> /Users/davidlaxer/pig/trunk/bin/pig David-Laxers-MacBook-Pro:~ davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/09 01:36:52 INFO pig.Main: Pig script completed in 327 milliseconds (327 ms) David-Laxers-MacBook-Pro:~ davidlaxer$
On Oct 8, 2014, at 9:58 PM, David Laxer davidl@softintel.com wrote:
I downloaded pig 14 source and built it:
$ svn co http://svn.apache.org/repos/asf/pig/trunk $ ant $ cd contrib/piggybank/java $ ant $ ./pig -help
Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18
USAGE: Pig [options] [-] : Run interactively in grunt shell. Pig [options] -e[xecute] cmd [cmd ...] : Run cmd(s). Pig [options] [-f[ile]] file : Run cmds found in file. options include: -4, -log4jconf - Log4j configuration file, overrides log conf -b, -brief - Brief logging (no timestamps) -c, -check - Syntax check -d, -debug - Debug level, INFO is default -e, -execute - Commands to execute (within quotes) -f, -file - Path to the script to execute -g, -embedded - ScriptEngine classname or keyword for the ScriptEngine -h, -help - Display this message. You can specify topic to get help for that topic. properties is the only topic currently supported: -h properties. -i, -version - Display version information -l, -logfile - Path to client side log file; default is current working directory. -m, -param_file - Path to the parameter file -p, -param - Key value pair of the form param=val -r, -dryrun - Produces script with substituted parameters. Script is not executed. -t, -optimizer_off - Turn optimizations off. The following values are supported: ConstantCalculator - Calculate constants at compile time SplitFilter - Split filter conditions PushUpFilter - Filter as early as possible MergeFilter - Merge filter conditions PushDownForeachFlatten - Join or explode as late as possible LimitOptimizer - Limit as early as possible ColumnMapKeyPrune - Remove unused data AddForEach - Add ForEach to remove unneeded columns MergeForEach - Merge adjacent ForEach GroupByConstParallelSetter - Force parallel 1 for "group all" statement PartitionFilterOptimizer - Pushdown partition filter conditions to loader implementing LoadMetaData PredicatePushdownOptimizer - Pushdown filter predicates to loader implementing LoadPredicatePushDown All - Disable all optimizations All optimizations listed here are enabled by default. Optimization values are case insensitive. -v, -verbose - Print all error messages to screen -w, -warning - Turn warning logging on; also turns warning aggregation off -x, -exectype - Set execution mode: local|mapreduce, default is mapreduce. -F, -stop_on_failure - Aborts execution on the first failed job; default is off -M, -no_multiquery - Turn multiquery optimization off; default is on -N, -no_fetch - Turn fetch optimization off; default is on -P, -propertyFile - Path to property file -printCmdDebug - Overrides anything else and prints the actual command used to run Pig, including any environment variables that are set by the pig command. 14/10/08 21:58:08 INFO pig.Main: Pig script completed in 148 milliseconds (148 ms)
(virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ /Users/davidlaxer/pig/trunk/bin/pig -l /tmp -x local -v -w sent_counts.pig 14/10/08 21:48:53 INFO security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 14/10/08 21:48:53 INFO pig.ExecTypeProvider: Picked LOCAL as the ExecType 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Apache Pig version 0.14.0-SNAPSHOT (r1630244) compiled Oct 08 2014, 21:36:18 2014-10-08 21:48:53,266 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal error. org/apache/commons/io/input/ClassLoaderObjectInputStream 2014-10-08 21:48:53,288 [main] ERROR org.apache.pig.Main - java.lang.NoClassDefFoundError: org/apache/commons/io/input/ClassLoaderObjectInputStream at org.apache.pig.Main.run(Main.java:414) at org.apache.pig.Main.main(Main.java:170) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:192) Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.input.ClassLoaderObjectInputStream at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 7 more
Details also at logfile: /private/tmp/pig_1412822933095.log 2014-10-08 21:48:53,328 [main] INFO org.apache.pig.Main - Pig script completed in 297 milliseconds (297 ms) (virtualenv)David-Laxers-MacBook-Pro:pig davidlaxer$ vi /private/tmp/pig_1412822933095.log
On Oct 8, 2014, at 3:56 PM, Russell Jurney notifications@github.com wrote:
Try downloading Pig 12 or 13 and report back.
— Reply to this email directly or view it on GitHub.
pig -l /tmp -x local -v -w sent_counts.pig 2014-08-13 22:26:16,744 [main] INFO org.apache.pig.Main - Apache Pig version 0.11.2-SNAPSHOT (rUnversioned directory) compiled Aug 13 2014, 21:53:01 2014-08-13 22:26:16,745 [main] INFO org.apache.pig.Main - Logging error messages to: /private/tmp/pig_1407990376721.log 2014-08-13 22:26:17,005 [main] INFO org.apache.hadoop.security.Groups - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000 2014-08-13 22:26:17,222 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /Users/davidlaxer/.pigbootup not found 2014-08-13 22:26:17,271 [main] INFO org.apache.pig.tools.parameters.PreprocessorContext - Executing command : echo $HOME 2014-08-13 22:26:17,443 [main] WARN org.apache.hadoop.conf.Configuration - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used 2014-08-13 22:26:17,445 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: file:/// 2014-08-13 22:26:17,449 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:17,450 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:17,451 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:17,452 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:17,538 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:17,539 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:17,608 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:17,608 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:17,687 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:17,696 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:17,783 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:17,788 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:18,926 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:18,930 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:18,996 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId= 2014-08-13 22:26:19,670 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:19,671 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:19,672 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:19,767 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:19,767 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:19,768 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:19,874 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:19,874 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:19,886 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:19,980 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:19,981 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:19,987 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,018 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,018 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,039 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,145 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,158 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,159 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,210 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,210 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,211 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,322 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,322 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,323 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,412 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY,ORDER_BY,FILTER 2014-08-13 22:26:20,497 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,521 [main] INFO org.apache.pig.newplan.logical.rules.ColumnPruneVisitor - Columns pruned for messages: $0, $1, $2, $3, $4, $5, $8, $9, $10 2014-08-13 22:26:20,561 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,562 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,583 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:20,583 [main] WARN org.apache.hadoop.conf.Configuration - mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator 2014-08-13 22:26:20,803 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false 2014-08-13 22:26:20,874 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,875 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,905 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer - Choosing to move algebraic foreach to combiner 2014-08-13 22:26:20,952 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 3 2014-08-13 22:26:20,952 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 3 2014-08-13 22:26:20,959 [main] WARN org.apache.hadoop.conf.Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 2014-08-13 22:26:20,961 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-08-13 22:26:20,973 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 2014-08-13 22:26:21,014 [main] WARN org.apache.pig.backend.hadoop20.PigJobControl - falling back to default JobControl (not using hadoop 0.20 ?) java.lang.NoSuchFieldException: runnerState at java.lang.Class.getDeclaredField(Class.java:2057) at org.apache.pig.backend.hadoop20.PigJobControl.(PigJobControl.java:51)
at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:97)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:285)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
at org.apache.pig.PigServer.execute(PigServer.java:1239)
at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:604)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
2014-08-13 22:26:21,052 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,055 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2014-08-13 22:26:21,106 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2014-08-13 22:26:21,107 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2014-08-13 22:26:21,107 [main] WARN org.apache.hadoop.conf.Configuration - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2014-08-13 22:26:21,107 [main] WARN org.apache.hadoop.conf.Configuration - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2014-08-13 22:26:21,114 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
2014-08-13 22:26:21,116 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=23891952
2014-08-13 22:26:21,117 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1
2014-08-13 22:26:21,118 [main] WARN org.apache.hadoop.conf.Configuration - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2014-08-13 22:26:21,260 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2014-08-13 22:26:21,274 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
2014-08-13 22:26:21,275 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
2014-08-13 22:26:21,275 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /var/folders/nj/nphdkhyj6s1dttb0pd9zb2wc0000gn/T/1407990381274-0
2014-08-13 22:26:21,488 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2014-08-13 22:26:21,491 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
2014-08-13 22:26:21,492 [main] ERROR org.apache.pig.tools.grunt.Grunt - java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:296)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
at org.apache.pig.PigServer.execute(PigServer.java:1239)
at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:604)
at org.apache.pig.Main.main(Main.java:157)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:192)
Details also at logfile: /private/tmp/pig_1407990376721.log David-Laxers-MacBook-Pro:pig davidlaxer$
sudo ant clean jar-withouthadoop Buildfile: /Users/davidlaxer/pig-0.11.1-src/build.xml
clean: [delete] Deleting directory /Users/davidlaxer/pig-0.11.1-src/build
clean:
clean:
ivy-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar [get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar [get] Not modified - so not downloaded
ivy-init-dirs: [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/lib [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/report [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/ivy/maven
ivy-probe-antlib:
ivy-init-antlib:
ivy-init: [ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ :: [ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml
ivy-resolve: [ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.11.2-SNAPSHOT [ivy:resolve] confs: [master, default, runtime, compile, test, javadoc, releaseaudit, jdiff, checkstyle, buildJar, hadoop20, hadoop23] [ivy:resolve] found com.sun.jersey#jersey-core;1.8 in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.0 in maven2 [ivy:resolve] found commons-cli#commons-cli;1.2 in maven2 [ivy:resolve] found xmlenc#xmlenc;0.52 in maven2 [ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2 [ivy:resolve] found commons-codec#commons-codec;1.4 in maven2 [ivy:resolve] found org.apache.commons#commons-math;2.1 in maven2 [ivy:resolve] found commons-configuration#commons-configuration;1.6 in maven2 [ivy:resolve] found commons-collections#commons-collections;3.2.1 in maven2 [ivy:resolve] found commons-lang#commons-lang;2.4 in maven2 [ivy:resolve] found commons-logging#commons-logging;1.1.1 in maven2 [ivy:resolve] found commons-digester#commons-digester;1.8 in maven2 [ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in maven2 [ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in maven2 [ivy:resolve] found commons-net#commons-net;1.4.1 in maven2 [ivy:resolve] found oro#oro;2.0.8 in maven2 [ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in maven2 [ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in maven2 [ivy:resolve] found org.mortbay.jetty#servlet-api;2.5-20081211 in maven2 [ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2 [ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2 [ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in maven2 [ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in maven2 [ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in maven2 [ivy:resolve] found org.eclipse.jdt#core;3.1.1 in maven2 [ivy:resolve] found ant#ant;1.6.5 in maven2 [ivy:resolve] found commons-el#commons-el;1.0 in maven2 [ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in maven2 [ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in maven2 [ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.0 in maven2 [ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in maven2 [ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in maven2 [ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in maven2 [ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in maven2 [ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in maven2 [ivy:resolve] found commons-io#commons-io;2.3 in maven2 [ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2 [ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2 [ivy:resolve] found log4j#log4j;1.2.16 in maven2 [ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2 [ivy:resolve] found org.apache.avro#avro;1.5.3 in maven2 [ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in maven2 [ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in maven2 [ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in maven2 [ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in maven2 [ivy:resolve] found com.jcraft#jsch;0.1.38 in maven2 [ivy:resolve] found jline#jline;0.9.94 in maven2 [ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2 [ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2 [ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2 [ivy:resolve] found joda-time#joda-time;1.6 in maven2 [ivy:resolve] found com.google.guava#guava;11.0 in maven2 [ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2 [ivy:resolve] found rhino#js;1.7R2 in maven2 [ivy:resolve] found org.antlr#antlr;3.4 in maven2 [ivy:resolve] found org.antlr#antlr-runtime;3.4 in maven2 [ivy:resolve] found org.antlr#stringtemplate;3.2.1 in maven2 [ivy:resolve] found antlr#antlr;2.7.7 in maven2 [ivy:resolve] found org.antlr#ST4;4.0.4 in maven2 [ivy:resolve] found org.apache.zookeeper#zookeeper;3.3.3 in maven2 [ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2 [ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2 [ivy:resolve] found org.apache.hbase#hbase;0.90.0 in maven2 [ivy:resolve] found org.vafer#jdeb;0.8 in maven2 [ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2 [ivy:resolve] found xalan#xalan;2.7.1 in maven2 [ivy:resolve] found xalan#serializer;2.7.1 in maven2 [ivy:resolve] found xml-apis#xml-apis;1.3.04 in maven2 [ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2 [ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2 [ivy:resolve] found junit#junit;4.11 in maven2 [ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in maven2 [ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in maven2 [ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2 [ivy:resolve] found junit#junit;3.8.1 in maven2 [ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2 [ivy:resolve] found commons-collections#commons-collections;3.2 in maven2 [ivy:resolve] found commons-lang#commons-lang;2.1 in maven2 [ivy:resolve] found jdiff#jdiff;1.0.9 in maven2 [ivy:resolve] found checkstyle#checkstyle;4.2 in maven2 [ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in maven2 [ivy:resolve] found commons-cli#commons-cli;1.0 in maven2 [ivy:resolve] found commons-logging#commons-logging;1.0.3 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in maven2 [ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2 [ivy:resolve] found com.sun.jersey#jersey-server;1.8 in maven2 [ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2 [ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in maven2 [ivy:resolve] found javax.servlet#servlet-api;2.5 in maven2 [ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2 [ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in maven2 [ivy:resolve] found javax.inject#javax.inject;1 in maven2 [ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in maven2 [ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in maven2 [ivy:resolve] found com.google.inject#guice;3.0 in maven2 [ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in maven2 [ivy:resolve] found aopalliance#aopalliance;1.0 in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.0-alpha in maven2 [ivy:resolve] :: resolution report :: resolve 6281ms :: artifacts dl 178ms [ivy:resolve] :: evicted modules: [ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [javadoc, default, test, buildJar, runtime] [ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [javadoc, default, compile, test, buildJar, runtime] [ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [javadoc, default, compile, test, buildJar, runtime] [ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [javadoc, default, compile, test, buildJar, hadoop20, runtime] [ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [javadoc, default, compile, test, buildJar, runtime] [ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [javadoc, default, compile, test, buildJar, runtime] [ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [javadoc, default, compile, test, buildJar, runtime] [ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [javadoc, default, test, buildJar, runtime]
ivy-compile: [ivy:retrieve] :: retrieving :: org.apache.pig#pig [ivy:retrieve] confs: [compile] [ivy:retrieve] 69 artifacts copied, 0 already retrieved (66821kB/2244ms) [ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:cachepath] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml
init: [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/impl/logicalLayer/parser [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/tools/pigscript/parser [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/tools/parameters [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/classes [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/build/test/classes [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/data/parser [move] Moving 1 file to /Users/davidlaxer/pig-0.11.1-src/build/ivy/lib/Pig
cc-compile: [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/pigscript/parser/PigScriptParser.jj . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "JavaCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully. [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/parameters/PigFileParser.jj . . . [javacc] Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "JavaCharStream.java" does not exist. Will create one. [javacc] Parser generated with 0 errors and 1 warnings. [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/src/org/apache/pig/tools/parameters/ParamLoader.jj . . . [javacc] File "TokenMgrError.java" is being rebuilt. [javacc] File "ParseException.java" is being rebuilt. [javacc] File "Token.java" is being rebuilt. [javacc] File "JavaCharStream.java" is being rebuilt. [javacc] Parser generated successfully. [jjtree] Java Compiler Compiler Version 4.2 (Tree Builder) [jjtree](type "jjtree" with no arguments for help) [jjtree] Reading from file /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/DOTParser.jjt . . . [jjtree] File "Node.java" does not exist. Will create one. [jjtree] File "SimpleNode.java" does not exist. Will create one. [jjtree] File "DOTParserTreeConstants.java" does not exist. Will create one. [jjtree] File "JJTDOTParserState.java" does not exist. Will create one. [jjtree] Annotated grammar generated successfully in /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj [javacc] Java Compiler Compiler Version 4.2 (Parser Generator) [javacc](type "javacc" with no arguments for help) [javacc] Reading from file /Users/davidlaxer/pig-0.11.1-src/test/org/apache/pig/test/utils/dotGraph/parser/DOTParser.jj . . . [javacc] File "TokenMgrError.java" does not exist. Will create one. [javacc] File "ParseException.java" does not exist. Will create one. [javacc] File "Token.java" does not exist. Will create one. [javacc] File "SimpleCharStream.java" does not exist. Will create one. [javacc] Parser generated successfully.
prepare: [mkdir] Created dir: /Users/davidlaxer/pig-0.11.1-src/src-gen/org/apache/pig/parser
genLexer:
genParser:
genTreeParser:
gen:
compile: [echo] * Building Main Sources * [echo] * To compile with all warnings enabled, supply -Dall.warnings=1 on command line * [echo] * If all.warnings property is supplied, compile-sources-all-warnings target will be executed * [echo] * Else, compile-sources (which only warns about deprecations) target will be executed *
compile-sources: [javac] /Users/davidlaxer/pig-0.11.1-src/build.xml:531: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds [javac] Compiling 787 source files to /Users/davidlaxer/pig-0.11.1-src/build/classes [javac] warning: [options] bootstrap class path not set in conjunction with -source 1.5 [javac] warning: [options] source value 1.5 is obsolete and will be removed in a future release [javac] warning: [options] target value 1.5 is obsolete and will be removed in a future release [javac] warning: [options] To suppress warnings about obsolete options, use -Xlint:-options. [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. [javac] 4 warnings [copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src/build/classes/org/apache/pig/tools/grunt [copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src/build/classes/org/apache/pig/tools/grunt
compile-sources-all-warnings:
jar-withouthadoop:
jar-withouthadoopWithSvn:
ivy-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar [get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar [get] Not modified - so not downloaded
ivy-init-dirs:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
ivy-resolve:
ivy-buildJar: [ivy:retrieve] :: retrieving :: org.apache.pig#pig [ivy:retrieve] confs: [buildJar] [ivy:retrieve] 9 artifacts copied, 67 already retrieved (9631kB/208ms)
buildJar-withouthadoop: [echo] svnString Unversioned directory [jar] Building jar: /Users/davidlaxer/pig-0.11.1-src/build/pig-0.11.2-SNAPSHOT.jar [jar] Building jar: /Users/davidlaxer/pig-0.11.1-src/build/pig-0.11.2-SNAPSHOT-withouthadoop.jar [copy] Copying 1 file to /Users/davidlaxer/pig-0.11.1-src
jar-withouthadoopWithOutSvn:
BUILD SUCCESSFUL Total time: 1 minute 55 seconds David-Laxers-MacBook-Pro:pig-0.11.1-src davidlaxer$ ant test Buildfile: /Users/davidlaxer/pig-0.11.1-src/build.xml
test:
ivy-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0/ivy-2.2.0.jar [get] To: /Users/davidlaxer/pig-0.11.1-src/ivy/ivy-2.2.0.jar [get] Not modified - so not downloaded
ivy-init-dirs:
ivy-probe-antlib:
ivy-init-antlib:
ivy-init: [ivy:configure] :: Ivy 2.2.0 - 20100923230623 :: http://ant.apache.org/ivy/ :: [ivy:configure] :: loading settings :: file = /Users/davidlaxer/pig-0.11.1-src/ivy/ivysettings.xml
ivy-resolve: [ivy:resolve] :: resolving dependencies :: org.apache.pig#pig;0.11.2-SNAPSHOT [ivy:resolve] confs: [master, default, runtime, compile, test, javadoc, releaseaudit, jdiff, checkstyle, buildJar, hadoop20, hadoop23] [ivy:resolve] found com.sun.jersey#jersey-core;1.8 in default [ivy:resolve] found org.apache.hadoop#hadoop-core;1.0.0 in maven2 [ivy:resolve] found commons-cli#commons-cli;1.2 in fs [ivy:resolve] found xmlenc#xmlenc;0.52 in default [ivy:resolve] found commons-httpclient#commons-httpclient;3.0.1 in maven2 [ivy:resolve] found commons-codec#commons-codec;1.4 in fs [ivy:resolve] found org.apache.commons#commons-math;2.1 in default [ivy:resolve] found commons-configuration#commons-configuration;1.6 in default [ivy:resolve] found commons-collections#commons-collections;3.2.1 in fs [ivy:resolve] found commons-lang#commons-lang;2.4 in fs [ivy:resolve] found commons-logging#commons-logging;1.1.1 in fs [ivy:resolve] found commons-digester#commons-digester;1.8 in fs [ivy:resolve] found commons-beanutils#commons-beanutils;1.7.0 in fs [ivy:resolve] found commons-beanutils#commons-beanutils-core;1.8.0 in default [ivy:resolve] found commons-net#commons-net;1.4.1 in maven2 [ivy:resolve] found oro#oro;2.0.8 in fs [ivy:resolve] found org.mortbay.jetty#jetty;6.1.26 in fs [ivy:resolve] found org.mortbay.jetty#jetty-util;6.1.26 in fs [ivy:resolve] found tomcat#jasper-runtime;5.5.12 in maven2 [ivy:resolve] found tomcat#jasper-compiler;5.5.12 in maven2 [ivy:resolve] found org.mortbay.jetty#jsp-api-2.1;6.1.14 in default [ivy:resolve] found org.mortbay.jetty#servlet-api-2.5;6.1.14 in default [ivy:resolve] found org.mortbay.jetty#jsp-2.1;6.1.14 in default [ivy:resolve] found org.eclipse.jdt#core;3.1.1 in default [ivy:resolve] found ant#ant;1.6.5 in maven2 [ivy:resolve] found commons-el#commons-el;1.0 in default [ivy:resolve] found net.java.dev.jets3t#jets3t;0.7.1 in default [ivy:resolve] found net.sf.kosmosfs#kfs;0.3 in maven2 [ivy:resolve] found hsqldb#hsqldb;1.8.0.10 in default [ivy:resolve] found org.apache.hadoop#hadoop-test;1.0.0 in maven2 [ivy:resolve] found org.apache.ftpserver#ftplet-api;1.0.0 in maven2 [ivy:resolve] found org.apache.mina#mina-core;2.0.0-M5 in fs [ivy:resolve] found org.slf4j#slf4j-api;1.5.2 in maven2 [ivy:resolve] found org.apache.ftpserver#ftpserver-core;1.0.0 in maven2 [ivy:resolve] found org.apache.ftpserver#ftpserver-deprecated;1.0.0-M2 in maven2 [ivy:resolve] found commons-io#commons-io;2.3 in maven2 [ivy:resolve] found org.apache.httpcomponents#httpclient;4.1 in maven2 [ivy:resolve] found org.apache.httpcomponents#httpcore;4.1 in maven2 [ivy:resolve] found log4j#log4j;1.2.16 in maven2 [ivy:resolve] found org.slf4j#slf4j-log4j12;1.6.1 in maven2 [ivy:resolve] found org.apache.avro#avro;1.5.3 in maven2 [ivy:resolve] found com.thoughtworks.paranamer#paranamer;2.3 in maven2 [ivy:resolve] found org.xerial.snappy#snappy-java;1.0.3.2 in maven2 [ivy:resolve] found org.slf4j#slf4j-api;1.6.1 in maven2 [ivy:resolve] found com.googlecode.json-simple#json-simple;1.1 in default [ivy:resolve] found com.jcraft#jsch;0.1.38 in fs [ivy:resolve] found jline#jline;0.9.94 in fs [ivy:resolve] found net.java.dev.javacc#javacc;4.2 in maven2 [ivy:resolve] found org.codehaus.groovy#groovy-all;1.8.6 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.8.8 in maven2 [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.8.8 in maven2 [ivy:resolve] found org.fusesource.jansi#jansi;1.9 in maven2 [ivy:resolve] found joda-time#joda-time;1.6 in maven2 [ivy:resolve] found com.google.guava#guava;11.0 in maven2 [ivy:resolve] found org.python#jython-standalone;2.5.3 in maven2 [ivy:resolve] found rhino#js;1.7R2 in maven2 [ivy:resolve] found org.antlr#antlr;3.4 in default [ivy:resolve] found org.antlr#antlr-runtime;3.4 in default [ivy:resolve] found org.antlr#stringtemplate;3.2.1 in default [ivy:resolve] found antlr#antlr;2.7.7 in fs [ivy:resolve] found org.antlr#ST4;4.0.4 in default [ivy:resolve] found org.apache.zookeeper#zookeeper;3.3.3 in maven2 [ivy:resolve] found dk.brics.automaton#automaton;1.11-8 in maven2 [ivy:resolve] found org.jruby#jruby-complete;1.6.7 in maven2 [ivy:resolve] found org.apache.hbase#hbase;0.90.0 in maven2 [ivy:resolve] found org.vafer#jdeb;0.8 in maven2 [ivy:resolve] found org.mockito#mockito-all;1.8.4 in maven2 [ivy:resolve] found xalan#xalan;2.7.1 in maven2 [ivy:resolve] found xalan#serializer;2.7.1 in maven2 [ivy:resolve] found xml-apis#xml-apis;1.3.04 in fs [ivy:resolve] found xerces#xercesImpl;2.10.0 in maven2 [ivy:resolve] found xml-apis#xml-apis;1.4.01 in maven2 [ivy:resolve] found junit#junit;4.11 in fs [ivy:resolve] found org.hamcrest#hamcrest-core;1.3 in fs [ivy:resolve] found org.jboss.netty#netty;3.2.2.Final in maven2 [ivy:resolve] found org.apache.hive#hive-exec;0.8.0 in maven2 [ivy:resolve] found junit#junit;3.8.1 in fs [ivy:resolve] found com.google.code.p.arat#rat-lib;0.5.1 in maven2 [ivy:resolve] found commons-collections#commons-collections;3.2 in fs [ivy:resolve] found commons-lang#commons-lang;2.1 in fs [ivy:resolve] found jdiff#jdiff;1.0.9 in fs [ivy:resolve] found checkstyle#checkstyle;4.2 in maven2 [ivy:resolve] found commons-beanutils#commons-beanutils-core;1.7.0 in maven2 [ivy:resolve] found commons-cli#commons-cli;1.0 in fs [ivy:resolve] found commons-logging#commons-logging;1.0.3 in fs [ivy:resolve] found org.codehaus.jackson#jackson-mapper-asl;1.0.1 in default [ivy:resolve] found org.codehaus.jackson#jackson-core-asl;1.0.1 in default [ivy:resolve] found com.sun.jersey#jersey-bundle;1.8 in maven2 [ivy:resolve] found com.sun.jersey#jersey-server;1.8 in default [ivy:resolve] found com.sun.jersey.contribs#jersey-guice;1.8 in maven2 [ivy:resolve] found commons-httpclient#commons-httpclient;3.1 in fs [ivy:resolve] found javax.servlet#servlet-api;2.5 in fs [ivy:resolve] found javax.ws.rs#jsr311-api;1.1.1 in maven2 [ivy:resolve] found com.google.protobuf#protobuf-java;2.4.0a in default [ivy:resolve] found javax.inject#javax.inject;1 in maven2 [ivy:resolve] found javax.xml.bind#jaxb-api;2.2.2 in maven2 [ivy:resolve] found com.sun.xml.bind#jaxb-impl;2.2.3-1 in default [ivy:resolve] found com.google.inject#guice;3.0 in maven2 [ivy:resolve] found com.google.inject.extensions#guice-servlet;3.0 in maven2 [ivy:resolve] found aopalliance#aopalliance;1.0 in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-annotations;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-auth;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-hdfs;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-core;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-jobclient;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-tests;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-app;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-shuffle;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-api;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-web-proxy;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-common;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-nodemanager;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-yarn-server-resourcemanager;2.0.0-alpha in maven2 [ivy:resolve] found org.apache.hadoop#hadoop-mapreduce-client-hs;2.0.0-alpha in maven2 [ivy:resolve] :: resolution report :: resolve 13603ms :: artifacts dl 5473ms [ivy:resolve] :: evicted modules: [ivy:resolve] junit#junit;3.8.1 by [junit#junit;4.11] in [default, test, runtime, javadoc, buildJar] [ivy:resolve] commons-logging#commons-logging;1.0.3 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-codec#commons-codec;1.2 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-logging#commons-logging;1.1 by [commons-logging#commons-logging;1.1.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-codec#commons-codec;1.3 by [commons-codec#commons-codec;1.4] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-httpclient#commons-httpclient;3.1 by [commons-httpclient#commons-httpclient;3.0.1] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.0.1 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.slf4j#slf4j-api;1.5.2 by [org.slf4j#slf4j-api;1.6.1] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.mina#mina-core;2.0.0-M4 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.ftpserver#ftplet-api;1.0.0-M2 by [org.apache.ftpserver#ftplet-api;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.ftpserver#ftpserver-core;1.0.0-M2 by [org.apache.ftpserver#ftpserver-core;1.0.0] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.apache.mina#mina-core;2.0.0-M2 by [org.apache.mina#mina-core;2.0.0-M5] in [default, hadoop20, test, compile, runtime, javadoc, buildJar] [ivy:resolve] commons-cli#commons-cli;1.0 by [commons-cli#commons-cli;1.2] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.codehaus.jackson#jackson-mapper-asl;1.7.3 by [org.codehaus.jackson#jackson-mapper-asl;1.8.8] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] org.antlr#antlr-runtime;3.3 by [org.antlr#antlr-runtime;3.4] in [default, test, compile, runtime, javadoc, buildJar] [ivy:resolve] xml-apis#xml-apis;1.3.04 by [xml-apis#xml-apis;1.4.01] in [default, test, runtime, javadoc, buildJar]
[ivy:resolve] [ivy:resolve] :: problems summary :: [ivy:resolve] :::: WARNINGS [ivy:resolve] [FAILED ] org.mortbay.jetty#jetty;6.1.26!jetty.zip: (0ms) [ivy:resolve] ==== local: tried [ivy:resolve] /Users/davidlaxer/.ivy2/local/org.mortbay.jetty/jetty/6.1.26/zips/jetty.zip [ivy:resolve] ==== maven2: tried [ivy:resolve] http://repo2.maven.org/maven2/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip [ivy:resolve] ==== jboss-maven2: tried [ivy:resolve] http://repository.jboss.com/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip [ivy:resolve] ==== apache-snapshots: tried [ivy:resolve] http://repository.apache.org/content/groups/snapshots-group/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.zip [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: [ivy:resolve] :: FAILED DOWNLOADS :: [ivy:resolve] :: ^ see resolution messages for details ^ :: [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: [ivy:resolve] :: org.mortbay.jetty#jetty;6.1.26!jetty.zip [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: [ivy:resolve] [ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
BUILD FAILED /Users/davidlaxer/pig-0.11.1-src/build.xml:941: The following error occurred while executing this line: /Users/davidlaxer/pig-0.11.1-src/build.xml:1723: impossible to resolve dependencies: resolve failed - see output for details
Total time: 23 seconds
find ~ -name '6.1.26' -ls 42361118 1056 -rw-r--r-- 1 davidlaxer staff 540234 Dec 22 2012 /Users/davidlaxer/.bundler/ruby/1.8/sunspot-78717a338942/sunspot_solr/solr/lib/jetty-6.1.26-patched-JETTY-1340.jar 42361119 352 -rw-r--r-- 1 davidlaxer staff 177393 Dec 22 2012 /Users/davidlaxer/.bundler/ruby/1.8/sunspot-78717a338942/sunspot_solr/solr/lib/jetty-util-6.1.26-patched-JETTY-1340.jar 80795382 8 -rw-r--r-- 1 davidlaxer staff 2189 May 22 18:03 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivy-6.1.26.xml 82151461 8 -rw-r--r-- 1 davidlaxer staff 425 May 22 18:03 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivy-6.1.26.xml.original 80795336 8 -rw-r--r-- 1 davidlaxer staff 838 Aug 13 20:52 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/ivydata-6.1.26.properties 80796510 1056 -rw-r--r-- 1 davidlaxer staff 539912 Nov 10 2010 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty/jars/jetty-6.1.26.jar 80795393 16 -rw-r--r-- 1 davidlaxer staff 7327 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivy-6.1.26.xml 82151464 8 -rw-r--r-- 1 davidlaxer staff 3876 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivy-6.1.26.xml.original 80795391 8 -rw-r--r-- 1 davidlaxer staff 900 Aug 13 20:52 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/ivydata-6.1.26.properties 80796764 352 -rw-r--r-- 1 davidlaxer staff 177131 Nov 10 2010 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/jetty-util/jars/jetty-util-6.1.26.jar 80795380 16 -rw-r--r-- 1 davidlaxer staff 5000 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivy-6.1.26.xml 82151467 24 -rw-r--r-- 1 davidlaxer staff 9205 May 22 18:02 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivy-6.1.26.xml.original 80795345 8 -rw-r--r-- 1 davidlaxer staff 620 Aug 9 18:00 /Users/davidlaxer/.ivy2/cache/org.mortbay.jetty/project/ivydata-6.1.26.properties 75248719 0 drwxr-xr-x 9 davidlaxer staff 306 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26 75248840 1056 -rw-r--r-- 1 davidlaxer staff 539912 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar 75248805 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar.lastUpdated 75248848 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar.sha1 75248723 8 -rw-r--r-- 1 davidlaxer staff 425 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom 75248720 8 -rw-r--r-- 1 davidlaxer staff 376 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom.lastUpdated 75248725 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.pom.sha1 75248696 0 drwxr-xr-x 9 davidlaxer staff 306 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26 75248830 352 -rw-r--r-- 1 davidlaxer staff 177131 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar 75248804 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar.lastUpdated 75248835 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar.sha1 75248705 8 -rw-r--r-- 1 davidlaxer staff 3876 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom 75248698 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom.lastUpdated 75248707 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.pom.sha1 75248709 0 drwxr-xr-x 6 davidlaxer staff 204 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26 75248715 24 -rw-r--r-- 1 davidlaxer staff 9205 May 22 18:02 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom 75248711 8 -rw-r--r-- 1 davidlaxer staff 505 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom.lastUpdated 75248717 8 -rw-r--r-- 1 davidlaxer staff 40 May 22 18:03 /Users/davidlaxer/.m2/repository/org/mortbay/jetty/project/6.1.26/project-6.1.26.pom.sha1 42356239 1056 -rw-r--r-- 1 davidlaxer staff 540234 Dec 22 2012 /Users/davidlaxer/chorus/vendor/solr/lib/jetty-6.1.26-patched-JETTY-1340.jar 42356240 352 -rw-r--r-- 1 davidlaxer staff 177393 Dec 22 2012 /Users/davidlaxer/chorus/vendor/solr/lib/jetty-util-6.1.26-patched-JETTY-1340.jar 75177741 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/common/lib/jetty-6.1.26.jar 75177736 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/common/lib/jetty-util-6.1.26.jar 75184493 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar 75184491 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar 75184734 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/tools/lib/jetty-6.1.26.jar 75184730 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/tools/lib/jetty-util-6.1.26.jar 75184619 1056 -rw-r--r-- 1 davidlaxer staff 539912 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-6.1.26.jar 75184615 352 -rw-r--r-- 1 davidlaxer staff 177131 Mar 31 02:49 /Users/davidlaxer/Downloads/hadoop-2.4.0/share/hadoop/yarn/lib/jetty-util-6.1.26.jar 82312261 3400 -rw-r--r-- 1 davidlaxer staff 1740076 Aug 13 21:01 /Users/davidlaxer/Downloads/jetty-hadoop-fix-6.1.26.cloudera.zip 82312276 0 drwxr-xr-x 16 davidlaxer staff 544 Aug 13 21:04 /Users/davidlaxer/jetty-hadoop-fix-6.1.26.cloudera