nexr / RHive

RHive is an R extension facilitating distributed computing via Apache Hive.
http://nexr.github.io/RHive
122 stars 63 forks source link

Ant Build Failure #97

Closed bedantaguru closed 8 years ago

bedantaguru commented 8 years ago

Ant build failed.

My setup Hadoop 2.6.0-cdh5.4.2 Cloudera 5.4.2 Hive 1.1.0-cdh5.4.2

Does RHive support these setup?

[root@master1 RHive]# ant build
Buildfile: /root/Downloads/rhive/RHive/build.xml

compile:
    [mkdir] Created dir: /root/Downloads/rhive/RHive/build/classes
    [javac] Compiling 21 source files to /root/Downloads/rhive/RHive/build/classes
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/AuthUtils.java:4: error: cannot find symbol
    [javac] import org.apache.hadoop.conf.Configuration;
    [javac]                              ^
    [javac]   symbol:   class Configuration
    [javac]   location: package org.apache.hadoop.conf
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/AuthUtils.java:5: error: cannot find symbol
    [javac] import org.apache.hadoop.security.UserGroupInformation;
    [javac]                                  ^
    [javac]   symbol:   class UserGroupInformation
    [javac]   location: package org.apache.hadoop.security
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/AuthUtils.java:27: error: cannot find symbol
    [javac]     public static void setConfigurationUserGroup(Configuration conf){
    [javac]                                                  ^
    [javac]   symbol:   class Configuration
    [javac]   location: class AuthUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:10: error: cannot find symbol
    [javac] import org.apache.hadoop.conf.Configuration;
    [javac]                              ^
    [javac]   symbol:   class Configuration
    [javac]   location: package org.apache.hadoop.conf
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:11: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileStatus;
    [javac]                            ^
    [javac]   symbol:   class FileStatus
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:12: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileSystem;
    [javac]                            ^
    [javac]   symbol:   class FileSystem
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:13: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileUtil;
    [javac]                            ^
    [javac]   symbol:   class FileUtil
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:14: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FsShell;
    [javac]                            ^
    [javac]   symbol:   class FsShell
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:15: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.Path;
    [javac]                            ^
    [javac]   symbol:   class Path
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:16: error: package org.apache.hadoop.hdfs.tools does not exist
    [javac] import org.apache.hadoop.hdfs.tools.DFSck;
    [javac]                                    ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:17: error: cannot find symbol
    [javac] import org.apache.hadoop.security.UserGroupInformation;
    [javac]                                  ^
    [javac]   symbol:   class UserGroupInformation
    [javac]   location: package org.apache.hadoop.security
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:27: error: cannot find symbol
    [javac]     private static Configuration conf;
    [javac]                    ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:93: error: cannot find symbol
    [javac]     private static int ls(FileStatus src, FileSystem srcFs) throws IOException {
    [javac]                           ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:93: error: cannot find symbol
    [javac]     private static int ls(FileStatus src, FileSystem srcFs) throws IOException {
    [javac]                                           ^
    [javac]   symbol:   class FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:122: error: cannot find symbol
    [javac]     private static FileStatus[] listStatus(FileSystem srcFs, FileStatus src) throws IOException {
    [javac]                                            ^
    [javac]   symbol:   class FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:122: error: cannot find symbol
    [javac]     private static FileStatus[] listStatus(FileSystem srcFs, FileStatus src) throws IOException {
    [javac]                                                              ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:122: error: cannot find symbol
    [javac]     private static FileStatus[] listStatus(FileSystem srcFs, FileStatus src) throws IOException {
    [javac]                    ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:351: error: cannot find symbol
    [javac]     private static void closeFileSystem(FileSystem fs) {
    [javac]                                         ^
    [javac]   symbol:   class FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:360: error: cannot find symbol
    [javac]     public static Configuration getConf(String defaultFS) throws IOException{
    [javac]                   ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:372: error: cannot find symbol
    [javac]     public static Configuration getConf() throws IOException{
    [javac]                   ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/HdfsUtils.java:5: error: cannot find symbol
    [javac] import org.apache.hadoop.conf.Configuration;
    [javac]                              ^
    [javac]   symbol:   class Configuration
    [javac]   location: package org.apache.hadoop.conf
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/HdfsUtils.java:6: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileSystem;
    [javac]                            ^
    [javac]   symbol:   class FileSystem
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/HdfsUtils.java:7: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.Path;
    [javac]                            ^
    [javac]   symbol:   class Path
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/HdfsUtils.java:10: error: cannot find symbol
    [javac]     private static final Configuration conf = new Configuration();
    [javac]                          ^
    [javac]   symbol:   class Configuration
    [javac]   location: class HdfsUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/HiveJdbcClient.java:4: error: cannot find symbol
    [javac] import org.apache.hadoop.security.UserGroupInformation;
    [javac]                                  ^
    [javac]   symbol:   class UserGroupInformation
    [javac]   location: package org.apache.hadoop.security
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDFArrayToString.java:15: error: cannot find symbol
    [javac] import org.apache.hadoop.io.Text;
    [javac]                            ^
    [javac]   symbol:   class Text
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFExpand.java:35: error: cannot find symbol
    [javac] import org.apache.hadoop.io.IntWritable;
    [javac]                            ^
    [javac]   symbol:   class IntWritable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFExpand.java:37: error: cannot find symbol
    [javac] import org.apache.hadoop.io.Writable;
    [javac]                            ^
    [javac]   symbol:   class Writable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFExpand.java:53: error: cannot find symbol
    [javac]     transient Writable[] retRow; // returned row value but only use one.
    [javac]               ^
    [javac]   symbol:   class Writable
    [javac]   location: class GenericUDTFExpand
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFExpand.java:54: error: cannot find symbol
    [javac]     transient Writable[] row; // object pool of non-null writable, avoid creating
    [javac]               ^
    [javac]   symbol:   class Writable
    [javac]   location: class GenericUDTFExpand
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFExpand.java:122: error: cannot find symbol
    [javac]     private Writable getColumnWritable(String typeName)
    [javac]             ^
    [javac]   symbol:   class Writable
    [javac]   location: class GenericUDTFExpand
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFUnFold.java:35: error: cannot find symbol
    [javac] import org.apache.hadoop.io.IntWritable;
    [javac]                            ^
    [javac]   symbol:   class IntWritable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFUnFold.java:55: error: cannot find symbol
    [javac]     transient Writable[] retCols; // array of returned column values
    [javac]               ^
    [javac]   symbol:   class Writable
    [javac]   location: class GenericUDTFUnFold
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFUnFold.java:56: error: cannot find symbol
    [javac]     transient Writable[] cols; // object pool of non-null writable, avoid creating
    [javac]               ^
    [javac]   symbol:   class Writable
    [javac]   location: class GenericUDTFUnFold
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFUnFold.java:126: error: cannot find symbol
    [javac]     private Writable getColumnWritable(String typeName)
    [javac]             ^
    [javac]   symbol:   class Writable
    [javac]   location: class GenericUDTFUnFold
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:25: error: cannot find symbol
    [javac] import org.apache.hadoop.conf.Configuration;
    [javac]                              ^
    [javac]   symbol:   class Configuration
    [javac]   location: package org.apache.hadoop.conf
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:26: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileSystem;
    [javac]                            ^
    [javac]   symbol:   class FileSystem
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:27: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.Path;
    [javac]                            ^
    [javac]   symbol:   class Path
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:100: error: cannot find symbol
    [javac]         private static Configuration conf = new Configuration();
    [javac]                        ^
    [javac]   symbol:   class Configuration
    [javac]   location: class GenericRUDAF
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:113: error: cannot find symbol
    [javac]         private Text result;
    [javac]                 ^
    [javac]   symbol:   class Text
    [javac]   location: class GenericRUDAF
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:532: error: cannot find symbol
    [javac]         private Path getLocalPath(String name) {
    [javac]                 ^
    [javac]   symbol:   class Path
    [javac]   location: class GenericRUDAF
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDF.java:41: error: cannot find symbol
    [javac] import org.apache.hadoop.io.IntWritable;
    [javac]                            ^
    [javac]   symbol:   class IntWritable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDF.java:58: error: cannot find symbol
    [javac]     private static Configuration conf = new Configuration();
    [javac]                    ^
    [javac]   symbol:   class Configuration
    [javac]   location: class RUDF
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDF.java:250: error: cannot find symbol
    [javac]     private Path getLocalPath(String name) {
    [javac]             ^
    [javac]   symbol:   class Path
    [javac]   location: class RUDF
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:21: error: cannot find symbol
    [javac] import org.apache.hadoop.io.IntWritable;
    [javac]                            ^
    [javac]   symbol:   class IntWritable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:22: error: cannot find symbol
    [javac] import org.apache.hadoop.io.LongWritable;
    [javac]                            ^
    [javac]   symbol:   class LongWritable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:23: error: cannot find symbol
    [javac] import org.apache.hadoop.io.NullWritable;
    [javac]                            ^
    [javac]   symbol:   class NullWritable
    [javac]   location: package org.apache.hadoop.io
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RangeKeyUDF.java:219: error: cannot find symbol
    [javac]             abstract Writable searchWritable(RangeTree tree, Object value);
    [javac]                      ^
    [javac]   symbol:   class Writable
    [javac]   location: class RANGEVALUE
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:85: error: cannot find symbol
    [javac]         public Writable convertWritable(Object obj) {
    [javac]                ^
    [javac]   symbol:   class Writable
    [javac]   location: class RangeTree<T,V>
    [javac]   where T,V are type-variables:
    [javac]     T extends Object declared in class RangeTree
    [javac]     V extends Object declared in class RangeTree
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/UDFUtils.java:6: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileStatus;
    [javac]                            ^
    [javac]   symbol:   class FileStatus
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/UDFUtils.java:9: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.PathFilter;
    [javac]                            ^
    [javac]   symbol:   class PathFilter
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/UDFUtils.java:22: error: cannot find symbol
    [javac]     public static Path getPath(String name) {
    [javac]                   ^
    [javac]   symbol:   class Path
    [javac]   location: class UDFUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/UDFUtils.java:98: error: cannot find symbol
    [javac]     private static class RDataPathFilter implements PathFilter {
    [javac]                                                     ^
    [javac]   symbol:   class PathFilter
    [javac]   location: class UDFUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/UDFUtils.java:102: error: cannot find symbol
    [javac]         public boolean accept(Path path) {
    [javac]                               ^
    [javac]   symbol:   class Path
    [javac]   location: class RDataPathFilter
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:113: error: cannot find symbol
    [javac]         public Writable searchWritable(String value) {
    [javac]                ^
    [javac]   symbol:   class Writable
    [javac]   location: class StringRangeTree<V>
    [javac]   where V is a type-variable:
    [javac]     V extends Object declared in class StringRangeTree
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:129: error: cannot find symbol
    [javac]         public Writable searchWritable(int value) {
    [javac]                ^
    [javac]   symbol:   class Writable
    [javac]   location: class IntRangeTree<V>
    [javac]   where V is a type-variable:
    [javac]     V extends Object declared in class IntRangeTree
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:145: error: cannot find symbol
    [javac]         public Writable searchWritable(long value) {
    [javac]                ^
    [javac]   symbol:   class Writable
    [javac]   location: class LongRangeTree<V>
    [javac]   where V is a type-variable:
    [javac]     V extends Object declared in class LongRangeTree
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:161: error: cannot find symbol
    [javac]         public Writable searchWritable(double value) {
    [javac]                ^
    [javac]   symbol:   class Writable
    [javac]   location: class DoubleRangeTree<V>
    [javac]   where V is a type-variable:
    [javac]     V extends Object declared in class DoubleRangeTree
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/RangeTreeFactory.java:177: error: cannot find symbol
    [javac]         public Writable searchWritable(float value) {
    [javac]                ^
    [javac]   symbol:   class Writable
    [javac]   location: class FloatRangeTree<V>
    [javac]   where V is a type-variable:
    [javac]     V extends Object declared in class FloatRangeTree
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/TransformUtils.java:20: error: cannot find symbol
    [javac] import org.apache.hadoop.fs.FileStatus;
    [javac]                            ^
    [javac]   symbol:   class FileStatus
    [javac]   location: package org.apache.hadoop.fs
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/util/TransformUtils.java:26: error: cannot find symbol
    [javac]     public static String[] tranform(FileStatus fs) throws Exception {
    [javac]                                     ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class TransformUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/AuthUtils.java:24: error: cannot find symbol
    [javac]         UserGroupInformation.loginUserFromKeytab(principal, keytab);
    [javac]         ^
    [javac]   symbol:   variable UserGroupInformation
    [javac]   location: class AuthUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/AuthUtils.java:28: error: cannot find symbol
    [javac]         UserGroupInformation.setConfiguration(conf);
    [javac]         ^
    [javac]   symbol:   variable UserGroupInformation
    [javac]   location: class AuthUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:30: error: cannot find symbol
    [javac]         Configuration conf = getConf(defaultFS);
    [javac]         ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:32: error: cannot find symbol
    [javac]             FileSystem.get(conf);
    [javac]             ^
    [javac]   symbol:   variable FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:41: error: cannot find symbol
    [javac]         Configuration conf = getConf(defaultFS);
    [javac]         ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:43: error: cannot find symbol
    [javac]         Path srcPath = new Path(src);
    [javac]         ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:43: error: cannot find symbol
    [javac]         Path srcPath = new Path(src);
    [javac]                            ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:44: error: cannot find symbol
    [javac]         FileSystem fs = null;
    [javac]         ^
    [javac]   symbol:   class FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:46: error: cannot find symbol
    [javac]         List<FileStatus> items = new ArrayList<FileStatus>();
    [javac]              ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:46: error: cannot find symbol
    [javac]         List<FileStatus> items = new ArrayList<FileStatus>();
    [javac]                                                ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:49: error: cannot find symbol
    [javac]             FileStatus[] stats = fs.globStatus(srcPath);
    [javac]             ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:51: error: cannot find symbol
    [javac]                 for (FileStatus stat : stats) {
    [javac]                      ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:55: error: cannot find symbol
    [javac]                         Path path = stat.getPath();
    [javac]                         ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:56: error: cannot find symbol
    [javac]                         FileStatus files[] = fs.listStatus(path);
    [javac]                         ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:58: error: cannot find symbol
    [javac]                             for (FileStatus file : files) {
    [javac]                                  ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:76: error: cannot find symbol
    [javac]                 FileStatus item = items.get(j);
    [javac]                 ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:94: error: cannot find symbol
    [javac]         FileStatus items[] = listStatus(srcFs, src);
    [javac]         ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:99: error: cannot find symbol
    [javac]             FileStatus stat = items[i];
    [javac]             ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:108: error: cannot find symbol
    [javac]             FileStatus item = items[i];
    [javac]             ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:124: error: cannot find symbol
    [javac]             FileStatus files[] = {src};
    [javac]             ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:128: error: cannot find symbol
    [javac]         Path path = src.getPath();
    [javac]         ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:129: error: cannot find symbol
    [javac]         FileStatus files[] = srcFs.listStatus(path);
    [javac]         ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:131: error: cannot find symbol
    [javac]             files = new FileStatus[0];
    [javac]                         ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:138: error: cannot find symbol
    [javac]         Configuration conf = getConf(defaultFS);
    [javac]         ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:140: error: cannot find symbol
    [javac]         Path srcPath = new Path(src);
    [javac]         ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:140: error: cannot find symbol
    [javac]         Path srcPath = new Path(src);
    [javac]                            ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:141: error: cannot find symbol
    [javac]         FileSystem fs = null;
    [javac]         ^
    [javac]   symbol:   class FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:142: error: cannot find symbol
    [javac]         FileStatus items[] = null;
    [javac]         ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:147: error: cannot find symbol
    [javac]             Path pathItems[] = FileUtil.stat2Paths(fs.globStatus(srcPath), srcPath);
    [javac]             ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:147: error: cannot find symbol
    [javac]             Path pathItems[] = FileUtil.stat2Paths(fs.globStatus(srcPath), srcPath);
    [javac]                                ^
    [javac]   symbol:   variable FileUtil
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:150: error: cannot find symbol
    [javac]                 items = new FileStatus[0];
    [javac]                             ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:169: error: cannot find symbol
    [javac]                 FileStatus item = items[j];
    [javac]                 ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:180: error: cannot find symbol
    [javac]         Configuration conf = getConf(defaultFS);
    [javac]         ^
    [javac]   symbol:   class Configuration
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:182: error: cannot find symbol
    [javac]         Path srcPath = new Path(src);
    [javac]         ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:182: error: cannot find symbol
    [javac]         Path srcPath = new Path(src);
    [javac]                            ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:183: error: cannot find symbol
    [javac]         FileSystem fs = null;
    [javac]         ^
    [javac]   symbol:   class FileSystem
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:184: error: cannot find symbol
    [javac]         FileStatus status[] = null;
    [javac]         ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:189: error: cannot find symbol
    [javac]             status = fs.globStatus(new Path(src));
    [javac]                                        ^
    [javac]   symbol:   class Path
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/FSUtils.java:191: error: cannot find symbol
    [javac]                 status = new FileStatus[0];
    [javac]                              ^
    [javac]   symbol:   class FileStatus
    [javac]   location: class FSUtils
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hadoop/JobManager.java:33: warning: [deprecation] getUsedMemory() in ClusterStatus has been deprecated
    [javac]             clusterStatus.getUsedMemory();
    [javac]                          ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFExpand.java:63: warning: [deprecation] initialize(ObjectInspector[]) in GenericUDTF has been deprecated
    [javac]     public StructObjectInspector initialize(ObjectInspector[] args) throws UDFArgumentException {
    [javac]                                  ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/GenericUDTFUnFold.java:65: warning: [deprecation] initialize(ObjectInspector[]) in GenericUDTF has been deprecated
    [javac]     public StructObjectInspector initialize(ObjectInspector[] args)
    [javac]                                  ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:223: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         public AggregationBuffer getNewAggregationBuffer() throws HiveException {
    [javac]                ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:230: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         public void reset(AggregationBuffer agg) throws HiveException {
    [javac]                           ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:238: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         public void iterate(AggregationBuffer agg, Object[] parameters)
    [javac]                             ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:308: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         public Object terminatePartial(AggregationBuffer agg)
    [javac]                                        ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:351: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         public void merge(AggregationBuffer agg, Object partial)
    [javac]                           ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:415: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         public Object terminate(AggregationBuffer agg) throws HiveException {
    [javac]                                 ^
    [javac] /root/Downloads/rhive/RHive/RHive/inst/javasrc/src/com/nexr/rhive/hive/udf/RUDAF.java:214: warning: [deprecation] AggregationBuffer in GenericUDAFEvaluator has been deprecated
    [javac]         static class RResultAgg implements AggregationBuffer {
    [javac]                                            ^
    [javac] 100 errors
    [javac] 10 warnings

BUILD FAILED
/root/Downloads/rhive/RHive/build.xml:39: Compile failed; see the compiler error output for details.
ghost commented 8 years ago

We don't try the CDH, but I have some ideas. IMHO, the ant could not find hadoop and hive related jars(hadoop-commons-2.6.0.jar, etc).

In the build.xml, there are codes for classpath like this:

    <path id="classpath">
        <fileset dir="./" includes="**/*.jar"/>
        <fileset dir="${lib.dir}" includes="*.jar"/>
        <fileset dir="${env.HADOOP_HOME}" includes="**/*.jar"/>
        <fileset dir="${env.HIVE_HOME}/lib/" includes="**/*.jar"/>
    </path>

You can fix or add necessary CDH dirs. In the example, ranger branch build under the apache bigtop dist.

Hope your success! Thanks.

bedantaguru commented 8 years ago

Wow thanks a lot for quick reply. I'm able to build it now.

Here is what I modified

  <path id="classpath">
        <fileset dir="./" includes="**/*.jar"/>
        <fileset dir="${lib.dir}" includes="*.jar"/>
        <fileset dir="${env.HADOOP_HOME}" includes="**/*.jar"/>
        <fileset dir="${env.HIVE_HOME}/lib/" includes="**/*.jar"/>
    <fileset dir="/opt/cloudera/parcels/CDH-5.4.2-1.cdh5.4.2.p0.2/lib/" includes="**/*.jar"/>
    </path>

Thanks a lot. Now I'll test it.