search

lucidworks / hive-solr

Code to index Hive tables to Solr and Solr indexes to Hive
Apache License 2.0
47 stars 34 forks source link

Unsupported major.minor 52.0 #35

Closed FabioVCoelho closed 6 years ago

FabioVCoelho commented 7 years ago

Hi, i'm having the following problem: When i use the .jar on hive with a jdk 1.8 the class com.lucidworks.hadoop.hive.LWStorageHandler send an error of minor.major, so, i changed my computer to use a jdk 1.8, than it works, but when i try to put some data in to the solr table, the class com/lucidworks/hadoop/hive/LWHiveInputFormat give me a error of Unsupported major.minor version 52.0, so either way some class will give me a error =/ I followed the readme step by step.

acesar commented 7 years ago

@FabioVCoelho The issue here is that you compile the hive-solr jar with java 1.8 and your hive cluster is running with java 1.7.

Please compile hive-solr again with java 1.7 and retry

To compile with java 1.7, please use the following commit: https://github.com/lucidworks/hive-solr/commit/f39cd7b0d5ba02cb0e06f4230d21c0d2a83cc346

hive-solr in master was updated to Solr 6.x and it now only works with java 1.8

FabioVCoelho commented 7 years ago

Hi, here is my java -version (java version "1.7.0_95"), so, I deleted the folder, and started all over again... git init, git clone, git submodule init, git submodule update. Then i changed the gradle.properties to: -version=2.2.7 and solrVersion=5.5.2 then ./gradlew give me the following problem: error: package java.time does not exist. error: cannot find symbol. and a lot of those. I'm not expert in git so, is there i way to pull this old version that u send me as commit?

here is the debug log, sorry i don't know how to put this in a better view, just code

`15:07:05.165 [ERROR] [system.err] error: error reading /home/fabio/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar; invalid LOC header (bad signature) 15:07:05.269 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:18: error: package java.time does not exist 15:07:05.269 [ERROR] [system.err] import java.time.Instant; 15:07:05.269 [ERROR] [system.err] ^ 15:07:05.270 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:19: error: package java.time.format does not exist 15:07:05.270 [ERROR] [system.err] import java.time.format.DateTimeFormatter; 15:07:05.270 [ERROR] [system.err] ^ 15:07:05.284 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/security/SolrSecurity.java:27: error: cannot find symbol 15:07:05.284 [ERROR] [system.err] HttpClientUtil.addConfigurer(new Krb5HttpClientConfigurer()); 15:07:05.284 [ERROR] [system.err] ^ 15:07:05.284 [ERROR] [system.err] symbol: method addConfigurer(Krb5HttpClientConfigurer) 15:07:05.284 [ERROR] [system.err] location: class HttpClientUtil 15:07:05.286 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/security/FusionKrb5HttpClientConfigurer.java:53: error: cannot find symbol 15:07:05.286 [ERROR] [system.err] HttpClientUtil.addConfigurer(new FusionKrb5HttpClientConfigurer(fusionPrincipal)); 15:07:05.286 [ERROR] [system.err] ^ 15:07:05.286 [ERROR] [system.err] symbol: method addConfigurer(FusionKrb5HttpClientConfigurer) 15:07:05.287 [ERROR] [system.err] location: class HttpClientUtil 15:07:05.306 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/fusion/FusionPipelineClient.java:125: warning: [deprecation] BEST_MATCH in CookieSpecs has been deprecated 15:07:05.307 [ERROR] [system.err] globalConfig = RequestConfig.custom().setCookieSpec(CookieSpecs.BEST_MATCH).build(); 15:07:05.307 [ERROR] [system.err] ^ 15:07:05.333 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/fusion/FusionPipelineClient.java:594: error: cannot find symbol 15:07:05.333 [ERROR] [system.err] fusionSession.solrClient = new HttpSolrClient.Builder() 15:07:05.333 [ERROR] [system.err] ^ 15:07:05.333 [ERROR] [system.err] symbol: class Builder 15:07:05.333 [ERROR] [system.err] location: class HttpSolrClient 15:07:05.367 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/LWMapRedInputFormat.java:258: error: cannot find symbol 15:07:05.367 [ERROR] [system.err] solrCloud = new CloudSolrClient.Builder() 15:07:05.367 [ERROR] [system.err] ^ 15:07:05.367 [ERROR] [system.err] symbol: class Builder 15:07:05.367 [ERROR] [system.err] location: class CloudSolrClient 15:07:05.370 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/LWMapRedInputFormat.java:306: error: cannot find symbol 15:07:05.370 [ERROR] [system.err] solr = new HttpSolrClient.Builder() 15:07:05.370 [ERROR] [system.err] ^ 15:07:05.370 [ERROR] [system.err] symbol: class Builder 15:07:05.370 [ERROR] [system.err] location: class HttpSolrClient 15:07:05.370 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/LWMapRedInputFormat.java:311: error: cannot find symbol 15:07:05.371 [ERROR] [system.err] solr = new CloudSolrClient.Builder() 15:07:05.371 [ERROR] [system.err] ^ 15:07:05.371 [ERROR] [system.err] symbol: class Builder 15:07:05.371 [ERROR] [system.err] location: class CloudSolrClient 15:07:05.372 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/LWMapRedInputFormat.java:327: error: cannot find symbol 15:07:05.372 [ERROR] [system.err] solr = new ConcurrentUpdateSolrClient.Builder(connectionUri) 15:07:05.372 [ERROR] [system.err] ^ 15:07:05.372 [ERROR] [system.err] symbol: class Builder 15:07:05.372 [ERROR] [system.err] location: class ConcurrentUpdateSolrClient 15:07:05.387 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:148: error: cannot find symbol 15:07:05.387 [ERROR] [system.err] fields.add(mapField("_hadoop_tdt", null, DateTimeFormatter.ISO_INSTANT.format(Instant.now()))); 15:07:05.387 [ERROR] [system.err] ^ 15:07:05.387 [ERROR] [system.err] symbol: variable Instant 15:07:05.387 [ERROR] [system.err] location: class FusionRecordWriter 15:07:05.388 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:148: error: package DateTimeFormatter does not exist 15:07:05.388 [ERROR] [system.err] fields.add(mapField("_hadoop_tdt", null, DateTimeFormatter.ISO_INSTANT.format(Instant.now()))); 15:07:05.388 [ERROR] [system.err] ^ 15:07:05.391 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:203: warning: [unchecked] unchecked call to add(E) as a member of the raw type List 15:07:05.391 [ERROR] [system.err] fields.add(mapField(DATA_SOURCE_COLLECTION_FIELD, null, 15:07:05.391 [ERROR] [system.err] ^ 15:07:05.392 [ERROR] [system.err] where E is a type-variable: 15:07:05.392 [ERROR] [system.err] E extends Object declared in interface List 15:07:05.392 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:205: warning: [unchecked] unchecked call to add(E) as a member of the raw type List 15:07:05.392 [ERROR] [system.err] fields.add(mapField(DATA_SOURCE_PIPELINE_FIELD, null, jobConf.get(FUSION_DATASOURCE_PIPELINE, UNKNOWN))); 15:07:05.393 [ERROR] [system.err] ^ 15:07:05.393 [ERROR] [system.err] where E is a type-variable: 15:07:05.393 [ERROR] [system.err] E extends Object declared in interface List 15:07:05.394 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:206: warning: [unchecked] unchecked call to add(E) as a member of the raw type List 15:07:05.394 [ERROR] [system.err] fields.add(mapField(DATA_SOURCE_TYPE_FIELD, null, jobConf.get(FUSION_DATASOURCE_TYPE, UNKNOWN))); 15:07:05.394 [ERROR] [system.err] ^ 15:07:05.394 [ERROR] [system.err] where E is a type-variable: 15:07:05.394 [ERROR] [system.err] E extends Object declared in interface List 15:07:05.395 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/FusionOutputFormat.java:207: warning: [unchecked] unchecked call to add(E) as a member of the raw type List 15:07:05.396 [ERROR] [system.err] fields.add(mapField(BATCH_ID_FIELD, null, jobConf.get(FUSION_BATCHID, UNKNOWN))); 15:07:05.396 [ERROR] [system.err] ^ 15:07:05.396 [ERROR] [system.err] where E is a type-variable: 15:07:05.396 [ERROR] [system.err] E extends Object declared in interface List 15:07:05.400 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/LucidWorksWriter.java:74: error: cannot find symbol 15:07:05.401 [ERROR] [system.err] solr = new CloudSolrClient.Builder() 15:07:05.401 [ERROR] [system.err] ^ 15:07:05.401 [ERROR] [system.err] symbol: class Builder 15:07:05.401 [ERROR] [system.err] location: class CloudSolrClient 15:07:05.402 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/com/lucidworks/hadoop/io/LucidWorksWriter.java:87: error: cannot find symbol 15:07:05.402 [ERROR] [system.err] solr = new ConcurrentUpdateSolrClient.Builder(solrURL) 15:07:05.402 [ERROR] [system.err] ^ 15:07:05.402 [ERROR] [system.err] symbol: class Builder 15:07:05.402 [ERROR] [system.err] location: class ConcurrentUpdateSolrClient 15:07:05.458 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/edu/cmu/lemurproject/WarcFileInputFormat.java:61: warning: [unchecked] getRecordReader(InputSplit,JobConf,Reporter) in WarcFileInputFormat overrides getRecordReader(InputSplit,JobConf,Reporter) in FileInputFormat 15:07:05.458 [ERROR] [system.err] public RecordReader getRecordReader(InputSplit split, JobConf conf, Reporter reporter) 15:07:05.458 [ERROR] [system.err] ^ 15:07:05.458 [ERROR] [system.err] return type requires unchecked conversion from RecordReader to RecordReader<LongWritable,WritableWarcRecord> 15:07:05.458 [ERROR] [system.err] where K,V are type-variables: 15:07:05.458 [ERROR] [system.err] K extends Object declared in class FileInputFormat 15:07:05.458 [ERROR] [system.err] V extends Object declared in class FileInputFormat 15:07:05.459 [ERROR] [system.err] /home/fabio/Documents/hive-solr/hive-solr/solr-hadoop-common/solr-hadoop-io/src/main/java/edu/cmu/lemurproject/WarcFileInputFormat.java:61: warning: [unchecked] getRecordReader(InputSplit,JobConf,Reporter) in WarcFileInputFormat implements getRecordReader(InputSplit,JobConf,Reporter) in InputFormat 15:07:05.460 [ERROR] [system.err] public RecordReader getRecordReader(InputSplit split, JobConf conf, Reporter reporter) 15:07:05.460 [ERROR] [system.err] ^ 15:07:05.460 [ERROR] [system.err] return type requires unchecked conversion from RecordReader to RecordReader<LongWritable,WritableWarcRecord> 15:07:05.460 [ERROR] [system.err] where K,V are type-variables: 15:07:05.460 [ERROR] [system.err] K extends Object declared in interface InputFormat 15:07:05.460 [ERROR] [system.err] V extends Object declared in interface InputFormat

15:07:05.463 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] FAILURE: Build failed with an exception. 15:07:05.463 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 15:07:05.463 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] * What went wrong: 15:07:05.463 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Execution failed for task ':solr-hadoop-common:solr-hadoop-io:compileJava'. 15:07:05.463 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] > Compilation failed; see the compiler error output for details.`

Thank you for your time. It's probably the same problem that the issue #34