search

spring-attic / spring-hadoop-samples

Spring Hadoop Samples
Apache License 2.0
492 stars 466 forks source link

I need a SpringBatch Hive 13, HiverServer2 sample #20

Open sagpid opened 10 years ago

sagpid commented 10 years ago

I am trying to get the sample working when running against hadoop 2.4.1, Hiveserver2, Hive 13.

I am having problems and please find below details of a second instance of failure. This is in hive-batch project from spring-hadoop-samples.

Thanks for any help.

My properties are

hd.fs=hdfs://aa.0.11.120:8020
localSourceFile=data/nbatweets-small.txt
tweets.input.path=/tweets/input

The stack trace is as given below.

localSourceFile = /home/sagar/Downloads/spring-hadoop-samples/hive-batch/target/appassembler/data/nbatweets-small.txt
inputDir = /tweets/input
about to execute the file copying 
exiting
01:06:34,304  INFO amework.samples.hadoop.hive.HiveBatchApp:  37 - Batch Tweet Influencers Hive Job Running
01:06:34,411  INFO ch.core.launch.support.SimpleJobLauncher: 133 - Job: [FlowJob: [name=hiveJob]] launched with the following parameters: [{}]
01:06:34,471  INFO amework.batch.core.job.SimpleStepHandler: 146 - Executing step: [influencer-step]
01:06:34,589 ERROR ngframework.batch.core.step.AbstractStep: 225 - Encountered an error executing step influencer-step in job hiveJob
org.springframework.dao.DataAccessResourceFailureException: Invalid method name: 'execute'; nested exception is org.apache.thrift.TApplicationException: Invalid method name: 'execute'
    at org.springframework.data.hadoop.hive.HiveUtils.convert(HiveUtils.java:69)
    at org.springframework.data.hadoop.hive.HiveTemplate.convertHiveAccessException(HiveTemplate.java:99)
    at org.springframework.data.hadoop.hive.HiveTemplate.execute(HiveTemplate.java:82)
    at org.springframework.data.hadoop.hive.HiveTemplate.executeScript(HiveTemplate.java:261)