nathanmarz / cascalog

Data processing on Hadoop without the hassle.
Other
1.38k stars 178 forks source link

RemoteException Server IPC version 9 cannot communicate with client version 4 org.apache.hadoop.ipc.Client.call #260

Open thbeh opened 10 years ago

thbeh commented 10 years ago

Currently I am testing Clojure/Cascalog with Hortonworks HDP but got the following errors..

//lein repl - compile with no error test2.core=> (?<- (stdout) ?line :> ?line)) 14/08/10 16:51:20 INFO util.HadoopUtil: using default application jar, may cause class not found exceptions on the cluster 14/08/10 16:51:20 INFO planner.HadoopPlanner: using application jar: /home/thbeh/.m2/repository/cascading/cascading-hadoop/2.5.3/cascading-hadoop-2.5.3.jar 14/08/10 16:51:20 INFO property.AppProps: using app.id: BEBDEA9EC7EB4A7A8326312A43920527

RemoteException Server IPC version 9 cannot communicate with client version 4 org.apache.hadoop.ipc.Client.call (Client.java:1113)

// HADDOP version $HADOOP_HOME/bin/hadoop version Hadoop 2.2.0.2.0.6.0-102 Subversion git@github.com:hortonworks/hadoop.git -r 02ad68f19849a0a986dac36b705491f6791f9179 Compiled by jenkins on 2014-01-21T05:01Z Compiled with protoc 2.5.0 From source with checksum 66f6c486e27479105979740178fbf0 This command was run using /home/thbeh/hadoop-2.2.0.2.0.6.0-102/share/hadoop/common/hadoop-common-2.2.0.2.0.6.0-102.jar

// project.clj (defproject test2 "0.1.0-SNAPSHOT" :description "FIXME: write description" :url "http://example.com/FIXME" :license {:name "Eclipse Public License" :url "http://www.eclipse.org/legal/epl-v10.html"} :dependencies [ [org.clojure/clojure "1.6.0"] [cascalog/cascalog-core "2.1.1"] ] :profiles { :provided {:dependencies [[org.apache.hadoop/hadoop-core "1.2.1"]]}} :namespaces [test2.core] :main test2.core :aot [test2.core] )

// src/test2/core.clj (ns test2.core (:use cascalog.api) (:gen-class) )

(defn foo "I don't do a whole lot." [x](println x))

sritchie commented 9 years ago

I'm not seeing hortonworks in your build - You're probably going to have to replace [[org.apache.hadoop/hadoop-core "1.2.1"]] with the hortonworks build, or else you'll be compiling against a different version of hadoop than you're running. That's probably the issue.