forcedotcom / phoenix

BSD 3-Clause "New" or "Revised" License
558 stars 227 forks source link

Phoenix 3.0.0 not working with HBASE 0.94.9 #723

Closed SatyaNarayan1 closed 10 years ago

SatyaNarayan1 commented 10 years ago

reposting here just in case, please close if its looked on https://issues.apache.org/jira/browse/PHOENIX-59

We have a hbase cluster setup with hbase 0.94.9 , I tried to deploy phoenix 3.0.0 in the cluster. sqlline and psql scripts are working, but when I am trying to load data using pig script or csv-bulk-loader script it is not able to connect to master.

below are the errors , based on what I found EOFException is coming due to version mismatch of HBase. I tried compiling phoenix with HBASE 0.94.9 but its mi

2014-02-19 13:24:15,377 INFO [main-SendThread(zookeeper_host:2181)] org.apache.zookeeper.ClientCnxn: Socket connection established tozookeeper_host/10.218.104.229:2181, initiating session 2014-02-19 13:24:15,408 INFO [main-SendThread(zookeeper_host:2181)] org.apache.zookeeper.ClientCnxn: Session establishment complete on server zookeeper_host/10.218.104.229:2181, sessionid = 0x143ceb98c3702f7, negotiated timeout = 40000 2014-02-19 13:24:15,488 INFO [main] org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: getMaster attempt 0 of 14 failed; retrying after sleep of 1005 java.io.IOException: Call to master_host:60000 failed on local exception: java.io.EOFException at org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:1030) at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:999) at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:86) at com.sun.proxy.$Proxy9.getProtocolVersion(Unknown Source) at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:138) at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:712) at org.apache.hadoop.hbase.client.HBaseAdmin.(HBaseAdmin.java:128) at org.apache.phoenix.query.ConnectionQueryServicesImpl.ensureTableCreated(ConnectionQueryServicesImpl.java:589) at org.apache.phoenix.query.ConnectionQueryServicesImpl.createTable(ConnectionQueryServicesImpl.java:804) at org.apache.phoenix.schema.MetaDataClient.createTableInternal(MetaDataClient.java:993) at org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:385) at org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:166) at org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:224) at org.apache.phoenix.jdbc.PhoenixStatement.executeUpdate(PhoenixStatement.java:859) at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:999) at org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:77) at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.connect(PhoenixEmbeddedDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:579) at java.sql.DriverManager.getConnection(DriverManager.java:190) at org.apache.phoenix.pig.PhoenixPigConfiguration.getConnection(PhoenixPigConfiguration.java:90) at org.apache.phoenix.pig.hadoop.PhoenixOutputFormat.getConnection(PhoenixOutputFormat.java:91) at org.apache.phoenix.pig.hadoop.PhoenixOutputFormat.getRecordWriter(PhoenixOutputFormat.java:68) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.(MapTask.java:588) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:707) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:333) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:158) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1284) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:153) Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:646) at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:580)

Tried compiling phoenix with HBASE 0.94.9 it failed /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/parse/ComparisonParseNode.java:[24,38] cannot find symbol symbol: class CompareFilter location: package org.apache.hadoop.hbase.filter /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/compile/StatementContext.java:[24,38] cannot find symbol symbol: class Scan location: package org.apache.hadoop.hbase.client /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/compile/StatementContext.java:[25,34] cannot find symbol symbol: class ImmutableBytesWritable location: package org.apache.hadoop.hbase.io /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/expression/Expression.java:[22,34] cannot find symbol symbol: class ImmutableBytesWritable location: package org.apache.hadoop.hbase.io /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/parse/ComparisonParseNode.java:[51,34] package CompareFilter does not exist /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/parse/ComparisonParseNode.java:[56,34] package CompareFilter does not exist /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/schema/PDataType.java:[31,34] cannot find symbol symbol: class ImmutableBytesWritable location: package org.apache.hadoop.hbase.io /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/schema/PDataType.java:[32,36] cannot find symbol symbol: class Base64 location: package org.apache.hadoop.hbase.util /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/schema/PDataType.java:[33,36] cannot find symbol symbol: class Bytes location: package org.apache.hadoop.hbase.util /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/compile/StatementContext.java:[50,19] cannot find symbol symbol: class Scan location: class org.apache.phoenix.compile.StatementContext /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/compile/StatementContext.java:[57,19] cannot find symbol symbol: class ImmutableBytesWritable location: class org.apache.phoenix.compile.StatementContext /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixStatement.java:[35,36] cannot find symbol symbol: class Pair location: package org.apache.hadoop.hbase.util /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/compile/ExpressionCompiler.java:[29,52] package org.apache.hadoop.hbase.filter.CompareFilter does not exist /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/compile/ExpressionCompiler.java:[30,34] cannot find symbol symbol: class ImmutableBytesWritable location: package org.apache.hadoop.hbase.io /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServices.java:[25,31] cannot find symbol symbol: class HRegionLocation location: package org.apache.hadoop.hbase /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServices.java:[26,31] cannot find symbol symbol: class HTableDescriptor location: package org.apache.hadoop.hbase /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServices.java:[27,38] cannot find symbol symbol: class HBaseAdmin location: package org.apache.hadoop.hbase.client /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServices.java:[28,38] cannot find symbol symbol: class HTableInterface location: package org.apache.hadoop.hbase.client /home/psatya/phoenix-3.0.0/incubator-phoenix-master/phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServices.java:[29,38] cannot find symbol symbol: class Mutation

SatyaNarayan1 commented 10 years ago

It worked , issue was becouse of secure hbase , once i disabled security in hbase connectivity worked. EOFExcepton is confusing.