search

apache / accumulo

Apache Accumulo
https://accumulo.apache.org
Apache License 2.0
1.07k stars 445 forks source link

NullPointerException when doing MapReduce job #705

Closed deniskuzZ closed 6 years ago

deniskuzZ commented 6 years ago

Caused by: java.lang.NullPointerException at org.apache.accumulo.core.client.mapred.AbstractInputFormat$AbstractRecordReader.initialize(AbstractInputFormat.java:608) at org.apache.accumulo.core.client.mapred.AccumuloRowInputFormat$1.initialize(AccumuloRowInputFormat.java:60)

deniskuzZ commented 6 years ago

Null check should be added for tableConfig

keith-turner commented 6 years ago

In what version of Accumulo did you see this?

deniskuzZ commented 6 years ago

Hi Keith,

Issue is reproducible in v1.8.1, v1.9.2 and works fine with v1.7.3.

Use-case that I was testing: 1) Created from Hive CLI Accumulo backed table

CREATE TABLE accumulo_pushdown(key string, value string) STORED BY 'org.apache.hadoop.hive.accumulo.AccumuloStorageHandler' WITH SERDEPROPERTIES ("accumulo.columns.mapping" = ":rowid,cf:string");

2) Executed below statement (triggered MapReduce job)

select * from accumulo_pushdown where key>'90' and value like '%9%';

Caused by: java.lang.NullPointerException

at org.apache.accumulo.core.client.mapred.AbstractInputFormat$AbstractRecordReader.initialize(AbstractInputFormat.java:637)

at org.apache.accumulo.core.client.mapred.AccumuloRowInputFormat$1.initialize(AccumuloRowInputFormat.java:67)

at org.apache.accumulo.core.client.mapred.AccumuloRowInputFormat.getRecordReader(AccumuloRowInputFormat.java:92)

at org.apache.hadoop.hive.accumulo.mr.HiveAccumuloTableInputFormat.getRecordReader(HiveAccumuloTableInputFormat.java:224)

at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:295)

Please let me know if you need some additional information.

Regards,

Denys

ср, 17 окт. 2018 г. в 16:55, Keith Turner notifications@github.com:

In what version of Accumulo did you see this?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/apache/accumulo/issues/705#issuecomment-430662029, or mute the thread https://github.com/notifications/unsubscribe-auth/ACojOPyaEfymfCrtB84FAY1inikl1lhLks5ul0T_gaJpZM4Xj4z5 .

deniskuzZ commented 6 years ago

Btw. I have submitted upstream patch for that: https://issues.apache.org/jira/browse/ACCUMULO-4857

Would be great if you could take a look.

milleruntime commented 6 years ago

Hey @deniskuzZ thanks for the information. No need to also create a JIRA issue. The github issue you created here is all we need to look into the error you are seeing. Please close ACCUMULO-4857 as a duplicate, thanks!

deniskuzZ commented 6 years ago

HI @milleruntime, closed. Here is a pull request: https://github.com/apache/accumulo/pull/706