search

br1ghtyang / asterixdb

Automatically exported from code.google.com/p/asterixdb
0 stars 0 forks source link

TPC-H q18 array index out of bounds exception #580

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
To reproduce the issue, run q18 in the web interface on SF=1 with 3 nodes, the 
default configuration, and one IO device.

After one runs q18, one will get the error: "50331656 
[ArrayIndexOutOfBoundsException]".

I tried removing the group by clause in the query and the modified query 
(attached) does not get this error.  Subqueries of the original q18 do not get 
this exception

Original issue reported on code.google.com by cmcintyr...@gmail.com on 27 Jul 2013 at 1:10

GoogleCodeExporter commented 8 years ago 
Here is the modified query mentioned above.

Original comment by cmcintyr...@gmail.com on 29 Jul 2013 at 6:52

Attachments:

GoogleCodeExporter commented 8 years ago 
Here are the optimized logical plans for q18 and q18_mod.

Original comment by cmcintyr...@gmail.com on 29 Jul 2013 at 6:54

Attachments:

GoogleCodeExporter commented 8 years ago 
[deleted comment]
GoogleCodeExporter commented 8 years ago 
The lowest part of the stack trace for the ArrayIndexOutOfBounds error is 
below.  Although not entirely similar to the stack trace of q05's error, both 
seem to involve optimized hash join.

Caused by: java.lang.ArrayIndexOutOfBoundsException: 50331725
        at edu.uci.ics.asterix.formats.nontagged.AqlPredicateEvaluatorFactoryProvider$1$1.evaluate(AqlPredicateEvaluatorFactoryProvider.java:63)
        at edu.uci.ics.hyracks.dataflow.std.join.InMemoryHashJoin.join(InMemoryHashJoin.java:122)
        at edu.uci.ics.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.applyInMemHashJoin(OptimizedHybridHashJoinOperatorDescriptor.java:614)
        at edu.uci.ics.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.joinPartitionPair(OptimizedHybridHashJoinOperatorDescriptor.java:455)
        at edu.uci.ics.hyracks.dataflow.std.join.OptimizedHybridHashJoinOperatorDescriptor$ProbeAndJoinActivityNode$1.close(OptimizedHybridHashJoinOperatorDescriptor.java:414)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$2.close(AlgebricksMetaOperatorDescriptor.java:141)
        at edu.uci.ics.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.close(IndexSearchOperatorNodePushable.java:150)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.std.EmptyTupleSourceRuntimeFactory$1.open(EmptyTupleSourceRuntimeFactory.java:56)
        at edu.uci.ics.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$1.initialize(AlgebricksMetaOperatorDescriptor.java:104)
        at edu.uci.ics.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:81)
        at edu.uci.ics.hyracks.control.nc.Task.run(Task.java:228)
        ... 3 more

Original comment by cmcintyr...@gmail.com on 29 Jul 2013 at 11:26

GoogleCodeExporter commented 8 years ago 
q18 no longer gets an exception, and here is the fixed version of the query.

Original comment by cmcintyr...@gmail.com on 31 Jul 2013 at 8:55

Attachments:

GoogleCodeExporter commented 8 years ago 
Pouria, this should be fixed by your Hyracks-Join fix. 
Please assign back to me for verification once it's merged into the Hyracks 
master.

Thanks,
Till

Original comment by westm...@gmail.com on 2 Aug 2013 at 5:58

GoogleCodeExporter commented 8 years ago 
Pouria pushed his fix to master, so re-assigning issue to Till.

Original comment by pouria.p...@gmail.com on 2 Aug 2013 at 6:00

GoogleCodeExporter commented 8 years ago

Original comment by westm...@gmail.com on 9 Aug 2013 at 5:01