search

namhnguyen / asterixdb

Automatically exported from code.google.com/p/asterixdb
0 stars 0 forks source link

Sporadic test failure #511

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
The query runtime/aggregate/agg_number_rec Sporadically fail when running from 
eclipse or command line.
When it fail in eclipse I get the following exception:

edu.uci.ics.hyracks.api.exceptions.HyracksException: Job failed on account of:
edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .

    at edu.uci.ics.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:190)
    at edu.uci.ics.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:44)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:722)
Caused by: edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.hyracks.control.nc.Task.pushFrames(Task.java:320)
    at edu.uci.ics.hyracks.control.nc.Task.run(Task.java:261)
    ... 3 more
Caused by: edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.hyracks.algebricks.runtime.serializer.ResultSerializerFactoryProvider$1$1.appendTuple(ResultSerializerFactoryProvider.java:69)
    at edu.uci.ics.hyracks.dataflow.std.result.ResultWriterOperatorDescriptor$1.nextFrame(ResultWriterOperatorDescriptor.java:91)
    at edu.uci.ics.hyracks.dataflow.common.comm.util.FrameUtils.flushFrame(FrameUtils.java:38)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:38)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.aggreg.AggregateRuntimeFactory$1.close(AggregateRuntimeFactory.java:104)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$2.close(AlgebricksMetaOperatorDescriptor.java:141)
    at edu.uci.ics.hyracks.control.nc.Task.pushFrames(Task.java:311)
    ... 4 more
Caused by: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.asterix.dataflow.data.nontagged.printers.ARecordPrinterFactory$1.print(ARecordPrinterFactory.java:50)
    at edu.uci.ics.hyracks.algebricks.runtime.writers.PrinterBasedWriterFactory$1.printTuple(PrinterBasedWriterFactory.java:48)
    at edu.uci.ics.hyracks.algebricks.runtime.serializer.ResultSerializerFactoryProvider$1$1.appendTuple(ResultSerializerFactoryProvider.java:65)
    ... 12 more
Caused by: java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.asterix.om.pointables.ARecordPointable.set(ARecordPointable.java:264)
    at edu.uci.ics.asterix.dataflow.data.nontagged.printers.ARecordPrinterFactory$1.print(ARecordPrinterFactory.java:46)
    ... 14 more
Caused by: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.asterix.om.util.NonTaggedFormatUtil.getFieldValueLength(NonTaggedFormatUtil.java:145)
    at edu.uci.ics.asterix.om.pointables.ARecordPointable.set(ARecordPointable.java:254)
    ... 15 more
Jun 05, 2013 8:34:13 PM edu.uci.ics.asterix.api.http.servlet.RESTAPIServlet 
doGet
SEVERE: Job failed on account of:
edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .

edu.uci.ics.hyracks.api.exceptions.HyracksException: Job failed on account of:
edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .

    at edu.uci.ics.hyracks.control.cc.job.JobRun.waitForCompletion(JobRun.java:190)
    at edu.uci.ics.hyracks.control.cc.work.WaitForJobCompletionWork$1.run(WaitForJobCompletionWork.java:44)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:722)
Caused by: edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.hyracks.control.nc.Task.pushFrames(Task.java:320)
    at edu.uci.ics.hyracks.control.nc.Task.run(Task.java:261)
    ... 3 more
Caused by: edu.uci.ics.hyracks.api.exceptions.HyracksDataException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.hyracks.algebricks.runtime.serializer.ResultSerializerFactoryProvider$1$1.appendTuple(ResultSerializerFactoryProvider.java:69)
    at edu.uci.ics.hyracks.dataflow.std.result.ResultWriterOperatorDescriptor$1.nextFrame(ResultWriterOperatorDescriptor.java:91)
    at edu.uci.ics.hyracks.dataflow.common.comm.util.FrameUtils.flushFrame(FrameUtils.java:38)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:38)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:41)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.aggreg.AggregateRuntimeFactory$1.close(AggregateRuntimeFactory.java:104)
    at edu.uci.ics.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$2.close(AlgebricksMetaOperatorDescriptor.java:141)
    at edu.uci.ics.hyracks.control.nc.Task.pushFrames(Task.java:311)
    ... 4 more
Caused by: 
edu.uci.ics.hyracks.algebricks.common.exceptions.AlgebricksException: 
java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.asterix.dataflow.data.nontagged.printers.ARecordPrinterFactory$1.print(ARecordPrinterFactory.java:50)
    at edu.uci.ics.hyracks.algebricks.runtime.writers.PrinterBasedWriterFactory$1.printTuple(PrinterBasedWriterFactory.java:48)
    at edu.uci.ics.hyracks.algebricks.runtime.serializer.ResultSerializerFactoryProvider$1$1.appendTuple(ResultSerializerFactoryProvider.java:65)
    ... 12 more
Caused by: java.lang.IllegalStateException: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.asterix.om.pointables.ARecordPointable.set(ARecordPointable.java:264)
    at edu.uci.ics.asterix.dataflow.data.nontagged.printers.ARecordPrinterFactory$1.print(ARecordPrinterFactory.java:46)
    ... 14 more
Caused by: 
edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException: No 
getLength implemented for a value of this type SYSTEM_NULL .
    at edu.uci.ics.asterix.om.util.NonTaggedFormatUtil.getFieldValueLength(NonTaggedFormatUtil.java:145)
    at edu.uci.ics.asterix.om.pointables.ARecordPointable.set(ARecordPointable.java:254)
    ... 15 more

edu.uci.ics.hyracks.algebricks.common.exceptions.NotImplementedException

Assigning it to JArod since he is working on aggregation. I cc'ed Madhu since I 
see result distribution operators in the stack trace.

Original issue reported on code.google.com by salsuba...@gmail.com on 6 Jun 2013 at 3:57

GoogleCodeExporter commented 9 years ago 
I have added a fix (reviewed by Yingyi) for this by fixing a bug on non-handled 
system_null in min/max aggregator. Since the failure shows sporadically, I will 
keep this issue open for a while in case it comes back.

Original comment by jarod...@gmail.com on 7 Jun 2013 at 7:38

GoogleCodeExporter commented 9 years ago 
I still see this failure and it is still sporadic. Here is the stack trace:
java.lang.Exception: Test 
"src/test/resources/runtimets/queries/aggregate/agg_number_rec/agg_number_rec.3.
query.aql" FAILED!
    at edu.uci.ics.asterix.test.aql.TestsUtils.executeTest(TestsUtils.java:373)
    at edu.uci.ics.asterix.test.runtime.ExecutionTest.test(ExecutionTest.java:119)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:601)
    at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
    at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
    at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
    at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
    at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
    at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
    at org.junit.runners.Suite.runChild(Suite.java:128)
    at org.junit.runners.Suite.runChild(Suite.java:24)
    at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
    at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
    at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
    at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
    at org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)
    at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:119)
    at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:101)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:601)
    at org.apache.maven.surefire.booter.ProviderFactory$ClassLoaderProxy.invoke(ProviderFactory.java:103)
    at com.sun.proxy.$Proxy0.invoke(Unknown Source)
    at org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:150)
    at org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcess(SurefireStarter.java:74)
    at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:69)
Caused by: java.lang.NullPointerException
    at java.io.Writer.write(Writer.java:157)
    at edu.uci.ics.asterix.test.aql.TestsUtils.writeResultsToFile(TestsUtils.java:175)
    at edu.uci.ics.asterix.test.aql.TestsUtils.executeTest(TestsUtils.java:350)
    ... 39 more

Original comment by salsuba...@gmail.com on 21 Jun 2013 at 12:40

GoogleCodeExporter commented 9 years ago 
I don't think the original issue and the last stack trace are related? The 
original stack trace was a runtime error. And the last stack trace fails in 
java.io.Writer. Can you please paste your query? I am guessing there was a 
syntax error.

Original comment by madhusudancs on 21 Jun 2013 at 1:00

GoogleCodeExporter commented 9 years ago 
I didn't create any query. 
I built asterix and the same test case (runtime/aggregate/agg_number_rec) 
failed. It happens sporadically.
I know it is a different exception but I assume it is related since JArod had a 
comment indicating that he is not sure whether his fix solved the problem 
completely.

Original comment by salsuba...@gmail.com on 21 Jun 2013 at 1:04

GoogleCodeExporter commented 9 years ago 
Alright.

Original comment by madhusudancs on 21 Jun 2013 at 1:09

GoogleCodeExporter commented 9 years ago 
Sattam, are you seeing the error when running the latest master branch?

Original comment by jarod...@gmail.com on 21 Jun 2013 at 1:33

GoogleCodeExporter commented 9 years ago 
Yes.

Original comment by salsuba...@gmail.com on 21 Jun 2013 at 1:41