search

cloud-software-foundation / c5

c5
Apache License 2.0
12 stars 8 forks source link

BasicTableCreationTest does not fail, even if an HRegion write fails during it #256

Closed joshua-g closed 10 years ago

joshua-g commented 10 years ago

Output:

/usr/lib/jvm/java-8-oracle/bin/java -Dvisualvm.id=225031442570181 -ea -Didea.launcher.port=7534 -Didea.launcher.bin.path=/opt/intellij-idea-ce/bin -Dfile.encoding=UTF-8 -classpath /opt/intellij-idea-ce/lib/idea_rt.jar:/opt/intellij-idea-ce/plugins/junit/lib/junit-rt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/plugin.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfr.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jsse.jar:/usr/lib/jvm/java-8-oracle/jre/lib/resources.jar:/usr/lib/jvm/java-8-oracle/jre/lib/deploy.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jfxswt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/javaws.jar:/usr/lib/jvm/java-8-oracle/jre/lib/charsets.jar:/usr/lib/jvm/java-8-oracle/jre/lib/jce.jar:/usr/lib/jvm/java-8-oracle/jre/lib/rt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/management-agent.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/zipfs.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunjce_provider.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunpkcs11.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/jfxrt.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/nashorn.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/sunec.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/localedata.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/dnsns.jar:/usr/lib/jvm/java-8-oracle/jre/lib/ext/cldrdata.jar:/home/josh/IdeaProjects/c5/c5db/target/test-classes:/home/josh/IdeaProjects/c5/c5db/target/classes:/home/josh/.m2/repository/com/github/spullara/mustache/java/compiler/0.8.14/compiler-0.8.14.jar:/home/josh/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-server/9.1.4.v20140401/jetty-server-9.1.4.v20140401.jar:/home/josh/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-http/9.1.4.v20140401/jetty-http-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-util/9.1.4.v20140401/jetty-util-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-io/9.1.4.v20140401/jetty-io-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-servlet/9.1.4.v20140401/jetty-servlet-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-security/9.1.4.v20140401/jetty-security-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/websocket/websocket-server/9.1.4.v20140401/websocket-server-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.1.4.v20140401/websocket-common-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.1.4.v20140401/websocket-api-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.1.4.v20140401/websocket-client-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/websocket/websocket-servlet/9.1.4.v20140401/websocket-servlet-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-rewrite/9.1.4.v20140401/jetty-rewrite-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/eclipse/jetty/jetty-client/9.1.4.v20140401/jetty-client-9.1.4.v20140401.jar:/home/josh/.m2/repository/org/clojure/clojure/1.5.1/clojure-1.5.1.jar:/home/josh/.m2/repository/io/protostuff/protostuff-api/1.1.0-SNAPSHOT/protostuff-api-1.1.0-SNAPSHOT.jar:/home/josh/.m2/repository/io/protostuff/protostuff-runtime/1.1.0-SNAPSHOT/protostuff-runtime-1.1.0-SNAPSHOT.jar:/home/josh/.m2/repository/io/protostuff/protostuff-collectionschema/1.1.0-SNAPSHOT/protostuff-collectionschema-1.1.0-SNAPSHOT.jar:/home/josh/.m2/repository/io/protostuff/protostuff-json/1.1.0-SNAPSHOT/protostuff-json-1.1.0-SNAPSHOT.jar:/home/josh/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/home/josh/.m2/repository/io/protostuff/protostuff-core/1.1.0-SNAPSHOT/protostuff-core-1.1.0-SNAPSHOT.jar:/home/josh/IdeaProjects/c5/hbase-server/target/classes:/home/josh/IdeaProjects/c5/hbase-common/target/classes:/home/josh/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/home/josh/.m2/repository/commons-codec/commons-codec/1.7/commons-codec-1.7.jar:/home/josh/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/josh/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/josh/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/josh/.m2/repository/org/apache/hadoop/hadoop-core/1.1.2/hadoop-core-1.1.2.jar:/home/josh/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/josh/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/josh/.m2/repository/com/sun/jersey/jersey-core/1.8/jersey-core-1.8.jar:/home/josh/.m2/repository/com/sun/jersey/jersey-json/1.8/jersey-json-1.8.jar:/home/josh/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/josh/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/josh/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/josh/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/josh/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/josh/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/josh/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.8/jackson-jaxrs-1.8.8.jar:/home/josh/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.8/jackson-xc-1.8.8.jar:/home/josh/.m2/repository/com/sun/jersey/jersey-server/1.8/jersey-server-1.8.jar:/home/josh/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/josh/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/josh/.m2/repository/org/apache/commons/commons-math/2.2/commons-math-2.2.jar:/home/josh/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/josh/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/josh/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/josh/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/josh/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar:/home/josh/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/josh/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/josh/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/josh/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/josh/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/josh/.m2/repository/org/mortbay/jetty/jsp-api-2.1/6.1.14/jsp-api-2.1-6.1.14.jar:/home/josh/.m2/repository/org/mortbay/jetty/servlet-api-2.5/6.1.14/servlet-api-2.5-6.1.14.jar:/home/josh/.m2/repository/org/mortbay/jetty/jsp-2.1/6.1.14/jsp-2.1-6.1.14.jar:/home/josh/.m2/repository/org/jetbrains/annotations/13.0/annotations-13.0.jar:/home/josh/.m2/repository/com/github/stephenc/findbugs/findbugs-annotations/1.3.9-1/findbugs-annotations-1.3.9-1.jar:/home/josh/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/josh/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/josh/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/josh/.m2/repository/org/mockito/mockito-core/1.9.0/mockito-core-1.9.0.jar:/home/josh/.m2/repository/org/objenesis/objenesis/1.0/objenesis-1.0.jar:/home/josh/.m2/repository/org/hamcrest/hamcrest-library/1.3/hamcrest-library-1.3.jar:/home/josh/IdeaProjects/c5/hbase-protocol/target/classes:/home/josh/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/josh/IdeaProjects/c5/hbase-client/target/classes:/home/josh/.m2/repository/io/netty/netty/3.6.6.Final/netty-3.6.6.Final.jar:/home/josh/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/home/josh/.m2/repository/org/slf4j/slf4j-api/1.7.4/slf4j-api-1.7.4.jar:/home/josh/.m2/repository/org/cloudera/htrace/htrace-core/2.01/htrace-core-2.01.jar:/home/josh/IdeaProjects/c5/hbase-prefix-tree/target/classes:/home/josh/IdeaProjects/c5/hbase-hadoop-compat/target/classes:/home/josh/IdeaProjects/c5/hbase-hadoop1-compat/target/classes:/home/josh/.m2/repository/com/yammer/metrics/metrics-core/2.1.2/metrics-core-2.1.2.jar:/home/josh/.m2/repository/com/github/stephenc/high-scale-lib/high-scale-lib/1.1.1/high-scale-lib-1.1.1.jar:/home/josh/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/josh/.m2/repository/org/eclipse/jdt/core/3.1.1/core-3.1.1.jar:/home/josh/.m2/repository/org/jamon/jamon-runtime/2.3.1/jamon-runtime-2.3.1.jar:/home/josh/.m2/repository/org/jmock/jmock-junit4/2.6.0/jmock-junit4-2.6.0.jar:/home/josh/.m2/repository/org/jmock/jmock/2.6.0/jmock-2.6.0.jar:/home/josh/.m2/repository/org/jmock/jmock-legacy/2.6.0/jmock-legacy-2.6.0.jar:/home/josh/.m2/repository/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar:/home/josh/.m2/repository/io/netty/netty-all/4.0.19.Final/netty-all-4.0.19.Final.jar:/home/josh/.m2/repository/org/slf4j/slf4j-simple/1.7.4/slf4j-simple-1.7.4.jar:/home/josh/.m2/repository/org/jetlang/jetlang/0.2.10/jetlang-0.2.10.jar:/home/josh/.m2/repository/com/codahale/metrics/metrics-core/3.0.0/metrics-core-3.0.0.jar:/home/josh/IdeaProjects/c5/c5-proto/target/classes:/home/josh/IdeaProjects/c5/c5db-client/target/classes com.intellij.rt.execution.application.AppMain com.intellij.rt.execution.junit.JUnitStarter -ideVersion5 c5db.tablet.BasicTableCreationTest
[pool-1-thread-1] INFO c5db.tablet.TabletService - Waiting to find at least 1 nodes to bootstrap with
14/06/25 15:15:08 WARN impl.MetricsSystemImpl: Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-hbase.properties, hadoop-metrics2.properties
14/06/25 15:15:08 INFO hfile.CacheConfig: Allocating LruBlockCache with maximum size 522.8m
14/06/25 15:15:08 INFO compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
14/06/25 15:15:08 INFO util.ChecksumType: Checksum using org.apache.hadoop.util.PureJavaCrc32
14/06/25 15:15:09 INFO regionserver.HRegion: Onlined 33578e495f8173aac4be480afe41410a; next sequenceid=1
14/06/25 15:15:09 INFO regionserver.RegionCoprocessorHost: Load coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully.
14/06/25 15:15:09 INFO compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
14/06/25 15:15:09 INFO regionserver.HRegion: Onlined 46aa66db55d07e30edfb7574ec48c567; next sequenceid=1
[main] ERROR c5db.tablet.hregionbridge.HRegionBridge - error in HRegionBridge#simplePut
java.io.IOException: Error encountered while waiting within OLogShim#sync
    at c5db.log.OLogShim.sync(OLogShim.java:189)
    at c5db.log.OLogShim.sync(OLogShim.java:170)
    at org.apache.hadoop.hbase.regionserver.HRegion.syncOrDefer(HRegion.java:5416)
    at org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:2246)
    at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:1964)
    at org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:1925)
    at org.apache.hadoop.hbase.regionserver.HRegion.doBatchMutate(HRegion.java:2440)
    at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1887)
    at c5db.tablet.hregionbridge.HRegionBridge.simplePut(HRegionBridge.java:190)
    at c5db.tablet.hregionbridge.HRegionBridge.mutate(HRegionBridge.java:154)
    at c5db.tablet.TabletService.addEntryToMeta(TabletService.java:377)
    at c5db.tablet.TabletService.createUserTableHelper(TabletService.java:363)
    at c5db.tablet.TabletService.createUserTable(TabletService.java:344)
    at c5db.tablet.TabletService.acceptCommand(TabletService.java:308)
    at c5db.tablet.BasicTableCreationTest.shouldCreateMetaEntryAppropriatelyOnTableCreation(BasicTableCreationTest.java:255)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
    at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
    at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
    at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
    at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
    at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
    at org.jmock.integration.junit4.JUnitRuleMockery$1.evaluate(JUnitRuleMockery.java:49)
    at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
    at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
    at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
    at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
    at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
    at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
    at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
    at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
    at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
    at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:74)
    at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:202)
    at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:65)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at com.intellij.rt.execution.application.AppMain.main(AppMain.java:120)
Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task.
    at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:276)
    at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96)
    at c5db.log.OLogShim.sync(OLogShim.java:182)
    ... 43 more
14/06/25 15:15:19 INFO compactions.CompactionConfiguration: size [134217728, 9223372036854775807); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; delete expired; major period 604800000, major jitter 0.500000
14/06/25 15:15:19 INFO regionserver.HRegion: Onlined 2a0f1a3fb8c18fd81a4d5489cdda6fe8; next sequenceid=1

Process finished with exit code 0
joshua-g commented 10 years ago

As of d0f80e05ced7771bf8426e46f0b94828c80bc8fe, this test now uses a mock region instead of HRegion -- can we close this issue?

posix4e commented 10 years ago

Yep On Sep 17, 2014 1:34 PM, "Joshua Greenberg" notifications@github.com wrote:

As of d0f80e0 https://github.com/OhmData/c5/commit/d0f80e05ced7771bf8426e46f0b94828c80bc8fe, this test now uses a mock region instead of HRegion -- can we close this issue?

— Reply to this email directly or view it on GitHub https://github.com/OhmData/c5/issues/256#issuecomment-55955651.