pinpoint-apm / pinpoint

APM, (Application Performance Management) tool for large-scale distributed systems.
https://pinpoint-apm.gitbook.io/
Apache License 2.0
13.37k stars 3.75k forks source link

A fatal error has been detected by the Java Runtime Environment #2843

Closed Shindooseon closed 7 years ago

Shindooseon commented 7 years ago

Hi!

  1. offline이라 mvn으로 Install하지 못하고, 제공된 *.war(~collector.war, ~web.war) 파일로 tomcat에 deploy하고 start했는데 아래 메시지가 도시됨 -> offline에서 mvn install할 수 있는 방법이 있는지?
  2. 아래 fatal error는 왜 발생하는지?(collector, web 모두 발생) ------------------------- 아래 ----------------------- #

    A fatal error has been detected by the Java Runtime Environment:

    #

    SIGBUS (0xa) at pc=0xffffffff7dd70578, pid=12017, tid=0x0000000000000015

    #

    JRE version: Java(TM) SE Runtime Environment (8.0_121-b13) (build 1.8.0_121-b13)

    Java VM: Java HotSpot(TM) 64-Bit Server VM (25.121-b13 mixed mode solaris-sparc compressed oops)

    Problematic frame:

    V [libjvm.so+0xd70578] Unsafe_SetLong+0x168

    #

    Core dump written. Default location: /app/tomcat/bin/core or core.12017

    #

    If you would like to submit a bug report, please visit:

    http://bugreport.java.com/bugreport/crash.jsp

    #

--------------- T H R E A D ---------------

Current thread (0x0000000100f5e800): JavaThread "localhost-startStop-1" daemon [_thread_in_vm, id=21, stack(0xffffffff61e00000,0xffffffff61f00000)]

siginfo: si_signo: 10 (SIGBUS), si_code: 1 (BUS_ADRALN), si_addr: 0xffffffff56bcaecc

Registers: G1=0x0000000000190460 G2=0x0000000000190400 G3=0x0000000000190400 G4=0x0000000000000000 G5=0x0000000000000000 G6=0xffffffff203fe000 G7=0xffffffff7e90a200 Y=0x0000000000000000 O0=0x0000000000000000 O1=0x00000000001bd338 O2=0x0000000000000000 O3=0x0000000000000000 O4=0x0000000000000000 O5=0x0000000000000000 O6=0xffffffff61ef78e1 O7=0x0000000030000000 L0=0xffffffff7e0cd708 L1=0x0000000000000006 L2=0xffffffff56bcaeb8 L3=0x0000000000000001 L4=0x0000000000001ffc L5=0xffffffff7e25db60 L6=0x0000000000190458 L7=0xffffffff7e28aa40 I0=0xffffffff7e25db78 I1=0x0000000100f5e800 I2=0xffffffff61ef8470 I3=0x0000000000000014 I4=0x0000000000002ef1 I5=0xffffffff7e25db68 I6=0xffffffff61ef7991 I7=0xffffffff6a011d10 PC=0xffffffff7dd70578 nPC=0xffffffff7dd7057c

Top of Stack: (sp=0xffffffff61ef80e0) 0xffffffff61ef80e0: ffffffff7e0cd708 0000000000000006 0xffffffff61ef80f0: ffffffff56bcaeb8 0000000000000001 0xffffffff61ef8100: 0000000000001ffc ffffffff7e25db60 0xffffffff61ef8110: 0000000000190458 ffffffff7e28aa40 0xffffffff61ef8120: ffffffff7e25db78 0000000100f5e800 0xffffffff61ef8130: ffffffff61ef8470 0000000000000014 0xffffffff61ef8140: 0000000000002ef1 ffffffff7e25db68 0xffffffff61ef8150: ffffffff61ef7991 ffffffff6a011d10 0xffffffff61ef8160: 0000000000000000 0000000000000000 0xffffffff61ef8170: ffffffff7e1ff228 0000000100154e70 0xffffffff61ef8180: 0000001600000000 ffffffff1f47d2d8 0xffffffff61ef8190: 00000000001bd000 0000000000000000 0xffffffff61ef81a0: ffffffff1f47d2d8 ffffffff61ef8478 0xffffffff61ef81b0: ffffffff7e25db68 ffffffff6a00d898 0xffffffff61ef81c0: ffffffff61ef8360 0000000100f5e800 0xffffffff61ef81d0: 0000000000000000 ffffffff61ef8478

Instructions: (pc=0xffffffff7dd70578) 0xffffffff7dd70558: a2 10 20 06 7f ff 22 db 90 10 00 19 a2 10 20 06 0xffffffff7dd70568: e2 26 62 70 a4 10 20 00 2a ce 80 02 e4 5e a0 00 0xffffffff7dd70578: f8 74 80 1b e6 5e 60 48 ea 5c e0 10 e8 5c e0 08 0xffffffff7dd70588: ec 5d 60 00 02 c5 80 08 b6 10 20 07 90 10 00 14

Register to memory mapping:

G1=0x0000000000190460 is an unknown value G2=0x0000000000190400 is an unknown value G3=0x0000000000190400 is an unknown value G4=0x0000000000000000 is an unknown value G5=0x0000000000000000 is an unknown value G6=0xffffffff203fe000 is an unknown value G7=0xffffffff7e90a200 is an unknown value

O0=0x0000000000000000 is an unknown value O1=0x00000000001bd338 is an unknown value O2=0x0000000000000000 is an unknown value O3=0x0000000000000000 is an unknown value O4=0x0000000000000000 is an unknown value O5=0x0000000000000000 is an unknown value O6=0xffffffff61ef78e1 is pointing into the stack for thread: 0x0000000100f5e800 O7=0x0000000030000000 is an unknown value

L0=0xffffffff7e0cd708: _GLOBAL_OFFSETTABLE+0 in /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/server/libjvm.so at 0xffffffff7d000000 L1=0x0000000000000006 is an unknown value L2=0xffffffff56bcaeb8 is an oop [B

I0=0xffffffff7e25db78: 1cTMaskFillerForNativeGvtbl_+0x2bf0 in /app/jdk/jdk1.8.0121/jre/lib/sparcv9/server/libjvm.so at 0xffffffff7d000000 I1=0x0000000100f5e800 is a thread I2=0xffffffff61ef8470 is pointing into the stack for thread: 0x0000000100f5e800 I3=0x0000000000000014 is an unknown value I4=0x0000000000002ef1 is an unknown value I5=0xffffffff7e25db68: 1cTMaskFillerForNativeGvtbl+0x2be0 in /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/server/libjvm.so at 0xffffffff7d000000 I6=0xffffffff61ef7991 is pointing into the stack for thread: 0x0000000100f5e800 I7=0xffffffff6a011d10 is at code_begin+528 in an Interpreter codelet method entry point (kind = native) [0xffffffff6a011b00, 0xffffffff6a011f00] 1024 bytes

Stack: [0xffffffff61e00000,0xffffffff61f00000], sp=0xffffffff61ef80e0, free space=992k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0xd70578] Unsafe_SetLong+0x168 j sun.misc.Unsafe.putLong(Ljava/lang/Object;JJ)V+0 j sun.misc.Unsafe.putLong(Ljava/lang/Object;JJ)V+0 j org.apache.hadoop.hbase.util.Bytes.putLongUnsafe([BIJ)I+23 j org.apache.hadoop.hbase.util.Bytes.putLong([BIJ)I+60 j org.apache.hadoop.hbase.client.ClientIdGenerator.generateClientId()[B+65 j org.apache.hadoop.hbase.client.PerClientRandomNonceGenerator.()V+15 j org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(Lorg/apache/hadoop/conf/Configuration;)V+218 j org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(Lorg/apache/hadoop/conf/Configuration;ZLjava/util/concurrent/ExecutorService;Lorg/apache/hadoop/hbase/security/User;)V+2 v ~StubRoutines::call_stub V [libjvm.so+0x73c9cc] void JavaCalls::call_helper(JavaValue,methodHandle,JavaCallArguments,Thread)+0x744 V [libjvm.so+0xc31728] oopDescReflection::invoke(instanceKlassHandle,methodHandle,Handle,bool,objArrayHandle,BasicType,objArrayHandle,bool,Thread)+0x1d38 V [libjvm.so+0xc32524] oopDescReflection::invoke_constructor(oopDesc,objArrayHandle,Thread)+0x2ac V [libjvm.so+0x87d6b0] JVM_NewInstanceFromConstructor+0x200 C [libjava.so+0x1606c] Java_sun_reflect_NativeConstructorAccessorImpl_newInstance0+0x14 J 1217 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0xffffffff6a5b9f8c [0xffffffff6a5b9e20+0x16c] J 1216 C1 sun.reflect.NativeConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (89 bytes) @ 0xffffffff6a5c405c [0xffffffff6a5c2900+0x175c] J 452 C1 sun.reflect.DelegatingConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (9 bytes) @ 0xffffffff6a27cd30 [0xffffffff6a27cb40+0x1f0] J 446 C1 java.lang.reflect.Constructor.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (87 bytes) @ 0xffffffff6a28ff10 [0xffffffff6a28f820+0x6f0] j org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(Lorg/apache/hadoop/conf/Configuration;ZLjava/util/concurrent/ExecutorService;Lorg/apache/hadoop/hbase/security/User;)Lorg/apache/hadoop/hbase/client/Connection;+105 j org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(Lorg/apache/hadoop/conf/Configuration;Ljava/util/concurrent/ExecutorService;Lorg/apache/hadoop/hbase/security/User;)Lorg/apache/hadoop/hbase/client/Connection;+18 j org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(Lorg/apache/hadoop/conf/Configuration;Ljava/util/concurrent/ExecutorService;)Lorg/apache/hadoop/hbase/client/Connection;+3 j com.navercorp.pinpoint.common.hbase.PooledHTableFactory.(Lorg/apache/hadoop/conf/Configuration;IIZ)V+33 v ~StubRoutines::call_stub V [libjvm.so+0x73c9cc] void JavaCalls::call_helper(JavaValue,methodHandle,JavaCallArguments,Thread)+0x744 V [libjvm.so+0xc31728] oopDescReflection::invoke(instanceKlassHandle,methodHandle,Handle,bool,objArrayHandle,BasicType,objArrayHandle,bool,Thread)+0x1d38 V [libjvm.so+0xc32524] oopDescReflection::invoke_constructor(oopDesc,objArrayHandle,Thread)+0x2ac V [libjvm.so+0x87d6b0] JVM_NewInstanceFromConstructor+0x200 C [libjava.so+0x1606c] Java_sun_reflect_NativeConstructorAccessorImpl_newInstance0+0x14 J 1217 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0xffffffff6a5b9f8c [0xffffffff6a5b9e20+0x16c] J 1216 C1 sun.reflect.NativeConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (89 bytes) @ 0xffffffff6a5c405c [0xffffffff6a5c2900+0x175c] J 452 C1 sun.reflect.DelegatingConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (9 bytes) @ 0xffffffff6a27cd30 [0xffffffff6a27cb40+0x1f0] J 446 C1 java.lang.reflect.Constructor.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (87 bytes) @ 0xffffffff6a28ff10 [0xffffffff6a28f820+0x6f0] j org.springframework.beans.BeanUtils.instantiateClass(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object;+12 j org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(Lorg/springframework/beans/factory/support/RootBeanDefinition;Ljava/lang/String;Lorg/springframework/beans/factory/BeanFactory;Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object;+34 j org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+860 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+13 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+202 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+34 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+124 j org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject()Ljava/lang/Object;+16 j org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132 j org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object;+375 j org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5 j org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(Ljava/lang/Object;Lorg/springframework/beans/factory/config/RuntimeBeanReference;)Ljava/lang/Object;+95 j org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+15 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(Ljava/lang/String;Lorg/springframework/beans/factory/config/BeanDefinition;Lorg/springframework/beans/BeanWrapper;Lorg/springframework/beans/PropertyValues;)V+238 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+342 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+222 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+124 j org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject()Ljava/lang/Object;+16 j org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132 j org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object;+375 j org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5 j org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(Ljava/lang/String;Ljava/lang/Class;Lorg/springframework/beans/factory/config/DependencyDescriptor;)Ljava/util/Map;+175 j org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+803 j org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+111 j org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V+95 j org.springframework.beans.factory.annotation.InjectionMetadata.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V+118 j org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(Lorg/springframework/beans/PropertyValues;[Ljava/beans/PropertyDescriptor;Ljava/lang/Object;Ljava/lang/String;)Lorg/springframework/beans/PropertyValues;+19 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+305 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+222 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+124 j org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject()Ljava/lang/Object;+16 j org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132 j org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object;+375 j org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5 j org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons()V+231 j org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(Lorg/springframework/beans/factory/config/ConfigurableListableBeanFactory;)V+103 j org.springframework.context.support.AbstractApplicationContext.refresh()V+54 j org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(Lorg/springframework/web/context/ConfigurableWebApplicationContext;Ljavax/servlet/ServletContext;)V+135 j org.springframework.web.context.ContextLoader.initWebApplicationContext(Ljavax/servlet/ServletContext;)Lorg/springframework/web/context/WebApplicationContext;+132 j org.springframework.web.context.ContextLoaderListener.contextInitialized(Ljavax/servlet/ServletContextEvent;)V+5 j org.apache.catalina.core.StandardContext.listenerStart()Z+628 j org.apache.catalina.core.StandardContext.startInternal()V+1132 j org.apache.catalina.util.LifecycleBase.start()V+210 j org.apache.catalina.core.ContainerBase.addChildInternal(Lorg/apache/catalina/Container;)V+170 j org.apache.catalina.core.ContainerBase.addChild(Lorg/apache/catalina/Container;)V+26 j org.apache.catalina.core.StandardHost.addChild(Lorg/apache/catalina/Container;)V+40 j org.apache.catalina.startup.HostConfig.deployDirectory(Lorg/apache/catalina/util/ContextName;Ljava/io/File;)V+512 j org.apache.catalina.startup.HostConfig$DeployDirectory.run()V+12 j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 j java.util.concurrent.FutureTask.run()V+42 j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub V [libjvm.so+0x73c9cc] void JavaCalls::call_helper(JavaValue,methodHandle,JavaCallArguments,Thread)+0x744 V [libjvm.so+0x73b18c] void JavaCalls::call_virtual(JavaValue,KlassHandle,Symbol,Symbol,JavaCallArguments,Thread)+0x334 V [libjvm.so+0x73b450] void JavaCalls::call_virtual(JavaValue,Handle,KlassHandle,Symbol,Symbol,Thread)+0x50 V [libjvm.so+0x86addc] void thread_entry(JavaThread,Thread*)+0xdc V [libjvm.so+0xd36fa4] void JavaThread::thread_main_inner()+0xf4 V [libjvm.so+0xd36e90] void JavaThread::run()+0x320 V [libjvm.so+0xb75f58] java_start+0x390 C [libc.so.1+0xd825c] _lwp_start+0x8

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.misc.Unsafe.putLong(Ljava/lang/Object;JJ)V+0 j org.apache.hadoop.hbase.util.Bytes.putLongUnsafe([BIJ)I+23 j org.apache.hadoop.hbase.util.Bytes.putLong([BIJ)I+60 j org.apache.hadoop.hbase.client.ClientIdGenerator.generateClientId()[B+65 j org.apache.hadoop.hbase.client.PerClientRandomNonceGenerator.()V+15 j org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(Lorg/apache/hadoop/conf/Configuration;)V+218 j org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(Lorg/apache/hadoop/conf/Configuration;ZLjava/util/concurrent/ExecutorService;Lorg/apache/hadoop/hbase/security/User;)V+2 v ~StubRoutines::call_stub J 1217 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0xffffffff6a5b9edc [0xffffffff6a5b9e20+0xbc] J 1216 C1 sun.reflect.NativeConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (89 bytes) @ 0xffffffff6a5c405c [0xffffffff6a5c2900+0x175c] J 452 C1 sun.reflect.DelegatingConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (9 bytes) @ 0xffffffff6a27cd30 [0xffffffff6a27cb40+0x1f0] J 446 C1 java.lang.reflect.Constructor.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (87 bytes) @ 0xffffffff6a28ff10 [0xffffffff6a28f820+0x6f0] j org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(Lorg/apache/hadoop/conf/Configuration;ZLjava/util/concurrent/ExecutorService;Lorg/apache/hadoop/hbase/security/User;)Lorg/apache/hadoop/hbase/client/Connection;+105 j org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(Lorg/apache/hadoop/conf/Configuration;Ljava/util/concurrent/ExecutorService;Lorg/apache/hadoop/hbase/security/User;)Lorg/apache/hadoop/hbase/client/Connection;+18 j org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(Lorg/apache/hadoop/conf/Configuration;Ljava/util/concurrent/ExecutorService;)Lorg/apache/hadoop/hbase/client/Connection;+3 j com.navercorp.pinpoint.common.hbase.PooledHTableFactory.(Lorg/apache/hadoop/conf/Configuration;IIZ)V+33 v ~StubRoutines::call_stub J 1217 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0xffffffff6a5b9edc [0xffffffff6a5b9e20+0xbc] J 1216 C1 sun.reflect.NativeConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (89 bytes) @ 0xffffffff6a5c405c [0xffffffff6a5c2900+0x175c] J 452 C1 sun.reflect.DelegatingConstructorAccessorImpl.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (9 bytes) @ 0xffffffff6a27cd30 [0xffffffff6a27cb40+0x1f0] J 446 C1 java.lang.reflect.Constructor.newInstance([Ljava/lang/Object;)Ljava/lang/Object; (87 bytes) @ 0xffffffff6a28ff10 [0xffffffff6a28f820+0x6f0] j org.springframework.beans.BeanUtils.instantiateClass(Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object;+12 j org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(Lorg/springframework/beans/factory/support/RootBeanDefinition;Ljava/lang/String;Lorg/springframework/beans/factory/BeanFactory;Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Ljava/lang/Object;+34 j org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+860 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/reflect/Constructor;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+13 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Lorg/springframework/beans/BeanWrapper;+202 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+34 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+124 j org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject()Ljava/lang/Object;+16 j org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132 j org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object;+375 j org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5 j org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(Ljava/lang/Object;Lorg/springframework/beans/factory/config/RuntimeBeanReference;)Ljava/lang/Object;+95 j org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+15 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(Ljava/lang/String;Lorg/springframework/beans/factory/config/BeanDefinition;Lorg/springframework/beans/BeanWrapper;Lorg/springframework/beans/PropertyValues;)V+238 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+342 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+222 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+124 j org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject()Ljava/lang/Object;+16 j org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132 j org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object;+375 j org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5 j org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(Ljava/lang/String;Ljava/lang/Class;Lorg/springframework/beans/factory/config/DependencyDescriptor;)Ljava/util/Map;+175 j org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+803 j org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(Lorg/springframework/beans/factory/config/DependencyDescriptor;Ljava/lang/String;Ljava/util/Set;Lorg/springframework/beans/TypeConverter;)Ljava/lang/Object;+111 j org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V+95 j org.springframework.beans.factory.annotation.InjectionMetadata.inject(Ljava/lang/Object;Ljava/lang/String;Lorg/springframework/beans/PropertyValues;)V+118 j org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(Lorg/springframework/beans/PropertyValues;[Ljava/beans/PropertyDescriptor;Ljava/lang/Object;Ljava/lang/String;)Lorg/springframework/beans/PropertyValues;+19 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;Lorg/springframework/beans/BeanWrapper;)V+305 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+222 j org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(Ljava/lang/String;Lorg/springframework/beans/factory/support/RootBeanDefinition;[Ljava/lang/Object;)Ljava/lang/Object;+124 j org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject()Ljava/lang/Object;+16 j org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(Ljava/lang/String;Lorg/springframework/beans/factory/ObjectFactory;)Ljava/lang/Object;+132 j org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Ljava/lang/String;Ljava/lang/Class;[Ljava/lang/Object;Z)Ljava/lang/Object;+375 j org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Ljava/lang/String;)Ljava/lang/Object;+5 j org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons()V+231 j org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(Lorg/springframework/beans/factory/config/ConfigurableListableBeanFactory;)V+103 j org.springframework.context.support.AbstractApplicationContext.refresh()V+54 j org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(Lorg/springframework/web/context/ConfigurableWebApplicationContext;Ljavax/servlet/ServletContext;)V+135 j org.springframework.web.context.ContextLoader.initWebApplicationContext(Ljavax/servlet/ServletContext;)Lorg/springframework/web/context/WebApplicationContext;+132 j org.springframework.web.context.ContextLoaderListener.contextInitialized(Ljavax/servlet/ServletContextEvent;)V+5 j org.apache.catalina.core.StandardContext.listenerStart()Z+628 j org.apache.catalina.core.StandardContext.startInternal()V+1132 j org.apache.catalina.util.LifecycleBase.start()V+210 j org.apache.catalina.core.ContainerBase.addChildInternal(Lorg/apache/catalina/Container;)V+170 j org.apache.catalina.core.ContainerBase.addChild(Lorg/apache/catalina/Container;)V+26 j org.apache.catalina.core.StandardHost.addChild(Lorg/apache/catalina/Container;)V+40 j org.apache.catalina.startup.HostConfig.deployDirectory(Lorg/apache/catalina/util/ContextName;Ljava/io/File;)V+512 j org.apache.catalina.startup.HostConfig$DeployDirectory.run()V+12 j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 j java.util.concurrent.FutureTask.run()V+42 j java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95 j java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread ) =>0x0000000100f5e800 JavaThread "localhost-startStop-1" daemon [_thread_in_vm, id=21, stack(0xffffffff61e00000,0xffffffff61f00000)] 0x0000000100e41800 JavaThread "Catalina-startStop-1" daemon [_thread_blocked, id=20, stack(0xffffffff62000000,0xffffffff62100000)] 0x0000000100e09000 JavaThread "NioBlockingSelector.BlockPoller-2" daemon [_thread_in_native, id=19, stack(0xffffffff62200000,0xffffffff62300000)] 0x0000000100fbc000 JavaThread "NioBlockingSelector.BlockPoller-1" daemon [_thread_in_native, id=18, stack(0xffffffff62400000,0xffffffff62500000)] 0x0000000100cdf800 JavaThread "GC Daemon" daemon [_thread_blocked, id=17, stack(0xffffffff63800000,0xffffffff63900000)] 0x0000000100454000 JavaThread "AsyncFileHandlerWriter-1300109446" daemon [_thread_blocked, id=16, stack(0xffffffff64a00000,0xffffffff64b00000)] 0x0000000100341000 JavaThread "Service Thread" daemon [_thread_blocked, id=14, stack(0xffffffff64e00000,0xffffffff64f00000)] 0x000000010030e000 JavaThread "C1 CompilerThread2" daemon [_thread_blocked, id=13, stack(0xffffffff65000000,0xffffffff65100000)] 0x000000010030c800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=12, stack(0xffffffff65200000,0xffffffff65300000)] 0x0000000100309800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=11, stack(0xffffffff65400000,0xffffffff65500000)] 0x0000000100308800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=10, stack(0xffffffff65600000,0xffffffff65700000)] 0x00000001002d2800 JavaThread "Finalizer" daemon [_thread_blocked, id=9, stack(0xffffffff65800000,0xffffffff65900000)] 0x00000001002c8800 JavaThread "Reference Handler" daemon [_thread_blocked, id=8, stack(0xffffffff65a00000,0xffffffff65b00000)] 0x000000010010f000 JavaThread "main" [_thread_blocked, id=2, stack(0xffffffff7b400000,0xffffffff7b500000)]

Other Threads: 0x00000001002c0000 VMThread [stack: 0xffffffff65c00000,0xffffffff65d00000] [id=7] 0x0000000100344800 WatcherThread [stack: 0xffffffff64c00000,0xffffffff64d00000] [id=15]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap: PSYoungGen total 204800K, used 107774K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 172032K, 62% used [0xffffffff50400000,0xffffffff56d3fa48,0xffffffff5ac00000) from space 32768K, 0% used [0xffffffff5e400000,0xffffffff5e400000,0xffffffff60400000) to space 45056K, 0% used [0xffffffff5ac00000,0xffffffff5ac00000,0xffffffff5d800000) ParOldGen total 270336K, used 15829K [0xffffffff20400000, 0xffffffff30c00000, 0xffffffff50400000) object space 270336K, 5% used [0xffffffff20400000,0xffffffff213755b8,0xffffffff30c00000) Metaspace used 25267K, capacity 25764K, committed 26112K, reserved 1073152K class space used 2951K, capacity 3072K, committed 3072K, reserved 1048576K

Card table byte_map: [0xffffffff7a300000,0xffffffff7a502000] byte_map_base: 0xff7fffff7a9fe000

Marking Bits: (ParMarkBitMap*) 0xffffffff7e2781a0 Begin Bits: [0xffffffff66000000, 0xffffffff67000000) End Bits: [0xffffffff67000000, 0xffffffff68000000)

Polling page: 0xffffffff7b300000

CodeCache: size=245760Kb used=12194Kb max_used=13383Kb free=233565Kb bounds [0xffffffff6a000000, 0xffffffff6ad20000, 0xffffffff79000000] total_blobs=3064 nmethods=2640 adapters=334 compilation: enabled

Compilation events (10 events): Event: 9.349 Thread 0x000000010030e000 nmethod 2961 0xffffffff6a5cdb50 code [0xffffffff6a5cdd00, 0xffffffff6a5ce170] Event: 9.350 Thread 0x000000010030e000 2962 3 com.sun.org.apache.xerces.internal.parsers.XML11Configuration::addRecognizedParamsAndSetDefaults (173 bytes) Event: 9.352 Thread 0x000000010030e000 nmethod 2962 0xffffffff6a35e550 code [0xffffffff6a35e920, 0xffffffff6a3603f8] Event: 9.352 Thread 0x000000010030e000 2963 3 com.sun.org.apache.xerces.internal.util.URI::initializePath (605 bytes) Event: 9.368 Thread 0x000000010030e000 nmethod 2963 0xffffffff6a3826d0 code [0xffffffff6a383a80, 0xffffffff6a38d830] Event: 9.368 Thread 0x000000010030e000 2966 3 com.sun.org.apache.xerces.internal.impl.Constants$ArrayEnumeration::nextElement (37 bytes) Event: 9.368 Thread 0x000000010030e000 nmethod 2966 0xffffffff6a69be50 code [0xffffffff6a69bfe0, 0xffffffff6a69c370] Event: 9.368 Thread 0x000000010030e000 2964 3 com.sun.org.apache.xerces.internal.impl.Constants$ArrayEnumeration::hasMoreElements (18 bytes) Event: 9.369 Thread 0x000000010030e000 nmethod 2964 0xffffffff6a5cd710 code [0xffffffff6a5cd880, 0xffffffff6a5cdaa8] Event: 9.389 Thread 0x000000010030e000 2968 3 java.security.Provider::parseLegacyPut (457 bytes)

GC Heap History (10 events): Event: 4.857 GC heap before {Heap before GC invocations=3 (full 0): PSYoungGen total 229376K, used 229358K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 100% used [0xffffffff50400000,0xffffffff5c400000,0xffffffff5c400000) from space 32768K, 99% used [0xffffffff5e400000,0xffffffff603fb9d8,0xffffffff60400000) to space 32768K, 0% used [0xffffffff5c400000,0xffffffff5c400000,0xffffffff5e400000) ParOldGen total 262144K, used 204K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 0% used [0xffffffff20400000,0xffffffff204331a8,0xffffffff30400000) Metaspace used 14799K, capacity 15080K, committed 15360K, reserved 1062912K class space used 1652K, capacity 1724K, committed 1792K, reserved 1048576K Event: 4.913 GC heap after Heap after GC invocations=3 (full 0): PSYoungGen total 229376K, used 32750K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 0% used [0xffffffff50400000,0xffffffff50400000,0xffffffff5c400000) from space 32768K, 99% used [0xffffffff5c400000,0xffffffff5e3fbad0,0xffffffff5e400000) to space 32768K, 0% used [0xffffffff5e400000,0xffffffff5e400000,0xffffffff60400000) ParOldGen total 262144K, used 3895K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 1% used [0xffffffff20400000,0xffffffff207cdea8,0xffffffff30400000) Metaspace used 14799K, capacity 15080K, committed 15360K, reserved 1062912K class space used 1652K, capacity 1724K, committed 1792K, reserved 1048576K } Event: 5.592 GC heap before {Heap before GC invocations=4 (full 0): PSYoungGen total 229376K, used 229358K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 100% used [0xffffffff50400000,0xffffffff5c400000,0xffffffff5c400000) from space 32768K, 99% used [0xffffffff5c400000,0xffffffff5e3fbad0,0xffffffff5e400000) to space 32768K, 0% used [0xffffffff5e400000,0xffffffff5e400000,0xffffffff60400000) ParOldGen total 262144K, used 3895K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 1% used [0xffffffff20400000,0xffffffff207cdea8,0xffffffff30400000) Metaspace used 14801K, capacity 15080K, committed 15360K, reserved 1062912K class space used 1652K, capacity 1724K, committed 1792K, reserved 1048576K Event: 5.641 GC heap after Heap after GC invocations=4 (full 0): PSYoungGen total 229376K, used 31352K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 0% used [0xffffffff50400000,0xffffffff50400000,0xffffffff5c400000) from space 32768K, 95% used [0xffffffff5e400000,0xffffffff6029e2d8,0xffffffff60400000) to space 32768K, 0% used [0xffffffff5c400000,0xffffffff5c400000,0xffffffff5e400000) ParOldGen total 262144K, used 3903K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 1% used [0xffffffff20400000,0xffffffff207cfea8,0xffffffff30400000) Metaspace used 14801K, capacity 15080K, committed 15360K, reserved 1062912K class space used 1652K, capacity 1724K, committed 1792K, reserved 1048576K } Event: 6.461 GC heap before {Heap before GC invocations=5 (full 0): PSYoungGen total 229376K, used 227960K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 100% used [0xffffffff50400000,0xffffffff5c400000,0xffffffff5c400000) from space 32768K, 95% used [0xffffffff5e400000,0xffffffff6029e2d8,0xffffffff60400000) to space 32768K, 0% used [0xffffffff5c400000,0xffffffff5c400000,0xffffffff5e400000) ParOldGen total 262144K, used 3903K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 1% used [0xffffffff20400000,0xffffffff207cfea8,0xffffffff30400000) Metaspace used 14838K, capacity 15144K, committed 15360K, reserved 1062912K class space used 1654K, capacity 1724K, committed 1792K, reserved 1048576K Event: 6.510 GC heap after Heap after GC invocations=5 (full 0): PSYoungGen total 229376K, used 32745K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 0% used [0xffffffff50400000,0xffffffff50400000,0xffffffff5c400000) from space 32768K, 99% used [0xffffffff5c400000,0xffffffff5e3fa4f0,0xffffffff5e400000) to space 32768K, 0% used [0xffffffff5e400000,0xffffffff5e400000,0xffffffff60400000) ParOldGen total 262144K, used 7883K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 3% used [0xffffffff20400000,0xffffffff20bb2d60,0xffffffff30400000) Metaspace used 14838K, capacity 15144K, committed 15360K, reserved 1062912K class space used 1654K, capacity 1724K, committed 1792K, reserved 1048576K } Event: 7.998 GC heap before {Heap before GC invocations=6 (full 0): PSYoungGen total 229376K, used 141275K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 196608K, 55% used [0xffffffff50400000,0xffffffff56dfc9b8,0xffffffff5c400000) from space 32768K, 99% used [0xffffffff5c400000,0xffffffff5e3fa4f0,0xffffffff5e400000) to space 32768K, 0% used [0xffffffff5e400000,0xffffffff5e400000,0xffffffff60400000) ParOldGen total 262144K, used 7883K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 3% used [0xffffffff20400000,0xffffffff20bb2d60,0xffffffff30400000) Metaspace used 20800K, capacity 21130K, committed 21248K, reserved 1069056K class space used 2429K, capacity 2511K, committed 2560K, reserved 1048576K Event: 8.030 GC heap after Heap after GC invocations=6 (full 0): PSYoungGen total 204800K, used 15734K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 172032K, 0% used [0xffffffff50400000,0xffffffff50400000,0xffffffff5ac00000) from space 32768K, 48% used [0xffffffff5e400000,0xffffffff5f35da70,0xffffffff60400000) to space 45056K, 0% used [0xffffffff5ac00000,0xffffffff5ac00000,0xffffffff5d800000) ParOldGen total 262144K, used 7891K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 3% used [0xffffffff20400000,0xffffffff20bb4d60,0xffffffff30400000) Metaspace used 20800K, capacity 21130K, committed 21248K, reserved 1069056K class space used 2429K, capacity 2511K, committed 2560K, reserved 1048576K } Event: 8.030 GC heap before {Heap before GC invocations=7 (full 1): PSYoungGen total 204800K, used 15734K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 172032K, 0% used [0xffffffff50400000,0xffffffff50400000,0xffffffff5ac00000) from space 32768K, 48% used [0xffffffff5e400000,0xffffffff5f35da70,0xffffffff60400000) to space 45056K, 0% used [0xffffffff5ac00000,0xffffffff5ac00000,0xffffffff5d800000) ParOldGen total 262144K, used 7891K [0xffffffff20400000, 0xffffffff30400000, 0xffffffff50400000) object space 262144K, 3% used [0xffffffff20400000,0xffffffff20bb4d60,0xffffffff30400000) Metaspace used 20800K, capacity 21130K, committed 21248K, reserved 1069056K class space used 2429K, capacity 2511K, committed 2560K, reserved 1048576K Event: 8.140 GC heap after Heap after GC invocations=7 (full 1): PSYoungGen total 204800K, used 0K [0xffffffff50400000, 0xffffffff60400000, 0xffffffff60400000) eden space 172032K, 0% used [0xffffffff50400000,0xffffffff50400000,0xffffffff5ac00000) from space 32768K, 0% used [0xffffffff5e400000,0xffffffff5e400000,0xffffffff60400000) to space 45056K, 0% used [0xffffffff5ac00000,0xffffffff5ac00000,0xffffffff5d800000) ParOldGen total 270336K, used 15829K [0xffffffff20400000, 0xffffffff30c00000, 0xffffffff50400000) object space 270336K, 5% used [0xffffffff20400000,0xffffffff213755b8,0xffffffff30c00000) Metaspace used 20800K, capacity 21130K, committed 21248K, reserved 1069056K class space used 2429K, capacity 2511K, committed 2560K, reserved 1048576K }

Deoptimization events (10 events): Event: 8.677 Thread 0x0000000100f5e800 Uncommon trap: reason=class_check action=maybe_recompile pc=0xffffffff6aa16d18 method=com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next()I @ 24 Event: 8.677 Thread 0x0000000100f5e800 Uncommon trap: reason=class_check action=maybe_recompile pc=0xffffffff6aa16d18 method=com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next()I @ 24 Event: 8.677 Thread 0x0000000100f5e800 Uncommon trap: reason=class_check action=maybe_recompile pc=0xffffffff6aa16d18 method=com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next()I @ 24 Event: 8.677 Thread 0x0000000100f5e800 Uncommon trap: reason=class_check action=maybe_recompile pc=0xffffffff6aa16d18 method=com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next()I @ 24 Event: 8.680 Thread 0x0000000100f5e800 Uncommon trap: reason=unstable_if action=reinterpret pc=0xffffffff6a9f70c8 method=com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next()I @ 1140 Event: 8.855 Thread 0x0000000100f5e800 Uncommon trap: reason=unstable_if action=reinterpret pc=0xffffffff6acdb34c method=org.springframework.asm.ClassReader.readCode(Lorg/springframework/asm/MethodVisitor;Lorg/springframework/asm/Context;I)V @ 799 Event: 8.856 Thread 0x0000000100f5e800 Uncommon trap: reason=unstable_if action=reinterpret pc=0xffffffff6a82b238 method=java.util.concurrent.ConcurrentHashMap.get(Ljava/lang/Object;)Ljava/lang/Object; @ 76 Event: 9.104 Thread 0x0000000100f5e800 Uncommon trap: reason=class_check action=maybe_recompile pc=0xffffffff6aa625b4 method=java.util.regex.Pattern$BmpCharProperty.match(Ljava/util/regex/Matcher;ILjava/lang/CharSequence;)Z @ 31 Event: 9.104 Thread 0x0000000100f5e800 Uncommon trap: reason=class_check action=maybe_recompile pc=0xffffffff6aa625b4 method=java.util.regex.Pattern$BmpCharProperty.match(Ljava/util/regex/Matcher;ILjava/lang/CharSequence;)Z @ 31 Event: 9.234 Thread 0x0000000100f5e800 Uncommon trap: reason=unstable_if action=reinterpret pc=0xffffffff6a45360c method=java.lang.CharacterDataLatin1.digit(II)I @ 82

Internal exceptions (10 events): Event: 8.588 Thread 0x0000000100f5e800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/data/hadoop/hbase/HbaseAccessorBeanInfo> (0xffffffff53796bc8) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/classfile/systemDictionary.cpp, li Event: 8.590 Thread 0x0000000100f5e800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/data/hadoop/hbase/HbaseAccessorCustomizer> (0xffffffff53802640) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/classfile/systemDictionary.cpp, Event: 8.593 Thread 0x0000000100f5e800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/data/hadoop/hbase/HbaseTemplateCustomizer> (0xffffffff53876fe0) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/classfile/systemDictionary.cpp, Event: 8.598 Thread 0x0000000100f5e800 Exception <a 'java/lang/ClassNotFoundException': com/navercorp/pinpoint/common/hbase/HbaseTemplate2Customizer> (0xffffffff539001f8) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/classfile/systemDictionary.cpp, l Event: 8.610 Thread 0x0000000100f5e800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/data/hadoop/hbase/HbaseConfigurationFactoryBeanBeanInfo> (0xffffffff539fe588) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/classfile/systemDi Event: 8.612 Thread 0x0000000100f5e800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/data/hadoop/hbase/HbaseConfigurationFactoryBeanCustomizer> (0xffffffff53a7e108) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/classfile/system Event: 9.103 Thread 0x0000000100f5e800 Exception <a 'java/lang/reflect/InvocationTargetException'> (0xffffffff55f08130) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/runtime/reflection.cpp, line 1092] Event: 9.198 Thread 0x0000000100f5e800 Exception <a 'java/lang/NoSuchFieldError': method resolution failed> (0xffffffff56221680) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/prims/methodHandles.cpp, line 1146] Event: 9.202 Thread 0x0000000100f5e800 Exception <a 'java/lang/NoSuchFieldError': method resolution failed> (0xffffffff5622f4e0) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/prims/methodHandles.cpp, line 1146] Event: 9.246 Thread 0x0000000100f5e800 Exception <a 'java/io/IOException'> (0xffffffff562bc4a0) thrown at [/HUDSON/workspace/8-2-build-solaris-sparcv9/jdk8u121/8372/hotspot/src/share/vm/prims/jni.cpp, line 709]

Events (10 events): Event: 9.381 loading class sun/net/InetAddressCachePolicy Event: 9.381 loading class sun/net/InetAddressCachePolicy done Event: 9.382 loading class sun/net/InetAddressCachePolicy$1 Event: 9.382 loading class sun/net/InetAddressCachePolicy$1 done Event: 9.382 loading class sun/net/InetAddressCachePolicy$2 Event: 9.382 loading class sun/net/InetAddressCachePolicy$2 done Event: 9.382 loading class java/net/InetAddress$CacheEntry Event: 9.382 loading class java/net/InetAddress$CacheEntry done Event: 9.386 loading class java/lang/NegativeArraySizeException Event: 9.386 loading class java/lang/NegativeArraySizeException done

Dynamic libraries: 0x0000000100000000 /app/jdk/jdk1.8.0_121/bin/java 0xffffffff7f000000 /app/jdk/jdk1.8.0_121/bin/../lib/sparcv9/jli/libjli.so 0xffffffff7f100000 /lib/64/libthread.so.1 0xffffffff7ed00000 /lib/64/libdl.so.1 0xffffffff7ea00000 /lib/64/libc.so.1 0xffffffff7e800000 /platform/SUNW,SPARC-Enterprise/lib/sparcv9/libc_psr.so.1 0xffffffff7d000000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/server/libjvm.so 0xffffffff7e400000 /lib/64/libsocket.so.1 0xffffffff7e600000 /usr/lib/64/libsched.so.1 0xffffffff7ce00000 /lib/64/libm.so.1 0xffffffff7cc00000 /usr/lib/64/libCrun.so.1 0xffffffff7ca00000 /lib/64/libdoor.so.1 0xffffffff7c800000 /usr/lib/64/libdemangle.so.1 0xffffffff7c600000 /lib/64/libkstat.so.1 0xffffffff7c400000 /lib/64/libnsl.so.1 0xffffffff7c200000 /lib/64/libm.so.2 0xffffffff7c000000 /lib/64/libscf.so.1 0xffffffff7be00000 /lib/64/libuutil.so.1 0xffffffff7bc00000 /lib/64/libgen.so.1 0xffffffff7ba00000 /lib/64/libmd.so.1 0xffffffff7b800000 /lib/64/libmp.so.2 0xffffffff7b200000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libverify.so 0xffffffff7b000000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libjava.so 0xffffffff7aa00000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libzip.so 0xffffffff64800000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libmanagement.so 0xffffffff64600000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libnet.so 0xffffffff64400000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libnio.so 0xffffffff64200000 /lib/64/librt.so.1 0xffffffff64000000 /lib/64/libsendfile.so.1 0xffffffff63d00000 /lib/64/libaio.so.1 0xffffffff63600000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libj2ucrypto.so 0xffffffff63300000 /usr/lib/64/libsoftcrypto.so 0xffffffff63100000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libj2pkcs11.so 0xffffffff62f00000 /usr/lib/sparcv9/libpkcs11.so 0xffffffff62d00000 /usr/lib/64/libcryptoutil.so.1 0xffffffff62b00000 /usr/lib/security/64/pkcs11_softtoken_extra.so 0xffffffff62900000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libsunec.so 0xffffffff60b00000 /app/jdk/jdk1.8.0_121/jre/lib/sparcv9/libjaas_unix.so

VM Arguments: jvm_args: -Djava.util.logging.config.file=/app/pinpoint-collector/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.awt.headless=true -Xms512m -Xmx1024m -XX:NewSize=256m -XX:MaxNewSize=256m -XX:+DisableExplicitGC -Djdk.tls.ephemeralDHKeySize=2048 -Djava.protocol.handler.pkgs=org.apache.catalina.webresources -Denv=product -Denv.servername=pinpoint-collector -Dcatalina.base=/app/pinpoint-collector -Dcatalina.home=/app/tomcat -Djava.io.tmpdir=/app/pinpoint-collector/temp java_command: org.apache.catalina.startup.Bootstrap start java_class_path (initial): /app/tomcat/bin/bootstrap.jar:/app/tomcat/bin/tomcat-juli.jar Launcher Type: SUN_STANDARD

Environment Variables: JAVA_HOME=/app/jdk/jdk1.8.0_121 PATH=/bin:/usr/local/bin:/usr/local/mysql/bin:/usr/bin:/usr/sbin:/usr/ccs/bin:/usr/openwin/bin:/usr/sfw/bin:/usr/platform/SUNW,SPARC-Enterprise/sbin:/app/hbase/bin LD_LIBRARY_PATH=/usr/lib:/usr/local/lib:/usr/openwin/lib:/usr/openwin/lib:/usr/openwin/bin:/usr/dt/lib:/usr/ucblib:/usr/local/xml/lib:/usr/local/ssl/lib:/usr/local/db/lib:/usr/platform/SUNW,SPARC-Enterprise/lib:/usr/local/lib:/usr/lib:/usr/ucblib:/usr/ccs/lib SHELL=/bin/ksh

Signal Handlers: SIGSEGV: [libjvm.so+0xdeeeb8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO SIGBUS: [libjvm.so+0xdeeeb8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO SIGFPE: [libjvm.so+0xb808b8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO SIGPIPE: [libjvm.so+0xb808b8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO SIGXFSZ: [libjvm.so+0xb808b8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO SIGILL: [libjvm.so+0xb808b8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none SIGUSR2: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none SIGQUIT: [libjvm.so+0xb7a458], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART SIGHUP: [libjvm.so+0xb7a458], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART SIGINT: SIG_IGN, sa_mask[0]=00000000000000000000000000000000, sa_flags=none SIGTERM: [libjvm.so+0xb7a458], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART SIG39: [libjvm.so+0xb80908], sa_mask[0]=00000000000000000000000000000000, sa_flags=SA_SIGINFO SIG40: [libjvm.so+0xb808b8], sa_mask[0]=11111111011111111111110111111111, sa_flags=SA_RESTART|SA_SIGINFO

--------------- S Y S T E M ---------------

OS: Oracle Solaris 10 8/11 s10s_u10wos_17b SPARC Copyright (c) 1983, 2011, Oracle and/or its affiliates. All rights reserved. Assembled 23 August 2011

uname:SunOS 5.10 Generic_147440-01 sun4u (T2 libthread) rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity load average:0.19 0.14 0.74

CPU:total 4 v9, popc, vis1, vis2, sparc64

Memory: 8k page, physical 8388608k(5896864k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.121-b13) for solaris-sparc JRE (1.8.0_121-b13), built on Dec 13 2016 00:00:43 by "java_re" with Sun Studio 12u1

time: Wed Apr 19 15:08:56 2017 elapsed time: 9 seconds (0d 0h 0m 9s)

=============

Description

Environment

Additional Info

emeroad commented 7 years ago
  1. 별도의 offline install 은 제공하지 않습니다.
  2. SPARC JDK와 hbase가 잘 맞지 않는듯합니다.
    • hbase lib가 unsafe를 사용하여 value assign할때 jvm crash가 발생하는데, JVM버그로 보입니다. SPARC 엔지니어에게 문의해보시거나, linux에 설치 하길 권장합니다.

https://www.cloudera.com/downloads/manager/5-11-0.html cloudera의 지원 OS에 SPARC & solaris 은 존재하지 않기 때문에, HBase측에서도 버그에 대한 우회책을 제공할 가능성이 낮아 보입니다.

emeroad commented 7 years ago

Related Issues: http://stackoverflow.com/questions/16847319/cassandra-on-solaris-10-64-bit-crashing-with-unsafe-getlong