apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.23k stars 3.58k forks source link

[Bug] expireTimeOfIncompleteChunkedMessage(1, TimeUnit.MILLISECONDS) has bug #18158

Closed startjava closed 1 year ago

startjava commented 2 years ago

Search before asking

Version

2.10.2

Minimal reproduce step

@RequestMapping("sendMessage2")
public String sendMessage2() throws IOException, PulsarAdminException {
    int sendMessageValueSize = 1024 * 1024 * 12;
    int writeByteCount = 0;
    ByteArrayOutputStream bteArrayOutputStream = new ByteArrayOutputStream();
    while (writeByteCount <= sendMessageValueSize) {
        byte[] byteArray = "我是火星人".getBytes("utf-8");
        bteArrayOutputStream.write(byteArray);
        writeByteCount = writeByteCount + byteArray.length;
    }
    System.out.println(writeByteCount);

    String messageValue = new String(bteArrayOutputStream.toByteArray(), "utf-8") + " 结束了!";
    for (int i = 0; i < 10; i++) {
        producer.send(messageValue);
    }
    System.out.println(messageValue);
    List<? extends PublisherStats> publishers = pulsarAdmin.topics().getStats(myTopic1).getPublishers();
    for (int i = 0; i < publishers.size(); i++) {
        PublisherStats publisherStats = publishers.get(i);
        System.out.println("getProducerName=" + publisherStats.getProducerName() + " getChunkedMessageRate=" + publisherStats.getChunkedMessageRate());
    }
    return "成功生产2";
}

send big 12MB message

(1)http://localhost:8085/sendMessage2 (2)consumer console print info: C:\jdk1.8\bin\java.exe -XX:TieredStopAtLevel=1 -noverify -Dspring.output.ansi.enabled=always -Dcom.sun.management.jmxremote -Dspring.jmx.enabled=true -Dspring.liveBeansView.mbeanDomain -Dspring.application.admin.enabled=true -javaagent:C:\ideaIU-2022.2.win\lib\idea_rt.jar=61157:C:\ideaIU-2022.2.win\bin -Dfile.encoding=UTF-8 -classpath C:\jdk1.8\jre\lib\charsets.jar;C:\jdk1.8\jre\lib\deploy.jar;C:\jdk1.8\jre\lib\ext\access-bridge-64.jar;C:\jdk1.8\jre\lib\ext\cldrdata.jar;C:\jdk1.8\jre\lib\ext\dnsns.jar;C:\jdk1.8\jre\lib\ext\jaccess.jar;C:\jdk1.8\jre\lib\ext\jfxrt.jar;C:\jdk1.8\jre\lib\ext\localedata.jar;C:\jdk1.8\jre\lib\ext\nashorn.jar;C:\jdk1.8\jre\lib\ext\sunec.jar;C:\jdk1.8\jre\lib\ext\sunjce_provider.jar;C:\jdk1.8\jre\lib\ext\sunmscapi.jar;C:\jdk1.8\jre\lib\ext\sunpkcs11.jar;C:\jdk1.8\jre\lib\ext\zipfs.jar;C:\jdk1.8\jre\lib\javaws.jar;C:\jdk1.8\jre\lib\jce.jar;C:\jdk1.8\jre\lib\jfr.jar;C:\jdk1.8\jre\lib\jfxswt.jar;C:\jdk1.8\jre\lib\jsse.jar;C:\jdk1.8\jre\lib\management-agent.jar;C:\jdk1.8\jre\lib\plugin.jar;C:\jdk1.8\jre\lib\resources.jar;C:\jdk1.8\jre\lib\rt.jar;C:\Users\Administrator\Desktop\Pulsar_Java_Client\chunking-consumer\target\classes;C:\mvn_repository\org\springframework\boot\spring-boot-starter-web\2.7.1\spring-boot-starter-web-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot-starter\2.7.1\spring-boot-starter-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot\2.7.1\spring-boot-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot-autoconfigure\2.7.1\spring-boot-autoconfigure-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot-starter-logging\2.7.1\spring-boot-starter-logging-2.7.1.jar;C:\mvn_repository\ch\qos\logback\logback-classic\1.2.11\logback-classic-1.2.11.jar;C:\mvn_repository\ch\qos\logback\logback-core\1.2.11\logback-core-1.2.11.jar;C:\mvn_repository\org\apache\logging\log4j\log4j-to-slf4j\2.17.2\log4j-to-slf4j-2.17.2.jar;C:\mvn_repository\org\apache\logging\log4j\log4j-api\2.17.2\log4j-api-2.17.2.jar;C:\mvn_repository\jakarta\annotation\jakarta.annotation-api\1.3.5\jakarta.annotation-api-1.3.5.jar;C:\mvn_repository\org\springframework\spring-core\5.3.21\spring-core-5.3.21.jar;C:\mvn_repository\org\springframework\spring-jcl\5.3.21\spring-jcl-5.3.21.jar;C:\mvn_repository\org\yaml\snakeyaml\1.30\snakeyaml-1.30.jar;C:\mvn_repository\org\springframework\boot\spring-boot-starter-json\2.7.1\spring-boot-starter-json-2.7.1.jar;C:\mvn_repository\com\fasterxml\jackson\core\jackson-databind\2.13.3\jackson-databind-2.13.3.jar;C:\mvn_repository\com\fasterxml\jackson\core\jackson-annotations\2.13.3\jackson-annotations-2.13.3.jar;C:\mvn_repository\com\fasterxml\jackson\core\jackson-core\2.13.3\jackson-core-2.13.3.jar;C:\mvn_repository\com\fasterxml\jackson\datatype\jackson-datatype-jdk8\2.13.3\jackson-datatype-jdk8-2.13.3.jar;C:\mvn_repository\com\fasterxml\jackson\datatype\jackson-datatype-jsr310\2.13.3\jackson-datatype-jsr310-2.13.3.jar;C:\mvn_repository\com\fasterxml\jackson\module\jackson-module-parameter-names\2.13.3\jackson-module-parameter-names-2.13.3.jar;C:\mvn_repository\org\springframework\boot\spring-boot-starter-tomcat\2.7.1\spring-boot-starter-tomcat-2.7.1.jar;C:\mvn_repository\org\apache\tomcat\embed\tomcat-embed-core\9.0.64\tomcat-embed-core-9.0.64.jar;C:\mvn_repository\org\apache\tomcat\embed\tomcat-embed-el\9.0.64\tomcat-embed-el-9.0.64.jar;C:\mvn_repository\org\apache\tomcat\embed\tomcat-embed-websocket\9.0.64\tomcat-embed-websocket-9.0.64.jar;C:\mvn_repository\org\springframework\spring-web\5.3.21\spring-web-5.3.21.jar;C:\mvn_repository\org\springframework\spring-beans\5.3.21\spring-beans-5.3.21.jar;C:\mvn_repository\org\springframework\spring-webmvc\5.3.21\spring-webmvc-5.3.21.jar;C:\mvn_repository\org\springframework\spring-aop\5.3.21\spring-aop-5.3.21.jar;C:\mvn_repository\org\springframework\spring-context\5.3.21\spring-context-5.3.21.jar;C:\mvn_repository\org\springframework\spring-expression\5.3.21\spring-expression-5.3.21.jar;C:\mvn_repository\org\apache\pulsar\pulsar-client-all\2.10.2\pulsar-client-all-2.10.2.jar;C:\mvn_repository\org\apache\pulsar\pulsar-client-api\2.10.2\pulsar-client-api-2.10.2.jar;C:\mvn_repository\org\apache\pulsar\bouncy-castle-bc\2.10.2\bouncy-castle-bc-2.10.2-pkg.jar;C:\mvn_repository\org\bouncycastle\bcpkix-jdk15on\1.69\bcpkix-jdk15on-1.69.jar;C:\mvn_repository\org\bouncycastle\bcprov-jdk15on\1.69\bcprov-jdk15on-1.69.jar;C:\mvn_repository\org\bouncycastle\bcutil-jdk15on\1.69\bcutil-jdk15on-1.69.jar;C:\mvn_repository\org\bouncycastle\bcprov-ext-jdk15on\1.69\bcprov-ext-jdk15on-1.69.jar;C:\mvn_repository\org\slf4j\slf4j-api\1.7.36\slf4j-api-1.7.36.jar;C:\mvn_repository\javax\validation\validation-api\2.0.1.Final\validation-api-2.0.1.Final.jar;C:\mvn_repository\net\jcip\jcip-annotations\1.0\jcip-annotations-1.0.jar;C:\mvn_repository\org\apache\pulsar\pulsar-client-admin-api\2.10.2\pulsar-client-admin-api-2.10.2.jar;C:\mvn_repository\jakarta\ws\rs\jakarta.ws.rs-api\2.1.6\jakarta.ws.rs-api-2.1.6.jar;C:\mvn_repository\jakarta\xml\bind\jakarta.xml.bind-api\2.3.3\jakarta.xml.bind-api-2.3.3.jar;C:\mvn_repository\jakarta\activation\jakarta.activation-api\1.2.2\jakarta.activation-api-1.2.2.jar;C:\mvn_repository\javax\xml\bind\jaxb-api\2.3.1\jaxb-api-2.3.1.jar;C:\mvn_repository\com\sun\activation\javax.activation\1.2.0\javax.activation-1.2.0.jar;C:\mvn_repository\org\slf4j\jul-to-slf4j\1.7.36\jul-to-slf4j-1.7.36.jar;C:\mvn_repository\org\apache\pulsar\pulsar-package-core\2.10.2\pulsar-package-core-2.10.2.jar;C:\mvn_repository\com\google\guava\guava\31.0.1-jre\guava-31.0.1-jre.jar;C:\mvn_repository\com\google\guava\failureaccess\1.0.1\failureaccess-1.0.1.jar;C:\mvn_repository\com\google\guava\listenablefuture\9999.0-empty-to-avoid-conflict-with-guava\listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar;C:\mvn_repository\com\google\code\findbugs\jsr305\3.0.2\jsr305-3.0.2.jar;C:\mvn_repository\org\checkerframework\checker-qual\3.12.0\checker-qual-3.12.0.jar;C:\mvn_repository\com\google\errorprone\error_prone_annotations\2.7.1\error_prone_annotations-2.7.1.jar;C:\mvn_repository\com\google\j2objc\j2objc-annotations\1.3\j2objc-annotations-1.3.jar;C:\mvn_repository\com\google\code\gson\gson\2.9.0\gson-2.9.0.jar;C:\mvn_repository\org\apache\commons\commons-lang3\3.12.0\commons-lang3-3.12.0.jar;C:\mvn_repository\com\beust\jcommander\1.78\jcommander-1.78.jar com.ghy.www.Application

. _ _ /\ / '_ () \ \ \ \ ( ( )\ | ' | '| | ' \/ ` | \ \ \ \ \/ _)| |)| | | | | || (| | ) ) ) ) ' |__| .|| ||| |\, | / / / / =========|_|==============|__/=//// :: Spring Boot :: (v2.7.1)

2022-10-22 13:15:27.763 INFO 16828 --- [ main] com.ghy.www.Application : Starting Application using Java 1.8.0_351 on DESKTOP-5DJML06 with PID 16828 (C:\Users\Administrator\Desktop\Pulsar_Java_Client\chunking-consumer\target\classes started by Administrator in C:\Users\Administrator\Desktop\Pulsar_Java_Client) 2022-10-22 13:15:27.767 INFO 16828 --- [ main] com.ghy.www.Application : No active profile set, falling back to 1 default profile: "default" 2022-10-22 13:15:28.745 INFO 16828 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8086 (http) 2022-10-22 13:15:28.753 INFO 16828 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-10-22 13:15:28.754 INFO 16828 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.64] 2022-10-22 13:15:28.910 INFO 16828 --- [ main] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-10-22 13:15:28.910 INFO 16828 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 1079 ms 2022-10-22 13:15:30.891 INFO 16828 --- [r-client-io-1-1] o.a.pulsar.client.impl.ConnectionPool : [[id: 0x86f62746, L:/192.168.3.188:61177 - R:/192.168.3.84:6650]] Connected to server 2022-10-22 13:15:31.045 INFO 16828 --- [r-client-io-1-1] o.a.p.c.impl.ConsumerStatsRecorderImpl : Starting Pulsar consumer status recorder with config: {"topicNames":["myTopic1"],"topicsPattern":null,"subscriptionName":"myTopic1_subscriptionName1","subscriptionType":"Exclusive","subscriptionProperties":null,"subscriptionMode":"Durable","receiverQueueSize":1000,"acknowledgementsGroupTimeMicros":100000,"negativeAckRedeliveryDelayMicros":60000000,"maxTotalReceiverQueueSizeAcrossPartitions":50000,"consumerName":null,"ackTimeoutMillis":0,"tickDurationMillis":1000,"priorityLevel":0,"maxPendingChunkedMessage":10,"autoAckOldestChunkedMessageOnQueueFull":false,"expireTimeOfIncompleteChunkedMessageMillis":1,"cryptoFailureAction":"FAIL","properties":{},"readCompacted":false,"subscriptionInitialPosition":"Latest","patternAutoDiscoveryPeriod":60,"regexSubscriptionMode":"PersistentOnly","deadLetterPolicy":null,"retryEnable":false,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"replicateSubscriptionState":false,"resetIncludeHead":false,"keySharedPolicy":null,"batchIndexAckEnabled":false,"ackReceiptEnabled":false,"poolMessages":false,"startPaused":false,"maxPendingChuckedMessage":10} 2022-10-22 13:15:31.055 INFO 16828 --- [r-client-io-1-1] o.a.p.c.impl.ConsumerStatsRecorderImpl : Pulsar client config: {"serviceUrl":"pulsar://192.168.3.84:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"useTcpNoDelay":true,"useTls":false,"tlsTrustCertsFilePath":"","tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":null,"tlsTrustStorePassword":null,"tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":67108864,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null} 2022-10-22 13:15:31.067 INFO 16828 --- [r-client-io-1-1] o.a.pulsar.client.impl.ConnectionPool : [[id: 0xe2e0a970, L:/192.168.3.188:61178 - R:/192.168.3.84:6650]] Connected to server 2022-10-22 13:15:31.068 INFO 16828 --- [r-client-io-1-1] org.apache.pulsar.client.impl.ClientCnx : [id: 0xe2e0a970, L:/192.168.3.188:61178 - R:/192.168.3.84:6650] Connected through proxy to target broker at localhost:6650 2022-10-22 13:15:31.071 INFO 16828 --- [r-client-io-1-1] o.a.pulsar.client.impl.ConsumerImpl : [myTopic1][myTopic1_subscriptionName1] Subscribing to topic on cnx [id: 0xe2e0a970, L:/192.168.3.188:61178 - R:/192.168.3.84:6650], consumerId 0 2022-10-22 13:15:31.080 INFO 16828 --- [r-client-io-1-1] o.a.pulsar.client.impl.ConsumerImpl : [myTopic1][myTopic1_subscriptionName1] Subscribed to topic on /192.168.3.84:6650 -- consumer: 0 2022-10-22 13:15:31.380 INFO 16828 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8086 (http) with context path '' 2022-10-22 13:15:31.392 INFO 16828 --- [ main] com.ghy.www.Application : Started Application in 4.163 seconds (JVM running for 5.195) 2022-10-22 13:15:35.553 WARN 16828 --- [r-client-io-1-1] c.s.circe.checksum.Crc32cIntChecksum : Failed to load Circe JNI library. Falling back to Java based CRC32c provider 2022-10-22 13:15:35.576 INFO 16828 --- [nt-internal-4-1] o.a.pulsar.client.impl.ConsumerImpl : Removing chunk message-id 987:154:-1 #

A fatal error has been detected by the Java Runtime Environment:

#

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000005c95d567, pid=16828, tid=0x0000000000004ad8

#

JRE version: Java(TM) SE Runtime Environment (8.0_351-b10) (build 1.8.0_351-b10)

Java VM: Java HotSpot(TM) 64-Bit Server VM (25.351-b10 mixed mode windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x26d567]

#

Failed to write core dump. Minidumps are not enabled by default on client versions of Windows

#

An error report file with more information is saved as:

C:\Users\Administrator\Desktop\Pulsar_Java_Client\hs_err_pid16828.log

#

If you would like to submit a bug report, please visit:

http://bugreport.java.com/bugreport/crash.jsp

#

Process finished with exit code 1 (3)#

A fatal error has been detected by the Java Runtime Environment:

#

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x000000005c95d567, pid=16828, tid=0x0000000000004ad8

#

JRE version: Java(TM) SE Runtime Environment (8.0_351-b10) (build 1.8.0_351-b10)

Java VM: Java HotSpot(TM) 64-Bit Server VM (25.351-b10 mixed mode windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x26d567]

#

Failed to write core dump. Minidumps are not enabled by default on client versions of Windows

#

If you would like to submit a bug report, please visit:

http://bugreport.java.com/bugreport/crash.jsp

#

--------------- T H R E A D ---------------

Current thread (0x000001f479399800): JavaThread "pulsar-client-io-1-1" [_thread_in_vm, id=19160, stack(0x000000d894200000,0x000000d894300000)]

siginfo: ExceptionCode=0xc0000005, writing address 0x000001f47e5ceffe

Registers: RAX=0x000000000000e6ab, RBX=0x000001f479399800, RCX=0x000001f47e5ceffe, RDX=0x000001f47ddbc072 RSP=0x000000d8942fde38, RBP=0x0000000000100000, RSI=0x0000000000000000, RDI=0x0000000000000000 R8 =0x000000000007dfe0, R9 =0x000001f47e4d3040, R10=0x000001f40001a002, R11=0x000000005c91afe0 R12=0x0000000000000000, R13=0x000001f475f7eaf0, R14=0x0000000000000000, R15=0x000001f47dcc00b6 RIP=0x000000005c95d567, EFLAGS=0x0000000000010202

Top of Stack: (sp=0x000000d8942fde38) 0x000000d8942fde38: 000000005c8ce417 0000000000000001 0x000000d8942fde48: 000000005c82729c 000001f479399800 0x000000d8942fde58: 000000005c7b9cc0 000000000000006c 0x000000d8942fde68: 000000d8942fdef9 000001f479399800 0x000000d8942fde78: 000000d8942fdf98 000001f475f7eaf0 0x000000d8942fde88: 000001f40001a02e 000000d8942fdf38 0x000000d8942fde98: 0000000000000020 000001f4000083fd 0x000000d8942fdea8: 000000005c7f516b 0000000000000000 0x000000d8942fdeb8: 000001f47e4d3040 0000000000100000 0x000000d8942fdec8: 000001f47c772768 000001f47c772768 0x000000d8942fded8: 000001f47c778480 000000071769c848 0x000000d8942fdee8: 000000005c7f579c 000000d8942fdf90 0x000000d8942fdef8: 000000d8942fdef8 0000000000000000 0x000000d8942fdf08: 000000d8942fdf98 000001f475fac708 0x000000d8942fdf18: 0000000000000000 000001f475f7eaf0 0x000000d8942fdf28: 0000000000000000 000000d8942fdf58

Instructions: (pc=0x000000005c95d567) 0x000000005c95d547: fe 49 8d 48 ff 49 8d 0c 49 4a 8d 14 42 4d 85 c0 0x000000005c95d557: 74 27 0f 1f 80 00 00 00 00 0f b7 02 48 8d 52 fe 0x000000005c95d567: 66 89 01 48 8d 49 fe 49 83 e8 01 75 ec c3 48 8b 0x000000005c95d577: d1 49 8b c9 e9 3a 40 33 00 c3 cc cc cc cc cc cc

Register to memory mapping:

RAX=0x000000000000e6ab is an unknown value RBX=0x000001f479399800 is a thread RCX=0x000001f47e5ceffe is an unknown value RDX=0x000001f47ddbc072 is an unknown value RSP=0x000000d8942fde38 is pointing into the stack for thread: 0x000001f479399800 RBP=0x0000000000100000 is an unknown value RSI=0x0000000000000000 is an unknown value RDI=0x0000000000000000 is an unknown value R8 =0x000000000007dfe0 is an unknown value R9 =0x000001f47e4d3040 is an unknown value R10=0x000001f40001a002 is at code_begin+962 in an Interpreter codelet method entry point (kind = native) [0x000001f400019c40, 0x000001f40001a6e0] 2720 bytes R11=0x000000005c91afe0 is an unknown value R12=0x0000000000000000 is an unknown value R13={method} {0x000001f475f7eaf8} 'copyMemory' '(Ljava/lang/Object;JLjava/lang/Object;JJ)V' in 'sun/misc/Unsafe' R14=0x0000000000000000 is an unknown value R15=0x000001f47dcc00b6 is an unknown value

Stack: [0x000000d894200000,0x000000d894300000], sp=0x000000d8942fde38, free space=1015k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [jvm.dll+0x26d567]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.misc.Unsafe.copyMemory(Ljava/lang/Object;JLjava/lang/Object;JJ)V+0 j sun.misc.Unsafe.copyMemory(JJJ)V+7 j org.apache.pulsar.shade.io.netty.util.internal.PlatformDependent0.copyMemoryWithSafePointPolling(JJJ)V+24 j org.apache.pulsar.shade.io.netty.util.internal.PlatformDependent0.copyMemory(JJJ)V+12 j org.apache.pulsar.shade.io.netty.util.internal.PlatformDependent.copyMemory(JJJ)V+4 j org.apache.pulsar.shade.io.netty.buffer.UnsafeByteBufUtil.setBytes(Lorg/apache/pulsar/shade/io/netty/buffer/AbstractByteBuf;JILorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;II)V+86 j org.apache.pulsar.shade.io.netty.buffer.PooledUnsafeDirectByteBuf.setBytes(ILorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;II)Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;+11 j org.apache.pulsar.shade.io.netty.buffer.AbstractByteBuf.writeBytes(Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;II)Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;+14 j org.apache.pulsar.shade.io.netty.buffer.AbstractByteBuf.writeBytes(Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;I)Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;+18 j org.apache.pulsar.shade.io.netty.buffer.AbstractByteBuf.writeBytes(Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;)Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;+6 j org.apache.pulsar.client.impl.ConsumerImpl.processMessageChunk(Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;Lorg/apache/pulsar/common/api/proto/MessageMetadata;Lorg/apache/pulsar/client/impl/MessageIdImpl;Lorg/apache/pulsar/common/api/proto/MessageIdData;Lorg/apache/pulsar/client/impl/ClientCnx;)Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;+361 j org.apache.pulsar.client.impl.ConsumerImpl.messageReceived(Lorg/apache/pulsar/common/api/proto/CommandMessage;Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;Lorg/apache/pulsar/client/impl/ClientCnx;)V+489 j org.apache.pulsar.client.impl.ClientCnx.handleMessage(Lorg/apache/pulsar/common/api/proto/CommandMessage;Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;)V+73 j org.apache.pulsar.common.protocol.PulsarDecoder.channelRead(Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;Ljava/lang/Object;)V+698 J 3439 C1 org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Ljava/lang/Object;)V (40 bytes) @ 0x000001f4006a792c [0x000001f4006a7740+0x1ec] J 3438 C1 org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Lorg/apache/pulsar/shade/io/netty/channel/AbstractChannelHandlerContext;Ljava/lang/Object;)V (54 bytes) @ 0x000001f4006a6fdc [0x000001f4006a6e60+0x17c] j org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(Ljava/lang/Object;)Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;+7 j org.apache.pulsar.shade.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;Lorg/apache/pulsar/shade/io/netty/handler/codec/CodecOutputList;I)V+13 j org.apache.pulsar.shade.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;Ljava/util/List;I)V+13 j org.apache.pulsar.shade.io.netty.handler.codec.ByteToMessageDecoder.callDecode(Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;Lorg/apache/pulsar/shade/io/netty/buffer/ByteBuf;Ljava/util/List;)V+24 j org.apache.pulsar.shade.io.netty.handler.codec.ByteToMessageDecoder.channelRead(Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;Ljava/lang/Object;)V+79 J 3439 C1 org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Ljava/lang/Object;)V (40 bytes) @ 0x000001f4006a792c [0x000001f4006a7740+0x1ec] J 3438 C1 org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Lorg/apache/pulsar/shade/io/netty/channel/AbstractChannelHandlerContext;Ljava/lang/Object;)V (54 bytes) @ 0x000001f4006a6fdc [0x000001f4006a6e60+0x17c] j org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(Ljava/lang/Object;)Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;+7 j org.apache.pulsar.shade.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(Lorg/apache/pulsar/shade/io/netty/channel/ChannelHandlerContext;Ljava/lang/Object;)V+2 J 3439 C1 org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Ljava/lang/Object;)V (40 bytes) @ 0x000001f4006a792c [0x000001f4006a7740+0x1ec] J 3438 C1 org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(Lorg/apache/pulsar/shade/io/netty/channel/AbstractChannelHandlerContext;Ljava/lang/Object;)V (54 bytes) @ 0x000001f4006a6fdc [0x000001f4006a6e60+0x17c] j org.apache.pulsar.shade.io.netty.channel.DefaultChannelPipeline.fireChannelRead(Ljava/lang/Object;)Lorg/apache/pulsar/shade/io/netty/channel/ChannelPipeline;+5 j org.apache.pulsar.shade.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read()V+159 j org.apache.pulsar.shade.io.netty.channel.nio.NioEventLoop.processSelectedKey(Ljava/nio/channels/SelectionKey;Lorg/apache/pulsar/shade/io/netty/channel/nio/AbstractNioChannel;)V+113 j org.apache.pulsar.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized()V+51 j org.apache.pulsar.shade.io.netty.channel.nio.NioEventLoop.processSelectedKeys()V+8 j org.apache.pulsar.shade.io.netty.channel.nio.NioEventLoop.run()V+263 j org.apache.pulsar.shade.io.netty.util.concurrent.SingleThreadEventExecutor$4.run()V+44 j org.apache.pulsar.shade.io.netty.util.internal.ThreadExecutorMap$2.run()V+11 j org.apache.pulsar.shade.io.netty.util.concurrent.FastThreadLocalRunnable.run()V+4 j java.lang.Thread.run()V+11 v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread ) 0x000001f47b0bf000 JavaThread "pulsar-client-internal-4-1" [_thread_blocked, id=24668, stack(0x000000d895500000,0x000000d895600000)] 0x000001f47b0b9000 JavaThread "pulsar-client-scheduled-5-1" [_thread_blocked, id=24956, stack(0x000000d895400000,0x000000d895500000)] 0x000001f47b0b7800 JavaThread "RMI TCP Connection(3)-172.30.48.1" daemon [_thread_in_native, id=1960, stack(0x000000d895300000,0x000000d895400000)] 0x000001f47b0be800 JavaThread "RMI TCP Connection(2)-172.30.48.1" daemon [_thread_in_native, id=38760, stack(0x000000d895200000,0x000000d895300000)] 0x000001f47b0bd800 JavaThread "DestroyJavaVM" [_thread_blocked, id=28832, stack(0x000000d892400000,0x000000d892500000)] 0x000001f47b0b8800 JavaThread "http-nio-8086-Acceptor" daemon [_thread_in_native, id=36048, stack(0x000000d895100000,0x000000d895200000)] 0x000001f47b0ba000 JavaThread "http-nio-8086-Poller" daemon [_thread_in_native, id=25920, stack(0x000000d895000000,0x000000d895100000)] 0x000001f47b0b7000 JavaThread "http-nio-8086-exec-10" daemon [_thread_blocked, id=21024, stack(0x000000d894f00000,0x000000d895000000)] 0x000001f47afbf000 JavaThread "http-nio-8086-exec-9" daemon [_thread_blocked, id=2684, stack(0x000000d894e00000,0x000000d894f00000)] 0x000001f47afc0000 JavaThread "http-nio-8086-exec-8" daemon [_thread_blocked, id=37800, stack(0x000000d894d00000,0x000000d894e00000)] 0x000001f47afbe800 JavaThread "http-nio-8086-exec-7" daemon [_thread_blocked, id=27996, stack(0x000000d894c00000,0x000000d894d00000)] 0x000001f47afbb800 JavaThread "http-nio-8086-exec-6" daemon [_thread_blocked, id=21812, stack(0x000000d894b00000,0x000000d894c00000)] 0x000001f47afbd000 JavaThread "http-nio-8086-exec-5" daemon [_thread_blocked, id=7628, stack(0x000000d894a00000,0x000000d894b00000)] 0x000001f47afba000 JavaThread "http-nio-8086-exec-4" daemon [_thread_blocked, id=27064, stack(0x000000d894900000,0x000000d894a00000)] 0x000001f47afbc000 JavaThread "http-nio-8086-exec-3" daemon [_thread_blocked, id=14128, stack(0x000000d894800000,0x000000d894900000)] 0x000001f47afba800 JavaThread "http-nio-8086-exec-2" daemon [_thread_blocked, id=38692, stack(0x000000d894700000,0x000000d894800000)] 0x000001f47afbd800 JavaThread "http-nio-8086-exec-1" daemon [_thread_blocked, id=1568, stack(0x000000d894600000,0x000000d894700000)] 0x000001f47afb9000 JavaThread "pulsar-timer-6-1" [_thread_blocked, id=20664, stack(0x000000d894500000,0x000000d894600000)] 0x000001f47a898000 JavaThread "AsyncHttpClient-timer-8-1" [_thread_blocked, id=34228, stack(0x000000d894300000,0x000000d894400000)] =>0x000001f479399800 JavaThread "pulsar-client-io-1-1" [_thread_in_vm, id=19160, stack(0x000000d894200000,0x000000d894300000)] 0x000001f47aad6800 JavaThread "Thread-6" daemon [_thread_in_native, id=21856, stack(0x000000d894100000,0x000000d894200000)] 0x000001f47a9db000 JavaThread "container-0" [_thread_blocked, id=22824, stack(0x000000d894000000,0x000000d894100000)] 0x000001f47a9da000 JavaThread "Catalina-utility-2" [_thread_blocked, id=35540, stack(0x000000d893f00000,0x000000d894000000)] 0x000001f47a9d9000 JavaThread "Catalina-utility-1" [_thread_blocked, id=38324, stack(0x000000d893e00000,0x000000d893f00000)] 0x000001f4798eb800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=5996, stack(0x000000d893d00000,0x000000d893e00000)] 0x000001f47a5ac000 JavaThread "RMI TCP Connection(1)-172.30.48.1" daemon [_thread_in_native, id=20888, stack(0x000000d893c00000,0x000000d893d00000)] 0x000001f479478800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=21420, stack(0x000000d893a00000,0x000000d893b00000)] 0x000001f47919d800 JavaThread "Service Thread" daemon [_thread_blocked, id=38904, stack(0x000000d893900000,0x000000d893a00000)] 0x000001f47916f000 JavaThread "C1 CompilerThread3" daemon [_thread_blocked, id=32584, stack(0x000000d893800000,0x000000d893900000)] 0x000001f479166000 JavaThread "C2 CompilerThread2" daemon [_thread_blocked, id=23220, stack(0x000000d893700000,0x000000d893800000)] 0x000001f479161000 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=36884, stack(0x000000d893600000,0x000000d893700000)] 0x000001f47915a000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=1884, stack(0x000000d893500000,0x000000d893600000)] 0x000001f479158800 JavaThread "Monitor Ctrl-Break" daemon [_thread_in_native, id=4024, stack(0x000000d893400000,0x000000d893500000)] 0x000001f4769d9000 JavaThread "Attach Listener" daemon [_thread_blocked, id=22288, stack(0x000000d893300000,0x000000d893400000)] 0x000001f478de3800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=2432, stack(0x000000d893200000,0x000000d893300000)] 0x000001f4769a7800 JavaThread "Finalizer" daemon [_thread_blocked, id=26972, stack(0x000000d893100000,0x000000d893200000)] 0x000001f47699f800 JavaThread "Reference Handler" daemon [_thread_blocked, id=22568, stack(0x000000d893000000,0x000000d893100000)]

Other Threads: 0x000001f476976800 VMThread [stack: 0x000000d892f00000,0x000000d893000000] [id=1692] 0x000001f479484000 WatcherThread [stack: 0x000000d893b00000,0x000000d893c00000] [id=33588]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

heap address: 0x00000005c2e00000, size: 8146 MB, Compressed Oops mode: Zero based, Oop shift amount: 3 Narrow klass base: 0x0000000000000000, Narrow klass shift: 3 Compressed class space size: 1073741824 Address: 0x00000007c0000000

Heap: PSYoungGen total 152576K, used 102104K [0x0000000716500000, 0x0000000723c00000, 0x00000007c0000000) eden space 131072K, 77% used [0x0000000716500000,0x000000071c8b6268,0x000000071e500000) from space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) to space 21504K, 0% used [0x0000000722700000,0x0000000722700000,0x0000000723c00000) ParOldGen total 375296K, used 14826K [0x00000005c2e00000, 0x00000005d9c80000, 0x0000000716500000) object space 375296K, 3% used [0x00000005c2e00000,0x00000005c3c7a9b0,0x00000005d9c80000) Metaspace used 42953K, capacity 45516K, committed 45696K, reserved 1089536K class space used 5451K, capacity 5937K, committed 6016K, reserved 1048576K

Card table byte_map: [0x000001f473480000,0x000001f474470000] byte_map_base: 0x000001f470669000

Marking Bits: (ParMarkBitMap*) 0x000000005ced8fd0 Begin Bits: [0x000001f40f000000, 0x000001f416f48000) End Bits: [0x000001f416f48000, 0x000001f41ee90000)

Polling page: 0x000001f471840000

CodeCache: size=245760Kb used=6836Kb max_used=6836Kb free=238923Kb bounds [0x000001f400000000, 0x000001f4006b0000, 0x000001f40f000000] total_blobs=4043 nmethods=3460 adapters=495 compilation: enabled

Compilation events (10 events): Event: 9.300 Thread 0x000001f47916f000 3456 1 org.apache.pulsar.shade.io.netty.channel.nio.AbstractNioChannel::unsafe (8 bytes) Event: 9.300 Thread 0x000001f47916f000 nmethod 3456 0x000001f4006ab850 code [0x000001f4006ab9a0, 0x000001f4006abb18] Event: 9.306 Thread 0x000001f47916f000 3457 1 org.apache.pulsar.shade.io.netty.util.internal.PlatformDependent::hasUnsafe (12 bytes) Event: 9.306 Thread 0x000001f47916f000 nmethod 3457 0x000001f4006abb90 code [0x000001f4006abce0, 0x000001f4006abdd8] Event: 9.361 Thread 0x000001f47916f000 3458 % 1 com.scurrilous.circe.crc.ReflectedIntCrc::resumeRaw @ 3 (41 bytes) Event: 9.361 Thread 0x000001f47916f000 nmethod 3458% 0x000001f4006ac690 code [0x000001f4006ac800, 0x000001f4006aca18] Event: 9.361 Thread 0x000001f47916f000 3459 1 com.scurrilous.circe.crc.ReflectedIntCrc::resumeRaw (41 bytes) Event: 9.362 Thread 0x000001f47916f000 nmethod 3459 0x000001f4006acbd0 code [0x000001f4006acd40, 0x000001f4006aced8] Event: 9.376 Thread 0x000001f47916f000 3460 1 org.apache.pulsar.shade.io.netty.buffer.AbstractPooledDerivedByteBuf::unwrap (5 bytes) Event: 9.377 Thread 0x000001f47916f000 nmethod 3460 0x000001f4006ad050 code [0x000001f4006ad1a0, 0x000001f4006ad2b8]

GC Heap History (10 events): Event: 1.951 GC heap before {Heap before GC invocations=1 (full 0): PSYoungGen total 152576K, used 128526K [0x0000000716500000, 0x0000000720f00000, 0x00000007c0000000) eden space 131072K, 98% used [0x0000000716500000,0x000000071e283b98,0x000000071e500000) from space 21504K, 0% used [0x000000071fa00000,0x000000071fa00000,0x0000000720f00000) to space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) ParOldGen total 348160K, used 0K [0x00000005c2e00000, 0x00000005d8200000, 0x0000000716500000) object space 348160K, 0% used [0x00000005c2e00000,0x00000005c2e00000,0x00000005d8200000) Metaspace used 20254K, capacity 21208K, committed 21296K, reserved 1067008K class space used 2667K, capacity 2894K, committed 2944K, reserved 1048576K Event: 1.963 GC heap after Heap after GC invocations=1 (full 0): PSYoungGen total 152576K, used 15563K [0x0000000716500000, 0x0000000720f00000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 72% used [0x000000071e500000,0x000000071f432d58,0x000000071fa00000) to space 21504K, 0% used [0x000000071fa00000,0x000000071fa00000,0x0000000720f00000) ParOldGen total 348160K, used 24K [0x00000005c2e00000, 0x00000005d8200000, 0x0000000716500000) object space 348160K, 0% used [0x00000005c2e00000,0x00000005c2e06000,0x00000005d8200000) Metaspace used 20254K, capacity 21208K, committed 21296K, reserved 1067008K class space used 2667K, capacity 2894K, committed 2944K, reserved 1048576K } Event: 1.963 GC heap before {Heap before GC invocations=2 (full 1): PSYoungGen total 152576K, used 15563K [0x0000000716500000, 0x0000000720f00000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 72% used [0x000000071e500000,0x000000071f432d58,0x000000071fa00000) to space 21504K, 0% used [0x000000071fa00000,0x000000071fa00000,0x0000000720f00000) ParOldGen total 348160K, used 24K [0x00000005c2e00000, 0x00000005d8200000, 0x0000000716500000) object space 348160K, 0% used [0x00000005c2e00000,0x00000005c2e06000,0x00000005d8200000) Metaspace used 20254K, capacity 21208K, committed 21296K, reserved 1067008K class space used 2667K, capacity 2894K, committed 2944K, reserved 1048576K Event: 1.990 GC heap after Heap after GC invocations=2 (full 1): PSYoungGen total 152576K, used 0K [0x0000000716500000, 0x0000000720f00000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) to space 21504K, 0% used [0x000000071fa00000,0x000000071fa00000,0x0000000720f00000) ParOldGen total 237056K, used 14841K [0x00000005c2e00000, 0x00000005d1580000, 0x0000000716500000) object space 237056K, 6% used [0x00000005c2e00000,0x00000005c3c7e7d0,0x00000005d1580000) Metaspace used 20254K, capacity 21208K, committed 21296K, reserved 1067008K class space used 2667K, capacity 2894K, committed 2944K, reserved 1048576K } Event: 3.899 GC heap before {Heap before GC invocations=3 (full 1): PSYoungGen total 152576K, used 131072K [0x0000000716500000, 0x0000000720f00000, 0x00000007c0000000) eden space 131072K, 100% used [0x0000000716500000,0x000000071e500000,0x000000071e500000) from space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) to space 21504K, 0% used [0x000000071fa00000,0x000000071fa00000,0x0000000720f00000) ParOldGen total 237056K, used 14841K [0x00000005c2e00000, 0x00000005d1580000, 0x0000000716500000) object space 237056K, 6% used [0x00000005c2e00000,0x00000005c3c7e7d0,0x00000005d1580000) Metaspace used 31760K, capacity 33600K, committed 33792K, reserved 1079296K class space used 4148K, capacity 4516K, committed 4608K, reserved 1048576K Event: 3.910 GC heap after Heap after GC invocations=3 (full 1): PSYoungGen total 152576K, used 14840K [0x0000000716500000, 0x0000000723600000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 69% used [0x000000071fa00000,0x000000072087e3c0,0x0000000720f00000) to space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) ParOldGen total 237056K, used 14849K [0x00000005c2e00000, 0x00000005d1580000, 0x0000000716500000) object space 237056K, 6% used [0x00000005c2e00000,0x00000005c3c807d0,0x00000005d1580000) Metaspace used 31760K, capacity 33600K, committed 33792K, reserved 1079296K class space used 4148K, capacity 4516K, committed 4608K, reserved 1048576K } Event: 4.351 GC heap before {Heap before GC invocations=4 (full 1): PSYoungGen total 152576K, used 42795K [0x0000000716500000, 0x0000000723600000, 0x00000007c0000000) eden space 131072K, 21% used [0x0000000716500000,0x000000071804c908,0x000000071e500000) from space 21504K, 69% used [0x000000071fa00000,0x000000072087e3c0,0x0000000720f00000) to space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) ParOldGen total 237056K, used 14849K [0x00000005c2e00000, 0x00000005d1580000, 0x0000000716500000) object space 237056K, 6% used [0x00000005c2e00000,0x00000005c3c807d0,0x00000005d1580000) Metaspace used 33541K, capacity 35412K, committed 35456K, reserved 1079296K class space used 4347K, capacity 4702K, committed 4736K, reserved 1048576K Event: 4.356 GC heap after Heap after GC invocations=4 (full 1): PSYoungGen total 152576K, used 8879K [0x0000000716500000, 0x0000000723c00000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 41% used [0x000000071e500000,0x000000071edabeb8,0x000000071fa00000) to space 21504K, 0% used [0x0000000722700000,0x0000000722700000,0x0000000723c00000) ParOldGen total 237056K, used 14857K [0x00000005c2e00000, 0x00000005d1580000, 0x0000000716500000) object space 237056K, 6% used [0x00000005c2e00000,0x00000005c3c827d0,0x00000005d1580000) Metaspace used 33541K, capacity 35412K, committed 35456K, reserved 1079296K class space used 4347K, capacity 4702K, committed 4736K, reserved 1048576K } Event: 4.356 GC heap before {Heap before GC invocations=5 (full 2): PSYoungGen total 152576K, used 8879K [0x0000000716500000, 0x0000000723c00000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 41% used [0x000000071e500000,0x000000071edabeb8,0x000000071fa00000) to space 21504K, 0% used [0x0000000722700000,0x0000000722700000,0x0000000723c00000) ParOldGen total 237056K, used 14857K [0x00000005c2e00000, 0x00000005d1580000, 0x0000000716500000) object space 237056K, 6% used [0x00000005c2e00000,0x00000005c3c827d0,0x00000005d1580000) Metaspace used 33541K, capacity 35412K, committed 35456K, reserved 1079296K class space used 4347K, capacity 4702K, committed 4736K, reserved 1048576K Event: 4.381 GC heap after Heap after GC invocations=5 (full 2): PSYoungGen total 152576K, used 0K [0x0000000716500000, 0x0000000723c00000, 0x00000007c0000000) eden space 131072K, 0% used [0x0000000716500000,0x0000000716500000,0x000000071e500000) from space 21504K, 0% used [0x000000071e500000,0x000000071e500000,0x000000071fa00000) to space 21504K, 0% used [0x0000000722700000,0x0000000722700000,0x0000000723c00000) ParOldGen total 375296K, used 14826K [0x00000005c2e00000, 0x00000005d9c80000, 0x0000000716500000) object space 375296K, 3% used [0x00000005c2e00000,0x00000005c3c7a9b0,0x00000005d9c80000) Metaspace used 33541K, capacity 35412K, committed 35456K, reserved 1079296K class space used 4347K, capacity 4702K, committed 4736K, reserved 1048576K }

Deoptimization events (0 events): No events

Classes redefined (0 events): No events

Internal exceptions (10 events): Event: 4.924 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/web/servlet/config/annotation/DelegatingWebMvcConfigurationCustomizer> (0x0000000719a90e78) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\v Event: 4.925 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/boot/autoconfigure/web/servlet/WebMvcAutoConfiguration$EnableWebMvcConfigurationCustomizer> (0x0000000719ab5260) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\290 Event: 4.926 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/context/ResourceLoaderAwareCustomizer> (0x0000000719adb020) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\classfile\systemDictionary.cpp Event: 4.926 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/beans/factory/AwareCustomizer> (0x0000000719aed528) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\classfile\systemDictionary.cpp, line 2 Event: 4.926 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/context/ApplicationContextAwareCustomizer> (0x0000000719b018e8) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\classfile\systemDictionary Event: 4.927 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/beans/factory/AwareCustomizer> (0x0000000719b14408) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\classfile\systemDictionary.cpp, line 2 Event: 4.927 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/web/context/ServletContextAwareCustomizer> (0x0000000719b28758) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\classfile\systemDictionary Event: 4.927 Thread 0x000001f471644800 Exception <a 'java/lang/ClassNotFoundException': org/springframework/beans/factory/AwareCustomizer> (0x0000000719b3acd8) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\classfile\systemDictionary.cpp, line 2 Event: 5.075 Thread 0x000001f471644800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.lambda$thenComparing$36697e65$1(Ljava/util/Comparator;Ljava/lang/Object;Ljava/lang/Object;)I> (0x000000071aa13a40) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hots Event: 5.091 Thread 0x000001f471644800 Exception <a 'java/lang/IncompatibleClassChangeError': Found class java.lang.Object, but interface was expected> (0x000000071abc1ad0) thrown at [C:\jenkins\workspace\8-2-build-windows-x64-cygwin\jdk8u351\2908\hotspot\src\share\vm\interpreter\linkResolver.

Events (10 events): Event: 9.378 loading class org/apache/pulsar/shade/io/netty/buffer/ByteBuf done Event: 9.378 loading class org/apache/pulsar/client/impl/ConsumerImpl$ChunkedMessageCtx Event: 9.378 loading class org/apache/pulsar/client/impl/ConsumerImpl$ChunkedMessageCtx done Event: 9.378 loading class org/apache/pulsar/shade/io/netty/buffer/ByteBuf Event: 9.378 loading class org/apache/pulsar/shade/io/netty/buffer/ByteBuf done Event: 9.379 loading class org/apache/pulsar/client/impl/ConsumerImpl$ChunkedMessageCtx$1 Event: 9.379 loading class org/apache/pulsar/client/impl/ConsumerImpl$ChunkedMessageCtx$1 done Event: 9.379 loading class org/apache/pulsar/client/impl/ConsumerImpl Event: 9.379 loading class org/apache/pulsar/client/impl/ConsumerImpl done Event: 9.379 Thread 0x000001f47b0bf000 Thread added: 0x000001f47b0bf000

Dynamic libraries: 0x00007ff7f8f90000 - 0x00007ff7f8fd7000 C:\jdk1.8\bin\java.exe 0x00007ffd68cd0000 - 0x00007ffd68ec8000 C:\WINDOWS\SYSTEM32\ntdll.dll 0x00007ffd676a0000 - 0x00007ffd6775d000 C:\WINDOWS\System32\KERNEL32.DLL 0x00007ffd66870000 - 0x00007ffd66b3e000 C:\WINDOWS\System32\KERNELBASE.dll 0x00007ffd689f0000 - 0x00007ffd68a9e000 C:\WINDOWS\System32\ADVAPI32.dll 0x00007ffd683b0000 - 0x00007ffd6844e000 C:\WINDOWS\System32\msvcrt.dll 0x00007ffd67030000 - 0x00007ffd670cc000 C:\WINDOWS\System32\sechost.dll 0x00007ffd66dd0000 - 0x00007ffd66ef5000 C:\WINDOWS\System32\RPCRT4.dll 0x00007ffd678f0000 - 0x00007ffd67a90000 C:\WINDOWS\System32\USER32.dll 0x00007ffd664f0000 - 0x00007ffd66512000 C:\WINDOWS\System32\win32u.dll 0x00007ffd67760000 - 0x00007ffd6778a000 C:\WINDOWS\System32\GDI32.dll 0x00007ffd66730000 - 0x00007ffd6683b000 C:\WINDOWS\System32\gdi32full.dll 0x00007ffd66b40000 - 0x00007ffd66bdd000 C:\WINDOWS\System32\msvcp_win.dll 0x00007ffd66be0000 - 0x00007ffd66ce0000 C:\WINDOWS\System32\ucrtbase.dll 0x00007ffd4d1b0000 - 0x00007ffd4d44a000 C:\WINDOWS\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.19041.1110_none_60b5254171f9507e\COMCTL32.dll 0x00007ffd66da0000 - 0x00007ffd66dd0000 C:\WINDOWS\System32\IMM32.DLL 0x00007ffd4b470000 - 0x00007ffd4b485000 C:\jdk1.8\jre\bin\vcruntime140.dll 0x00007ffd268a0000 - 0x00007ffd2693b000 C:\jdk1.8\jre\bin\msvcp140.dll 0x000000005c6f0000 - 0x000000005cf51000 C:\jdk1.8\jre\bin\server\jvm.dll 0x00007ffd67860000 - 0x00007ffd67868000 C:\WINDOWS\System32\PSAPI.DLL 0x00007ffd648a0000 - 0x00007ffd648c7000 C:\WINDOWS\SYSTEM32\WINMM.dll 0x00007ffd5b0a0000 - 0x00007ffd5b0aa000 C:\WINDOWS\SYSTEM32\VERSION.dll 0x00007ffd51ee0000 - 0x00007ffd51ee9000 C:\WINDOWS\SYSTEM32\WSOCK32.dll 0x00007ffd66000000 - 0x00007ffd6606b000 C:\WINDOWS\SYSTEM32\WS2_32.dll 0x00007ffd64c20000 - 0x00007ffd64c32000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll 0x00007ffd5b410000 - 0x00007ffd5b420000 C:\jdk1.8\jre\bin\verify.dll 0x00007ffd4a650000 - 0x00007ffd4a67b000 C:\jdk1.8\jre\bin\java.dll 0x00007ffd3a6a0000 - 0x00007ffd3a6d0000 C:\jdk1.8\jre\bin\instrument.dll 0x00007ffd4a630000 - 0x00007ffd4a648000 C:\jdk1.8\jre\bin\zip.dll 0x00007ffd67bc0000 - 0x00007ffd68303000 C:\WINDOWS\System32\SHELL32.dll 0x00007ffd63ee0000 - 0x00007ffd64675000 C:\WINDOWS\SYSTEM32\windows.storage.dll 0x00007ffd672e0000 - 0x00007ffd67634000 C:\WINDOWS\System32\combase.dll 0x00007ffd65d70000 - 0x00007ffd65da0000 C:\WINDOWS\SYSTEM32\Wldp.dll 0x00007ffd68aa0000 - 0x00007ffd68b4d000 C:\WINDOWS\System32\SHCORE.dll 0x00007ffd68b50000 - 0x00007ffd68ba5000 C:\WINDOWS\System32\shlwapi.dll 0x00007ffd663a0000 - 0x00007ffd663bf000 C:\WINDOWS\SYSTEM32\profapi.dll 0x00007ffd3f940000 - 0x00007ffd3f95a000 C:\ideaIU-2022.2.win\bin\breakgen64.dll 0x00007ffd5faa0000 - 0x00007ffd5fabc000 C:\jdk1.8\jre\bin\net.dll 0x00007ffd65b50000 - 0x00007ffd65bba000 C:\WINDOWS\system32\mswsock.dll 0x00007ffd65850000 - 0x00007ffd6591a000 C:\WINDOWS\SYSTEM32\DNSAPI.dll 0x00007ffd65810000 - 0x00007ffd6584b000 C:\WINDOWS\SYSTEM32\IPHLPAPI.DLL 0x00007ffd683a0000 - 0x00007ffd683a8000 C:\WINDOWS\System32\NSI.dll 0x00007ffd5edd0000 - 0x00007ffd5edda000 C:\Windows\System32\rasadhlp.dll 0x00007ffd5bc20000 - 0x00007ffd5bca0000 C:\WINDOWS\System32\fwpuclnt.dll 0x00007ffd66840000 - 0x00007ffd66867000 C:\WINDOWS\System32\bcrypt.dll 0x00007ffd505d0000 - 0x00007ffd505dd000 C:\jdk1.8\jre\bin\management.dll 0x00007ffd420e0000 - 0x00007ffd420f3000 C:\jdk1.8\jre\bin\nio.dll 0x00007ffd65db0000 - 0x00007ffd65dc8000 C:\WINDOWS\SYSTEM32\CRYPTSP.dll 0x00007ffd65480000 - 0x00007ffd654b4000 C:\WINDOWS\system32\rsaenh.dll 0x00007ffd66360000 - 0x00007ffd6638e000 C:\WINDOWS\SYSTEM32\USERENV.dll 0x00007ffd66460000 - 0x00007ffd664e2000 C:\WINDOWS\System32\bcryptprimitives.dll 0x00007ffd65ce0000 - 0x00007ffd65cec000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll 0x00007ffd5f520000 - 0x00007ffd5f537000 C:\WINDOWS\SYSTEM32\dhcpcsvc6.DLL 0x00007ffd5f400000 - 0x00007ffd5f41d000 C:\WINDOWS\SYSTEM32\dhcpcsvc.DLL 0x00007ffd4f840000 - 0x00007ffd4f857000 C:\WINDOWS\system32\napinsp.dll 0x00007ffd4f7d0000 - 0x00007ffd4f7eb000 C:\WINDOWS\system32\pnrpnsp.dll 0x00007ffd60db0000 - 0x00007ffd60dc5000 C:\WINDOWS\system32\wshbth.dll 0x00007ffd5f3e0000 - 0x00007ffd5f3fd000 C:\WINDOWS\system32\NLAapi.dll 0x00007ffd4f770000 - 0x00007ffd4f782000 C:\WINDOWS\System32\winrnr.dll 0x00007ffd3a670000 - 0x00007ffd3a694000 C:\jdk1.8\jre\bin\sunec.dll 0x00007ffd4b8c0000 - 0x00007ffd4b8cd000 C:\jdk1.8\jre\bin\sunmscapi.dll 0x00007ffd66520000 - 0x00007ffd66676000 C:\WINDOWS\System32\CRYPT32.dll 0x00007ffd65ec0000 - 0x00007ffd65ee7000 C:\WINDOWS\SYSTEM32\ncrypt.dll 0x00007ffd65e80000 - 0x00007ffd65ebb000 C:\WINDOWS\SYSTEM32\NTASN1.dll 0x00007ffd646b0000 - 0x00007ffd64894000 C:\WINDOWS\SYSTEM32\dbghelp.dll

VM Arguments: jvm_args: -XX:TieredStopAtLevel=1 -Xverify:none -Dspring.output.ansi.enabled=always -Dcom.sun.management.jmxremote -Dspring.jmx.enabled=true -Dspring.liveBeansView.mbeanDomain -Dspring.application.admin.enabled=true -javaagent:C:\ideaIU-2022.2.win\lib\idea_rt.jar=61157:C:\ideaIU-2022.2.win\bin -Dfile.encoding=UTF-8 java_command: com.ghy.www.Application java_class_path (initial): C:\jdk1.8\jre\lib\charsets.jar;C:\jdk1.8\jre\lib\deploy.jar;C:\jdk1.8\jre\lib\ext\access-bridge-64.jar;C:\jdk1.8\jre\lib\ext\cldrdata.jar;C:\jdk1.8\jre\lib\ext\dnsns.jar;C:\jdk1.8\jre\lib\ext\jaccess.jar;C:\jdk1.8\jre\lib\ext\jfxrt.jar;C:\jdk1.8\jre\lib\ext\localedata.jar;C:\jdk1.8\jre\lib\ext\nashorn.jar;C:\jdk1.8\jre\lib\ext\sunec.jar;C:\jdk1.8\jre\lib\ext\sunjce_provider.jar;C:\jdk1.8\jre\lib\ext\sunmscapi.jar;C:\jdk1.8\jre\lib\ext\sunpkcs11.jar;C:\jdk1.8\jre\lib\ext\zipfs.jar;C:\jdk1.8\jre\lib\javaws.jar;C:\jdk1.8\jre\lib\jce.jar;C:\jdk1.8\jre\lib\jfr.jar;C:\jdk1.8\jre\lib\jfxswt.jar;C:\jdk1.8\jre\lib\jsse.jar;C:\jdk1.8\jre\lib\management-agent.jar;C:\jdk1.8\jre\lib\plugin.jar;C:\jdk1.8\jre\lib\resources.jar;C:\jdk1.8\jre\lib\rt.jar;C:\Users\Administrator\Desktop\Pulsar_Java_Client\chunking-consumer\target\classes;C:\mvn_repository\org\springframework\boot\spring-boot-starter-web\2.7.1\spring-boot-starter-web-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot-starter\2.7.1\spring-boot-starter-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot\2.7.1\spring-boot-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot-autoconfigure\2.7.1\spring-boot-autoconfigure-2.7.1.jar;C:\mvn_repository\org\springframework\boot\spring-boot-starter-logging\2.7.1\spring-boot-starter-logging-2.7.1.jar;C:\mvn_repository\ch\qos\logback\logback-classic\1.2.11\logback-classic-1.2.11.jar;C:\mvn_repository\ch\qos\logback\logback-core\1.2.11\logback-core-1.2.11.jar;C:\mvn_repository\org\apache\logging\log4j\log4j-to-slf4j\2.17.2\log4j-to-slf4j-2.17.2.jar;C:\mvn_repository\org\apache\logging\log4j\log4j-api\2.17.2\log4j-api-2.17.2.jar;C:\mvn_repository\jakarta\annotation\jakarta.annotation-api\1.3.5\jakarta.annotation-api-1.3.5.jar;C:\mvn_repository\org\springframework\spring-core\5.3.21\spring-core-5.3.21.jar;C:\mvn_repository\org\springframework\spring-jcl\5.3.21\spring-jcl-5.3.21.jar;C:\mvn_repository\org\yaml\snakeyaml\ Launcher Type: SUN_STANDARD

Environment Variables: JAVA_HOME=C:\jdk1.8 PATH=C:\Oracle11G\product\11.2.0\dbhome_1\bin;C:\jdk1.8\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;C:\Program Files\Bandizip\;C:\nexus\nexus-3.37.0-01\bin;C:\Program Files\nodejs\;C:\Git\cmd;C:\apache-maven-3.8.4-bin\apache-maven-3.8.4\bin;C:\Program Files\MySQL\MySQL Server 8.0\bin;C:\Users\Administrator\AppData\Local\Microsoft\WindowsApps;C:\Users\Administrator\AppData\Roaming\npm USERNAME=Administrator OS=Windows_NT PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 158 Stepping 10, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 10 , 64 bit Build 19041 (10.0.19041.1889)

CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core) family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx

Memory: 4k page, physical 33359028k(13804664k free), swap 42247492k(5148248k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.351-b10) for windows-amd64 JRE (1.8.0_351-b10), built on Sep 15 2022 02:58:06 by "java_re" with MS VC++ 15.9 (VS2017)

time: Sat Oct 22 13:15:35 2022 timezone: Intel64 Family 6 Model 158 Stepping 10, GenuineIntel elapsed time: 9.395832 seconds (0d 0h 0m 9s)

What did you expect to see?

success remove chunk

What did you see instead?

?

Anything else?

No response

Are you willing to submit a PR?

github-actions[bot] commented 1 year ago

The issue had no activity for 30 days, mark with Stale label.

startjava commented 1 year ago

@codelipenghui
This bug caused the JVM to crash, which is quite serious.

github-actions[bot] commented 1 year ago

The issue had no activity for 30 days, mark with Stale label.

tisonkun commented 1 year ago

Do not how to reproduce. Please open a new issue with well-formatted log and reasoning.