search

alibaba / nacos

an easy-to-use dynamic service discovery, configuration and service management platform for building cloud native applications.
https://nacos.io
Apache License 2.0
30.06k stars 12.8k forks source link

nacos2x导致内存泄漏（nacos2x causes memory leaks） #6667

Closed TOP-LH closed 3 years ago

TOP-LH commented 3 years ago

nacos2x导致内存泄漏（nacos2x causes memory leaks）

  1. 版本信息

    1. JDK8
    2. Nacos 2.0.0-bugfix
    3. springboot 2.1.1.RELEASE

  2. pom坐标

    <?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
        xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
   <modelVersion>4.0.0</modelVersion>
   <parent>
       <groupId>org.springframework.boot</groupId>
       <artifactId>spring-boot-starter-parent</artifactId>
       <version>2.1.1.RELEASE</version>
       <relativePath/>
   </parent>

   <groupId>com.xxx</groupId>
   <artifactId>xxx</artifactId>
   <packaging>pom</packaging>
   <version>1.0-SNAPSHOT</version>

   <modules>
       <module>xxx-beans</module>
       <module>xxx-dao</module>
       <module>xxx-webservice</module>
       <module>xxx-proto-lib</module>
       <module>xxx-kingdee</module>
       <module>xxx-iservice</module>
       <module>xxx-service-impl</module>
       <module>xxx-web</module>
   </modules>

   <properties>
       <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
       <project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding>
       <java.version>1.8</java.version>

       <spring-boot.version>2.1.1.RELEASE</spring-boot.version>
       <spring-cloud.version>Greenwich.SR6</spring-cloud.version>
       <spring-cloud-alibaba.version>2.1.1.RELEASE</spring-cloud-alibaba.version>

       <mybatis.spring.boot.starter.version>1.3.2</mybatis.spring.boot.starter.version>
       <pagehelper.spring.boot.starter.version>1.2.5</pagehelper.spring.boot.starter.version>
       <lock4j-redis.version>2.2.1</lock4j-redis.version>
       <fastjson.version>1.2.47</fastjson.version>
       <druid.version>1.1.14</druid.version>
       <commons.io.version>2.5</commons.io.version>
       <commons.fileupload.version>1.3.3</commons.fileupload.version>
       <bitwalker.version>1.19</bitwalker.version>
       <jwt.version>0.9.0</jwt.version>
       <poi.version>3.17</poi.version>
       <oshi.version>3.9.1</oshi.version>
       <velocity.version>1.7</velocity.version>
       <cas.version>3.6.1</cas.version>
       <dubbo.version>2.7.3</dubbo.version>
       <hutool.version>5.7.5</hutool.version>
       <tk-mapper.version>2.1.5</tk-mapper.version>
       <knife4j.version>2.0.4</knife4j.version>
       <mockito.version>3.11.2</mockito.version>
   </properties>

   <dependencyManagement>
       <dependencies>
           <!-- Spring Boot -->
           <dependency>
               <groupId>org.springframework.boot</groupId>
               <artifactId>spring-boot-dependencies</artifactId>
               <version>${spring-boot.version}</version>
               <type>pom</type>
               <scope>import</scope>
           </dependency>

           <!-- Spring Cloud -->
           <dependency>
               <groupId>org.springframework.cloud</groupId>
               <artifactId>spring-cloud-dependencies</artifactId>
               <version>${spring-cloud.version}</version>
               <type>pom</type>
               <scope>import</scope>
           </dependency>

           <!-- Spring Cloud Alibaba -->
           <dependency>
               <groupId>com.alibaba.cloud</groupId>
               <artifactId>spring-cloud-alibaba-dependencies</artifactId>
               <version>${spring-cloud-alibaba.version}</version>
               <type>pom</type>
               <scope>import</scope>
           </dependency>
       </dependencies>
   </dependencyManagement>

   <dependencies>
       <!--springboot 基础类-->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter</artifactId>
       </dependency>

       <!-- SpringBoot 测试 -->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-test</artifactId>
           <scope>test</scope>
       </dependency>

       <!--SpringBoot 监控数据-->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-actuator</artifactId>
       </dependency>

       <!-- SpringBoot 拦截器 -->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-aop</artifactId>
       </dependency>

       <!-- SpringBoot Web容器 -->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-web</artifactId>
           <!--排除tomcat使用undertow-->
           <exclusions>
               <exclusion>
                   <groupId>org.springframework.boot</groupId>
                   <artifactId>spring-boot-starter-tomcat</artifactId>
               </exclusion>
           </exclusions>
       </dependency>

       <!--undertow 启动容器-->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-undertow</artifactId>
       </dependency>

       <!-- redis 缓存操作 -->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-data-redis</artifactId>
       </dependency>

       <!--springcloud 和 nacos 集成-->
       <!--注册中心-->
       <dependency>
           <groupId>com.alibaba.cloud</groupId>
           <artifactId>spring-cloud-starter-alibaba-nacos-discovery</artifactId>
           <exclusions>
               <exclusion>
                   <groupId>com.alibaba.nacos</groupId>
                   <artifactId>nacos-client</artifactId>
               </exclusion>
           </exclusions>
       </dependency>
       <!--配置中心-->
       <dependency>
           <groupId>com.alibaba.cloud</groupId>
           <artifactId>spring-cloud-starter-alibaba-nacos-config</artifactId>
           <exclusions>
               <exclusion>
                   <groupId>com.alibaba.nacos</groupId>
                   <artifactId>nacos-client</artifactId>
               </exclusion>
           </exclusions>
       </dependency>
       <dependency>
           <groupId>com.alibaba.nacos</groupId>
           <artifactId>nacos-client</artifactId>
           <version>2.0.0</version>
       </dependency>

       <!--配置文件自动装配-->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-configuration-processor</artifactId>
           <optional>true</optional>
       </dependency>

       <!-- pool 对象池 -->
       <dependency>
           <groupId>org.apache.commons</groupId>
           <artifactId>commons-pool2</artifactId>
       </dependency>

       <!-- Mysql驱动包 -->
       <dependency>
           <groupId>mysql</groupId>
           <artifactId>mysql-connector-java</artifactId>
           <scope>runtime</scope>
       </dependency>

       <!-- pagehelper 分页插件 -->
       <dependency>
           <groupId>com.github.pagehelper</groupId>
           <artifactId>pagehelper-spring-boot-starter</artifactId>
           <version>${pagehelper.spring.boot.starter.version}</version>
       </dependency>

       <!--  分布式锁  -->
       <!--  https://gitee.com/baomidou/lock4j  -->
       <dependency>
           <groupId>com.baomidou</groupId>
           <artifactId>lock4j-redis-template-spring-boot-starter</artifactId>
           <version>${lock4j-redis.version}</version>
       </dependency>

       <!--阿里数据库连接池 -->
       <dependency>
           <groupId>com.alibaba</groupId>
           <artifactId>druid-spring-boot-starter</artifactId>
           <version>${druid.version}</version>
       </dependency>

       <!--常用工具类 -->
       <dependency>
           <groupId>org.apache.commons</groupId>
           <artifactId>commons-lang3</artifactId>
       </dependency>

       <!--io常用工具类 -->
       <dependency>
           <groupId>commons-io</groupId>
           <artifactId>commons-io</artifactId>
           <version>${commons.io.version}</version>
       </dependency>

       <!--文件上传工具类 -->
       <dependency>
           <groupId>commons-fileupload</groupId>
           <artifactId>commons-fileupload</artifactId>
           <version>${commons.fileupload.version}</version>
           <exclusions>
               <exclusion>
                   <artifactId>commons-io</artifactId>
                   <groupId>commons-io</groupId>
               </exclusion>
           </exclusions>
       </dependency>

       <!-- 解析客户端操作系统、浏览器等 -->
       <dependency>
           <groupId>eu.bitwalker</groupId>
           <artifactId>UserAgentUtils</artifactId>
           <version>${bitwalker.version}</version>
       </dependency>

       <!-- 阿里JSON解析器 -->
       <dependency>
           <groupId>com.alibaba</groupId>
           <artifactId>fastjson</artifactId>
           <version>${fastjson.version}</version>
       </dependency>

       <!--Spring框架基本的核心工具-->
       <dependency>
           <groupId>org.springframework</groupId>
           <artifactId>spring-context-support</artifactId>
       </dependency>

       <!--导出pdf 开始-->
       <dependency>
           <groupId>com.itextpdf</groupId>
           <artifactId>itextpdf</artifactId>
           <version>5.5.13</version>
       </dependency>
       <dependency>
           <groupId>com.itextpdf</groupId>
           <artifactId>itext-asian</artifactId>
           <version>5.2.0</version>
       </dependency>
       <!--导出pdf 结束-->

       <!--Token生成与解析-->
       <dependency>
           <groupId>io.jsonwebtoken</groupId>
           <artifactId>jjwt</artifactId>
           <version>${jwt.version}</version>
       </dependency>

       <!-- 接口文档 -->
       <dependency>
           <groupId>com.github.xiaoymin</groupId>
           <artifactId>knife4j-spring-boot-starter</artifactId>
           <version>${knife4j.version}</version>
       </dependency>

       <!-- 获取系统信息 -->
       <dependency>
           <groupId>com.github.oshi</groupId>
           <artifactId>oshi-core</artifactId>
           <version>${oshi.version}</version>
       </dependency>

       <dependency>
           <groupId>net.java.dev.jna</groupId>
           <artifactId>jna</artifactId>
       </dependency>

       <dependency>
           <groupId>net.java.dev.jna</groupId>
           <artifactId>jna-platform</artifactId>
       </dependency>

       <!--excel工具-->
       <dependency>
           <groupId>com.alibaba</groupId>
           <artifactId>easyexcel</artifactId>
           <version>2.2.5</version>
       </dependency>

       <!--velocity代码生成使用模板 -->
       <dependency>
           <groupId>org.apache.velocity</groupId>
           <artifactId>velocity</artifactId>
           <version>${velocity.version}</version>
       </dependency>

       <dependency>
           <groupId>org.jasig.cas.client</groupId>
           <artifactId>cas-client-support-springboot</artifactId>
           <version>${cas.version}</version>
       </dependency>

       <!-- Dubbo Spring Boot Starter -->
       <dependency>
           <groupId>org.apache.dubbo</groupId>
           <artifactId>dubbo-spring-boot-starter</artifactId>
           <version>${dubbo.version}</version>
       </dependency>
       <dependency>
           <groupId>org.apache.dubbo</groupId>
           <artifactId>dubbo-registry-nacos</artifactId>
           <version>${dubbo.version}</version>
       </dependency>
       <!--Dubbo end-->

       <dependency>
           <groupId>org.springframework.kafka</groupId>
           <artifactId>spring-kafka</artifactId>
       </dependency>

       <!--日志异步-->
       <dependency>
           <groupId>com.lmax</groupId>
           <artifactId>disruptor</artifactId>
           <version>3.4.2</version>
       </dependency>

       <!--简化get、set方法-->
       <dependency>
           <groupId>org.projectlombok</groupId>
           <artifactId>lombok</artifactId>
       </dependency>

       <!--grpc 开始-->
       <dependency>
           <groupId>io.grpc</groupId>
           <artifactId>grpc-netty-shaded</artifactId>
           <version>1.14.0</version>
       </dependency>
       <dependency>
           <groupId>io.grpc</groupId>
           <artifactId>grpc-protobuf</artifactId>
           <version>1.14.0</version>
       </dependency>
       <dependency>
           <groupId>io.grpc</groupId>
           <artifactId>grpc-stub</artifactId>
           <version>1.14.0</version>
       </dependency>
       <dependency>
           <groupId>com.google.protobuf</groupId>
           <artifactId>protobuf-java-util</artifactId>
           <version>3.7.1</version>
           <exclusions>
               <exclusion>
                   <groupId>com.google.errorprone</groupId>
                   <artifactId>error_prone_annotations</artifactId>
               </exclusion>
           </exclusions>
       </dependency>
       <!--grpc 结束-->

       <!--webservice 开始-->
       <dependency>
           <groupId>org.springframework.boot</groupId>
           <artifactId>spring-boot-starter-web-services</artifactId>
       </dependency>
       <!--webseriver tomcat整合-->
       <dependency>
           <groupId>org.apache.cxf</groupId>
           <artifactId>cxf-spring-boot-starter-jaxws</artifactId>
           <version>3.3.4</version>
       </dependency>
       <dependency>
           <groupId>org.apache.axis</groupId>
           <artifactId>axis</artifactId>
           <version>1.4</version>
       </dependency>
       <dependency>
           <groupId>javax.xml.rpc</groupId>
           <artifactId>javax.xml.rpc-api</artifactId>
           <version>1.1.1</version>
       </dependency>
       <!--webservice commons-discovery-->
       <dependency>
           <groupId>commons-discovery</groupId>
           <artifactId>commons-discovery</artifactId>
           <version>0.2</version>
       </dependency>
       <!--webservice wsdl-->
       <dependency>
           <groupId>javax.wsdl</groupId>
           <artifactId>wsdl4j</artifactId>
           <version>1.6.2</version>
       </dependency>
       <!--webservice webserviceutils-->
       <dependency>
           <groupId>org.eclipse.jst</groupId>
           <artifactId>webserviceutils</artifactId>
           <version>1.0</version>
       </dependency>
       <!--webservice end-->

       <!--百度SDK-->
       <dependency>
           <groupId>com.baidu.aip</groupId>
           <artifactId>java-sdk</artifactId>
           <version>4.15.1</version>
           <exclusions>
               <exclusion>
                   <artifactId>slf4j-simple</artifactId>
                   <groupId>org.slf4j</groupId>
               </exclusion>
           </exclusions>
       </dependency>

       <!--minio 文件服务器-->
       <dependency>
           <groupId>com.gitee.pear-admin</groupId>
           <artifactId>minio-spring-boot-starter</artifactId>
           <version>master-SNAPSHOT</version>
       </dependency>

       <!-- bean 工具类 -->
       <dependency>
           <groupId>commons-beanutils</groupId>
           <artifactId>commons-beanutils</artifactId>
           <version>1.9.4</version>
       </dependency>

       <!--工具包-->
       <dependency>
           <groupId>cn.hutool</groupId>
           <artifactId>hutool-all</artifactId>
           <version>${hutool.version}</version>
       </dependency>

       <!-- https://mvnrepository.com/artifact/tk.mybatis/mapper-spring-boot-starter-->
       <dependency>
           <groupId>tk.mybatis</groupId>
           <artifactId>mapper-spring-boot-starter</artifactId>
           <version>${tk-mapper.version}</version>
       </dependency>

       <!--二维码-->
       <dependency>
           <groupId>com.google.zxing</groupId>
           <artifactId>core</artifactId>
           <version>3.3.3</version>
       </dependency>

       <!-- https://mvnrepository.com/artifact/org.mockito/mockito-core  -->
       <dependency>
           <groupId>org.mockito</groupId>
           <artifactId>mockito-core</artifactId>
           <version>${mockito.version}</version>
           <scope>test</scope>
       </dependency>
   </dependencies>

</project>

  3. 如何重现

    将nacos-client改为2X版本以上之后，请求任何一个mybatis方法都会内存泄漏

  4. 报错信息

    1. hs_err_pid7596.log

      #
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00007ffd62c769a0, pid=7596, tid=0x0000000000000268
#
# JRE version: OpenJDK Runtime Environment (8.0-b10) (build 1.8.0-262-b10)
# Java VM: OpenJDK 64-Bit Server VM (25.71-b10 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  0x00007ffd62c769a0
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x0000000028b89000):  JavaThread "XNIO-1 task-2" [_thread_in_native, id=616, stack(0x00000000007c0000,0x00000000008c0000)]

siginfo: ExceptionCode=0xc0000005, ExceptionInformation=0x0000000000000008 0x00007ffd62c769a0

Registers:
RAX=0x00007ffd62c769a0, RBX=0x000000003e8cdd50, RCX=0x0000000028b891e0, RDX=0x00000000008b9cb8
RSP=0x00000000008b9c38, RBP=0x00000000008b9ca8, RSI=0x0000000000200031, RDI=0x00000006c2c65fd8
R8 =0x0000000000000017, R9 =0x00000000329a4bc0, R10=0x0000000002c51b04, R11=0x00000000631b5920
R12=0x0000000000000000, R13=0x000000003e8cdd50, R14=0x00000000008b9cc0, R15=0x0000000028b89000
RIP=0x00007ffd62c769a0, EFLAGS=0x0000000000010202

Top of Stack: (sp=0x00000000008b9c38)
0x00000000008b9c38:   0000000002c51b30 0000000028b89000
0x00000000008b9c48:   000000003e8cdd50 0000000000200031
0x00000000008b9c58:   0000000028b89000 0000000002c51502
0x00000000008b9c68:   00000000008b9c68 000000003e8cdd50
0x00000000008b9c78:   00000000008b9cc0 000000003e8ce0e0
0x00000000008b9c88:   0000000000000000 000000003e8cdd50
0x00000000008b9c98:   0000000000000000 00000000008b9cc8
0x00000000008b9ca8:   00000000008b9d08 0000000002c37b80
0x00000000008b9cb8:   00000007b4a52e48 0000000002c47796
0x00000000008b9cc8:   00000000008b9cc8 000000003e8cdf37
0x00000000008b9cd8:   00000000008b9d20 000000003e8ce0e0
0x00000000008b9ce8:   0000000000000000 000000003e8cdfb0
0x00000000008b9cf8:   00000000008b9cc8 00000000008b9d18
0x00000000008b9d08:   00000000008b9d68 0000000002c37910
0x00000000008b9d18:   0000000000000000 00000007b4a52ed0
0x00000000008b9d28:   00000000008b9d28 000000003e8c4b8b 

Instructions: (pc=0x00007ffd62c769a0)
0x00007ffd62c76980:   
[error occurred during error reporting (printing registers, top of stack, instructions near pc), id 0xc0000005]

Register to memory mapping:

RAX=0x00007ffd62c769a0 is an unknown value
RBX={method} {0x000000003e8cdd58} 'aprMajorVersion' '()I' in 'io/grpc/netty/shaded/io/netty/internal/tcnative/Library'
RCX=0x0000000028b891e0 is an unknown value
RDX=0x00000000008b9cb8 is pointing into the stack for thread: 0x0000000028b89000
RSP=0x00000000008b9c38 is pointing into the stack for thread: 0x0000000028b89000
RBP=0x00000000008b9ca8 is pointing into the stack for thread: 0x0000000028b89000
RSI=0x0000000000200031 is an unknown value
RDI=0x00000006c2c65fd8 is an oop
ch.qos.logback.classic.Level 
- klass: 'ch/qos/logback/classic/Level'
R8 =0x0000000000000017 is an unknown value
R9 =0x00000000329a4bc0 is an unknown value
R10=0x0000000002c51b04 is at code_begin+1700 in an Interpreter codelet
method entry point (kind = native)  [0x0000000002c51460, 0x0000000002c52540]  4320 bytes
R11=0x00000000631b5920 is an unknown value
R12=0x0000000000000000 is an unknown value
R13={method} {0x000000003e8cdd58} 'aprMajorVersion' '()I' in 'io/grpc/netty/shaded/io/netty/internal/tcnative/Library'
R14=0x00000000008b9cc0 is pointing into the stack for thread: 0x0000000028b89000
R15=0x0000000028b89000 is a thread

Stack: [0x00000000007c0000,0x00000000008c0000],  sp=0x00000000008b9c38,  free space=999k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  0x00007ffd62c769a0

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  io.grpc.netty.shaded.io.netty.internal.tcnative.Library.aprMajorVersion()I+0
j  io.grpc.netty.shaded.io.netty.internal.tcnative.Library.initialize(Ljava/lang/String;Ljava/lang/String;)Z+31
j  io.grpc.netty.shaded.io.netty.handler.ssl.OpenSsl.initializeTcNative(Ljava/lang/String;)Z+3
j  io.grpc.netty.shaded.io.netty.handler.ssl.OpenSsl.<clinit>()V+240
v  ~StubRoutines::call_stub
j  io.grpc.netty.shaded.io.grpc.netty.GrpcSslContexts.defaultSslProvider()Lio/grpc/netty/shaded/io/netty/handler/ssl/SslProvider;+0
j  io.grpc.netty.shaded.io.grpc.netty.GrpcSslContexts.configure(Lio/grpc/netty/shaded/io/netty/handler/ssl/SslContextBuilder;)Lio/grpc/netty/shaded/io/netty/handler/ssl/SslContextBuilder;+1
j  io.grpc.netty.shaded.io.grpc.netty.GrpcSslContexts.forClient()Lio/grpc/netty/shaded/io/netty/handler/ssl/SslContextBuilder;+3
j  com.xxx.service.grpc.client.supplier.SupplierDealerControlClient.<init>(Ljava/lang/String;I)V+6
j  com.xxx.service.util.SupplierUtils.getSupplierStr(Lcom/xxx/beans/purchase/dto/SupplierDTO;)Ljava/lang/String;+284
j  com.xxx.service.util.SupplierUtils.getSupplierByCode(Lcom/xxx/beans/purchase/dto/SupplierDTO;)Ljava/util/Map;+2
j  com.xxx.service.impl.purchase.MPoHeadersSVImpl.selectMPoHeadersByPage(Ljava/lang/Integer;Ljava/lang/Integer;Lcom/xxx/beans/purchase/vo/MPoHeadersVO;)Lcom/wison/common/web/core/PageHelpTag;+588
j  com.xxx.service.impl.purchase.MPoHeadersSVImpl$$FastClassBySpringCGLIB$$2782ca1.invoke(ILjava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+532
j  org.springframework.cglib.proxy.MethodProxy.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+19
j  org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint()Ljava/lang/Object;+19
j  org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()Ljava/lang/Object;+19
j  org.springframework.transaction.interceptor.TransactionInterceptor$$Lambda$972.proceedWithInvocation()Ljava/lang/Object;+4
j  org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(Ljava/lang/reflect/Method;Ljava/lang/Class;Lorg/springframework/transaction/interceptor/TransactionAspectSupport$InvocationCallback;)Ljava/lang/Object;+73
j  org.springframework.transaction.interceptor.TransactionInterceptor.invoke(Lorg/aopalliance/intercept/MethodInvocation;)Ljava/lang/Object;+42
j  org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()Ljava/lang/Object;+120
j  org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(Ljava/lang/Object;Ljava/lang/reflect/Method;[Ljava/lang/Object;Lorg/springframework/cglib/proxy/MethodProxy;)Ljava/lang/Object;+133
j  com.xxx.service.impl.purchase.MPoHeadersSVImpl$$EnhancerBySpringCGLIB$$b79ecb3d.selectMPoHeadersByPage(Ljava/lang/Integer;Ljava/lang/Integer;Lcom/xxx/beans/purchase/vo/MPoHeadersVO;)Lcom/wison/common/web/core/PageHelpTag;+44
j  com.xxx.controller.purchase.MPoHeaderController.selectMPoHeadersByPage(Lcom/xxx/beans/purchase/vo/MPoHeadersVO;Ljava/lang/String;)Lcom/wison/common/web/core/Result;+18
j  com.xxx.controller.purchase.MPoHeaderController$$FastClassBySpringCGLIB$$ef68de8e.invoke(ILjava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+413
j  org.springframework.cglib.proxy.MethodProxy.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+19
j  org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint()Ljava/lang/Object;+19
j  org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()Ljava/lang/Object;+19
j  org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed()Ljava/lang/Object;+9
j  com.xxx.aspect.RequestLogAspect.doAround(Lorg/aspectj/lang/ProceedingJoinPoint;)Ljava/lang/Object;+20
v  ~StubRoutines::call_stub
J 2504  sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0x000000000317c5ff [0x000000000317c580+0x7f]
J 2503 C1 sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (104 bytes) @ 0x000000000317cddc [0x000000000317c9e0+0x3fc]
J 2501 C1 sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (10 bytes) @ 0x000000000317bfc4 [0x000000000317bf60+0x64]
J 2129 C1 java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (62 bytes) @ 0x00000000030abb9c [0x00000000030aba60+0x13c]
j  org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs([Ljava/lang/Object;)Ljava/lang/Object;+35
j  org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(Lorg/aspectj/lang/JoinPoint;Lorg/aspectj/weaver/tools/JoinPointMatch;Ljava/lang/Object;Ljava/lang/Throwable;)Ljava/lang/Object;+10
j  org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(Lorg/aopalliance/intercept/MethodInvocation;)Ljava/lang/Object;+58
j  org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()Ljava/lang/Object;+120
j  org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(Lorg/aopalliance/intercept/MethodInvocation;)Ljava/lang/Object;+1
j  org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()Ljava/lang/Object;+120
j  org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Lorg/aopalliance/intercept/MethodInvocation;)Ljava/lang/Object;+18
j  org.springframework.aop.framework.ReflectiveMethodInvocation.proceed()Ljava/lang/Object;+120
j  org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(Ljava/lang/Object;Ljava/lang/reflect/Method;[Ljava/lang/Object;Lorg/springframework/cglib/proxy/MethodProxy;)Ljava/lang/Object;+133
j  com.xxx.controller.purchase.MPoHeaderController$$EnhancerBySpringCGLIB$$5409ba0c.selectMPoHeadersByPage(Lcom/xxx/beans/purchase/vo/MPoHeadersVO;Ljava/lang/String;)Lcom/wison/common/web/core/Result;+40
v  ~StubRoutines::call_stub
J 2504  sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0x000000000317c5ff [0x000000000317c580+0x7f]
J 2503 C1 sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (104 bytes) @ 0x000000000317cddc [0x000000000317c9e0+0x3fc]
J 2501 C1 sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (10 bytes) @ 0x000000000317bfc4 [0x000000000317bf60+0x64]
J 2129 C1 java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (62 bytes) @ 0x00000000030abb9c [0x00000000030aba60+0x13c]
j  org.springframework.web.method.support.InvocableHandlerMethod.doInvoke([Ljava/lang/Object;)Ljava/lang/Object;+16
j  org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(Lorg/springframework/web/context/request/NativeWebRequest;Lorg/springframework/web/method/support/ModelAndViewContainer;[Ljava/lang/Object;)Ljava/lang/Object;+56
j  org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(Lorg/springframework/web/context/request/ServletWebRequest;Lorg/springframework/web/method/support/ModelAndViewContainer;[Ljava/lang/Object;)V+4
j  org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Lorg/springframework/web/method/HandlerMethod;)Lorg/springframework/web/servlet/ModelAndView;+244
j  org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Lorg/springframework/web/method/HandlerMethod;)Lorg/springframework/web/servlet/ModelAndView;+81
j  org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljava/lang/Object;)Lorg/springframework/web/servlet/ModelAndView;+7
j  org.springframework.web.servlet.DispatcherServlet.doDispatch(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+257
j  org.springframework.web.servlet.DispatcherServlet.doService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+212
j  org.springframework.web.servlet.FrameworkServlet.processRequest(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+71
j  org.springframework.web.servlet.FrameworkServlet.doPost(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+3
j  javax.servlet.http.HttpServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+131
j  org.springframework.web.servlet.FrameworkServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+33
j  javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+39
j  io.undertow.servlet.handlers.ServletHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+143
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+124
j  com.github.xiaoymin.knife4j.spring.filter.ProductionSecurityFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+76
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  com.github.xiaoymin.knife4j.spring.filter.SecurityBasicAuthFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+225
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  com.alibaba.druid.support.http.WebStatFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+190
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  org.springframework.boot.actuate.web.trace.servlet.HttpTraceFilter.doFilterInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+49
j  org.springframework.web.filter.OncePerRequestFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+111
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  org.springframework.web.filter.RequestContextFilter.doFilterInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+21
j  org.springframework.web.filter.OncePerRequestFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+111
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  org.springframework.web.filter.FormContentFilter.doFilterInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+38
j  org.springframework.web.filter.OncePerRequestFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+111
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+87
j  org.springframework.web.filter.OncePerRequestFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+111
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+21
j  org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+4
j  org.springframework.web.filter.OncePerRequestFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+111
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljavax/servlet/FilterChain;)V+53
j  org.springframework.web.filter.OncePerRequestFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+111
j  io.undertow.servlet.core.ManagedFilter.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Ljavax/servlet/FilterChain;)V+60
j  io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+149
j  io.undertow.servlet.handlers.FilterHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+122
j  io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+104
j  io.undertow.servlet.handlers.ServletChain$1.handleRequest(Lio/undertow/server/HttpServerExchange;)V+62
j  io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+19
j  io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+101
j  io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+40
j  io.undertow.server.handlers.PredicateHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+27
j  io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+21
j  io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+99
j  io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+58
j  io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+51
j  io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+14
j  io.undertow.server.handlers.PredicateHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+27
j  io.undertow.server.handlers.PredicateHandler.handleRequest(Lio/undertow/server/HttpServerExchange;)V+27
j  io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(Lio/undertow/server/HttpServerExchange;Lio/undertow/servlet/handlers/ServletRequestContext;)V+108
j  io.undertow.servlet.handlers.ServletInitialHandler.access$100(Lio/undertow/servlet/handlers/ServletInitialHandler;Lio/undertow/server/HttpServerExchange;Lio/undertow/servlet/handlers/ServletRequestContext;)V+3
j  io.undertow.servlet.handlers.ServletInitialHandler$2.call(Lio/undertow/server/HttpServerExchange;Lio/undertow/servlet/handlers/ServletRequestContext;)Ljava/lang/Object;+6
j  io.undertow.servlet.handlers.ServletInitialHandler$2.call(Lio/undertow/server/HttpServerExchange;Ljava/lang/Object;)Ljava/lang/Object;+6
j  io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(Lio/undertow/server/HttpServerExchange;Ljava/lang/Object;)Ljava/lang/Object;+42
j  io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(Lio/undertow/server/HttpServerExchange;Ljava/lang/Object;)Ljava/lang/Object;+20
j  io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(Lio/undertow/server/HttpServerExchange;Lio/undertow/servlet/handlers/ServletRequestContext;Lio/undertow/servlet/handlers/ServletChain;Ljavax/servlet/DispatcherType;)V+33
j  io.undertow.servlet.handlers.ServletInitialHandler.access$000(Lio/undertow/servlet/handlers/ServletInitialHandler;Lio/undertow/server/HttpServerExchange;Lio/undertow/servlet/handlers/ServletRequestContext;Lio/undertow/servlet/handlers/ServletChain;Ljavax/servlet/DispatcherType;)V+6
j  io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(Lio/undertow/server/HttpServerExchange;)V+33
j  io.undertow.server.Connectors.executeRootHandler(Lio/undertow/server/HttpHandler;Lio/undertow/server/HttpServerExchange;)V+8
j  io.undertow.server.HttpServerExchange$1.run()V+8
j  java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
j  java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
0x0000000028b82000 JavaThread "lettuce-nioEventLoop-5-2" daemon [_thread_in_native, id=5644, stack(0x00000000243c0000,0x00000000244c0000)]
=>0x0000000028b89000 JavaThread "XNIO-1 task-2" [_thread_in_native, id=616, stack(0x00000000007c0000,0x00000000008c0000)]
0x0000000028b81800 JavaThread "nacos-grpc-client-executor-6" daemon [_thread_blocked, id=13656, stack(0x0000000021df0000,0x0000000021ef0000)]
0x0000000028b86800 JavaThread "nacos-grpc-client-executor-5" daemon [_thread_blocked, id=1952, stack(0x00000000009c0000,0x0000000000ac0000)]
0x00000000328c1800 JavaThread "nacos-grpc-client-executor-5" daemon [_thread_blocked, id=1768, stack(0x00000000008c0000,0x00000000009c0000)]
0x00000000328b4800 JavaThread "XNIO-1 task-1" [_thread_blocked, id=12232, stack(0x0000000041c60000,0x0000000041d60000)]
0x00000000328c1000 JavaThread "elastic-evictor-1" daemon [_thread_blocked, id=10500, stack(0x0000000044980000,0x0000000044a80000)]
0x00000000328be800 JavaThread "SimplePauseDetectorThread_2" daemon [_thread_blocked, id=6928, stack(0x0000000044880000,0x0000000044980000)]
0x00000000328bd000 JavaThread "SimplePauseDetectorThread_1" daemon [_thread_blocked, id=7404, stack(0x0000000044780000,0x0000000044880000)]
0x00000000328c0000 JavaThread "SimplePauseDetectorThread_0" daemon [_thread_blocked, id=7920, stack(0x0000000044680000,0x0000000044780000)]
0x00000000328c2800 JavaThread "Thread-101" daemon [_thread_blocked, id=8068, stack(0x0000000044580000,0x0000000044680000)]
0x00000000328bc800 JavaThread "lettuce-nioEventLoop-5-1" daemon [_thread_in_native, id=13248, stack(0x0000000043470000,0x0000000043570000)]
0x00000000328bf800 JavaThread "grpc-default-boss-ELG-1-1" daemon [_thread_in_native, id=6468, stack(0x0000000041d60000,0x0000000041e60000)]
0x00000000328bb800 JavaThread "DestroyJavaVM" [_thread_blocked, id=12748, stack(0x0000000002850000,0x0000000002950000)]
0x00000000328b8800 JavaThread "async-service-1" [_thread_blocked, id=9364, stack(0x0000000040a50000,0x0000000040b50000)]
0x00000000328b4000 JavaThread "XNIO-1 Accept" [_thread_in_native, id=8504, stack(0x0000000040950000,0x0000000040a50000)]
0x00000000328b3000 JavaThread "XNIO-1 I/O-12" [_thread_in_native, id=10452, stack(0x0000000040850000,0x0000000040950000)]
0x00000000328b7000 JavaThread "XNIO-1 I/O-11" [_thread_in_native, id=10612, stack(0x0000000040750000,0x0000000040850000)]
0x00000000328b6000 JavaThread "XNIO-1 I/O-10" [_thread_in_native, id=12928, stack(0x0000000040650000,0x0000000040750000)]
0x00000000328ba000 JavaThread "XNIO-1 I/O-9" [_thread_in_native, id=2260, stack(0x0000000040550000,0x0000000040650000)]
0x00000000328b9800 JavaThread "XNIO-1 I/O-8" [_thread_in_native, id=13052, stack(0x0000000040450000,0x0000000040550000)]
0x00000000328b5800 JavaThread "XNIO-1 I/O-7" [_thread_in_native, id=7484, stack(0x0000000040350000,0x0000000040450000)]
0x00000000328b8000 JavaThread "XNIO-1 I/O-6" [_thread_in_native, id=12348, stack(0x0000000040250000,0x0000000040350000)]
0x000000001fb4d000 JavaThread "XNIO-1 I/O-5" [_thread_in_native, id=5640, stack(0x0000000040150000,0x0000000040250000)]
0x0000000028b8b000 JavaThread "XNIO-1 I/O-4" [_thread_in_native, id=7016, stack(0x0000000040050000,0x0000000040150000)]
0x0000000028b8a800 JavaThread "XNIO-1 I/O-3" [_thread_in_native, id=7060, stack(0x000000003ff50000,0x0000000040050000)]
0x0000000028b89800 JavaThread "XNIO-1 I/O-2" [_thread_in_native, id=2352, stack(0x000000003fe50000,0x000000003ff50000)]
0x0000000028b8d800 JavaThread "XNIO-1 I/O-1" [_thread_in_native, id=10172, stack(0x000000003fd50000,0x000000003fe50000)]
0x0000000028b8c000 JavaThread "ThreadPoolTaskScheduler-1" [_thread_blocked, id=12840, stack(0x000000002f0f0000,0x000000002f1f0000)]
0x0000000028b87800 JavaThread "NettyClientWorker-4-3" daemon [_thread_in_native, id=4412, stack(0x000000003af50000,0x000000003b050000)]
0x0000000028b88000 JavaThread "NettyClientWorker-4-2" daemon [_thread_in_native, id=8652, stack(0x0000000034af0000,0x0000000034bf0000)]
0x0000000028b86000 JavaThread "com.alibaba.nacos.client.naming.updater.-5" daemon [_thread_blocked, id=6716, stack(0x00000000349f0000,0x0000000034af0000)]
0x0000000028b7e800 JavaThread "com.alibaba.nacos.client.naming.updater.-4" daemon [_thread_blocked, id=10184, stack(0x00000000346f0000,0x00000000347f0000)]
0x0000000028b85000 JavaThread "com.alibaba.nacos.client.naming.updater.-3" daemon [_thread_blocked, id=7816, stack(0x00000000345f0000,0x00000000346f0000)]
0x0000000028b80000 JavaThread "com.alibaba.nacos.client.naming.updater.-2" daemon [_thread_blocked, id=9312, stack(0x00000000344f0000,0x00000000345f0000)]
0x0000000028b7f000 JavaThread "com.alibaba.nacos.client.naming.updater.-1" daemon [_thread_blocked, id=6056, stack(0x0000000033ff0000,0x00000000340f0000)]
0x0000000028b84800 JavaThread "DubboSaveRegistryCache-thread-1" daemon [_thread_blocked, id=6244, stack(0x0000000031910000,0x0000000031a10000)]
0x0000000028b80800 JavaThread "dubbo-client-idleCheck-thread-1" daemon [_thread_blocked, id=8124, stack(0x0000000031810000,0x0000000031910000)]
0x0000000028b83800 JavaThread "NettyClientWorker-4-1" daemon [_thread_in_native, id=7764, stack(0x0000000031410000,0x0000000031510000)]
0x000000001fb4b800 JavaThread "com.alibaba.nacos.client.naming.updater.0" daemon [_thread_blocked, id=7176, stack(0x0000000031310000,0x0000000031410000)]
0x000000001fb4a800 JavaThread "com.alibaba.nacos.client.identify.watcher.0" daemon [_thread_blocked, id=9324, stack(0x0000000030200000,0x0000000030300000)]
0x000000001fb4c000 JavaThread "grpc-nio-worker-ELG-1-6" daemon [_thread_in_native, id=4396, stack(0x000000002dfe0000,0x000000002e0e0000)]
0x000000001fb49800 JavaThread "grpc-nio-worker-ELG-1-5" daemon [_thread_in_native, id=11276, stack(0x000000002dee0000,0x000000002dfe0000)]
0x000000001fb42000 JavaThread "com.alibaba.nacos.client.remote.worker" daemon [_thread_blocked, id=5900, stack(0x000000002dde0000,0x000000002dee0000)]
0x000000001fb49000 JavaThread "com.alibaba.nacos.client.remote.worker" daemon [_thread_blocked, id=1248, stack(0x000000002dce0000,0x000000002dde0000)]
0x000000001fb48000 JavaThread "com.alibaba.nacos.naming.push.receiver" daemon [_thread_in_native, id=13020, stack(0x000000002dbe0000,0x000000002dce0000)]
0x000000001fb47800 JavaThread "com.alibaba.nacos.client.naming.security" daemon [_thread_blocked, id=11152, stack(0x000000002dae0000,0x000000002dbe0000)]
0x000000001fb41800 JavaThread "com.alibaba.nacos.naming.failover" daemon [_thread_blocked, id=5580, stack(0x000000002d9e0000,0x000000002dae0000)]
0x000000001fb43800 JavaThread "grpc-nio-worker-ELG-1-4" daemon [_thread_in_native, id=3200, stack(0x000000002b5c0000,0x000000002b6c0000)]
0x000000001fb3f000 JavaThread "grpc-nio-worker-ELG-1-3" daemon [_thread_in_native, id=11184, stack(0x000000002b4c0000,0x000000002b5c0000)]
0x000000001fb46000 JavaThread "com.alibaba.nacos.client.remote.worker" daemon [_thread_blocked, id=9780, stack(0x000000002b3c0000,0x000000002b4c0000)]
0x000000001fb3e800 JavaThread "com.alibaba.nacos.client.remote.worker" daemon [_thread_blocked, id=1240, stack(0x000000002b2c0000,0x000000002b3c0000)]
0x000000001fb45000 JavaThread "com.alibaba.nacos.naming.push.receiver" daemon [_thread_in_native, id=2772, stack(0x000000002b1c0000,0x000000002b2c0000)]
0x000000001fb43000 JavaThread "com.alibaba.nacos.client.naming.security" daemon [_thread_blocked, id=9752, stack(0x000000002b0c0000,0x000000002b1c0000)]
0x000000001fb3d800 JavaThread "com.alibaba.nacos.naming.failover" daemon [_thread_blocked, id=2364, stack(0x000000002adc0000,0x000000002aec0000)]
0x000000001fb40800 JavaThread "nacos.publisher-com.alibaba.nacos.client.naming.event.InstancesChangeEvent" daemon [_thread_blocked, id=12868, stack(0x000000002acc0000,0x000000002adc0000)]
0x000000001fb44800 JavaThread "nacos.publisher-com.alibaba.nacos.common.notify.SlowEvent" daemon [_thread_blocked, id=2388, stack(0x000000002abc0000,0x000000002acc0000)]
0x000000001fb40000 JavaThread "SimplePauseDetectorThread_0" daemon [_thread_blocked, id=4992, stack(0x000000002aac0000,0x000000002abc0000)]
0x0000000022fa4000 JavaThread "Thread-31" daemon [_thread_blocked, id=11660, stack(0x000000002a9c0000,0x000000002aac0000)]
0x0000000022f9f800 JavaThread "Druid-ConnectionPool-Destroy-2037260679" daemon [_thread_blocked, id=5204, stack(0x000000002a8c0000,0x000000002a9c0000)]
0x0000000022fa2000 JavaThread "Druid-ConnectionPool-Create-2037260679" daemon [_thread_blocked, id=8208, stack(0x000000002a7c0000,0x000000002a8c0000)]
0x0000000022fa5800 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=4976, stack(0x000000002a4c0000,0x000000002a5c0000)]
0x0000000022fa1000 JavaThread "spring.cloud.inetutils" daemon [_thread_blocked, id=13924, stack(0x000000002a3c0000,0x000000002a4c0000)]
0x0000000022fa2800 JavaThread "lettuce-eventExecutorLoop-1-1" daemon [_thread_blocked, id=11072, stack(0x0000000029ec0000,0x0000000029fc0000)]
0x0000000022fa0800 JavaThread "GC Daemon" daemon [_thread_blocked, id=11120, stack(0x00000000238c0000,0x00000000239c0000)]
0x0000000022fa5000 JavaThread "grpc-nio-worker-ELG-1-2" daemon [_thread_in_native, id=6008, stack(0x00000000247c0000,0x00000000248c0000)]
0x0000000022e4f000 JavaThread "grpc-nio-worker-ELG-1-1" daemon [_thread_in_native, id=13156, stack(0x00000000242c0000,0x00000000243c0000)]
0x0000000022ba1800 JavaThread "com.alibaba.nacos.client.remote.worker" daemon [_thread_blocked, id=9160, stack(0x0000000023dc0000,0x0000000023ec0000)]
0x0000000022b9f000 JavaThread "com.alibaba.nacos.client.remote.worker" daemon [_thread_blocked, id=6000, stack(0x0000000023cc0000,0x0000000023dc0000)]
0x0000000022990000 JavaThread "com.alibaba.nacos.client.Worker" daemon [_thread_blocked, id=8048, stack(0x0000000023bc0000,0x0000000023cc0000)]
0x00000000228f6000 JavaThread "pool-1-thread-1" [_thread_blocked, id=12076, stack(0x00000000218f0000,0x00000000219f0000)]
0x000000001df8b000 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=8564, stack(0x00000000221f0000,0x00000000222f0000)]
0x000000002053c000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=6728, stack(0x0000000021440000,0x0000000021540000)]
0x00000000202be800 JavaThread "Service Thread" daemon [_thread_blocked, id=4912, stack(0x0000000021340000,0x0000000021440000)]
0x0000000020240000 JavaThread "C1 CompilerThread3" daemon [_thread_blocked, id=11248, stack(0x0000000021240000,0x0000000021340000)]
0x0000000020237000 JavaThread "C2 CompilerThread2" daemon [_thread_blocked, id=1212, stack(0x0000000021140000,0x0000000021240000)]
0x0000000020236800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=3176, stack(0x0000000021040000,0x0000000021140000)]
0x0000000020235800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=12200, stack(0x0000000020f40000,0x0000000021040000)]
0x000000001df58000 JavaThread "JDWP Command Reader" daemon [_thread_in_native, id=14024, stack(0x000000001f670000,0x000000001f770000)]
0x000000001df4f000 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=7496, stack(0x000000001f570000,0x000000001f670000)]
0x000000001df4b000 JavaThread "JDWP Transport Listener: dt_socket" daemon [_thread_blocked, id=6384, stack(0x000000001f470000,0x000000001f570000)]
0x000000001df25000 JavaThread "Attach Listener" daemon [_thread_blocked, id=7520, stack(0x000000001f370000,0x000000001f470000)]
0x000000001df22800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=7612, stack(0x000000001f270000,0x000000001f370000)]
0x000000001c7b8800 JavaThread "Finalizer" daemon [_thread_blocked, id=7712, stack(0x000000001f110000,0x000000001f210000)]
0x000000001dea3000 JavaThread "Reference Handler" daemon [_thread_blocked, id=13252, stack(0x000000001f010000,0x000000001f110000)]

Other Threads:
0x000000001c7ad000 VMThread [stack: 0x000000001ef10000,0x000000001f010000] [id=8804]
0x000000002054b000 WatcherThread [stack: 0x0000000021540000,0x0000000021640000] [id=9140]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

heap address: 0x00000006c2c00000, size: 4052 MB, Compressed Oops mode: Zero based, Oop shift amount: 3
Narrow klass base: 0x0000000000000000, Narrow klass shift: 3
Compressed class space size: 1073741824 Address: 0x00000007c0000000

Heap:
PSYoungGen      total 1323008K, used 1244847K [0x000000076b980000, 0x00000007c0000000, 0x00000007c0000000)
eden space 1275392K, 94% used [0x000000076b980000,0x00000007b4c900f0,0x00000007b9700000)
from space 47616K, 95% used [0x00000007bcc00000,0x00000007bf89be98,0x00000007bfa80000)
to   space 53760K, 0% used [0x00000007b9700000,0x00000007b9700000,0x00000007bcb80000)
ParOldGen       total 382464K, used 141857K [0x00000006c2c00000, 0x00000006da180000, 0x000000076b980000)
object space 382464K, 37% used [0x00000006c2c00000,0x00000006cb688430,0x00000006da180000)
Metaspace       used 121228K, capacity 127163K, committed 127308K, reserved 1161216K
class space    used 13888K, capacity 14909K, committed 14936K, reserved 1048576K

Card table byte_map: [0x0000000011ff0000,0x00000000127e0000] byte_map_base: 0x000000000e9da000

Marking Bits: (ParMarkBitMap*) 0x0000000063758e90
Begin Bits: [0x0000000013730000, 0x0000000017680000)
End Bits:   [0x0000000017680000, 0x000000001b5d0000)

Polling page: 0x0000000000af0000

CodeCache: size=245760Kb used=27337Kb max_used=27337Kb free=218422Kb
bounds [0x0000000002c30000, 0x00000000046f0000, 0x0000000011c30000]
total_blobs=14417 nmethods=13711 adapters=626
compilation: enabled

Compilation events (10 events):
Event: 394.068 Thread 0x0000000020240000 13943   !   1       java.security.BasicPermissionCollection::add (168 bytes)
Event: 394.069 Thread 0x0000000020240000 nmethod 13943 0x00000000046e4f90 code [0x00000000046e5200, 0x00000000046e5d68]
Event: 394.120 Thread 0x0000000020240000 13944       1       java.util.logging.LogManager$LoggerContext::getRootLogger (8 bytes)
Event: 394.120 Thread 0x0000000020240000 nmethod 13944 0x00000000046e6550 code [0x00000000046e66a0, 0x00000000046e67d0]
Event: 394.120 Thread 0x0000000020240000 13945       1       java.util.logging.LogManager$LoggerContext::getGlobalLogger (6 bytes)
Event: 394.120 Thread 0x0000000020240000 nmethod 13945 0x00000000046e6890 code [0x00000000046e69e0, 0x00000000046e6af0]
Event: 394.137 Thread 0x0000000020240000 13946       1       java.io.FilterInputStream::read (9 bytes)
Event: 394.137 Thread 0x0000000020240000 nmethod 13946 0x00000000046e6b50 code [0x00000000046e6cc0, 0x00000000046e6e28]
Event: 394.166 Thread 0x0000000020240000 13947       1       java.lang.ClassLoaderHelper::mapAlternativeName (2 bytes)
Event: 394.166 Thread 0x0000000020240000 nmethod 13947 0x00000000046e6ed0 code [0x00000000046e7020, 0x00000000046e7110]

GC Heap History (10 events):
Event: 23.595 GC heap before
{Heap before GC invocations=22 (full 3):
PSYoungGen      total 1044480K, used 1025168K [0x000000076b980000, 0x00000007ae200000, 0x00000007c0000000)
eden space 1001984K, 100% used [0x000000076b980000,0x00000007a8c00000,0x00000007a8c00000)
from space 42496K, 54% used [0x00000007ab880000,0x00000007acf24068,0x00000007ae200000)
to   space 44032K, 0% used [0x00000007a8c00000,0x00000007a8c00000,0x00000007ab700000)
ParOldGen       total 219648K, used 110090K [0x00000006c2c00000, 0x00000006d0280000, 0x000000076b980000)
object space 219648K, 50% used [0x00000006c2c00000,0x00000006c9782b30,0x00000006d0280000)
Metaspace       used 92203K, capacity 96041K, committed 96216K, reserved 1134592K
class space    used 10710K, capacity 11437K, committed 11480K, reserved 1048576K
Event: 23.614 GC heap after
Heap after GC invocations=22 (full 3):
PSYoungGen      total 1046016K, used 44022K [0x000000076b980000, 0x00000007b7400000, 0x00000007c0000000)
eden space 1001984K, 0% used [0x000000076b980000,0x000000076b980000,0x00000007a8c00000)
from space 44032K, 99% used [0x00000007a8c00000,0x00000007ab6fd978,0x00000007ab700000)
to   space 51200K, 0% used [0x00000007b4200000,0x00000007b4200000,0x00000007b7400000)
ParOldGen       total 219648K, used 111093K [0x00000006c2c00000, 0x00000006d0280000, 0x000000076b980000)
object space 219648K, 50% used [0x00000006c2c00000,0x00000006c987d720,0x00000006d0280000)
Metaspace       used 92203K, capacity 96041K, committed 96216K, reserved 1134592K
class space    used 10710K, capacity 11437K, committed 11480K, reserved 1048576K
}
Event: 24.934 GC heap before
{Heap before GC invocations=23 (full 3):
PSYoungGen      total 1046016K, used 430705K [0x000000076b980000, 0x00000007b7400000, 0x00000007c0000000)
eden space 1001984K, 38% used [0x000000076b980000,0x000000078331ed80,0x00000007a8c00000)
from space 44032K, 99% used [0x00000007a8c00000,0x00000007ab6fd978,0x00000007ab700000)
to   space 51200K, 0% used [0x00000007b4200000,0x00000007b4200000,0x00000007b7400000)
ParOldGen       total 219648K, used 111093K [0x00000006c2c00000, 0x00000006d0280000, 0x000000076b980000)
object space 219648K, 50% used [0x00000006c2c00000,0x00000006c987d720,0x00000006d0280000)
Metaspace       used 94358K, capacity 98343K, committed 98380K, reserved 1136640K
class space    used 10851K, capacity 11586K, committed 11608K, reserved 1048576K
Event: 24.950 GC heap after
Heap after GC invocations=23 (full 3):
PSYoungGen      total 1189888K, used 25072K [0x000000076b980000, 0x00000007b7880000, 0x00000007c0000000)
eden space 1138688K, 0% used [0x000000076b980000,0x000000076b980000,0x00000007b1180000)
from space 51200K, 48% used [0x00000007b4200000,0x00000007b5a7c020,0x00000007b7400000)
to   space 49664K, 0% used [0x00000007b1180000,0x00000007b1180000,0x00000007b4200000)
ParOldGen       total 219648K, used 133954K [0x00000006c2c00000, 0x00000006d0280000, 0x000000076b980000)
object space 219648K, 60% used [0x00000006c2c00000,0x00000006caed0bc8,0x00000006d0280000)
Metaspace       used 94358K, capacity 98343K, committed 98380K, reserved 1136640K
class space    used 10851K, capacity 11586K, committed 11608K, reserved 1048576K
}
Event: 24.950 GC heap before
{Heap before GC invocations=24 (full 4):
PSYoungGen      total 1189888K, used 25072K [0x000000076b980000, 0x00000007b7880000, 0x00000007c0000000)
eden space 1138688K, 0% used [0x000000076b980000,0x000000076b980000,0x00000007b1180000)
from space 51200K, 48% used [0x00000007b4200000,0x00000007b5a7c020,0x00000007b7400000)
to   space 49664K, 0% used [0x00000007b1180000,0x00000007b1180000,0x00000007b4200000)
ParOldGen       total 219648K, used 133954K [0x00000006c2c00000, 0x00000006d0280000, 0x000000076b980000)
object space 219648K, 60% used [0x00000006c2c00000,0x00000006caed0bc8,0x00000006d0280000)
Metaspace       used 94358K, capacity 98343K, committed 98380K, reserved 1136640K
class space    used 10851K, capacity 11586K, committed 11608K, reserved 1048576K
Event: 25.162 GC heap after
Heap after GC invocations=24 (full 4):
PSYoungGen      total 1189888K, used 0K [0x000000076b980000, 0x00000007b7880000, 0x00000007c0000000)
eden space 1138688K, 0% used [0x000000076b980000,0x000000076b980000,0x00000007b1180000)
from space 51200K, 0% used [0x00000007b4200000,0x00000007b4200000,0x00000007b7400000)
to   space 49664K, 0% used [0x00000007b1180000,0x00000007b1180000,0x00000007b4200000)
ParOldGen       total 382464K, used 141841K [0x00000006c2c00000, 0x00000006da180000, 0x000000076b980000)
object space 382464K, 37% used [0x00000006c2c00000,0x00000006cb684430,0x00000006da180000)
Metaspace       used 94358K, capacity 98343K, committed 98380K, reserved 1136640K
class space    used 10851K, capacity 11586K, committed 11608K, reserved 1048576K
}
Event: 27.696 GC heap before
{Heap before GC invocations=25 (full 4):
PSYoungGen      total 1189888K, used 1138688K [0x000000076b980000, 0x00000007b7880000, 0x00000007c0000000)
eden space 1138688K, 100% used [0x000000076b980000,0x00000007b1180000,0x00000007b1180000)
from space 51200K, 0% used [0x00000007b4200000,0x00000007b4200000,0x00000007b7400000)
to   space 49664K, 0% used [0x00000007b1180000,0x00000007b1180000,0x00000007b4200000)
ParOldGen       total 382464K, used 141841K [0x00000006c2c00000, 0x00000006da180000, 0x000000076b980000)
object space 382464K, 37% used [0x00000006c2c00000,0x00000006cb684430,0x00000006da180000)
Metaspace       used 99357K, capacity 103667K, committed 103756K, reserved 1140736K
class space    used 11227K, capacity 12036K, committed 12120K, reserved 1048576K
Event: 27.706 GC heap after
Heap after GC invocations=25 (full 4):
PSYoungGen      total 1188352K, used 18272K [0x000000076b980000, 0x00000007bfa80000, 0x00000007c0000000)
eden space 1138688K, 0% used [0x000000076b980000,0x000000076b980000,0x00000007b1180000)
from space 49664K, 36% used [0x00000007b1180000,0x00000007b2358030,0x00000007b4200000)
to   space 47616K, 0% used [0x00000007bcc00000,0x00000007bcc00000,0x00000007bfa80000)
ParOldGen       total 382464K, used 141849K [0x00000006c2c00000, 0x00000006da180000, 0x000000076b980000)
object space 382464K, 37% used [0x00000006c2c00000,0x00000006cb686430,0x00000006da180000)
Metaspace       used 99357K, capacity 103667K, committed 103756K, reserved 1140736K
class space    used 11227K, capacity 12036K, committed 12120K, reserved 1048576K
}
Event: 31.052 GC heap before
{Heap before GC invocations=26 (full 4):
PSYoungGen      total 1188352K, used 1156960K [0x000000076b980000, 0x00000007bfa80000, 0x00000007c0000000)
eden space 1138688K, 100% used [0x000000076b980000,0x00000007b1180000,0x00000007b1180000)
from space 49664K, 36% used [0x00000007b1180000,0x00000007b2358030,0x00000007b4200000)
to   space 47616K, 0% used [0x00000007bcc00000,0x00000007bcc00000,0x00000007bfa80000)
ParOldGen       total 382464K, used 141849K [0x00000006c2c00000, 0x00000006da180000, 0x000000076b980000)
object space 382464K, 37% used [0x00000006c2c00000,0x00000006cb686430,0x00000006da180000)
Metaspace       used 105620K, capacity 110885K, committed 111180K, reserved 1146880K
class space    used 12151K, capacity 13086K, committed 13144K, reserved 1048576K
Event: 31.071 GC heap after
Heap after GC invocations=26 (full 4):
PSYoungGen      total 1323008K, used 45679K [0x000000076b980000, 0x00000007c0000000, 0x00000007c0000000)
eden space 1275392K, 0% used [0x000000076b980000,0x000000076b980000,0x00000007b9700000)
from space 47616K, 95% used [0x00000007bcc00000,0x00000007bf89be98,0x00000007bfa80000)
to   space 53760K, 0% used [0x00000007b9700000,0x00000007b9700000,0x00000007bcb80000)
ParOldGen       total 382464K, used 141857K [0x00000006c2c00000, 0x00000006da180000, 0x000000076b980000)
object space 382464K, 37% used [0x00000006c2c00000,0x00000006cb688430,0x00000006da180000)
Metaspace       used 105620K, capacity 110885K, committed 111180K, reserved 1146880K
class space    used 12151K, capacity 13086K, committed 13144K, reserved 1048576K
}

Deoptimization events (0 events):
No events

Classes redefined (0 events):
No events

Internal exceptions (10 events):
Event: 393.960 Thread 0x0000000028b89000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x00000007b40cd1d8) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\runtime\sharedRuntime.cpp, line 605]
Event: 394.013 Thread 0x0000000028b89000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x00000007b41dcb80) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\runtime\sharedRuntime.cpp, line 605]
Event: 394.133 Thread 0x0000000028b89000 Exception <a 'java/lang/reflect/InvocationTargetException'> (0x00000007b4a04580) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\runtime\reflection.cpp, line 1092]
Event: 394.160 Thread 0x0000000028b89000 Exception <a 'java/lang/NoSuchMethodError': Method io.grpc.netty.shaded.io.netty.internal.tcnative.NativeStaticallyReferencedJniMethods.sslOpNoTLSv13()I not found> (0x00000007b4a9e228) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\prims\jni.cpp, 
Event: 394.160 Thread 0x0000000028b89000 Exception <a 'java/lang/NoSuchMethodError'> (0x00000007b4a9e228) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\prims\jni.cpp, line 711]
Event: 394.160 Thread 0x0000000028b89000 Exception <a 'java/lang/reflect/InvocationTargetException'> (0x00000007b4a9ebd0) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\runtime\reflection.cpp, line 1092]
Event: 394.162 Thread 0x0000000028b89000 Exception <a 'java/lang/NoSuchMethodError': Method io.grpc.netty.shaded.io.netty.internal.tcnative.NativeStaticallyReferencedJniMethods.sslOpNoTLSv13()I not found> (0x00000007b4aa0240) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\prims\jni.cpp, 
Event: 394.162 Thread 0x0000000028b89000 Exception <a 'java/lang/NoSuchMethodError'> (0x00000007b4aa0240) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\prims\jni.cpp, line 711]
Event: 394.164 Thread 0x0000000028b89000 Exception <a 'java/lang/reflect/InvocationTargetException'> (0x00000007b4aa8318) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\runtime\reflection.cpp, line 1092]
Event: 394.166 Thread 0x0000000028b89000 Exception <a 'java/lang/reflect/InvocationTargetException'> (0x00000007b4ae8de8) thrown at [c:/openjdk/jdk8u/jdk8u/hotspot\src\share\vm\runtime\reflection.cpp, line 1092]

Events (10 events):
Event: 394.168 Thread 0x0000000028b89000 DEOPT PACKING pc=0x0000000003154a8c sp=0x00000000008b66e0
Event: 394.168 Thread 0x0000000028b89000 DEOPT UNPACKING pc=0x0000000002c775d0 sp=0x00000000008b6500 mode 1
Event: 394.171 loading class io/grpc/netty/shaded/io/netty/handler/ssl/ApplicationProtocolAccessor
Event: 394.171 loading class io/grpc/netty/shaded/io/netty/handler/ssl/ApplicationProtocolAccessor done
Event: 394.171 Thread 0x0000000028b89000 DEOPT PACKING pc=0x0000000002e71711 sp=0x00000000008b3f00
Event: 394.171 Thread 0x0000000028b89000 DEOPT UNPACKING pc=0x0000000002c775d0 sp=0x00000000008b3c50 mode 1
Event: 394.171 Thread 0x0000000028b89000 DEOPT PACKING pc=0x0000000003154b44 sp=0x00000000008b3f80
Event: 394.171 Thread 0x0000000028b89000 DEOPT UNPACKING pc=0x0000000002c775d0 sp=0x00000000008b3da0 mode 1
Event: 394.171 Thread 0x0000000028b89000 DEOPT PACKING pc=0x0000000003154a8c sp=0x00000000008b4110
Event: 394.171 Thread 0x0000000028b89000 DEOPT UNPACKING pc=0x0000000002c775d0 sp=0x00000000008b3f30 mode 1

Dynamic libraries:
0x00007ff7676f0000 - 0x00007ff767725000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\bin\java.exe
0x00007ffdac110000 - 0x00007ffdac305000   C:\WINDOWS\SYSTEM32\ntdll.dll
0x00007ffdab4d0000 - 0x00007ffdab58d000   C:\WINDOWS\System32\KERNEL32.DLL
0x00007ffda9ea0000 - 0x00007ffdaa169000   C:\WINDOWS\System32\KERNELBASE.dll
0x00007ffdaa530000 - 0x00007ffdaa5dc000   C:\WINDOWS\System32\ADVAPI32.dll
0x00007ffdaa490000 - 0x00007ffdaa52e000   C:\WINDOWS\System32\msvcrt.dll
0x00007ffdab820000 - 0x00007ffdab8bb000   C:\WINDOWS\System32\sechost.dll
0x00007ffdaa1d0000 - 0x00007ffdaa2fa000   C:\WINDOWS\System32\RPCRT4.dll
0x00007ffdaac20000 - 0x00007ffdaadc0000   C:\WINDOWS\System32\USER32.dll
0x00007ffda9a40000 - 0x00007ffda9a62000   C:\WINDOWS\System32\win32u.dll
0x00007ffdaa5e0000 - 0x00007ffdaa60a000   C:\WINDOWS\System32\GDI32.dll
0x00007ffda9890000 - 0x00007ffda999b000   C:\WINDOWS\System32\gdi32full.dll
0x00007ffda99a0000 - 0x00007ffda9a3d000   C:\WINDOWS\System32\msvcp_win.dll
0x00007ffda9da0000 - 0x00007ffda9ea0000   C:\WINDOWS\System32\ucrtbase.dll
0x00007ffd9acc0000 - 0x00007ffd9af5a000   C:\WINDOWS\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.19041.1110_none_60b5254171f9507e\COMCTL32.dll
0x00007ffdaadc0000 - 0x00007ffdaadf0000   C:\WINDOWS\System32\IMM32.DLL
0x00000000637e0000 - 0x00000000638b1000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\msvcr100.dll
0x0000000062fb0000 - 0x00000000637d5000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\server\jvm.dll
0x00007ffdab590000 - 0x00007ffdab598000   C:\WINDOWS\System32\PSAPI.DLL
0x00007ffda43b0000 - 0x00007ffda43b9000   C:\WINDOWS\SYSTEM32\WSOCK32.dll
0x00007ffda48d0000 - 0x00007ffda48da000   C:\WINDOWS\SYSTEM32\VERSION.dll
0x00007ffd97a80000 - 0x00007ffd97aa7000   C:\WINDOWS\SYSTEM32\WINMM.dll
0x00007ffdab920000 - 0x00007ffdab98b000   C:\WINDOWS\System32\WS2_32.dll
0x00007ffda43a0000 - 0x00007ffda43af000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\verify.dll
0x00007ffda4370000 - 0x00007ffda4399000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\java.dll
0x00007ffda41d0000 - 0x00007ffda4205000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\jdwp.dll
0x00007ffda42d0000 - 0x00007ffda42d8000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\npt.dll
0x00007ffda3600000 - 0x00007ffda3623000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\instrument.dll
0x00007ffda4350000 - 0x00007ffda4366000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\zip.dll
0x00007ffdab990000 - 0x00007ffdac0cf000   C:\WINDOWS\System32\SHELL32.dll
0x00007ffda7950000 - 0x00007ffda80e0000   C:\WINDOWS\SYSTEM32\windows.storage.dll
0x00007ffdaa610000 - 0x00007ffdaa965000   C:\WINDOWS\System32\combase.dll
0x00007ffda92a0000 - 0x00007ffda92cc000   C:\WINDOWS\SYSTEM32\Wldp.dll
0x00007ffdab270000 - 0x00007ffdab31e000   C:\WINDOWS\System32\SHCORE.dll
0x00007ffdaa300000 - 0x00007ffdaa355000   C:\WINDOWS\System32\shlwapi.dll
0x00007ffda9780000 - 0x00007ffda979f000   C:\WINDOWS\SYSTEM32\profapi.dll
0x00007ffda35f0000 - 0x00007ffda35f9000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\dt_socket.dll
0x00007ffda9000000 - 0x00007ffda906a000   C:\WINDOWS\system32\mswsock.dll
0x00007ffda4230000 - 0x00007ffda424a000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\net.dll
0x00007ffda8cf0000 - 0x00007ffda8dbc000   C:\WINDOWS\SYSTEM32\DNSAPI.dll
0x00007ffda8ca0000 - 0x00007ffda8cdb000   C:\WINDOWS\SYSTEM32\IPHLPAPI.DLL
0x00007ffdaa480000 - 0x00007ffdaa488000   C:\WINDOWS\System32\NSI.dll
0x00007ffd9f100000 - 0x00007ffd9f10a000   C:\Windows\System32\rasadhlp.dll
0x00007ffd9f110000 - 0x00007ffd9f18f000   C:\WINDOWS\System32\fwpuclnt.dll
0x00007ffda9a70000 - 0x00007ffda9a97000   C:\WINDOWS\System32\bcrypt.dll
0x00007ffda35e0000 - 0x00007ffda35ed000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\management.dll
0x00007ffda4210000 - 0x00007ffda4221000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\nio.dll
0x00007ffda91f0000 - 0x00007ffda9208000   C:\WINDOWS\SYSTEM32\CRYPTSP.dll
0x00007ffda8910000 - 0x00007ffda8944000   C:\WINDOWS\system32\rsaenh.dll
0x00007ffda9740000 - 0x00007ffda976e000   C:\WINDOWS\SYSTEM32\USERENV.dll
0x00007ffda9c60000 - 0x00007ffda9ce3000   C:\WINDOWS\System32\bcryptprimitives.dll
0x00007ffda9210000 - 0x00007ffda921c000   C:\WINDOWS\SYSTEM32\CRYPTBASE.dll
0x00007ffda2620000 - 0x00007ffda2637000   C:\WINDOWS\SYSTEM32\dhcpcsvc6.DLL
0x00007ffda3180000 - 0x00007ffda319d000   C:\WINDOWS\SYSTEM32\dhcpcsvc.DLL
0x00007ffda44c0000 - 0x00007ffda44d7000   C:\WINDOWS\system32\napinsp.dll
0x00007ffd79180000 - 0x00007ffd7919b000   C:\WINDOWS\system32\pnrpnsp.dll
0x00007ffda4d20000 - 0x00007ffda4d35000   C:\WINDOWS\system32\wshbth.dll
0x00007ffda3900000 - 0x00007ffda391d000   C:\WINDOWS\system32\NLAapi.dll
0x00007ffd78ec0000 - 0x00007ffd78ed2000   C:\WINDOWS\System32\winrnr.dll
0x00007ffd9fe90000 - 0x00007ffd9feb4000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\sunec.dll
0x00007ffda35c0000 - 0x00007ffda35cc000   C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\bin\sunmscapi.dll
0x00007ffda9b00000 - 0x00007ffda9c5f000   C:\WINDOWS\System32\CRYPT32.dll
0x00007ffda9310000 - 0x00007ffda9337000   C:\WINDOWS\SYSTEM32\ncrypt.dll
0x00007ffda92d0000 - 0x00007ffda930b000   C:\WINDOWS\SYSTEM32\NTASN1.dll
0x00007ffda0630000 - 0x00007ffda0814000   C:\WINDOWS\SYSTEM32\dbghelp.dll

VM Arguments:
jvm_args: -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:51733,suspend=y,server=n -XX:TieredStopAtLevel=1 -Xverify:none -Dspring.output.ansi.enabled=always -javaagent:C:\Users\24709\AppData\Local\JetBrains\IntelliJIdea2021.2\captureAgent\debugger-agent.jar -Dcom.sun.management.jmxremote -Dspring.jmx.enabled=true -Dspring.liveBeansView.mbeanDomain -Dspring.application.admin.enabled=true -Dfile.encoding=UTF-8 
java_command: com.xxx.ScmWebApplication
java_class_path (initial): C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\charsets.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\access-bridge-64.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\cldrdata.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\dnsns.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\jaccess.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\jfxrt.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\localedata.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\nashorn.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\sunec.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\sunjce_provider.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\sunmscapi.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\sunpkcs11.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\ext\zipfs.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\jce.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\jfxswt.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\jsse.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\management-agent.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\resources.jar;C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\jre\lib\rt.jar;D:\wison-project\java\wison-scm\scm-web\target\classes;D:\wison-project\java\wison-scm\scm-kingdee\target\classes;D:\wison-project\java\wison-scm\scm-webservice\target\classes;D:\wison-project\java\wison-scm\scm-iservice\target\classes;D:\wison-project\java\wison-scm\scm-service-impl\target\classes;D:\wison-project\java\wison-scm\scm-dao\target\classes;D:\wison-project\java\wison-scm\scm-proto-lib\target\classes;D:\apache-maven-3.8.1\repository\com\wison\wison-eas\1.0.0-SNAPSHOT\wison-eas-1.0.0-20210805.050304-15.jar;D:\apache-maven-3.8.1\repository\com\wison\message-email\1.0-SNAPSHOT\message-email-1.0-2021
Launcher Type: SUN_STANDARD

Environment Variables:
PATH=C:\Program Files\OpenJDK\jdk-8.0.262.10-hotspot\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;D:\Git\cmd;D:\apache-maven-3.8.1\bin;;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;D:\nodejs\;C:\Users\24709\AppData\Local\Microsoft\WindowsApps;D:\Bandizip\;D:\JetBrains\IntelliJ IDEA 2021.2\bin;;C:\Users\24709\AppData\Roaming\npm;D:\JetBrains\WebStorm 2021.2\bin;
USERNAME=24709
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 165 Stepping 3, GenuineIntel

---------------  S Y S T E M  ---------------

OS: Windows 10.0 , 64 bit Build 19041 (10.0.19041.1151)

CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core) family 6 model 165 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx

Memory: 4k page, physical 16591084k(3550144k free), swap 22096108k(5486532k free)

vm_info: OpenJDK 64-Bit Server VM (25.71-b10) for windows-amd64 JRE (1.8.0-262-b10), built on Jul 25 2020 01:22:05 by "Administrator" with MS VC++ 10.0 (VS2010)

time: Mon Aug 16 09:57:43 2021
timezone: �й���׼ʱ��
elapsed time: 394 seconds (0d 0h 6m 34s)

    2. 控制台打印日志

      2021-08-16 10:24:49 [XNIO-1 task-1] DEBUG c.w.s.d.s.M.sumGroupByPohIds - ==>  Preparing: SELECT t1.poh_id pohId, t2.po_number poNumber, IFNULL(sum(t1.store_qty),0) totalQty from m_matl_recv_rpts t1 left join m_po_headers t2 on t1.poh_id = t2.poh_id where t1.poh_id in ( ? , ? , ? , ? , ? , ? , ? , ? , ? , ? ) and t1.recv_type in ('1','2','3') group by t1.poh_id 
2021-08-16 10:24:49 [XNIO-1 task-1] DEBUG c.w.s.d.s.M.sumGroupByPohIds - ==> Parameters: 16432(Long), 16430(Long), 16425(Long), 16419(Long), 16418(Long), 16417(Long), 16411(Long), 16410(Long), 16409(Long), 16408(Long)
2021-08-16 10:24:49 [XNIO-1 task-1] DEBUG c.w.s.d.s.M.sumGroupByPohIds - <==      Total: 4
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00007ffd613b69a0, pid=12336, tid=0x0000000000001498
#
# JRE version: OpenJDK Runtime Environment (8.0-b10) (build 1.8.0-262-b10)
# Java VM: OpenJDK 64-Bit Server VM (25.71-b10 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  0x00007ffd613b69a0
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# An error report file with more information is saved as:
# D:\xxx-project\java\xxx\hs_err_pid12336.log
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
Disconnected from the target VM, address: '127.0.0.1:53703', transport: 'socket'

Process finished with exit code 1
realJackSun commented 3 years ago

可否用dump一下jvm内存，观察是哪些关键数据占用了内存？

TOP-LH commented 3 years ago

可否用dump一下jvm内存，观察是哪些关键数据占用了内存？

hprof文件可以吗，怎么发给你，这个东西有点大

macey888 commented 3 years ago

麻烦问一下这个问题有什么解决方案了吗？

TOP-LH commented 3 years ago

麻烦问一下这个问题有什么解决方案了吗？

还没，兄弟，帮我顶一下帖子，没热度了

gang0713 commented 3 years ago

我也是内存一直增加，难道也是因为这个问题？

TOP-LH commented 3 years ago

我也是内存一直增加，难道也是因为这个问题？

你们项目用GRPC了吗，nacos客户端是什么版本的？

KomachiSion commented 3 years ago

可否用dump一下jvm内存，观察是哪些关键数据占用了内存？

hprof文件可以吗，怎么发给你，这个东西有点大

自己先分析下hprof文件，找到泄漏的类是哪个，与其相关的引用是哪些。然后截图出来。

TOP-LH commented 3 years ago

可否用dump一下jvm内存，观察是哪些关键数据占用了内存？

hprof文件可以吗，怎么发给你，这个东西有点大

自己先分析下hprof文件，找到泄漏的类是哪个，与其相关的引用是哪些。然后截图出来。

有点专业了，不太会。能远程支援一下吗？

John-Chan commented 3 years ago

Windows 下，0xc0000005 这个错误是内存地址访问违规，也就是你的代码里面有野指针之类的问题，没看出来内存泄漏，建议关注一下nvative code是不是有平台兼容性问题。

TOP-LH commented 3 years ago

Windows 下，0xc0000005 这个错误是内存地址访问违规，也就是你的代码里面有野指针之类的问题，没看出来内存泄漏，建议关注一下nvative code是不是有平台兼容性问题。

linux和windows都会直接报错，但我使用nacos1就不会报错

KomachiSion commented 3 years ago

可能是有版本冲突，建议检查一下依赖树，看一下是不是有版本问题。

KomachiSion commented 3 years ago

No more response

Belyenochi commented 2 years ago

我也遇到这个问题

KeithTt commented 2 years ago

Same problem here.

messi612 commented 1 year ago

我这边碰到的问题差不多，一个是堆外内存占用高，一个是MpscArrayQueue(PoolThreadCache)的内存占用高，目前是通过-Dio.grpc.netty.shaded.io.netty.allocator.useCacheForAllThreads=false 使内存降下来了，这个参数为true，会使得grpc都通过PoolThreadLocalCache（PoolThreadCache) 分配内存，netty默认的话是只有worker线程才会使用PoolThreadCache

lovlyhao commented 1 year ago

有解决方案嘛。 com.alibaba.nacos.shaded.io.grpc.netty.shaded.io.netty.util.Recycler$WeakOrderQueue$Head @ 0x7962528f0 占了78% image

zz630 commented 1 year ago

有解决方案嘛。 com.alibaba.nacos.shaded.io.grpc.netty.shaded.io.netty.util.Recycler$WeakOrderQueue$Head @ 0x7962528f0 占了78% image

启动参数设置-Djraft.recyclers.maxCapacityPerThread=0关闭Recyclers试试

lxqgithub commented 1 year ago

Windows 下，0xc0000005 这个错误是内存地址访问违规，也就是你的代码里面有野指针之类的问题，没看出来内存泄漏，建议关注一下nvative code是不是有平台兼容性问题。

linux和windows都会直接报错，但我使用nacos1就不会报错

大佬 你这么详细的日志 怎么打印的？