search

thelastpickle / cassandra-reaper

Automated Repair Awesomeness for Apache Cassandra
http://cassandra-reaper.io/
Apache License 2.0
490 stars 218 forks source link

Error "Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80031,name=CompletedTasks javax.management.InstanceNotFoundException" observed in reaper logs" #1318

Open vchauhan81 opened 1 year ago

vchauhan81 commented 1 year ago

Project board link

We are using cassandra-reaper version 3.3.1. Cassandra database and reaper is configured for JMX authentication. Although reaper is functioning correctly, we are seeing following errors in reaper log. Need to confirm, what could be the possible root cause, fix for this issue.

OR [2023-07-04 00:10:01,928] [ForkJoinPool-1-worker-58] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=PendingTasks

javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=PendingTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-04 00:10:01,958] [ForkJoinPool-1-worker-58] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=ActiveTasks

javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=ActiveTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServer

┆Issue is synchronized with this Jira Story by Unito ┆Issue Number: REAP-48

vchauhan81 commented 1 year ago

More error stack trace -

WARN [2023-07-11 00:00:06,638] [Mailbox Cluster-nio-worker-2] c.d.d.c.RequestHandler - Query '[2 bound values] SELECT FROM repair_run_by_cluster_v2 WHERE cluster_name = ? limit ?;' generated server sidOR [2023-07-04 00:10:01,928] [ForkJoinPool-1-worker-58] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=PendingTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=PendingTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-04 00:10:01,958] [ForkJoinPool-1-worker-58] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=ActiveTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#80157,name=ActiveTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerWARN [2023-07-11 00:04:31,509] [Mailbox Cluster-nio-worker-6] c.d.d.c.RequestHandler - Query '[2 bound values] SELECT FROM repair_run_by_cluster_v2 WHERE cluster_name = ? limit ?;' generated server side warning(s): Read 362 live rows and 2278 tombstone cells for query SELECT * FROM reaper_current.repair_run_by_cluster_v2 WHERE cluster_name = mailboxcluster LIMIT 1000; token -6675551992983735733 (see tombstone_warn_threshold) ERROR [2023-07-11 00:04:35,164] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=TotalBlockedTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=TotalBlockedTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-11 00:04:35,172] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=CurrentlyBlockedTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=CurrentlyBlockedTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-11 00:04:35,190] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=MaxTasksQueued
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=MaxTasksQueued at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-11 00:04:35,208] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=CompletedTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=CompletedTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-11 00:04:35,228] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=MaxPoolSize
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=MaxPoolSize at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-11 00:04:35,233] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=ActiveTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=ActiveTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1078) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1714) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183) ERROR [2023-07-11 00:04:35,265] [ForkJoinPool-1-worker-1] i.c.j.MetricsProxy - Fail getting mbeanInfo or grabbing attributes for mbean org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=PendingTasks
javax.management.InstanceNotFoundException: org.apache.cassandra.metrics:type=ThreadPools,path=internal,scope=Repair#64451,name=PendingTasks at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1107) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBeanInfo(DefaultMBeanServerInterceptor.java:1387) at com.sun.jmx.mbeanserver.JmxMBeanServer.getMBeanInfo(JmxMBeanServer.java:932) at com.sun.jmx.remote.security.MBeanServerAccessController.getMBeanInfo(MBeanServerAccessController.java:411) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1473) at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:87) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1320) at java.security.AccessController.doPrivileged(AccessController.java:783) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1419) at javax.management.remote.rmi.RMIConnectionImpl.getMBeanInfo(RMIConnectionImpl.java:916) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55) at java.lang.reflect.Method.invoke(Method.java:508) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:374) at sun.rmi.transport.Transport$1.run(Transport.java:212) at sun.rmi.transport.Transport$1.run(Transport.java:209) at java.security.AccessController.doPrivileged(AccessController.java:783) at sun.rmi.transport.Transport.serviceCall(Transport.java:208) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:585) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:846) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:700) at java.security.AccessController.doPrivileged(AccessController.java:717) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:699) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.lang.Thread.run(Thread.java:826) at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:315) at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:291) at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:175) at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source) at javax.management.remote.rmi.RMIConnectionImpl_Stub.getMBeanInfo(Unknown Source) at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getMBeanInfo(RMIConnector.java:1090) at io.cassandrareaper.jmx.MetricsProxy.scrapeBean(MetricsProxy.java:110) at io.cassandrareaper.jmx.MetricsProxy.lambda$collectMetrics$0(MetricsProxy.java:93) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.Iterator.forEachRemaining(Iterator.java:127) at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1812) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:514) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:162) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:185) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:245) at java.util.stream.ReferencePipeline.forEachOrdered(ReferencePipeline.java:434) at io.cassandrareaper.jmx.MetricsProxy.collectMetrics(MetricsProxy.java:94) at io.cassandrareaper.jmx.ClusterFacade.collectMetrics(ClusterFacade.java:534) at io.cassandrareaper.service.MetricsService.grabAndStoreGenericMetrics(MetricsService.java:149) at io.cassandrareaper.service.Heart.updateMetricsForNode(Heart.java:275) at io.cassandrareaper.service.Heart.lambda$null$6(Heart.java:218) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:195) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:204) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:186) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1395) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:524) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:302) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:742) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:300)

kapilibm commented 1 year ago

In which version of reaper this fix will be available ?