search

FrankChen021 / bithon

An observability platform mainly for Java
Apache License 2.0
16 stars 5 forks source link

Sink trace discarded #633

Closed FrankChen021 closed 1 year ago

FrankChen021 commented 1 year ago

image

FrankChen021 commented 1 year ago

httpoutgoing image

FrankChen021 commented 1 year ago

image

FrankChen021 commented 1 year ago

Recorded same exceptions on 4 instances during 15:30-15:40. However, this exception was caught by TransformSpec in the metrics handling thread

[bTxId: bd83866b247a438c9fbb48b561842efa, bSpanId: 242840421720c46c, bMode: L] Failed to transform input data

java.lang.IllegalArgumentException: URLDecoder: Illegal hex characters in escape (%) pattern - For input string: "A/"
    at java.net.URLDecoder.decode(URLDecoder.java:194) ~[na:1.8.0_342]
    at org.bithon.server.sink.common.service.UriNormalizer.normalize(UriNormalizer.java:84) ~[server-sink-1.1.1-RELEASE.jar!/:na]
    at org.bithon.server.sink.common.service.UriNormalizer.normalize(UriNormalizer.java:75) ~[server-sink-1.1.1-RELEASE.jar!/:na]
    at org.bithon.server.sink.metrics.transformer.UriNormalizationTransformer.transformInternal(UriNormalizationTransformer.java:46) ~[server-sink-1.1.1-RELEASE.jar!/:na]
    at org.bithon.server.storage.datasource.input.transformer.AbstractSimpleTransformer.transform(AbstractSimpleTransformer.java:40) ~[server-storage-1.1.1-RELEASE.jar!/:na]
    at org.bithon.server.storage.datasource.input.TransformSpec.transform(TransformSpec.java:93) ~[server-storage-1.1.1-RELEASE.jar!/:na]
    at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) ~[na:1.8.0_342]
    at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) ~[na:1.8.0_342]
    at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[na:1.8.0_342]
    at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[na:1.8.0_342]
    at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[na:1.8.0_342]
    at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[na:1.8.0_342]
    at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566) ~[na:1.8.0_342]
    at org.bithon.server.sink.metrics.MetricMessageHandler$MetricSinkRunnable.run(MetricMessageHandler.java:130) ~[server-sink-1.1.1-RELEASE.jar!/:na]
    at org.bithon.agent.plugin.thread.utils.ObservedTask.runWithTracing(ObservedTask.java:71) ~[na:na]
    at org.bithon.agent.plugin.thread.utils.ObservedTask.run(ObservedTask.java:58) ~[na:na]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_342]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_342]
    at java.lang.Thread.run(Thread.java:750) ~[na:1.8.0_342]
FrankChen021 commented 1 year ago

All threads had the same stacks. image image

However, for normal processes, they don't have such stacks. Might be bugs from above functions.