elastic / logstash

Logstash - transport and process your logs, events, or other data
https://www.elastic.co/products/logstash
Other
112 stars 3.51k forks source link

[StackOverflowError] Getting a convergence (compilation) error on large pipelines #11591

Open blookot opened 4 years ago

blookot commented 4 years ago

I'm using Logstash 7.5.0 on GCP Debian 9 (30GB RAM, 28 allocated to JVM).

When running Logstash on a large pipeline (see attached), I'm getting An exception happened when converging configuration, see full output below:

vincent_maury@vincent-maury-logstash-testing:~$ sudo /usr/share/logstash/bin/logstash -f logstash-v20_oraclemsg.conf --path.settings /etc/logstash/
Thread.exclusive is deprecated, use Thread::Mutex
Sending Logstash logs to /var/log/logstash which is now configured via log4j2.properties
[2020-02-10T08:34:47,000][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2020-02-10T08:34:47,183][INFO ][logstash.runner          ] Starting Logstash {"logstash.version"=>"7.5.2"}
[2020-02-10T08:34:47,214][INFO ][logstash.agent           ] No persistent UUID file found. Generating new UUID {:uuid=>"2706b063-d7ab-4a7a-8492-356ebe809c49", :path=>"/var/lib/logstash/uuid"}
[2020-02-10T08:37:39,477][INFO ][org.reflections.Reflections] Reflections took 42 ms to scan 1 urls, producing 20 keys and 40 values
[2020-02-10T08:46:27,200][ERROR][logstash.agent           ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"Java::JavaLang::StackOverflowError", :message=>"", :backtrace=>["org.logstash.config.ir.graph.Graph.getIncomingEdges(Graph.java:104)", "org.logstash.config.ir.graph.Vertex.incomingEdges(Vertex.java:123)", "org.logstash.config.ir.graph.Vertex.incomingVertices(Vertex.java:119)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:471)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.split(CompiledPipeline.java:441)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:495)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.compileDependencies(CompiledPipeline.java:509)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.flatten(CompiledPipeline.java:470)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.filterDataset(CompiledPipeline.java:390)", "org.logstash.config.ir.CompiledPipeline$CompiledExecution.lambda$compileDependencies$4(CompiledPipeline.java:488)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)", "java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)", "java.util.Iterator.forEachRemaining(Iterator.java:116)", "java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)", "java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)", "java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)", "java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)", "java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)", "java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)"]}
warning: thread "Converge PipelineAction::Create<main>" terminated with exception (report_on_exception is true):
LogStash::Error: Don't know how to handle `Java::JavaLang::StackOverflowError` for `PipelineAction::Create<main>`
          create at org/logstash/execution/ConvergeResultExt.java:109
             add at org/logstash/execution/ConvergeResultExt.java:37
  converge_state at /usr/share/logstash/logstash-core/lib/logstash/agent.rb:339
[2020-02-10T08:46:27,335][ERROR][logstash.agent           ] An exception happened when converging configuration {:exception=>LogStash::Error, :message=>"Don't know how to handle `Java::JavaLang::StackOverflowError` for `PipelineAction::Create<main>`", :backtrace=>["org/logstash/execution/ConvergeResultExt.java:109:in `create'", "org/logstash/execution/ConvergeResultExt.java:37:in `add'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:339:in `block in converge_state'"]}
[2020-02-10T08:46:27,461][FATAL][logstash.runner          ] An unexpected error occurred! {:error=>#<LogStash::Error: Don't know how to handle `Java::JavaLang::StackOverflowError` for `PipelineAction::Create<main>`>, :backtrace=>["org/logstash/execution/ConvergeResultExt.java:109:in `create'", "org/logstash/execution/ConvergeResultExt.java:37:in `add'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:339:in `block in converge_state'"]}
[2020-02-10T08:46:27,581][ERROR][org.logstash.Logstash    ] java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit

logstash-v20_oraclemsg.txt

colinsurprenant commented 4 years ago

@blookot The stack overflow problem can be solved by increasing -Xss.

We have made improvements to the pipeline compilation which improves single-pipeline compilation/initialization time in 7.5.2 but also introduced a regression for the multi-pipeline use-case (so if using multi-pipelines, do not update to 7.5.2).

The compilation/initialization improvements and the fix for the regression will be in 7.6 (and 7.5.3 if there is a 7.5.3 in the future).

blookot commented 4 years ago

Hi @colinsurprenant Thank you very much for your answer. I tested this file again on 7.6.0 that was just released and I'm getting the same compilation error (after 15mn or so) with -Xss28g... I attached the output to this comment. output.txt I noticed that during the compilation, mostly 1 CPU is used, see top -H output below:

  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
 2601 root      20   0 32.122g 3.216g  20372 R 99.7 10.9   3:44.35 Converge Pipeli
 2594 root      20   0 32.122g 3.216g  20372 S  8.3 10.9   0:24.81 C1 CompilerThre
 2593 root      20   0 32.122g 3.216g  20372 S  3.3 10.9   0:29.26 C2 CompilerThre
 2602 root      20   0 32.122g 3.216g  20372 S  3.3 10.9   0:01.26 pool-3-thread-1
 2591 root      20   0 32.122g 3.216g  20372 S  2.0 10.9   0:30.06 C2 CompilerThre
 2592 root      20   0 32.122g 3.216g  20372 S  1.0 10.9   0:28.92 C2 CompilerThre
blookot commented 4 years ago

PS. During the whole 15mn of processing mentioned above, the 28GB of memory allocated to the JVM is not used! So I don't understand why it would result in a StackOverflow error...

vincent_maury@vincent-maury-logstash-testing:~$ free -m
              total        used        free      shared  buff/cache   available
Mem:          30163        3282       26698          10         182       26536
Swap:             0           0           0
colinsurprenant commented 4 years ago

@blookot -Xss28g is way too big. Default for this is typically in Kb (1024). You can see what the default is in your environment using

java -XX:+PrintFlagsFinal -version | grep ThreadStackSize

Note that I tried your -Xss28g and the result is interesting, it sets the stack at 0! 🤔

java -Xss28g -XX:+PrintFlagsFinal -version | grep ThreadStackSize
     intx CompilerThreadStackSize                   = 0                                   {pd product}
     intx ThreadStackSize                          := 0                                   {pd product}
     intx VMThreadStackSize                         = 1024
blookot commented 4 years ago

Sorry @colinsurprenant I didn't explicitely write the settings. I used -Xms28g and -Xmx28g which might be a terrible choice as well...

colinsurprenant commented 4 years ago

@blookot

blookot commented 4 years ago

Thanks again @colinsurprenant I'll try these settings. I initially set the 28GB because of reading our doc page that says: "Leave at least 1GB free for the OS and other processes" ;-)

colinsurprenant commented 4 years ago

@blookot leaving just 1Gb as a general rule feels wrong and does not take into account the total physical ram. I will followup with a doc issue to correct that, not sure where this is coming from. Note that ES docs still recommends not more that 50% as a general rule; I would say up to 75% should be ok IMO, especially as we get into high physical memory capacity.

colinsurprenant commented 4 years ago

created issue #11605