stdout scanner closed unexpectedly whilst running daemon

[jgough]

Just recently in the past week when building from head on trunk I've started getting this error 100% of the time when trying to run the daemon:

$ logstash-filter-verifier daemon start --loglevel debug
config: socket: /tmp/logstash-filter-verifier.sock
config: logstash-path: /usr/share/logstash/bin/logstash
Temporary directory for daemon created in "/tmp/lfv-3525936658"
state change: "created" -> "started" by "start"
start stderr scanner
Daemon listening on /tmp/logstash-filter-verifier.sock
Waiting for /tmp/lfv-3525936658/logstash-instance/3HxdGea8/logstash.log to appear...
start stdout scanner
stdout:  Using bundled JDK: /usr/share/logstash/jdk
stderr:  OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
stdout:  Sending Logstash logs to /tmp/lfv-3525936658/logstash-instance/3HxdGea8 which is now configured via log4j2.properties
stdout scanner closed unexpectedly
stderr scanner closed unexpectedly
state change: "started" -> "unknown" by "crash"
exit stdout scanner
shutdown log reader
broadcast shutdown for waitForState
state change: "unknown" -> "unknown" by "crash"
exit stderr scanner
failed to wait for child process: exit status 1
state change: "created" -> "started" by "start"
Waiting for /tmp/lfv-3525936658/logstash-instance/30BGK931/logstash.log to appear...
start stderr scanner
start stdout scanner
stdout:  Using bundled JDK: /usr/share/logstash/jdk
stderr:  OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
stdout:  Sending Logstash logs to /tmp/lfv-3525936658/logstash-instance/30BGK931 which is now configured via log4j2.properties
stderr scanner closed unexpectedly
state change: "started" -> "unknown" by "crash"
exit stderr scanner
shutdown log reader
broadcast shutdown for waitForState
exit stdout scanner
failed to wait for child process: exit status 1
state change: "created" -> "started" by "start"
start stderr scanner
start stdout scanner
Waiting for /tmp/lfv-3525936658/logstash-instance/QyT95TBS/logstash.log to appear...
stdout:  Using bundled JDK: /usr/share/logstash/jdk
stderr:  OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
stdout:  Sending Logstash logs to /tmp/lfv-3525936658/logstash-instance/QyT95TBS which is now configured via log4j2.properties
stderr scanner closed unexpectedly
state change: "started" -> "unknown" by "crash"
exit stderr scanner
broadcast shutdown for waitForState
shutdown log reader
exit stdout scanner
failed to wait for child process: exit status 1
state change: "created" -> "started" by "start"
start stderr scanner
Waiting for /tmp/lfv-3525936658/logstash-instance/ymvdp5mu/logstash.log to appear...
start stdout scanner
stdout:  Using bundled JDK: /usr/share/logstash/jdk
stderr:  OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release
....

I'm running it in a bit of a complex way inside a gitlab runner (and in docker in docker). As I mentioned above it has only just stopped working so the only think I can think of is something upstream affecting this?

I've tried to come up with repro steps for this but haven't been able to reproduce this issue in a standalone way. I'm going to keep trying to repro this. Do you have any idea why this might be occurring, or anything I can do to get more info on the issue?

[jgough]

I suspect this may be something deeper actually to do with the version of logstash that I am using. I've upgraded to 7.17.1 and seeing something different now. Will investigate a bit further and close if I can sort this.

[jgough]

Going to close this as I've fixed it with the latest version of logstash