micronaut-projects / micronaut-tracing

Distributed Tracing Support
Apache License 2.0
17 stars 27 forks source link

Micronaut Tracing 4.5.0 causing Starvation #229

Open driverpt opened 1 year ago

driverpt commented 1 year ago

Expected Behavior

AWS API Gateway Lambda Requests to work

Actual Behaviour

We're getting 503 Service Unavailable.

By analysing the Logs we notice that the Controllers are properly invoked and returned but after that the request just becomes a ghost.

Micronaut 4.4.0 doesn't work with Micronaut 3.8.1. See here for more information

Workaround: Downgrade Micronaut to 3.7.5 and Micronaut Tracing to 4.4.0.

Steps To Reproduce

  1. Create Micronaut Application
  2. Add micronaut-function-aws-api-proxy
  3. Add OpenTelemetry (e.g.: "io.opentelemetry:opentelemetry-exporter-otlp")
  4. Create Basic Controller
  5. Add GraalVM Native Compilation
  6. Deploy using lambda_provided Runtime to AWS Lambda

Environment Information

Example Application

No response

Version

3.8.1

n0tl3ss commented 1 year ago

Hi @driverpt

Can you try to use Micronaut core 3.7.5 and micronaut-tracing 4.5.0?

Thanks :)

driverpt commented 1 year ago
java.lang.NoSuchFieldError: io.opentelemetry.semconv.trace.attributes.SemanticAttributes.NET_SOCK_HOST_ADDR
io.opentelemetry.instrumentation.api.instrumenter.net.internal.InternalNetServerAttributesExtractor.onStart(InternalNetServerAttributesExtractor.java:78)
io.opentelemetry.instrumentation.api.instrumenter.net.NetServerAttributesExtractor.onStart(NetServerAttributesExtractor.java:36)
io.opentelemetry.instrumentation.api.instrumenter.Instrumenter.doStart(Instrumenter.java:176)
io.opentelemetry.instrumentation.api.instrumenter.Instrumenter.start(Instrumenter.java:129)
io.opentelemetry.instrumentation.api.instrumenter.PropagatingFromUpstreamInstrumenter.start(PropagatingFromUpstreamInstrumenter.java:31)
io.micronaut.tracing.opentelemetry.instrument.http.server.OpenTelemetryServerFilter.doFilter(OpenTelemetryServerFilter.java:84)
io.micronaut.http.filter.HttpServerFilter.doFilter(HttpServerFilter.java:48)
io.micronaut.http.server.RouteExecutor.filterPublisher(RouteExecutor.java:409)
io.micronaut.http.server.RouteExecutor.buildResultEmitter(RouteExecutor.java:634)
io.micronaut.http.server.RouteExecutor.executeRoute(RouteExecutor.java:354)
io.micronaut.function.aws.proxy.MicronautLambdaContainerHandler.handleRouteMatch(MicronautLambdaContainerHandler.java:360)
io.micronaut.function.aws.proxy.MicronautLambdaContainerHandler.lambda$handleRequest$2(MicronautLambdaContainerHandler.java:333)
io.micronaut.http.context.ServerRequestContext.with(ServerRequestContext.java:68)
io.micronaut.function.aws.proxy.MicronautLambdaContainerHandler.handleRequest(MicronautLambdaContainerHandler.java:325)
io.micronaut.function.aws.proxy.MicronautLambdaContainerHandler.handleRequest(MicronautLambdaContainerHandler.java:105)
io.micronaut.function.aws.proxy.AbstractLambdaContainerHandler.proxy(AbstractLambdaContainerHandler.java:205)
io.micronaut.function.aws.proxy.MicronautLambdaHandler.handleRequest(MicronautLambdaHandler.java:69)
io.micronaut.function.aws.proxy.MicronautLambdaHandler.handleRequest(MicronautLambdaHandler.java:35)
io.micronaut.function.aws.runtime.AbstractMicronautLambdaRuntime.startRuntimeApiEventLoop(AbstractMicronautLambdaRuntime.java:356)
io.micronaut.function.aws.runtime.AbstractMicronautLambdaRuntime.run(AbstractMicronautLambdaRuntime.java:137)
io.micronaut.function.aws.runtime.MicronautLambdaRuntime.main(MicronautLambdaRuntime.java:50)