search

newrelic / newrelic-dotnet-agent

The New Relic .NET language agent.
Apache License 2.0
97 stars 61 forks source link

Log decorating not linking to APM #1054

Closed amweiss closed 2 years ago

amweiss commented 2 years ago

We have an existing log shipping setup and tried to use the new log decorating (the old serilog enricher worked fine as well). However, now the logs aren't linked in APM even though they show up in the infrastructure logs.

Description Splunk log:

image

Infrastructure logs: image

APM logs:

image

Serilog formatter changed from: NewRelic.LogEnrichers.Serilog.NewRelicFormatter, NewRelic.LogEnrichers.Serilog to Serilog.Formatting.Json.JsonFormatter, Serilog with renderMessage=true and localDecorating enabled="true" set in the config.

If you need diagnostic logs, I'll send them though a support ticket.

nr-ahemsath commented 2 years ago

@amweiss Thanks for bringing this to our attention.

Can you clarify what you mean by "infrastructure logs"? Are they the same log messages from your application as the ones seen in Splunk, just in a different view in New Relic?

amweiss commented 2 years ago

Sorry, it used to be called that I think. It's the "logger" url of New Relic One from the fluentd log shipper: https://docs.newrelic.com/docs/logs/forward-logs/fluentd-plugin-log-forwarding

image

Yep, it's the exact same log lines in splunk and new relic (I guess I should have not redacted the whole thing 🙃) trace id and all, they are just no longer connected to APM like they were before for logs-in-context when we used the enricher and formatter.

nr-ahemsath commented 2 years ago

@amweiss Thanks for clarifying. At this point I think it would be better to work this issue through our support ticketing system (please reference this GH issue when creating the ticket though). I'm not sure at this point whether the issue is with how our agent is sending the data, or with how the UI/backend is trying to find your logs for that APM logs view. (One of the reasons why it will be better to work this through support is that we will need to be able to see the account-specific data which you are quite understandably hiding in your screenshots in order to answer this question.)

I'll close this issue once the support ticket has been created.

amweiss commented 2 years ago

@nr-ahemsath Case #00036857 created.