newrelic / newrelic-node-apollo-server-plugin

Apache License 2.0
62 stars 29 forks source link

cannot see custom attributes on new relic ui for graphql operations in a distributed trace #274

Closed rhyek closed 1 year ago

rhyek commented 1 year ago

Description

i have the following setup: nextjs app -> apollo federation gateway -> nestjs app with nestjs-graphql + apollo server i am testing out this plugin and am noticing i cannot see any graphql relevant information in my distributed traces aside from the transaction names having the grapqhl operation/fields in them. i am expecting to see something like what is described here: https://github.com/newrelic/newrelic-node-apollo-server-plugin/blob/main/docs/segments-and-spans.md#segments-and-spans

not sure if i'm looking at the correct section in the ui, but none of that is present in the attributes.

image

Expected Behavior

i expect to see the custom attributes mentioned in the plugin's documentation.

Logs

{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.266Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.266Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.304Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.304Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.305Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.305Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.305Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:39.305Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:39.817Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.061Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:40.062Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.239Z","msg":"Not recording function setTimeout, not in a transaction.","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.247Z","msg":"Recorded metric Nodejs/EventLoop/CPU/Usage: \"{\\\"total\\\":0.00872,\\\"min\\\":0.000009,\\\"max\\\":0.001177,\\\"sumOfSquares\\\":0.000004183408,\\\"count\\\":49,\\\"callCount\\\":49,\\\"totalExclusive\\\":0.00872}\"","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.247Z","msg":"Recorded metric CPU/User Time: 0.005425","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.247Z","msg":"Recorded metric CPU/System Time: 0.003178","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.247Z","msg":"Recorded metric CPU/User/Utilization: 0.00003616907793852923","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.247Z","msg":"Recorded metric CPU/System/Utilization: 0.00002118807920528035","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:41.251Z","msg":"Recorded memory","component":"sampler","rss":35618816,"heapTotal":31080448,"heapUsed":28000040,"external":7577860,"arrayBuffers":2248025}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.628Z","msg":"Not recording function setTimeout, not in a transaction.","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.632Z","msg":"Recorded metric Nodejs/EventLoop/CPU/Usage: \"{\\\"total\\\":0.006081,\\\"min\\\":0.000006,\\\"max\\\":0.001561,\\\"sumOfSquares\\\":0.000005313407,\\\"count\\\":20,\\\"callCount\\\":20,\\\"totalExclusive\\\":0.006081}\"","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.632Z","msg":"Recorded metric CPU/User Time: 0.002963","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.632Z","msg":"Recorded metric CPU/System Time: 0.002556","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.632Z","msg":"Recorded metric CPU/User/Utilization: 0.000019754650310020668","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.632Z","msg":"Recorded metric CPU/System/Utilization: 0.000017041136075738383","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:41.645Z","msg":"Recorded memory","component":"sampler","rss":35962880,"heapTotal":14942208,"heapUsed":11757144,"external":1078114,"arrayBuffers":59678}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.904Z","msg":"Not recording function setTimeout, not in a transaction.","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.932Z","msg":"Recorded memory","component":"sampler","rss":44367872,"heapTotal":79446016,"heapUsed":74431048,"external":3598206,"arrayBuffers":161395}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.933Z","msg":"Recorded metric Nodejs/EventLoop/CPU/Usage: \"{\\\"total\\\":0.01208,\\\"min\\\":0.000023,\\\"max\\\":0.002747,\\\"sumOfSquares\\\":0.000015312638,\\\"count\\\":21,\\\"callCount\\\":21,\\\"totalExclusive\\\":0.01208}\"","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.933Z","msg":"Recorded metric CPU/User Time: 0.0055","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.933Z","msg":"Recorded metric CPU/System Time: 0.006628","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.933Z","msg":"Recorded metric CPU/User/Utilization: 0.000036654448517160944","component":"sampler"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:41.933Z","msg":"Recorded metric CPU/System/Utilization: 0.00004417194268577141","component":"sampler"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.267Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.268Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.304Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.304Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.305Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.305Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.305Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:44.306Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.817Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:44.818Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.064Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.064Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.064Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.064Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.064Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.065Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.065Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:45.065Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:46.277Z","msg":"Recorded memory","component":"sampler","rss":35405824,"heapTotal":31080448,"heapUsed":28061296,"external":7577860,"arrayBuffers":2248025}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:46.647Z","msg":"Recorded memory","component":"sampler","rss":35749888,"heapTotal":14942208,"heapUsed":11812016,"external":1078114,"arrayBuffers":59678}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:46.917Z","msg":"Recorded memory","component":"sampler","rss":45285376,"heapTotal":79446016,"heapUsed":74524152,"external":3598206,"arrayBuffers":161395}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.393Z","msg":"Reset called on name state, path stack was undefined","component":"name-state"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.394Z","msg":"setName called on name state, path stack now \"[]\"","component":"name-state"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.394Z","msg":"Stored transaction 67303d02f42262e8 information on request and response","component":"http"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.394Z","msg":"Adding segment /graphql/mutation/testDistributedTracing to ROOT in 67303d02f42262e8","component":"segment"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.395Z","msg":"Applying user naming rules for RUM.","component":"http","url":"/graphql/mutation/testDistributedTracing","transaction":"67303d02f42262e8"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.401Z","msg":"Setting transaction name","component":"transaction","requestURL":{"protocol":null,"slashes":null,"auth":null,"host":null,"port":null,"hostname":null,"hash":null,"search":null,"query":{},"pathname":"/graphql/mutation/testDistributedTracing","path":"/graphql/mutation/testDistributedTracing","href":"/graphql/mutation/testDistributedTracing"},"statusCode":204,"transactionId":"67303d02f42262e8","transactionName":null}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.402Z","msg":"Finished setting transaction name from Uri","component":"transaction","transactionId":"67303d02f42262e8","transactionName":"WebTransaction/NormalizedUri/*","ignore":false}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.403Z","msg":"Not adding attribute host.displayName with undefined value type. This is expected for undefinedattributes and only an issue if an attribute is not expected to be undefinedor not of the type expected.","component":"attributes"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"Reset called on name state, path stack was undefined","component":"name-state"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"setName called on name state, path stack now \"[]\"","component":"name-state"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"Stored transaction 78c70aaeff584347 information on request and response","component":"http"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"Adding segment /graphql/mutation/testDistributedTracing to ROOT in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"Applying user naming rules for RUM.","component":"http","url":"/graphql/mutation/testDistributedTracing","transaction":"78c70aaeff584347"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"Accepting trace context DT payload for transaction 78c70aaeff584347","component":"transaction"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.404Z","msg":"Accepting TraceContext for transaction 78c70aaeff584347","component":"TraceContext"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.405Z","msg":"Accepted traceparent for transaction 78c70aaeff584347","component":"TraceContext"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.405Z","msg":"Accepted tracestate for transaction 78c70aaeff584347","component":"TraceContext"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.406Z","msg":"Begin requestDidStart","component":"ApolloServerPlugin","module":"NewRelicAPI"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.407Z","msg":"Adding segment GraphQL/operation/ApolloServer/<unknown> to /graphql/mutation/testDistributedTracing in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"GraphQL/operation/ApolloServer/<unknown>","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.407Z","msg":"Created segment","component":"TransactionShim","module":"NewRelicAPI","inContext":null,"parent":[0.461625,2.791166,"/graphql/mutation/testDistributedTracing",{},[[-1695325968404,-1695325968404,"GraphQL/operation/ApolloServer/<unknown>",{},[]]]],"parameters":null,"internal":false,"opaque":false}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.408Z","msg":"setName called on name state, path stack now \"[{\\\"path\\\":\\\"mutation/TEST_DISTRIBUTED_TRACING/testDistributedTracing\\\",\\\"params\\\":null}]\"","component":"name-state"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.410Z","msg":"Adding segment External/localhost:4002 to GraphQL/operation/ApolloServer/mutation/TEST_DISTRIBUTED_TRACING/testDistributedTracing in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.410Z","msg":"traceparent added with 00-4b7a7c7a83d50aa3b6c6763a23a72400-620dce5dc7be2783-01","component":"TraceContext"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"tracestate added with 3509235@nr=0-0-3509235-536415247-620dce5dc7be2783-78c70aaeff584347-1-1.617985-1695325968411","component":"TraceContext"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"Added outbound request w3c trace context headers in transaction 78c70aaeff584347","component":"transaction"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"DistributedTracePayload created with {\"ty\":\"App\",\"ac\":\"3509235\",\"ap\":\"536415247\",\"tx\":\"78c70aaeff584347\",\"tr\":\"4b7a7c7a83d50aa3b6c6763a23a72400\",\"pr\":1.617985,\"sa\":true,\"ti\":1695325968411,\"id\":\"620dce5dc7be2783\"}","component":"distributedTracePayload"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"DistributedTracePayload httpSafe: eyJ2IjpbMCwxXSwiZCI6eyJ0eSI6IkFwcCIsImFjIjoiMzUwOTIzNSIsImFwIjoiNTM2NDE1MjQ3IiwidHgiOiI3OGM3MGFhZWZmNTg0MzQ3IiwidHIiOiI0YjdhN2M3YTgzZDUwYWEzYjZjNjc2M2EyM2E3MjQwMCIsInByIjoxLjYxNzk4NSwic2EiOnRydWUsInRpIjoxNjk1MzI1OTY4NDExLCJpZCI6IjYyMGRjZTVkYzdiZTI3ODMifX0=","component":"distributedTracePayload"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"Added outbound request distributed tracing headers in transaction 78c70aaeff584347","component":"transaction"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"Adding segment http.Agent#createConnection to External/localhost:4002 in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"Adding segment net.Socket.connect to http.Agent#createConnection in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"net.Socket.connect","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"Created segment","component":"Shim","module":"net","recorder":null,"inContext":null,"parent":[7.367083,7.546375,"http.Agent#createConnection",{},[[-1695325968404,-1695325968404,"net.Socket.connect",{},[]]]],"parameters":null,"internal":false,"opaque":false}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.411Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Adding segment timers.setTimeout to net.Socket.connect in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"timers.setTimeout","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Created segment","component":"Shim","module":"timers","recorder":null,"inContext":null,"parent":[7.607708,7.780333,"net.Socket.connect",{},[[-1695325968404,-1695325968404,"timers.setTimeout",{},[]]]],"parameters":null,"internal":false,"opaque":false,"stream":null,"promise":null,"callback":0,"rowCallback":null,"after":null,"callbackRequired":null}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Binding callback 0 segment: true","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Wrapping nodule itself (<anonymous>).","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Applying segment timers.setTimeout","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Wrapping 1 properties on nodule.","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Replacing \"onread\" with wrapped version","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Wrapping 1 properties on nodule.","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Replacing \"emit\" with wrapped version","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Instrumented request.emit.emit.","component":"shimmer"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.412Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.413Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.413Z","msg":"Adding segment Callback: <anonymous> to timers.setTimeout in 78c70aaeff584347","component":"segment"}
{"v":0,"level":10,"name":"Callback: <anonymous>","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.413Z","msg":"Created segment","component":"Shim","module":"timers","recorder":null,"inContext":null,"parent":[7.908833,7.939374999999999,"timers.setTimeout",{},[[-1695325968404,-1695325968404,"Callback: <anonymous>",{},[]]]],"parameters":null,"internal":false,"opaque":false}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.413Z","msg":"Applying segment Callback: <anonymous>","component":"Shim","module":"timers"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.413Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.413Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.532Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.532Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.532Z","msg":"Instrumented response.emit.","component":"shimmer"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.532Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"net"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.534Z","msg":"End willSendResponse","component":"ApolloServerPlugin","module":"NewRelicAPI"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.534Z","msg":"Setting transaction name","component":"transaction","requestURL":{"protocol":null,"slashes":null,"auth":null,"host":null,"port":null,"hostname":null,"hash":null,"search":null,"query":{},"pathname":"/graphql/mutation/testDistributedTracing","path":"/graphql/mutation/testDistributedTracing","href":"/graphql/mutation/testDistributedTracing"},"statusCode":200,"transactionId":"78c70aaeff584347","transactionName":null}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.535Z","msg":"Finished setting transaction name from Uri","component":"transaction","transactionId":"78c70aaeff584347","transactionName":"WebTransaction/Nodejs/POST//mutation/TEST_DISTRIBUTED_TRACING/testDistributedTracing","ignore":false}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.535Z","msg":"Not adding attribute host.displayName with undefined value type. This is expected for undefinedattributes and only an issue if an attribute is not expected to be undefinedor not of the type expected.","component":"attributes"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:48.536Z","msg":"Applying segment net.Socket.connect","component":"Shim","module":"fs"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.268Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.268Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.308Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.308Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.308Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.308Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.308Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38340,"time":"2023-09-21T19:52:49.308Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"No transaction events to send.","component":"transaction-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.817Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38344,"time":"2023-09-21T19:52:49.818Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.065Z","msg":"error_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.066Z","msg":"No error events to send.","component":"error_tracer"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.066Z","msg":"analytic_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.066Z","msg":"Invoking remote method analytic_event_data","component":"remote_method"}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.071Z","msg":"Calling analytic_event_data on collector API","component":"remote_method","data":"[\"BcF73FD-YlmaADWL8yAg3GdlDJ8cAAgBAAAnIQEAAJXOAgQf-QwPAwAGMTEuMS4wABhDYXJsb3MtTWFjQm9vay1Qcm8ubG9jYWwAF2ZlZGVyYXRlZC1ncmFwaHFsLWxvY2Fs\",{\"reservoir_size\":833,\"events_seen\":2},[[{\"webDuration\":0.131117042,\"timestamp\":1695325968404,\"name\":\"WebTransaction/Nodejs/POST//mutation/TEST_DISTRIBUTED_TRACING/testDistributedTracing\",\"duration\":0.131117042,\"totalTime\":0.13019223435937502,\"type\":\"Transaction\",\"error\":false,\"externalDuration\":0.12133525,\"externalCallCount\":1,\"traceId\":\"4b7a7c7a83d50aa3b6c6763a23a72400\",\"guid\":\"78c70aaeff584347\",\"priority\":1.617985,\"sampled\":true,\"parent.type\":\"Browser\",\"parent.app\":\"601415515\",\"parent.account\":\"3509235\",\"parent.transportType\":\"HTTP\",\"parent.transportDuration\":0.016,\"parentSpanId\":\"7196bfeb4aae251e\"},{\"graphql.query\":\"mutation TEST_DISTRIBUTED_TRACING($somevar: String!) {\\n  testDistributedTracing(somevar: $somevar)\\n}\\n\",\"graphql.variables\":\"{\\\"somevar\\\":\\\"eyoo\\\"}\",\"tyty\":\"welcome,welcome\"},{\"request.headers.host\":\"localhost:4000\",\"request.headers.connection\":\"keep-alive\",\"request.headers.contentLength\":\"190\",\"request.headers.secChUa\":\"\\\"Chromium\\\";v=\\\"116\\\", \\\"Not)A;Brand\\\";v=\\\"24\\\", \\\"Google Chrome\\\";v=\\\"116\\\"\",\"request.headers.tracestate\":\"3509235@nr=0-1-3509235-601415515-7196bfeb4aae251e----1695325968389\",\"request.headers.traceparent\":\"00-4b7a7c7a83d50aa3b6c6763a23a72400-7196bfeb4aae251e-01\",\"request.headers.secChUaMobile\":\"?0\",\"request.headers.newrelic\":\"eyJ2IjpbMCwxXSwiZCI6eyJ0eSI6IkJyb3dzZXIiLCJhYyI6IjM1MDkyMzUiLCJhcCI6IjYwMTQxNTUxNSIsImlkIjoiNzE5NmJmZWI0YWFlMjUxZSIsInRyIjoiNGI3YTdjN2E4M2Q1MGFhM2I2YzY3NjNhMjNhNzI0MDAiLCJ0aSI6MTY5NTMyNTk2ODM4OX19\",\"request.headers.contentType\":\"application/json\",\"request.headers.accept\":\"*/*\",\"request.headers.userAgent\":\"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36\",\"request.headers.secChUaPlatform\":\"\\\"macOS\\\"\",\"request.headers.origin\":\"http://app.localhost:3000\",\"request.headers.secFetchSite\":\"cross-site\",\"request.headers.secFetchMode\":\"cors\",\"request.headers.secFetchDest\":\"empty\",\"request.headers.referer\":\"http://app.localhost:3000/\",\"request.headers.acceptEncoding\":\"gzip, deflate, br\",\"request.headers.acceptLanguage\":\"en-US,en;q=0.9\",\"request.method\":\"POST\",\"request.uri\":\"/graphql/mutation/testDistributedTracing\",\"http.statusCode\":\"200\",\"http.statusText\":\"OK\",\"response.headers.accessControlAllowOrigin\":\"http://app.localhost:3000\",\"response.headers.vary\":\"Origin\",\"response.headers.accessControlAllowCredentials\":\"true\",\"response.headers.cacheControl\":\"no-store\",\"response.headers.contentType\":\"application/json; charset=utf-8\",\"response.headers.contentLength\":\"64\",\"response.headers.eTag\":\"W/\\\"40-hCJKCxyBqJL6xUWMew1Uxl572RQ\\\"\"}],[{\"webDuration\":0.009318040999999999,\"timestamp\":1695325968393,\"name\":\"WebTransaction/NormalizedUri/*\",\"duration\":0.009318040999999999,\"totalTime\":0.004700125,\"type\":\"Transaction\",\"error\":false,\"traceId\":\"915751be23b501b7e400307b4ad55069\",\"guid\":\"67303d02f42262e8\",\"priority\":1.923496,\"sampled\":true},{},{\"request.headers.host\":\"localhost:4000\",\"request.headers.connection\":\"keep-alive\",\"request.headers.accept\":\"*/*\",\"request.headers.accessControlRequestMethod\":\"POST\",\"request.headers.accessControlRequestHeaders\":\"authorization,content-type,newrelic,traceparent,tracestate\",\"request.headers.origin\":\"http://app.localhost:3000\",\"request.headers.userAgent\":\"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36\",\"request.headers.secFetchMode\":\"cors\",\"request.headers.secFetchSite\":\"cross-site\",\"request.headers.secFetchDest\":\"empty\",\"request.headers.referer\":\"http://app.localhost:3000/\",\"request.headers.acceptEncoding\":\"gzip, deflate, br\",\"request.headers.acceptLanguage\":\"en-US,en;q=0.9\",\"request.method\":\"OPTIONS\",\"request.uri\":\"/graphql/mutation/testDistributedTracing\",\"http.statusCode\":\"204\",\"http.statusText\":\"No Content\",\"response.headers.accessControlAllowOrigin\":\"http://app.localhost:3000\",\"response.headers.vary\":\"Origin, Access-Control-Request-Headers\",\"response.headers.accessControlAllowCredentials\":\"true\",\"response.headers.accessControlAllowMethods\":\"GET,HEAD,PUT,PATCH,POST,DELETE\",\"response.headers.accessControlAllowHeaders\":\"authorization,content-type,newrelic,traceparent,tracestate\",\"response.headers.contentLength\":\"0\"}]]]","compressed":false}
{"v":0,"level":10,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.071Z","msg":"Posting to https://collector.newrelic.com:443/agent_listener/invoke_raw_method?marshal_format=json&protocol_version=17&license_key=0d8ecef73a353e6ff1f6b5a903594931FFFFNRAL&method=analytic_event_data&run_id=BcF73FD-YlmaADWL8yAg3GdlDJ8cAAgBAAAnIQEAAJXOAgQf-QwPAwAGMTEuMS4wABhDYXJsb3MtTWFjQm9vay1Qcm8ubG9jYWwAF2ZlZGVyYXRlZC1ncmFwaHFsLWxvY2Fs","component":"remote_method","body":"[\"BcF73FD-YlmaADWL8yAg3GdlDJ8cAAgBAAAnIQEAAJXOAgQf-QwPAwAGMTEuMS4wABhDYXJsb3MtTWFjQm9vay1Qcm8ubG9jYWwAF2ZlZGVyYXRlZC1ncmFwaHFsLWxvY2Fs\",{\"reservoir_size\":833,\"events_seen\":2},[[{\"webDuration\":0.131117042,\"timestamp\":1695325968404,\"name\":\"WebTransaction/Nodejs/POST//mutation/TEST_DISTRIBUTED_TRACING/testDistributedTracing\",\"duration\":0.131117042,\"totalTime\":0.13019223435937502,\"type\":\"Transaction\",\"error\":false,\"externalDuration\":0.12133525,\"externalCallCount\":1,\"traceId\":\"4b7a7c7a83d50aa3b6c6763a23a72400\",\"guid\":\"78c70aaeff584347\",\"priority\":1.617985,\"sampled\":true,\"parent.type\":\"Browser\",\"parent.app\":\"601415515\",\"parent.account\":\"3509235\",\"parent.transportType\":\"HTTP\",\"parent.transportDuration\":0.016,\"parentSpanId\":\"7196bfeb4aae251e\"},{\"graphql.query\":\"mutation TEST_DISTRIBUTED_TRACING($somevar: String!) {\\n  testDistributedTracing(somevar: $somevar)\\n}\\n\",\"graphql.variables\":\"{\\\"somevar\\\":\\\"eyoo\\\"}\",\"tyty\":\"welcome,welcome\"},{\"request.headers.host\":\"localhost:4000\",\"request.headers.connection\":\"keep-alive\",\"request.headers.contentLength\":\"190\",\"request.headers.secChUa\":\"\\\"Chromium\\\";v=\\\"116\\\", \\\"Not)A;Brand\\\";v=\\\"24\\\", \\\"Google Chrome\\\";v=\\\"116\\\"\",\"request.headers.tracestate\":\"3509235@nr=0-1-3509235-601415515-7196bfeb4aae251e----1695325968389\",\"request.headers.traceparent\":\"00-4b7a7c7a83d50aa3b6c6763a23a72400-7196bfeb4aae251e-01\",\"request.headers.secChUaMobile\":\"?0\",\"request.headers.newrelic\":\"eyJ2IjpbMCwxXSwiZCI6eyJ0eSI6IkJyb3dzZXIiLCJhYyI6IjM1MDkyMzUiLCJhcCI6IjYwMTQxNTUxNSIsImlkIjoiNzE5NmJmZWI0YWFlMjUxZSIsInRyIjoiNGI3YTdjN2E4M2Q1MGFhM2I2YzY3NjNhMjNhNzI0MDAiLCJ0aSI6MTY5NTMyNTk2ODM4OX19\",\"request.headers.contentType\":\"application/json\",\"request.headers.accept\":\"*/*\",\"request.headers.userAgent\":\"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36\",\"request.headers.secChUaPlatform\":\"\\\"macOS\\\"\",\"request.headers.origin\":\"http://app.localhost:3000\",\"request.headers.secFetchSite\":\"cross-site\",\"request.headers.secFetchMode\":\"cors\",\"request.headers.secFetchDest\":\"empty\",\"request.headers.referer\":\"http://app.localhost:3000/\",\"request.headers.acceptEncoding\":\"gzip, deflate, br\",\"request.headers.acceptLanguage\":\"en-US,en;q=0.9\",\"request.method\":\"POST\",\"request.uri\":\"/graphql/mutation/testDistributedTracing\",\"http.statusCode\":\"200\",\"http.statusText\":\"OK\",\"response.headers.accessControlAllowOrigin\":\"http://app.localhost:3000\",\"response.headers.vary\":\"Origin\",\"response.headers.accessControlAllowCredentials\":\"true\",\"response.headers.cacheControl\":\"no-store\",\"response.headers.contentType\":\"application/json; charset=utf-8\",\"response.headers.contentLength\":\"64\",\"response.headers.eTag\":\"W/\\\"40-hCJKCxyBqJL6xUWMew1Uxl572RQ\\\"\"}],[{\"webDuration\":0.009318040999999999,\"timestamp\":1695325968393,\"name\":\"WebTransaction/NormalizedUri/*\",\"duration\":0.009318040999999999,\"totalTime\":0.004700125,\"type\":\"Transaction\",\"error\":false,\"traceId\":\"915751be23b501b7e400307b4ad55069\",\"guid\":\"67303d02f42262e8\",\"priority\":1.923496,\"sampled\":true},{},{\"request.headers.host\":\"localhost:4000\",\"request.headers.connection\":\"keep-alive\",\"request.headers.accept\":\"*/*\",\"request.headers.accessControlRequestMethod\":\"POST\",\"request.headers.accessControlRequestHeaders\":\"authorization,content-type,newrelic,traceparent,tracestate\",\"request.headers.origin\":\"http://app.localhost:3000\",\"request.headers.userAgent\":\"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36\",\"request.headers.secFetchMode\":\"cors\",\"request.headers.secFetchSite\":\"cross-site\",\"request.headers.secFetchDest\":\"empty\",\"request.headers.referer\":\"http://app.localhost:3000/\",\"request.headers.acceptEncoding\":\"gzip, deflate, br\",\"request.headers.acceptLanguage\":\"en-US,en;q=0.9\",\"request.method\":\"OPTIONS\",\"request.uri\":\"/graphql/mutation/testDistributedTracing\",\"http.statusCode\":\"204\",\"http.statusText\":\"No Content\",\"response.headers.accessControlAllowOrigin\":\"http://app.localhost:3000\",\"response.headers.vary\":\"Origin, Access-Control-Request-Headers\",\"response.headers.accessControlAllowCredentials\":\"true\",\"response.headers.accessControlAllowMethods\":\"GET,HEAD,PUT,PATCH,POST,DELETE\",\"response.headers.accessControlAllowHeaders\":\"authorization,content-type,newrelic,traceparent,tracestate\",\"response.headers.contentLength\":\"0\"}]]]"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.072Z","msg":"custom_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.072Z","msg":"No custom events to send.","component":"custom-event-aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.072Z","msg":"log_event_data Aggregator data send.","component":"base_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.072Z","msg":"No log events to send.","component":"logs_aggregator"}
{"v":0,"level":20,"name":"newrelic","hostname":"Carlos-MacBook-Pro.local","pid":38350,"time":"2023-09-21T19:52:50.185Z","msg":"Finished receiving data back from the collector for analytic_event_data.","component":"remote_method"}

Steps to Reproduce

code (project is ESM):

import createNewRelicPlugin from '@newrelic/apollo-server-plugin';
...
// @ts-ignore
const newRelicPlugin = createNewRelicPlugin<ApolloServerPlugin>({
}) as ApolloServerPlugin;

const server = new ApolloServer({
  gateway,
  plugins: [ApolloServerPluginDrainHttpServer({ httpServer }), newRelicPlugin],
});

Your Environment

Additional context

i also tried explicitly setting custom parameters both using a return value for customOperationAttributes and newrelic.addCustomAttributes. none of the attributes show up. this makes me think it's not an issue with this plugin, necessarily, but something with the node agent, but wanted to post here as well, thanks.

newrelic 11.1.0 @newrelic/apollo-server-plugin 4.0.0 @apollo/gateway: 2.3.2 @apollo/server: 4.3.3

i'm using a newrelic.js file for configuration:

'use strict';
// https://github.com/newrelic-experimental/newrelic-nextjs-integration/blob/main/newrelic.js
/**
 * New Relic agent configuration.
 *
 * See lib/config/default.js in the agent distribution for a more complete
 * description of configuration variables and their potential values.
 */
exports.config = {
  /**
   * Array of application names.
   */
  app_name: [process.env.NEW_RELIC_APP_NAME],
  /**
   * Your New Relic license key.
   */
  license_key: process.env.NEW_RELIC_LICENSE_KEY,
  /**
   * This setting controls distributed tracing.
   * Distributed tracing lets you see the path that a request takes through your
   * distributed system. Enabling distributed tracing changes the behavior of some
   * New Relic features, so carefully consult the transition guide before you enable
   * this feature: https://docs.newrelic.com/docs/transition-guide-distributed-tracing
   * Default is true.
   */
  distributed_tracing: {
    /**
     * Enables/disables distributed tracing.
     *
     * @env NEW_RELIC_DISTRIBUTED_TRACING_ENABLED
     */
    enabled: true,
  },
  logging: {
    /**
     * Level at which to log. 'trace' is most useful to New Relic when diagnosing
     * issues with the agent, 'info' and higher will impose the least overhead on
     * production applications.
     */
    // level: 'info',
    level: 'trace',
  },
  application_logging: {
    forwarding: {
      enabled: true,
    },
  },
  /**
   * When true, all request headers except for those listed in attributes.exclude
   * will be captured for all traces, unless otherwise specified in a destination's
   * attributes include/exclude lists.
   */
  allow_all_headers: true,
  attributes: {
    enabled: true,
    /**
     * Prefix of attributes to exclude from all destinations. Allows * as wildcard
     * at end.
     *
     * NOTE: If excluding headers, they must be in camelCase form to be filtered.
     *
     * @env NEW_RELIC_ATTRIBUTES_EXCLUDE
     */
    exclude: [
      'request.headers.cookie',
      'request.headers.authorization',
      'request.headers.proxyAuthorization',
      'request.headers.setCookie*',
      'request.headers.x*',
      'response.headers.cookie',
      'response.headers.authorization',
      'response.headers.proxyAuthorization',
      'response.headers.setCookie*',
      'response.headers.x*',
    ],
  },
};
workato-integration[bot] commented 1 year ago

https://issues.newrelic.com/browse/NR-163343

bizob2828 commented 1 year ago

@rhyek using the configuration of customResolverAttributes and customOperationAttributes will assign those custom attributes to all resolver or operation spans, depending on how you set it. You appear to be highlighting a root span, you'd need to find the ones that are named /GraphQL/operation/ApolloServer/[operation-type]/[operation-name]/[deepest-unique-path] or /GraphQL/resolve/ApolloServer/[path].

Using our api addCustomAttributes it will add those attributes to whatever is the active span, so that would require more context into when/where you're calling that method.

I recommend working this through support.newrelic.com. They can help deep-dive into solving the problem. They will also ask to collect the necessary information which may or may not be sensitive (such as logs, account information, etc.). If you have a simple reproduction case, I may be able to take a look but would definitely need more information.