search

DataDog / datadog-lambda-extension

Datadog Lambda Extension
Apache License 2.0
81 stars 5 forks source link

Random logging duplication #168

Closed stasOR41k closed 10 months ago

stasOR41k commented 1 year ago

I'm using the latest(48) version of the DataDog Lambda Extention layer with the .NET 7 AOT function to send logs to the DataDog. The issue is that I have duplicate logs with the same request_id for some requests. CloudWatch shows logs correctly. No DataDog Forwarder is configured to send logs to the DataDog. No dd-tracer layer is installed as it is not compatible with the .NET AOT. Does anyone have an idea what is the issue?

IvanTopolcic commented 1 year ago

Have you been seeing this on a previous version? And would you be able to provide the logs, with DD_LOG_LEVEL set to debug?

stasOR41k commented 1 year ago

Good point, thank you! Found an interesting moment in the duplicated request logs. It is trying to send logs after the REPORT log and facing the issue UTC | DD_EXTENSION | WARN | Could not send payload: Post "https://http-intake.logs.datadoghq.com/api/v2/logs": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

2023-09-20 15:00:57 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 15:00:57 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 15:00:57.620057003 +0000 UTC m=+410.472997916 before retrying. Backoff duration 100ms due to -1 errors
2023-09-20 15:00:57 UTC | DD_EXTENSION | DEBUG | Send messages for pipeline logs (msg_count:15, content_size=12699, avg_msg_size=846.60)
2023-09-20 15:00:57 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 15:00:57.223557099 +0000 UTC m=+410.076498012 before retrying. Backoff duration 100ms due to 0 errors
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Waiting to shut down HTTP server
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Received shutdown event. Reason: spindown
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Enhanced metrics: {durationMs:1875.302 billedDurationMs:2813 memorySizeMB:256 maxMemoryUsedMB:172 initDurationMs:936.875 initDurationTelemetry:0 initStartTime:{wall:0 ext:0 loc:<nil>}}
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 15:00:56.793280515 +0000 UTC m=+409.646221440 before retrying. Backoff duration 100ms due to 1 errors
2023-09-20 15:00:56 UTC | DD_EXTENSION | WARN | Could not send payload: Post "https://http-intake.logs.datadoghq.com/api/v2/logs": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2023-09-20 15:00:56 UTC | DD_EXTENSION | DEBUG | Send messages for pipeline logs (msg_count:22, content_size=20838, avg_msg_size=947.18)
2023-09-20 15:00:56 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
REPORT RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1  Duration: 1875.30 ms    Runtime Duration: 1255.00 ms    Post Runtime Duration: 620.30 ms    Billed Duration: 2813 ms    Memory Size: 256 MB Max Memory Used: 172 MB Init Duration: 936.88 ms
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished flushing
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished metrics flush that was started at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | SyncForwarder has flushed 1 transactions
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Demultiplexer: sendIterableSeries: stop routine
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | SyncForwarder has flushed 1 transactions
2023-09-20 14:54:09 UTC | DD_EXTENSION | INFO | Successfully posted payload to "https://7-47-0-app.agent.datadoghq.com/api/v1/series", the agent will only log transaction success every 500 transactions
2023-09-20 14:54:09 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | https://http-intake.logs.datadoghq.com/api/v2/logs: sleeping until 2023-09-20 14:54:09.395379825 +0000 UTC m=+2.249173698 before retrying. Backoff duration 100ms due to 0 errors
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | The payload was not too big, returning the full payload
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | The payload was not too big, returning the full payload
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.response_duration","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":0.058,"Max":0.058,"Sum":0.058,"Avg":0.058,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Send messages for pipeline logs (msg_count:53, content_size=42887, avg_msg_size=809.19)
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished logs flush that was started at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Flush in the logs-agent done.
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Demultiplexer: sendIterableSeries: start sending iterable series to the serializer
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.response_latency","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":1242.641,"Max":1242.641,"Sum":1242.641,"Avg":1242.641,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.runtime_duration","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":1255,"Max":1255,"Sum":1255,"Avg":1255,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.invocations","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true","init_type:on-demand"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":1,"Max":1,"Sum":1,"Avg":1,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Sending sketches payload : {"metric":"aws.lambda.enhanced.produced_bytes","tags":["runtime:provided.al2","function_arn:arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu","executedversion:129","dd_extension_version:48","account_id:<some_account_id>","aws_account:<some_account_id>","memorysize:256","service:presignup","architecture:x86_64","env:dev-eu","region:eu-west-1","resource:presignup-dev-eu:129","functionname:presignup-dev-eu","cold_start:true"],"host":"","interval":10,"points":[{"sketch":{"summary":{"Min":442,"Max":442,"Sum":442,"Avg":442,"Cnt":1}},"ts":1695221640}]}
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Received a Flush trigger
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Beginning metrics flush at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Finished traces flush that was started at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | INFO | Triggering a flush in the logs-agent
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Beginning logs flush at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Beginning traces flush at time 1695221649
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | The flush strategy end has decided to flush at moment: stopping
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Received a runtimeDone log message for the current invocation a001011b-9ca1-4a9a-9f0b-33837aa243b1
2023-09-20 14:54:09 UTC | DD_EXTENSION | DEBUG | Runtime done metrics: {responseLatency:1242.641 responseDuration:0.058 producedBytes:442}
END RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1
END RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1
2023-09-20T14:54:09.075Z    a001011b-9ca1-4a9a-9f0b-33837aa243b1    info    {"coldStart":true,"xrayTraceId":"1-650b078e-443dd56a1f33aa0641d2a77b","userPoolId":"eu-west-1_ite8hRsNq","correlationId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","tenantId":"stage-lvt1w6stru20hrjn","functionName":"PreSignUp-dev-eu","functionVersion":"129","functionMemorySize":256,"functionArn":"arn:aws:lambda:eu-west-1:<some_account_id>:function:PreSignUp-dev-eu:current","functionRequestId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","timestamp":"2023-09-20T14:54:09.0593022Z","level":"Information","service":"PreSignUp","name":"AWS.Lambda.Powertools.Logging.Logger","message":"Successfully linked success+user1@simulator.amazonses.com email."}
2023-09-20T14:54:09.075Z    a001011b-9ca1-4a9a-9f0b-33837aa243b1    info    {"coldStart":true,"xrayTraceId":"1-650b078e-443dd56a1f33aa0641d2a77b","userPoolId":"eu-west-1_ite8hRsNq","correlationId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","tenantId":"stage-lvt1w6stru20hrjn","functionName":"PreSignUp-dev-eu","functionVersion":"129","functionMemorySize":256,"functionArn":"arn:aws:lambda:eu-west-1:<some_account_id>:function:PreSignUp-dev-eu:current","functionRequestId":"a001011b-9ca1-4a9a-9f0b-33837aa243b1","timestamp":"2023-09-20T14:54:09.0593022Z","level":"Information","service":"PreSignUp","name":"AWS.Lambda.Powertools.Logging.Logger","message":"Successfully linked success+user1@simulator.amazonses.com email."}
2023-09-20 14:54:08 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 14:54:08 UTC | DD_EXTENSION | INFO | retrying the first update of remote-config state (could not acquire agent auth token: unable to read authentication token file: open auth_token: no such file or directory)
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No lambda span, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | InitReport done metrics: {durationMs:0 billedDurationMs:0 memorySizeMB:0 maxMemoryUsedMB:0 initDurationMs:0 initDurationTelemetry:937.205 initStartTime:{wall:0 ext:0 loc:<nil>}}
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No lambda span, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | InitReport done metrics: {durationMs:0 billedDurationMs:0 memorySizeMB:0 maxMemoryUsedMB:0 initDurationMs:0 initDurationTelemetry:937.205 initStartTime:{wall:0 ext:0 loc:<nil>}}
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No init duration, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | The flush strategy end has decided to not flush at moment: starting
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | [ColdStartCreator] No init duration, passing
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | The flush strategy end has decided to not flush at moment: starting
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Starting Log Collection with ARN: arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu and RequestId:
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Received invocation event...
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Starting Log Collection with ARN: arn:aws:lambda:eu-west-1:<some_account_id>:function:presignup-dev-eu and RequestId:
2023-09-20 14:54:08 UTC | DD_EXTENSION | DEBUG | Received invocation event...
START RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1 Version: 129
START RequestId: a001011b-9ca1-4a9a-9f0b-33837aa243b1 Version: 129
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | serverless agent ready in 85.86127ms
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | finding the lambda runtime took 29.292816ms. found runtime: provided.al2
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | serverless agent ready in 85.86127ms
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | finding the lambda runtime took 29.292816ms. found runtime: provided.al2
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting ColdStartSpanCreator on Daemon
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting ColdStartSpanCreator
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | could not find a unique value for runtime
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting ColdStartSpanCreator on Daemon
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting ColdStartSpanCreator
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting DefaultEnv to "dev-eu" (from 'env' config option)
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Loaded configuration: /var/task/datadog.yaml
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Setting DefaultEnv to "dev-eu" (from 'env' config option)
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Loaded configuration: /var/task/datadog.yaml
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | grpc agent secure client created
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | grpc agent secure client created
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | attempting to create grpc agent client connection to: localhost:5001
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Adding AWS Logs Log Source
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | logs-agent started
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Starting logs-agent...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | setting agent metadata 'logs_transport': 'HTTP'
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | attempting to create grpc agent client connection to: localhost:5001
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Adding AWS Logs Log Source
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | logs-agent started
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Starting logs-agent...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | setting agent metadata 'logs_transport': 'HTTP'
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | otlp endpoint disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | otlp endpoint disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | appsec: security monitoring is not enabled: DD_SERVERLESS_APPSEC_ENABLED is not set to true
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Subscribing to Telemetry for types: [platform function extension]
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Enabling telemetry collection HTTP route
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | appsec: security monitoring is not enabled: DD_SERVERLESS_APPSEC_ENABLED is not set to true
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Subscribing to Telemetry for types: [platform function extension]
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Enabling telemetry collection HTTP route
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | dogstatsd-udp: starting to listen on 127.0.0.1:8125
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | DogStatsD will run 2 workers
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | dogstatsd-udp: 127.0.0.1:8125 successfully initialized
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | dogstatsd-udp: starting to listen on 127.0.0.1:8125
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | DogStatsD will run 2 workers
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | dogstatsd-udp: 127.0.0.1:8125 successfully initialized
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.aggregator_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Demultiplexer started
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Forwarder started
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.listeners_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'telemetry.dogstatsd.aggregator_channel_latency_buckets' is empty, falling back to default values
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Demultiplexer started
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Forwarder started
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Creating TimeSampler #0
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Retry queue storage on disk is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Using a SyncForwarder with a 5s timeout
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Creating TimeSampler #0
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | Retry queue storage on disk is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Using a SyncForwarder with a 5s timeout
2023-09-20 14:54:07 UTC | DD_EXTENSION | INFO | 0 Features detected from environment:
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'use_proxy_for_cloud_metadata' is enabled: adding cloud provider URL to the no_proxy list
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | FIPS mode is disabled
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | No config file detected, using environment variable based configuration only
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | 'use_proxy_for_cloud_metadata' is enabled: adding cloud provider URL to the no_proxy list
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Unable to restore the state from file
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Unable to restore the state from file
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting daemon to receive messages from runtime...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Datadog extension version : 48|Datadog environment variables: DD_API_KEY=***|DD_APM_REPLACE_TAGS=[]|DD_CAPTURE_LAMBDA_PAYLOAD=true|DD_ENV=dev-eu|DD_LAMBDA_HANDLER=bootstrap|DD_LOG_LEVEL=debug|DD_MERGE_XRAY_TRACES=true|DD_SERVICE=presignup|
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Starting daemon to receive messages from runtime...
2023-09-20 14:54:07 UTC | DD_EXTENSION | DEBUG | Datadog extension version : 48|Datadog environment variables: DD_API_KEY=***|DD_APM_REPLACE_TAGS=[]|DD_CAPTURE_LAMBDA_PAYLOAD=true|DD_ENV=dev-eu|DD_LAMBDA_HANDLER=bootstrap|DD_LOG_LEVEL=debug|DD_MERGE_XRAY_TRACES=true|DD_SERVICE=presignup|
duncanista commented 10 months ago

Hey @stasOR41k,

Are you still getting this issue with our latest version? We believe starting v50+, something in AWS side changed it was fixed, now our extension is in parity with CloudWatch. Let me know if this issue still persist. I will close it for now, but please feel free to re-open if this persists with the latest versions, or if you have any other questions! 🙇🏽

Onesco commented 10 months ago

@duncanista thanks for the feedback, had the same issue while using the Datadog lambda extension version 48 and will give feedback if it gets resolved.