DataDog / datadog-aas-extension

Datadog Azure App Services Site Extension
Apache License 2.0
9 stars 12 forks source link

Linux agent sometimes goes into "do not track" state #178

Closed gatsukichi closed 1 year ago

gatsukichi commented 1 year ago

https://github.com/DataDog/datadog-aas-extension/tree/master/linux

i read the above document Applied to azure linux app service.

I am using node js

While looking at the datadog service tab, I confirmed that logging was stopped in the middle.

So I checked the azure log, It turns out that there is a problem in the middle.

How do I solve this?

===

Below are some of the Azure AppService logs. From that point on, logging started not working.

2023-01-30T03:15:45.485309977Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/tagger/remote/tagger.go:330 in func1) | unable to establish stream, will possibly retry: unable to fetch authentication token: unable to read authentication token file: open /opt/datadog-agent/etc/auth_token: no such file or directory 2023-01-30T03:15:45.486246300Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (run.go:160 in Run) | starting remote tagger failed. falling back to local tagger: unable to fetch authentication token: unable to read authentication token file: open /opt/datadog-agent/etc/auth_token: no such file or directory 2023-01-30T03:15:45.486286001Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "cloudfoundry-container" could not start. error: component workloadmeta-cloudfoundry-container is disabled: Agent is not running on CloudFoundry 2023-01-30T03:15:45.486294801Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "cloudfoundry-vm" could not start. error: component workloadmeta-cloudfoundry-vm is disabled: Agent is not running on CloudFoundry 2023-01-30T03:15:45.486301501Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "docker" could not start. error: component workloadmeta-docker is disabled: Agent is not running on Docker 2023-01-30T03:15:45.486822713Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "ecs_fargate" could not start. error: component workloadmeta-ecs_fargate is disabled: Agent is not running on Fargate 2023-01-30T03:15:45.486841114Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "podman" could not start. error: component workloadmeta-podman is disabled: Podman not detected 2023-01-30T03:15:45.486848014Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "ecs" could not start. error: component workloadmeta-ecs is disabled: Agent is not running on Docker 2023-01-30T03:15:45.487778736Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "kube_metadata" could not start. error: component workloadmeta-kube_metadata is disabled: Agent is not running on Kubernetes 2023-01-30T03:15:45.487800437Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "containerd" could not start. error: component workloadmeta-containerd is disabled: Agent is not running on containerd 2023-01-30T03:15:45.487807937Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:340 in startCandidates) | workloadmeta collector "kubelet" could not start. error: component workloadmeta-kubelet is disabled: Agent is not running on Kubernetes 2023-01-30T03:15:45.487814237Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/workloadmeta/store.go:154 in Start) | workloadmeta store initialized successfully 2023-01-30T03:15:45.487940140Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (pkg/tagger/collectors/workloadmeta_main.go:115 in stream) | workloadmeta tagger collector started 2023-01-30T03:15:45.490209394Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (run.go:207 in Run) | Trace agent running on host 6bd25e3eb171 2023-01-30T03:15:45.491858033Z 2023-01-30 03:15:45 UTC | TRACE | INFO | (run.go:254 in Infof) | Listening for traces at http://localhost:8126