weaveworks / scope

Monitoring, visualisation & management for Docker & Kubernetes
https://www.weave.works/oss/scope/
Apache License 2.0
5.85k stars 709 forks source link

Scope-probe dropping all stats from containers #3817

Open Irrational-NX opened 4 years ago

Irrational-NX commented 4 years ago

What you expected to happen?

I expected the app to display all my containers

What happened?

The app works, I can access it through the browser, but no data is collected and displayed

How to reproduce it?

Just by using $ scope launch Or : $ scope launch --weave=false

Anything else we need to know?

the --debug option adds nothing relevant

I have scope running on another docker VM perfectly, launched exactly the same way, docker version is exactly the same, and the Ubuntu version also the same.

Versions:

$ scope version
Weave Scope version 1.13.1
$ docker version
Client:
 Version:       17.12.0-ce
 API version:   1.35
 Go version:    go1.9.2
 Git commit:    c97c6d6
 Built: Wed Dec 27 20:11:19 2017
 OS/Arch:       linux/amd64

Server:
 Engine:
  Version:      17.12.0-ce
  API version:  1.35 (minimum version 1.12)
  Go version:   go1.9.2
  Git commit:   c97c6d6
  Built:        Wed Dec 27 20:09:53 2017
  OS/Arch:      linux/amd64
  Experimental: false

$ uname -a
Linux docker-XXX 4.4.0-184-generic #214-Ubuntu SMP Thu Jun 4 10:14:11 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

$ kubectl version

Logs:

$ docker logs weavescope
warning: I'm not PID 1, I'm PID 20658
/sbin/runsvdir started
<app> INFO: 2020/09/01 13:30:49.567113 app starting, version 1.13.1, ID 50cbece845ad4b11
<app> INFO: 2020/09/01 13:30:49.567170 command line args: --mode=app --probe.docker=true --weave=false
<app> INFO: 2020/09/01 13:30:49.567639 Basic authentication disabled
time="2020-09-01T13:30:49Z" level=info msg="publishing to: 127.0.0.1:4040"
<probe> INFO: 2020/09/01 13:30:49.581732 Basic authentication disabled
<app> INFO: 2020/09/01 13:30:49.594288 listening on :4040
<probe> INFO: 2020/09/01 13:30:49.605134 command line args: --mode=probe --probe.docker=true --weave=false
<probe> INFO: 2020/09/01 13:30:49.605248 probe starting, version 1.13.1, ID 6fe6f6456e23c3f0
<probe> INFO: 2020/09/01 13:30:49.620487 Control connection to 127.0.0.1 starting
<probe> INFO: 2020/09/01 13:30:50.349264 Publish loop for 127.0.0.1 starting
<probe> WARN: 2020/09/01 13:30:52.377441 Docker reporter took longer than 1s
<probe> WARN: 2020/09/01 13:31:51.048194 docker container: dropping stats for 59ead40fa0ab17446b3daaed0d482445a8801034b9cfb621b26d9e33c098171f
<probe> WARN: 2020/09/01 13:31:51.050457 docker container: dropping stats for 356f61a2e4ea109079a79fb140464faa0db981fbb08512bc02710c7f7c3a2045
<probe> WARN: 2020/09/01 13:31:51.053844 docker container: dropping stats for 50b773ac0d93691db67c09afed96637c88a22f89d7b74e1b1c89108a05a5b82c
<probe> WARN: 2020/09/01 13:31:51.062908 docker container: dropping stats for e85fbc53d6f941e500699d7ea3c87bd37c181bd9d5acefba9e7e1057ddfe4120
<probe> WARN: 2020/09/01 13:31:51.063045 docker container: dropping stats for ff1519bf4de8ab17fa35a8ca496f193c3e92c57c5dd050976c329cdcea845b77
<probe> WARN: 2020/09/01 13:31:51.063160 docker container: dropping stats for 999a762de2600e69d543d313e2047e14a1e8329d32c3f59352b6d02aed7e0a28
<probe> WARN: 2020/09/01 13:31:52.047770 docker container: dropping stats for 59ead40fa0ab17446b3daaed0d482445a8801034b9cfb621b26d9e33c098171f
<probe> WARN: 2020/09/01 13:31:52.050474 docker container: dropping stats for 356f61a2e4ea109079a79fb140464faa0db981fbb08512bc02710c7f7c3a2045

or, if using Kubernetes:

$ kubectl logs <weave-scope-pod> -n <namespace>