aerokube / ggr

A lightweight load balancer used to create big Selenium clusters
https://aerokube.com/ggr/latest/
Apache License 2.0
314 stars 74 forks source link

Killed by oom #341

Closed achirkov-ep closed 3 years ago

achirkov-ep commented 3 years ago

Greetings! I used ggr for a week and have trouble with memory. GGR killed every 20-40 minutes by out of memory. Im trying give for ggr more memory, but this still happens. What i can do with is problem? On host installed ggr, ggr-ui, selenoid-ui. My monitoring history: https://i.ibb.co/8P3c2xH/2021-03-25-11-46-50.png ggr image: aerokube/ggr latest docker version:

Client: Docker Engine - Community
 Version:           20.10.5
 API version:       1.41
 Go version:        go1.13.15
 Git commit:        55c4c88
 Built:             Tue Mar  2 20:18:20 2021
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.5
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.13.15
  Git commit:       363e9a8
  Built:            Tue Mar  2 20:16:15 2021
  OS/Arch:          linux/amd64
  Experimental:     false
vania-pooh commented 3 years ago

@achirkov-ep Ggr is published as aerokube/ggr and is not related to aerokube/selenoid-ui. Should consume several hundreds of megabytes maximum.

achirkov-ep commented 3 years ago

@achirkov-ep Ggr is published as aerokube/ggr and is not related to aerokube/selenoid-ui. Should consume several hundreds of megabytes maximum.

Sorry, copied the wrong line from docker images, fixed in first message. Right now i set 12gb memory and ggr after 10-20 minutes take all 12gb and 2gb swap. After start ggr use only 400-500 mb.

achirkov-ep commented 3 years ago

for test i add --oom-kill-disable -m 10g to docker run. After 28 minutes ggr get all 10g and all free swap, 0 sessions in queue, when i try create session - after 5 minutes waiting - connection refused.

vania-pooh commented 3 years ago

@achirkov-ep need an example ggr log then. For comparison, this is ggr stats from big cluster:

# docker stats ggr
CONTAINER ID        NAME                CPU %               MEM USAGE / LIMIT     MEM %               NET I/O             BLOCK I/O           PIDS
f3d1cc82ab30        ggr                 63.02%              212.5MiB / XXXGiB   0.16%               0B / 0B             63.8MB / 0B         44
achirkov-ep commented 3 years ago

I have only 2 nodes. Max 20 sessions. Systemd running ggr:

[Unit]
Description=ggr
After=docker.service
Requires=docker.service

[Service]
TimeoutStartSec=0
Restart=always
ExecStartPre=-/usr/bin/docker stop %n
ExecStartPre=-/usr/bin/docker rm %n
ExecStartPre=/usr/bin/docker pull aerokube/ggr
ExecStart=/usr/bin/docker run  --rm --name %n -v /etc/grid-router/:/etc/grid-router:ro     -p 4444:4444  aerokube/ggr
ExecStop=/usr/bin/docker stop %n

[Install]
WantedBy=multi-user.target

My /etc/grid-router/quota/selenoid.xml :

<qa:browsers xmlns:qa="urn:config.gridrouter.qatools.ru">
<browser name="chrome" defaultVersion="88.0">
    <version number="88.0">
        <region name="node1">
            <host name="10.10.0.100" port="4444" count="1"/>
        </region>
        <region name="node2">
            <host name="10.10.0.101" port="4444" count="1"/>
        </region>
    </version>
</browser>
</qa:browsers>

Log ggr, use all memory after ~5 minutes.

Mar 25 10:18:19 ggr docker[3237]: 2021/03/25 10:18:19 [-] [-] [INIT] [-] [-] [-] [-] [-] [-] [Users file is "/etc/grid-router/users.htpasswd"]
Mar 25 10:18:19 ggr docker[3237]: 2021/03/25 10:18:19 [-] [-] [INIT] [-] [-] [-] [-] [-] [-] [Loading configuration files from "/etc/grid-router/quota"]
Mar 25 10:18:19 ggr docker[3237]: 2021/03/25 10:18:19 [0] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:19 ggr docker[3237]: 2021/03/25 10:18:19 [1] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:19 ggr docker[3237]: 2021/03/25 10:18:19 [2] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:20 ggr docker[3237]: 2021/03/25 10:18:20 [3] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:20 ggr docker[3237]: 2021/03/25 10:18:20 [4] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:20 ggr docker[3237]: 2021/03/25 10:18:20 [5] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:20 ggr docker[3237]: 2021/03/25 10:18:20 [6] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:20 ggr docker[3237]: 2021/03/25 10:18:20 [7] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:21 ggr systemd[1582]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.ZHTXpM.mount: Succeeded.
Mar 25 10:18:21 ggr systemd[1]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.ZHTXpM.mount: Succeeded.
Mar 25 10:18:21 ggr systemd-networkd[621]: vethcafc1bd: Gained IPv6LL
Mar 25 10:18:21 ggr docker[3237]: 2021/03/25 10:18:21 [7] [0.89s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [e9e88d14c226a78accd370ee591327a4] [1] [-]
Mar 25 10:18:21 ggr docker[3237]: 2021/03/25 10:18:21 [5] [0.90s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [12a25e8467bf1ee70de69b89084fe888] [1] [-]
Mar 25 10:18:22 ggr docker[3237]: 2021/03/25 10:18:22 [10] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:23 ggr docker[3237]: 2021/03/25 10:18:23 [10] [0.83s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [a5e28ff0158f5753b6ea4e1688ee51f1] [1] [-]
Mar 25 10:18:23 ggr docker[3237]: 2021/03/25 10:18:23 [72] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.100:4444] [e9e88d14c226a78accd370ee591327a4] [-] [-]
Mar 25 10:18:24 ggr docker[3237]: 2021/03/25 10:18:24 [75] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.100:4444] [12a25e8467bf1ee70de69b89084fe888] [-] [-]
Mar 25 10:18:24 ggr docker[3237]: 2021/03/25 10:18:24 [76] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:25 ggr docker[3237]: 2021/03/25 10:18:25 [76] [0.81s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [27a2c94cd270c39f662ca3c80ab1ffa7] [1] [-]
Mar 25 10:18:25 ggr docker[3237]: 2021/03/25 10:18:25 [78] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:26 ggr docker[3237]: 2021/03/25 10:18:26 [78] [0.70s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [a4b818160e3fde431650946b5767d9d0] [1] [-]
Mar 25 10:18:26 ggr docker[3237]: 2021/03/25 10:18:26 [106] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:28 ggr docker[3237]: 2021/03/25 10:18:28 [1] [8.90s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [bd67d76959bddfcf42be300ec3817936] [1] [-]
Mar 25 10:18:29 ggr docker[3237]: 2021/03/25 10:18:29 [162] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.100:4444] [a5e28ff0158f5753b6ea4e1688ee51f1] [-] [-]
Mar 25 10:18:29 ggr docker[3237]: 2021/03/25 10:18:29 [2] [9.90s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [580a54b30d8e3a69452c4c0e8f637b11] [1] [-]
Mar 25 10:18:30 ggr docker[3237]: 2021/03/25 10:18:30 [164] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:31 ggr docker[3237]: 2021/03/25 10:18:31 [164] [0.67s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [5e290bcea1351fc3784bf11fa120757d] [1] [-]
Mar 25 10:18:32 ggr docker[3237]: 2021/03/25 10:18:32 [0] [13.06s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [7183120694a8e42ac647e258f98b1bb2] [1] [-]
Mar 25 10:18:34 ggr docker[3237]: 2021/03/25 10:18:34 [3] [14.04s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [55d8c616425222cc3980ecdc539572ba] [1] [-]
Mar 25 10:18:34 ggr docker[3237]: 2021/03/25 10:18:34 [4] [13.83s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [25f6338e03552e0de7705b3a28d5e2e5] [1] [-]
Mar 25 10:18:34 ggr docker[3237]: 2021/03/25 10:18:34 [6] [13.83s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [aa38594687215553c35d2c3c87d19d6e] [1] [-]
Mar 25 10:18:35 ggr docker[3237]: 2021/03/25 10:18:35 [106] [9.11s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [7263471fabef23b4379f45ba75adeb0d] [1] [-]
Mar 25 10:18:39 ggr docker[3237]: 2021/03/25 10:18:39 [328] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [bd67d76959bddfcf42be300ec3817936] [-] [-]
Mar 25 10:18:40 ggr docker[3237]: 2021/03/25 10:18:40 [341] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:40 ggr docker[3237]: 2021/03/25 10:18:40 [348] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [aa38594687215553c35d2c3c87d19d6e] [-] [-]
Mar 25 10:18:40 ggr docker[3237]: 2021/03/25 10:18:40 [357] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [25f6338e03552e0de7705b3a28d5e2e5] [-] [-]
Mar 25 10:18:41 ggr docker[3237]: 2021/03/25 10:18:41 [359] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:41 ggr docker[3237]: 2021/03/25 10:18:41 [362] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:18:42 ggr docker[3237]: 2021/03/25 10:18:42 [368] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [7263471fabef23b4379f45ba75adeb0d] [-] [-]
Mar 25 10:18:42 ggr docker[3237]: 2021/03/25 10:18:42 [359] [0.77s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [695114af945d76f28e1abad55f700600] [1] [-]
Mar 25 10:18:42 ggr docker[3237]: 2021/03/25 10:18:42 [362] [0.71s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [cae613a1d8a8463bcc591e0b3608ceab] [1] [-]
Mar 25 10:18:42 ggr docker[3237]: 2021/03/25 10:18:42 [373] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [55d8c616425222cc3980ecdc539572ba] [-] [-]
Mar 25 10:18:43 ggr docker[3237]: 2021/03/25 10:18:43 [406] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:45 ggr docker[3237]: 2021/03/25 10:18:45 [451] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [580a54b30d8e3a69452c4c0e8f637b11] [-] [-]
Mar 25 10:18:45 ggr docker[3237]: 2021/03/25 10:18:45 [452] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:49 ggr docker[3237]: 2021/03/25 10:18:49 [341] [9.08s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [efe0af6eb98001ee8ff06f6a246d935e] [1] [-]
Mar 25 10:18:51 ggr docker[3237]: 2021/03/25 10:18:51 [469] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [7183120694a8e42ac647e258f98b1bb2] [-] [-]
Mar 25 10:18:51 ggr systemd[1582]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.zA95Js.mount: Succeeded.
Mar 25 10:18:51 ggr systemd[1]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.zA95Js.mount: Succeeded.
Mar 25 10:18:52 ggr docker[3237]: 2021/03/25 10:18:52 [406] [8.74s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [a579df2553f1570d188b0d6a073d04f8] [1] [-]
Mar 25 10:18:53 ggr docker[3237]: 2021/03/25 10:18:53 [452] [7.60s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [46e70045cda6766015c5f4d4cabee03c] [1] [-]
Mar 25 10:18:54 ggr docker[3237]: 2021/03/25 10:18:54 [478] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:18:57 ggr docker[3237]: 2021/03/25 10:18:57 [478] [3.00s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [5b59386885d10d95e0ad7a50638b5fc6] [1] [-]
Mar 25 10:19:21 ggr systemd[1]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.UorKvO.mount: Succeeded.
Mar 25 10:19:21 ggr systemd[1582]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.UorKvO.mount: Succeeded.
Mar 25 10:19:23 ggr docker[3237]: 2021/03/25 10:19:23 [883] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:19:24 ggr docker[3237]: 2021/03/25 10:19:24 [883] [0.66s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [514d9e449ec36f8ec7194242c526758c] [1] [-]
Mar 25 10:19:24 ggr docker[3237]: 2021/03/25 10:19:24 [915] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:19:26 ggr docker[3237]: 2021/03/25 10:19:26 [979] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.100:4444] [514d9e449ec36f8ec7194242c526758c] [-] [-]
Mar 25 10:19:27 ggr docker[3237]: 2021/03/25 10:19:27 [915] [2.87s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [52f1c8151b8632371d3af4658a3e7bec] [1] [-]
Mar 25 10:19:27 ggr docker[3237]: 2021/03/25 10:19:27 [983] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:19:27 ggr docker[3237]: 2021/03/25 10:19:27 [983] [0.65s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [d1d986ad89a466c09d68c2c280f8b9cb] [1] [-]
Mar 25 10:19:27 ggr docker[3237]: 2021/03/25 10:19:27 [988] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:19:28 ggr docker[3237]: 2021/03/25 10:19:28 [988] [0.72s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [f8f84e1e4da4416ce4c200d1302a49dd] [1] [-]
Mar 25 10:19:28 ggr docker[3237]: 2021/03/25 10:19:28 [999] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:19:29 ggr docker[3237]: 2021/03/25 10:19:29 [999] [0.75s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [292f4dc14d82addb0a03b750854c7d4c] [1] [-]
Mar 25 10:19:29 ggr docker[3237]: 2021/03/25 10:19:29 [1003] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:19:31 ggr docker[3237]: 2021/03/25 10:19:31 [1103] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [52f1c8151b8632371d3af4658a3e7bec] [-] [-]
Mar 25 10:19:31 ggr docker[3237]: 2021/03/25 10:19:31 [1115] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.101:4444] [5b59386885d10d95e0ad7a50638b5fc6] [-] [-]
Mar 25 10:19:32 ggr docker[3237]: 2021/03/25 10:19:32 [1121] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.100:4444] [292f4dc14d82addb0a03b750854c7d4c] [-] [-]
Mar 25 10:19:33 ggr docker[3237]: 2021/03/25 10:19:33 [1126] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:19:35 ggr docker[3237]: 2021/03/25 10:19:35 [1003] [5.94s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [670c7fd5f9696261b866330c782bce87] [1] [-]
Mar 25 10:19:35 ggr docker[3237]: 2021/03/25 10:19:35 [1145] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:19:39 ggr docker[3237]: 2021/03/25 10:19:39 [1126] [6.11s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [5ef5cbb21bb6768be6fb322c04c0a215] [1] [-]
Mar 25 10:19:40 ggr docker[3237]: 2021/03/25 10:19:40 [1145] [5.45s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [ca7d34de6d42ec265ad528f780de276f] [1] [-]
Mar 25 10:19:40 ggr docker[3237]: 2021/03/25 10:19:40 [1280] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:19:41 ggr docker[3237]: 2021/03/25 10:19:41 [1280] [0.69s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [fb2476208ff21443a21bc4ca2147ef34] [1] [-]
Mar 25 10:19:41 ggr docker[3237]: 2021/03/25 10:19:41 [1284] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [-] [1] [-]
Mar 25 10:19:42 ggr docker[3237]: 2021/03/25 10:19:42 [1284] [0.74s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.100:4444] [2e2e9aa1e4bf51c2d502b6c3591328dc] [1] [-]
Mar 25 10:19:42 ggr docker[3237]: 2021/03/25 10:19:42 [1299] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:19:43 ggr systemd[1]: Reloading.
Mar 25 10:19:43 ggr systemd[1]: /lib/systemd/system/dbus.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/dbus/system_bus_socket → /run/dbus/system_bus_socket; please update the unit file accordingly.
Mar 25 10:19:43 ggr systemd[1]: /lib/systemd/system/docker.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly.
Mar 25 10:19:43 ggr systemd[1]: ggr.service: Current command vanished from the unit file, execution of the command list won't be resumed.
Mar 25 10:19:44 ggr docker[3237]: 2021/03/25 10:19:44 [1455] [-] [SESSION_DELETED] [-] [10.10.0.50] [-] [10.10.0.100:4444] [fb2476208ff21443a21bc4ca2147ef34] [-] [-]
Mar 25 10:19:45 ggr docker[3237]: 2021/03/25 10:19:45 [1299] [3.32s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [efd10216f8a151d9493cdc1510ee4869] [1] [-]
Mar 25 10:19:45 ggr docker[3237]: 2021/03/25 10:19:45 [1465] [0.00s] [SESSION_ATTEMPTED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [-] [1] [-]
Mar 25 10:19:47 ggr systemd[1]: Stopping ggr...
Mar 25 10:19:47 ggr docker[3237]: 2021/03/25 10:19:47 [-] [5m0s] [SHUTTING_DOWN] [-] [-] [-] [-] [-] [-] [-]
Mar 25 10:19:50 ggr docker[3237]: 2021/03/25 10:19:50 [1465] [4.87s] [SESSION_CREATED] [selenoid] [10.10.0.50] [chrome-88.0-ANY] [10.10.0.101:4444] [52cad9284c38698903eb39f1b191b5cb] [1] [-]
Mar 25 10:19:51 ggr systemd[1]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.sbH2F0.mount: Succeeded.
Mar 25 10:19:51 ggr systemd[1582]: run-docker-runtime\x2drunc-moby-39a9f060ed3a40b1c36e400a227db0cd8ff133f1a605d91d9d2a454df186585f-runc.sbH2F0.mount: Succeeded.
Mar 25 10:19:57 ggr dockerd[835]: time="2021-03-25T10:19:57.131056909Z" level=info msg="Container adbd586f85f02a43c6b64a5ebda40b03a80f7fefb983bd94b3247924737af310 failed to exit within 10 seconds of signal 15 - using the force"
Mar 25 10:19:57 ggr dockerd[835]: time="2021-03-25T10:19:57.171087449Z" level=info msg="ignoring event" container=adbd586f85f02a43c6b64a5ebda40b03a80f7fefb983bd94b3247924737af310 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Mar 25 10:19:57 ggr containerd[664]: time="2021-03-25T10:19:57.171559032Z" level=info msg="shim disconnected" id=adbd586f85f02a43c6b64a5ebda40b03a80f7fefb983bd94b3247924737af310
Mar 25 10:19:57 ggr containerd[664]: time="2021-03-25T10:19:57.171915064Z" level=error msg="copy shim log" error="read /proc/self/fd/14: file already closed"
Mar 25 10:19:57 ggr systemd-networkd[621]: vethcafc1bd: Lost carrier
Mar 25 10:19:57 ggr kernel: [ 2061.906248] docker0: port 2(vethcafc1bd) entered disabled state
Mar 25 10:19:57 ggr kernel: [ 2061.907009] veth2e89528: renamed from eth0
Mar 25 10:19:57 ggr networkd-dispatcher[645]: WARNING:Unknown index 10 seen, reloading interface list
Mar 25 10:19:57 ggr systemd-udevd[3550]: ethtool: autonegotiation is unset or enabled, the speed and duplex are not writable.
Mar 25 10:19:57 ggr systemd-udevd[3550]: Using default interface naming scheme 'v245'.
Mar 25 10:19:57 ggr systemd-networkd[621]: vethcafc1bd: Link DOWN
Mar 25 10:19:57 ggr kernel: [ 2061.951296] docker0: port 2(vethcafc1bd) entered disabled state
Mar 25 10:19:57 ggr kernel: [ 2061.956348] device vethcafc1bd left promiscuous mode
Mar 25 10:19:57 ggr kernel: [ 2061.956354] docker0: port 2(vethcafc1bd) entered disabled state
Mar 25 10:19:57 ggr systemd-networkd[621]: rtnl: received neighbor for link '11' we don't know about, ignoring.
Mar 25 10:19:57 ggr systemd-networkd[621]: rtnl: received neighbor for link '11' we don't know about, ignoring.
Mar 25 10:19:57 ggr systemd-networkd[621]: veth2e89528: Failed to wait for the interface to be initialized: No such device
Mar 25 10:19:57 ggr systemd-udevd[3550]: veth2e89528: Failed to get link config: No such device
Mar 25 10:19:57 ggr systemd[1]: run-docker-netns-7d310a71181f.mount: Succeeded.
Mar 25 10:19:57 ggr systemd[1582]: run-docker-netns-7d310a71181f.mount: Succeeded.
Mar 25 10:19:57 ggr systemd[1582]: var-lib-docker-overlay2-fce61f9a2a8802bb39728202835726f7a92ef05cddcad3138017ee67b02a9cb0-merged.mount: Succeeded.
Mar 25 10:19:57 ggr systemd[1]: var-lib-docker-overlay2-fce61f9a2a8802bb39728202835726f7a92ef05cddcad3138017ee67b02a9cb0-merged.mount: Succeeded.
Mar 25 10:19:57 ggr docker[3492]: ggr.service
Mar 25 10:19:57 ggr systemd[1]: ggr.service: Main process exited, code=exited, status=137/n/a
Mar 25 10:19:57 ggr systemd[1]: ggr.service: Failed with result 'exit-code'.
vania-pooh commented 3 years ago

@achirkov-ep try to replace -p 4444:4444 with --net host.

achirkov-ep commented 3 years ago

Thanks, --net host fix my problem!