cockpit-project / cockpit

Cockpit is a web-based graphical interface for servers.
http://www.cockpit-project.org/
GNU Lesser General Public License v2.1
11.2k stars 1.11k forks source link

cockpit crashing at random #21098

Open gen-angry opened 3 weeks ago

gen-angry commented 3 weeks ago

Explain what happens

Brand new install of ubuntu 24.04.01, installed cockpit from backports. Installed a few addons (from backports when available). At random, the UI will stop working and cockpit-tls will spike to 100% for a time.

  1. Log into cockpit
  2. The UI will show a loading graphic for about 15-20 seconds, then pop up with a "connection failed".
  3. Refreshing the page, about 50/50 of the time it will log in fine and work as expected. The other half it will fail again.
  4. At random while I'm using it, it will suddenly become unresponsive. cockpit-tls will spike to 100% CPU usage in top for a time, then settle down, the UI will work again, and log me out. After logging back in, I get the same 50/50 thing as above.

There doesn't seem to be much rhyme or reason when it will crash out. It's done it on just about every page that I have. It's also worked great for a time as well, no issues, then it will start acting up again.

I'd imagine it's likely the same issues without much answers as I see scattered throughout of cockpit-tls taking a lot of CPU usage. Hopefully my logs reveal something. I posted three separate logs, the first two I had journalctl -f running, the third I did not.

I will dump more logs here when I can.

Thank you

Version of Cockpit

324-1~bpo24.04.1

Where is the problem in Cockpit?

Overview

Server operating system

Ubuntu

Server operating system version

24.04.01

What browsers are you using?

Firefox

System log

Oct 08 14:08:57 ubuntuserver sudo[5101]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:08:57 ubuntuserver sudo[5101]: pam_unix(sudo:session): session closed for user root
Oct 08 14:10:01 ubuntuserver systemd[1]: Starting sysstat-collect.service - system activity accounting tool...
Oct 08 14:10:01 ubuntuserver systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
Oct 08 14:10:01 ubuntuserver systemd[1]: sysstat-collect.service: Deactivated successfully.
Oct 08 14:10:01 ubuntuserver systemd[1]: Finished sysstat-collect.service - system activity accounting tool.
Oct 08 14:10:01 ubuntuserver systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.
Oct 08 14:10:01 ubuntuserver systemd[1]: Finished systemd-tmpfiles-clean.service - Cleanup of Temporary Directories.
Oct 08 14:10:41 ubuntuserver PackageKit[4263]: daemon quit
Oct 08 14:10:41 ubuntuserver systemd[1]: packagekit.service: Deactivated successfully.
Oct 08 14:11:16 ubuntuserver podman[1886]: @ - - [08/Oct/2024:13:58:34 -0400] "GET /v1.12/libpod/events HTTP/1.0" 200 21095 "" ""
Oct 08 14:11:16 ubuntuserver podman[1860]: @ - - [08/Oct/2024:13:58:34 -0400] "GET /v1.12/libpod/events HTTP/1.0" 200 0 "" ""
Oct 08 14:11:24 ubuntuserver podman[1860]: @ - - [08/Oct/2024:13:58:34 -0400] "GET /v1.12/libpod/containers/stats?stream=true HTTP/1.1" 200 4004 "" ""
Oct 08 14:11:26 ubuntuserver podman[1886]: @ - - [08/Oct/2024:13:58:34 -0400] "GET /v1.12/libpod/containers/stats?stream=true HTTP/1.1" 200 466470 "" ""
Oct 08 14:11:31 ubuntuserver podman[1860]: @ - - [08/Oct/2024:13:58:34 -0400] "GET /v1.12/libpod/events? HTTP/1.1" 200 0 "" ""
Oct 08 14:11:31 ubuntuserver sudo[1743]: pam_unix(sudo:session): session closed for user root
Oct 08 14:11:36 ubuntuserver systemd[1]: var-lib-containers-storage-overlay.mount: Deactivated successfully.
Oct 08 14:11:36 ubuntuserver systemd[1]: podman.service: Deactivated successfully.
Oct 08 14:11:36 ubuntuserver systemd[1]: podman.service: Consumed 2.625s CPU time.
Oct 08 14:11:43 ubuntuserver systemd[1]: systemd-timedated.service: Deactivated successfully.
Oct 08 14:11:46 ubuntuserver cockpit-ws[1727]: request timed out, closing
Oct 08 14:11:56 ubuntuserver cockpit-session[5671]: pam_ssh_add: Failed adding some keys
Oct 08 14:11:56 ubuntuserver cockpit-session[5671]: pam_unix(cockpit:session): session opened for user al(uid=1000) by al(uid=0)
Oct 08 14:11:56 ubuntuserver systemd-logind[979]: New session 6 of user al.
Oct 08 14:11:56 ubuntuserver systemd[1]: Started session-6.scope - Session 6 of User al.
Oct 08 14:11:56 ubuntuserver sudo[5679]:       al : PWD=/ ; USER=root ; COMMAND=/usr/bin/cockpit-bridge --privileged
Oct 08 14:11:56 ubuntuserver sudo[5679]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:12:11 ubuntuserver sudo[5679]: pam_unix(sudo:session): session closed for user root
Oct 08 14:12:11 ubuntuserver cockpit-session[5671]: pam_unix(cockpit:session): session closed for user al
Oct 08 14:12:11 ubuntuserver systemd[1]: session-6.scope: Deactivated successfully.
Oct 08 14:12:11 ubuntuserver systemd-logind[979]: Session 6 logged out. Waiting for processes to exit.
Oct 08 14:12:11 ubuntuserver systemd-logind[979]: Removed session 6.
Oct 08 14:12:26 ubuntuserver romm[2746]: 18:12:26 Cleaning registries for queue: high
Oct 08 14:12:26 ubuntuserver romm[2746]: 18:12:26 Cleaning registries for queue: default
Oct 08 14:12:26 ubuntuserver romm[2746]: 18:12:26 Cleaning registries for queue: low
Oct 08 14:12:26 ubuntuserver cockpit-ws[1727]: request timed out, closing
Oct 08 14:12:59 ubuntuserver romm[2746]: 6:M 08 Oct 2024 18:12:59.778 * 100 changes in 300 seconds. Saving...
Oct 08 14:12:59 ubuntuserver romm[2746]: 6:M 08 Oct 2024 18:12:59.779 * Background saving started by pid 1213
Oct 08 14:12:59 ubuntuserver romm[2746]: 1213:C 08 Oct 2024 18:12:59.901 * DB saved on disk
Oct 08 14:12:59 ubuntuserver romm[2746]: 1213:C 08 Oct 2024 18:12:59.902 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
Oct 08 14:12:59 ubuntuserver romm[2746]: 6:M 08 Oct 2024 18:12:59.980 * Background saving terminated with success
Oct 08 14:13:26 ubuntuserver systemd[1]: cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.service: Deactivated successfully.
Oct 08 14:13:26 ubuntuserver systemd[1]: cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.service: Consumed 3.177s CPU time.
Oct 08 14:13:26 ubuntuserver systemd[1]: cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket: Deactivated successfully.
Oct 08 14:13:26 ubuntuserver systemd[1]: Closed cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:13:32 ubuntuserver systemd[1]: Started cockpit-wsinstance-https-factory@1-1722-61690.service - Cockpit Web Service https instance factory (PID 1722/UID 61690).
Oct 08 14:13:32 ubuntuserver systemd[1]: Starting cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855...
Oct 08 14:13:32 ubuntuserver systemd[1]: Listening on cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:13:32 ubuntuserver systemd[1]: Started cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.service - Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:13:32 ubuntuserver systemd[1]: cockpit-wsinstance-https-factory@1-1722-61690.service: Deactivated successfully.
Oct 08 14:13:37 ubuntuserver cockpit-session[5858]: pam_ssh_add: Failed adding some keys
Oct 08 14:13:37 ubuntuserver cockpit-session[5858]: pam_unix(cockpit:session): session opened for user al(uid=1000) by al(uid=0)
Oct 08 14:13:37 ubuntuserver systemd-logind[979]: New session 7 of user al.
Oct 08 14:13:37 ubuntuserver systemd[1]: Started session-7.scope - Session 7 of User al.
Oct 08 14:13:37 ubuntuserver sudo[5866]:       al : PWD=/ ; USER=root ; COMMAND=/usr/bin/cockpit-bridge --privileged
Oct 08 14:13:37 ubuntuserver sudo[5866]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:13:52 ubuntuserver sudo[5866]: pam_unix(sudo:session): session closed for user root
Oct 08 14:13:52 ubuntuserver cockpit-session[5858]: pam_unix(cockpit:session): session closed for user al
Oct 08 14:13:52 ubuntuserver systemd[1]: session-7.scope: Deactivated successfully.
Oct 08 14:13:52 ubuntuserver systemd-logind[979]: Session 7 logged out. Waiting for processes to exit.
Oct 08 14:13:52 ubuntuserver systemd-logind[979]: Removed session 7.
Oct 08 14:14:07 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:14:43 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:14:44 ubuntuserver cockpit-session[5979]: pam_ssh_add: Failed adding some keys
Oct 08 14:14:44 ubuntuserver cockpit-session[5979]: pam_unix(cockpit:session): session opened for user al(uid=1000) by al(uid=0)
Oct 08 14:14:44 ubuntuserver systemd-logind[979]: New session 8 of user al.
Oct 08 14:14:44 ubuntuserver systemd[1]: Started session-8.scope - Session 8 of User al.
Oct 08 14:14:44 ubuntuserver sudo[5988]:       al : PWD=/ ; USER=root ; COMMAND=/usr/bin/cockpit-bridge --privileged
Oct 08 14:14:44 ubuntuserver sudo[5988]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:14:59 ubuntuserver sudo[5988]: pam_unix(sudo:session): session closed for user root
Oct 08 14:14:59 ubuntuserver cockpit-session[5979]: pam_unix(cockpit:session): session closed for user al
Oct 08 14:14:59 ubuntuserver systemd[1]: session-8.scope: Deactivated successfully.
Oct 08 14:14:59 ubuntuserver systemd-logind[979]: Session 8 logged out. Waiting for processes to exit.
Oct 08 14:14:59 ubuntuserver systemd-logind[979]: Removed session 8.
Oct 08 14:15:01 ubuntuserver CRON[6033]: pam_unix(cron:session): session opened for user root(uid=0) by root(uid=0)
Oct 08 14:15:01 ubuntuserver CRON[6034]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Oct 08 14:15:01 ubuntuserver CRON[6033]: pam_unix(cron:session): session closed for user root
Oct 08 14:15:12 ubuntuserver cockpit-session[6056]: pam_ssh_add: Failed adding some keys
Oct 08 14:15:12 ubuntuserver cockpit-session[6056]: pam_unix(cockpit:session): session opened for user al(uid=1000) by al(uid=0)
Oct 08 14:15:12 ubuntuserver systemd-logind[979]: New session 10 of user al.
Oct 08 14:15:12 ubuntuserver systemd[1]: Started session-10.scope - Session 10 of User al.
Oct 08 14:15:12 ubuntuserver sudo[6064]:       al : PWD=/ ; USER=root ; COMMAND=/usr/bin/cockpit-bridge --privileged
Oct 08 14:15:12 ubuntuserver sudo[6064]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:15:12 ubuntuserver cockpit-tls[1722]: cockpit-tls: gnutls_handshake failed: The TLS connection was non-properly terminated.
Oct 08 14:15:12 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.51' (uid=1000 pid=6063 comm="/usr/bin/python3 /usr/bin/cockpit-bridge" label="unconfined")
Oct 08 14:15:12 ubuntuserver systemd[1]: Starting systemd-hostnamed.service - Hostname Service...
Oct 08 14:15:13 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.hostname1'
Oct 08 14:15:13 ubuntuserver systemd[1]: Started systemd-hostnamed.service - Hostname Service.
Oct 08 14:15:13 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' requested by ':1.51' (uid=1000 pid=6063 comm="/usr/bin/python3 /usr/bin/cockpit-bridge" label="unconfined")
Oct 08 14:15:13 ubuntuserver systemd[1]: Starting systemd-timedated.service - Time & Date Service...
Oct 08 14:15:13 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.timedate1'
Oct 08 14:15:13 ubuntuserver systemd[1]: Started systemd-timedated.service - Time & Date Service.
Oct 08 14:15:13 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.PackageKit' unit='packagekit.service' requested by ':1.53' (uid=0 pid=6066 comm="/usr/bin/python3 /usr/bin/cockpit-bridge --privile" label="unconfined")
Oct 08 14:15:13 ubuntuserver systemd[1]: Starting packagekit.service - PackageKit Daemon...
Oct 08 14:15:13 ubuntuserver PackageKit[6087]: daemon start
Oct 08 14:15:13 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.PackageKit'
Oct 08 14:15:13 ubuntuserver systemd[1]: Started packagekit.service - PackageKit Daemon.
Oct 08 14:15:13 ubuntuserver PackageKit[6087]: resolve transaction /178_dbbcacbc from uid 0 finished with success after 214ms
Oct 08 14:15:13 ubuntuserver PackageKit[6087]: get-updates transaction /179_aadeddeb from uid 0 finished with success after 410ms
Oct 08 14:15:42 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:15:43 ubuntuserver systemd[1]: systemd-hostnamed.service: Deactivated successfully.
Oct 08 14:15:43 ubuntuserver systemd[1]: systemd-timedated.service: Deactivated successfully.
Oct 08 14:15:53 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:15:53 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:16:02 ubuntuserver cockpit-tls[1722]: cockpit-tls: gnutls_handshake failed: Error in the push function.
Oct 08 14:16:16 ubuntuserver sudo[6064]: pam_unix(sudo:session): session closed for user root
Oct 08 14:16:16 ubuntuserver cockpit-session[6056]: pam_unix(cockpit:session): session closed for user al
Oct 08 14:16:16 ubuntuserver systemd[1]: session-10.scope: Deactivated successfully.
Oct 08 14:16:16 ubuntuserver systemd[1]: session-10.scope: Consumed 2.754s CPU time.
Oct 08 14:16:16 ubuntuserver systemd-logind[979]: Session 10 logged out. Waiting for processes to exit.
Oct 08 14:16:16 ubuntuserver systemd-logind[979]: Removed session 10.
Oct 08 14:16:32 ubuntuserver cockpit-ws[1742]: /usr/lib/python3.12/asyncio/events.py:88: RuntimeWarning: The executor did not finishing joining its threads within 300 seconds.
Oct 08 14:16:32 ubuntuserver cockpit-ws[1742]:   self._context.run(self._callback, *self._args)
Oct 08 14:16:32 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:16:32 ubuntuserver cockpit-ws[5843]: request timed out, closing
Oct 08 14:16:59 ubuntuserver systemd[1]: Starting man-db.service - Daily man-db regeneration...
Oct 08 14:16:59 ubuntuserver systemd[1]: man-db.service: Deactivated successfully.
Oct 08 14:16:59 ubuntuserver systemd[1]: Finished man-db.service - Daily man-db regeneration.
Oct 08 14:17:01 ubuntuserver CRON[6320]: pam_unix(cron:session): session opened for user root(uid=0) by root(uid=0)
Oct 08 14:17:01 ubuntuserver CRON[6321]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 08 14:17:01 ubuntuserver CRON[6320]: pam_unix(cron:session): session closed for user root
Oct 08 14:17:31 ubuntuserver systemd[1]: cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.service: Deactivated successfully.
Oct 08 14:17:31 ubuntuserver systemd[1]: cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket: Deactivated successfully.
Oct 08 14:17:31 ubuntuserver systemd[1]: Closed cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:17:32 ubuntuserver systemd[1]: Started cockpit-wsinstance-https-factory@2-1722-61690.service - Cockpit Web Service https instance factory (PID 1722/UID 61690).
Oct 08 14:17:32 ubuntuserver systemd[1]: Starting cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855...
Oct 08 14:17:32 ubuntuserver systemd[1]: Listening on cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:17:32 ubuntuserver systemd[1]: Started cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.service - Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:17:32 ubuntuserver systemd[1]: cockpit-wsinstance-https-factory@2-1722-61690.service: Deactivated successfully.
Oct 08 14:17:37 ubuntuserver cockpit-session[6385]: pam_ssh_add: Failed adding some keys
Oct 08 14:17:37 ubuntuserver cockpit-session[6385]: pam_unix(cockpit:session): session opened for user al(uid=1000) by al(uid=0)
Oct 08 14:17:37 ubuntuserver systemd-logind[979]: New session 12 of user al.
Oct 08 14:17:37 ubuntuserver systemd[1]: Started session-12.scope - Session 12 of User al.
Oct 08 14:17:37 ubuntuserver sudo[6393]:       al : PWD=/ ; USER=root ; COMMAND=/usr/bin/cockpit-bridge --privileged
Oct 08 14:17:37 ubuntuserver sudo[6393]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:17:37 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service' requested by ':1.60' (uid=1000 pid=6392 comm="/usr/bin/python3 /usr/bin/cockpit-bridge" label="unconfined")
Oct 08 14:17:37 ubuntuserver systemd[1]: Starting systemd-hostnamed.service - Hostname Service...
Oct 08 14:17:37 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.hostname1'
Oct 08 14:17:37 ubuntuserver systemd[1]: Started systemd-hostnamed.service - Hostname Service.
Oct 08 14:17:37 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' requested by ':1.62' (uid=0 pid=6395 comm="/usr/bin/python3 /usr/bin/cockpit-bridge --privile" label="unconfined")
Oct 08 14:17:37 ubuntuserver systemd[1]: Starting systemd-timedated.service - Time & Date Service...
Oct 08 14:17:37 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.timedate1'
Oct 08 14:17:37 ubuntuserver systemd[1]: Started systemd-timedated.service - Time & Date Service.
Oct 08 14:18:07 ubuntuserver cockpit-ws[6370]: request timed out, closing
Oct 08 14:18:07 ubuntuserver cockpit-ws[6370]: request timed out, closing
Oct 08 14:18:07 ubuntuserver systemd[1]: systemd-hostnamed.service: Deactivated successfully.
Oct 08 14:18:07 ubuntuserver systemd[1]: Starting fwupd-refresh.service - Refresh fwupd metadata and update motd...
Oct 08 14:18:08 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.fwupd' unit='fwupd.service' requested by ':1.64' (uid=989 pid=6465 comm="/usr/bin/fwupdmgr refresh" label="unconfined")
Oct 08 14:18:08 ubuntuserver systemd[1]: Starting fwupd.service - Firmware update daemon...
Oct 08 14:18:08 ubuntuserver dbus-daemon[961]: [system] Activating via systemd: service name='org.freedesktop.UPower' unit='upower.service' requested by ':1.65' (uid=0 pid=6473 comm="/usr/libexec/fwupd/fwupd" label="unconfined")
Oct 08 14:18:08 ubuntuserver systemd[1]: Starting upower.service - Daemon for power management...
Oct 08 14:18:08 ubuntuserver PackageKit[6087]: resolve transaction /181_caadcabb from uid 0 finished with success after 232ms
Oct 08 14:18:08 ubuntuserver PackageKit[6087]: get-updates transaction /182_dadacbec from uid 0 finished with success after 452ms
Oct 08 14:18:10 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.UPower'
Oct 08 14:18:10 ubuntuserver systemd[1]: Started upower.service - Daemon for power management.
Oct 08 14:18:13 ubuntuserver fwupd[6473]: 18:18:13.145 FuPluginIntelMe      failed to get public key using /fpf/OemCred: generic failure [0xb]
Oct 08 14:18:13 ubuntuserver fwupd[6473]: 18:18:13.200 FuMain               Daemon ready for requests (locale en_US.UTF-8)
Oct 08 14:18:13 ubuntuserver dbus-daemon[961]: [system] Successfully activated service 'org.freedesktop.fwupd'
Oct 08 14:18:13 ubuntuserver systemd[1]: Started fwupd.service - Firmware update daemon.
Oct 08 14:18:13 ubuntuserver systemd[1]: fwupd-refresh.service: Deactivated successfully.
Oct 08 14:18:13 ubuntuserver systemd[1]: Finished fwupd-refresh.service - Refresh fwupd metadata and update motd.

---

Oct 08 14:32:34 ubuntuserver systemd[1]: Started user@1000.service - User Manager for UID 1000.
Oct 08 14:32:34 ubuntuserver systemd[1]: Started session-1.scope - Session 1 of User al.
Oct 08 14:32:42 ubuntuserver systemd[1]: Starting cockpit-ws-user.service - Dynamic user for cockpit-ws...
Oct 08 14:32:42 ubuntuserver systemd[1]: Finished cockpit-ws-user.service - Dynamic user for cockpit-ws.
Oct 08 14:32:42 ubuntuserver systemd[1]: Starting cockpit-wsinstance-http.socket - Socket for Cockpit Web Service http instance...
Oct 08 14:32:42 ubuntuserver systemd[1]: Starting cockpit-wsinstance-https-factory.socket - Socket for Cockpit Web Service https instance factory...
Oct 08 14:32:42 ubuntuserver systemd[1]: Listening on cockpit-wsinstance-http.socket - Socket for Cockpit Web Service http instance.
Oct 08 14:32:42 ubuntuserver systemd[1]: Listening on cockpit-wsinstance-https-factory.socket - Socket for Cockpit Web Service https instance factory.
Oct 08 14:32:42 ubuntuserver systemd[1]: Starting cockpit.service - Cockpit Web Service...
Oct 08 14:32:42 ubuntuserver systemd[1]: Started cockpit.service - Cockpit Web Service.
Oct 08 14:32:42 ubuntuserver systemd[1]: Created slice system-cockpit\x2dwsinstance\x2dhttps\x2dfactory.slice - Slice /system/cockpit-wsinstance-https-factory.
Oct 08 14:32:42 ubuntuserver systemd[1]: Started cockpit-wsinstance-https-factory@0-1715-61690.service - Cockpit Web Service https instance factory (PID 1715/UID 61690).
Oct 08 14:32:42 ubuntuserver systemd[1]: Created slice system-cockpit\x2dwsinstance\x2dhttps.slice - Slice /system/cockpit-wsinstance-https.
Oct 08 14:32:42 ubuntuserver systemd[1]: Created slice system-cockpithttps.slice - Resource limits for all cockpit-ws-https@.service instances.
Oct 08 14:32:42 ubuntuserver systemd[1]: Starting cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855...
Oct 08 14:32:42 ubuntuserver systemd[1]: Listening on cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.socket - Socket for Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:32:42 ubuntuserver systemd[1]: Started cockpit-wsinstance-https@e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.service - Cockpit Web Service https instance e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
Oct 08 14:32:42 ubuntuserver systemd[1]: cockpit-wsinstance-https-factory@0-1715-61690.service: Deactivated successfully.
Oct 08 14:32:46 ubuntuserver cockpit-session[1729]: pam_ssh_add: Failed adding some keys
Oct 08 14:32:46 ubuntuserver cockpit-session[1729]: pam_unix(cockpit:session): session opened for user al(uid=1000) by al(uid=0)
Oct 08 14:32:46 ubuntuserver systemd-logind[966]: New session 3 of user al.
Oct 08 14:32:46 ubuntuserver systemd[1]: Started session-3.scope - Session 3 of User al.
Oct 08 14:32:46 ubuntuserver sudo[1737]:       al : PWD=/ ; USER=root ; COMMAND=/usr/bin/cockpit-bridge --privileged
Oct 08 14:32:46 ubuntuserver sudo[1737]: pam_unix(sudo:session): session opened for user root(uid=0) by al(uid=1000)
Oct 08 14:33:01 ubuntuserver sudo[1737]: pam_unix(sudo:session): session closed for user root
Oct 08 14:33:01 ubuntuserver cockpit-session[1729]: pam_unix(cockpit:session): session closed for user al
Oct 08 14:33:01 ubuntuserver systemd[1]: session-3.scope: Deactivated successfully.
Oct 08 14:33:01 ubuntuserver systemd-logind[966]: Session 3 logged out. Waiting for processes to exit.
Oct 08 14:33:01 ubuntuserver systemd-logind[966]: Removed session 3.
Oct 08 14:33:16 ubuntuserver cockpit-ws[1720]: request timed out, closing

---

-- Boot 5419dd8beb0a4f2682f7480fcc7e3251 --
Oct 08 13:55:24 ubuntuserver systemd[1]: Starting cockpit.service - Cockpit Web Service...
Oct 08 13:55:24 ubuntuserver systemd[1]: Started cockpit.service - Cockpit Web Service.
Oct 08 14:15:12 ubuntuserver cockpit-tls[1722]: cockpit-tls: gnutls_handshake failed: The TLS connection was non-properly terminated.
Oct 08 14:16:02 ubuntuserver cockpit-tls[1722]: cockpit-tls: gnutls_handshake failed: Error in the push function.
Oct 08 14:20:30 ubuntuserver systemd[1]: Stopping cockpit.service - Cockpit Web Service...
Oct 08 14:20:30 ubuntuserver systemd[1]: cockpit.service: Deactivated successfully.
Oct 08 14:20:30 ubuntuserver systemd[1]: Stopped cockpit.service - Cockpit Web Service.
Oct 08 14:20:30 ubuntuserver systemd[1]: cockpit.service: Consumed 9min 3.732s CPU time.
-- Boot c68d45521e7945108434f543ba9d7f1e --
Oct 08 14:21:23 ubuntuserver systemd[1]: Starting cockpit.service - Cockpit Web Service...
Oct 08 14:21:23 ubuntuserver systemd[1]: Started cockpit.service - Cockpit Web Service.
Oct 08 14:27:43 ubuntuserver cockpit-tls[1587]: cockpit-tls: gnutls_handshake failed: The TLS connection was non-properly terminated.
Oct 08 14:30:47 ubuntuserver systemd[1]: Stopping cockpit.service - Cockpit Web Service...
Oct 08 14:30:47 ubuntuserver systemd[1]: cockpit.service: Deactivated successfully.
Oct 08 14:30:47 ubuntuserver systemd[1]: Stopped cockpit.service - Cockpit Web Service.
Oct 08 14:30:47 ubuntuserver systemd[1]: cockpit.service: Consumed 4min 53.685s CPU time.
-- Boot cbed87ab3b554496a0e2265f44427522 --
Oct 08 14:32:42 ubuntuserver systemd[1]: Starting cockpit.service - Cockpit Web Service...
Oct 08 14:32:42 ubuntuserver systemd[1]: Started cockpit.service - Cockpit Web Service.
gen-angry commented 3 weeks ago

went further down a rabbit hole.

adding

[WebService]
AllowUnencrypted=true

to /etc/cockpit/cockpit.conf then going to the http version of the site seems to have helped. It's faster overall and no crashes yet. I did have to delete the old cookie as the previous one prevented me from logging in.

Will report back after a time to see if it's stopped entirely. For me, this will work as I'm using this on a LAN-only server. But hopefully something helps here for those who have theirs public facing.