[Bug]: steam headless freezes randomly after update

[ApfelBirneKreis]

Describe the Bug

On Unraid steam headless freezes after a random time without doing anything. RAM usage goes up and one CPU Thread stays pinned to 100%. WebUI is not reachable.

Steps to Reproduce

No response

Expected Behavior

No response

Screenshots

No response

Relevant Settings

No response

Version

latest

Platform

-latest Unraid

Relevant log output

2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/sunshine.ini" during parsing
2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/udev.ini" during parsing
2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/vnc-audio.ini" during parsing
2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/vnc.ini" during parsing
2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/wol-power-manager.ini" during parsing
2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/xorg.ini" during parsing
2023-10-08 07:52:14,004 INFO Included extra file "/etc/supervisor.d/xvfb.ini" during parsing
2023-10-08 07:52:14,004 INFO Set uid to user 0 succeeded
2023-10-08 07:52:14,007 INFO RPC interface 'supervisor' initialized
2023-10-08 07:52:14,007 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2023-10-08 07:52:14,007 INFO supervisord started with pid 1
2023-10-08 07:52:15,008 INFO spawned: 'dbus' with pid 284
2023-10-08 07:52:15,009 INFO spawned: 'udev' with pid 285
2023-10-08 07:52:15,010 INFO spawned: 'xorg' with pid 286
2023-10-08 07:52:15,012 INFO spawned: 'frontend' with pid 287
2023-10-08 07:52:15,013 INFO spawned: 'pulseaudio' with pid 288
2023-10-08 07:52:15,014 INFO spawned: 'x11vnc' with pid 290
2023-10-08 07:52:15,015 INFO spawned: 'desktop' with pid 293
2023-10-08 07:52:15,016 INFO spawned: 'sunshine' with pid 294
PULSEAUDIO: Starting pulseaudio service
2023-10-08 07:52:15,031 WARN exited: xorg (exit status 1; not expected)
2023-10-08 07:52:15,042 INFO reaped unknown pid 317 (exit status 0)
2023-10-08 07:52:16,055 INFO success: dbus entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,055 INFO success: udev entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,056 INFO spawned: 'xorg' with pid 352
2023-10-08 07:52:16,056 INFO success: frontend entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,056 INFO success: pulseaudio entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,056 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,056 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,056 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:16,064 WARN exited: xorg (exit status 1; not expected)
2023-10-08 07:52:19,062 INFO spawned: 'xorg' with pid 395
2023-10-08 07:52:19,069 WARN exited: xorg (exit status 1; not expected)
2023-10-08 07:52:22,666 INFO spawned: 'xorg' with pid 531
2023-10-08 07:52:22,673 WARN exited: xorg (exit status 1; not expected)
2023-10-08 07:52:23,674 INFO gave up: xorg entered FATAL state, too many start retries too quickly
2023-10-08 07:52:45,133 WARN exited: x11vnc (exit status 11; not expected)
2023-10-08 07:52:45,152 INFO spawned: 'x11vnc' with pid 800
2023-10-08 07:52:45,152 WARN exited: sunshine (exit status 11; not expected)
2023-10-08 07:52:45,153 INFO spawned: 'sunshine' with pid 801
2023-10-08 07:52:45,157 WARN exited: desktop (exit status 11; not expected)
2023-10-08 07:52:46,158 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:46,159 INFO spawned: 'desktop' with pid 813
2023-10-08 07:52:46,159 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:47,164 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:52:47,164 INFO reaped unknown pid 822 (exit status 0)
2023-10-08 07:53:15,269 WARN exited: x11vnc (exit status 11; not expected)
2023-10-08 07:53:15,269 WARN exited: sunshine (exit status 11; not expected)
2023-10-08 07:53:15,270 INFO spawned: 'x11vnc' with pid 1170
2023-10-08 07:53:15,271 INFO spawned: 'sunshine' with pid 1171
2023-10-08 07:53:16,271 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:53:16,271 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:53:16,273 WARN exited: desktop (exit status 11; not expected)
2023-10-08 07:53:17,275 INFO spawned: 'desktop' with pid 1193
2023-10-08 07:53:18,281 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:53:18,281 INFO reaped unknown pid 1200 (exit status 0)
2023-10-08 07:53:45,388 WARN exited: x11vnc (exit status 11; not expected)
2023-10-08 07:53:45,388 WARN exited: sunshine (exit status 11; not expected)
2023-10-08 07:53:46,390 INFO spawned: 'x11vnc' with pid 1542
2023-10-08 07:53:46,391 INFO spawned: 'sunshine' with pid 1543
2023-10-08 07:53:47,392 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:53:47,392 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:53:47,395 WARN exited: desktop (exit status 11; not expected)
2023-10-08 07:53:48,397 INFO spawned: 'desktop' with pid 1566
2023-10-08 07:53:49,403 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:53:49,403 INFO reaped unknown pid 1576 (exit status 0)
2023-10-08 07:54:16,507 WARN exited: sunshine (exit status 11; not expected)
2023-10-08 07:54:16,508 INFO spawned: 'sunshine' with pid 1912
2023-10-08 07:54:16,508 WARN exited: x11vnc (exit status 11; not expected)
2023-10-08 07:54:16,509 INFO spawned: 'x11vnc' with pid 1914
2023-10-08 07:54:17,510 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:54:17,510 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:54:18,515 WARN exited: desktop (exit status 11; not expected)
2023-10-08 07:54:19,516 INFO spawned: 'desktop' with pid 1947
2023-10-08 07:54:20,523 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:54:20,523 INFO reaped unknown pid 1953 (exit status 0)
2023-10-08 07:54:46,637 WARN exited: sunshine (exit status 11; not expected)
2023-10-08 07:54:46,637 WARN exited: x11vnc (exit status 11; not expected)
2023-10-08 07:54:46,638 INFO spawned: 'x11vnc' with pid 2281
2023-10-08 07:54:46,639 INFO spawned: 'sunshine' with pid 2282
2023-10-08 07:54:47,640 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:54:47,640 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:54:49,649 WARN exited: desktop (exit status 11; not expected)
2023-10-08 07:54:50,650 INFO spawned: 'desktop' with pid 2328
2023-10-08 07:54:51,657 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:54:51,657 INFO reaped unknown pid 2336 (exit status 0)
2023-10-08 07:55:16,755 WARN exited: sunshine (exit status 11; not expected)
2023-10-08 07:55:16,756 WARN exited: x11vnc (exit status 11; not expected)
2023-10-08 07:55:16,756 INFO spawned: 'x11vnc' with pid 2650
2023-10-08 07:55:16,757 INFO spawned: 'sunshine' with pid 2652
2023-10-08 07:55:17,759 INFO success: x11vnc entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:55:17,759 INFO success: sunshine entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:55:20,771 WARN exited: desktop (exit status 11; not expected)
2023-10-08 07:55:21,773 INFO spawned: 'desktop' with pid 2709
2023-10-08 07:55:22,779 INFO success: desktop entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2023-10-08 07:55:22,779 INFO reaped unknown pid 2718 (exit status 0)

[Josh5]

Did you boot unraid in gui mode?

[ApfelBirneKreis]

Nope. i also have dongles on the internal intel graphics card and my 3060

[ApfelBirneKreis]

when i switch back to :debian-0.2.0 it works fine again

[Josh5]

Have you checked the logs for xorg to see why it is stopping?

[ApfelBirneKreis]

Yes but nothing to be seen there. It just Stopps unexpectedly. The only thing I notice is the ram filling up. It’s usually 8 gigs of ram in an idle state at the end of the day.

[blaizard]

I am having a similar issue, my setup is different though as I am running the container on a virtual machine with Proxmox (but symptoms are the same and this issue started to appear after an update from 2 or 3 weeks ago). The issue is consistent (it happen all the time), xorg stops unexpectedly at startup and sunshine cannot start, nor vnc.

[Josh5]

I can't do anything without logs. The Xorg logs will have details about why it is stopping. The container logs you posted above indicate it is Xorg that is failing.

[blaizard]

Here are some logs I got from my setup, let me knwo if you need anything else.

novnc.err.log x11vnc.log x11vnc.err.log xorg.err.log xorg.log

[alansari]

Can you try removing the container and reinstalling it from community apps again? before starting check the bottom of the template for Enable Keyboard and Mouse Passthrough and make sure its set to true. Other noteworthy things to check is if the container is running in host networking mode and that you have --runtime=nvidia in extra parameters. I believe you may have an older template that isn't compatible with the latest version. Come in and join us on discord if you would like faster response/support from the community! the culprit: FATAL: /usr/bin/start-xorg.sh: Gave up waiting for udev server to start in your xorg.log

[blaizard]

I tried what you said, but it didn't help. Note that I am using docker-compose not unraid. The original poster is using unraid. I am using the same template as provided here: https://github.com/Steam-Headless/docker-steam-headless/blob/master/docs/compose-files/docker-compose.privileged.yml and the same .env.

The root cause is that the udev server cannot start for some reason, not sure where to find the logs for it. But if I connect to the container and start it manually it then works.

root@SteamHeadless:/# service udev status
systemd-udevd is not running ... failed!
root@SteamHeadless:/# service udev start
Starting hotplug events dispatcher: systemd-udevd.
Synthesizing the initial hotplug events (subsystems)...done.
Synthesizing the initial hotplug events (devices)...done.
Waiting for /dev to be fully populated...
root@SteamHeadless:/# service udev status
systemd-udevd is running.

And after that I can connect to the novnc interface. Note that after subsequent restarts of the container, it now works and I don't need to do this manual command again, it's only for the first time. So this seem to have fixed the issue.

[ApfelBirneKreis]

worked after last update