System shutdown hang - Githubissues

Sometimes Qubes R3.1 shutdown never finishes.

Maybe it's a different issue - in my case it finishes but takes a long time because /tmp is busy and cannot be unmounted, which in turn prevents luks from being closed, which then prevents the underlying device from being stopped, which triggers a handful of timeouts. Eventually systemd shutdowns/reboots the machine though. The issue is reproducible, I get that problem each time I shutdown. Note: Qubes' install was done with auto partitioning - no fancy custom stuff here.

log's excerpt attached: journal-shutdown.txt

I encounter this occasionally on R2 too.

FWIW, tried to debug this as per https://wiki.freedesktop.org/www/Software/systemd/Debugging/#index2h1 ; for some reason /var/lib/xenstored can't be unmounted, the umount process dies with return status 32. See [173.256405] and [173.265964] lines onward in the attached systemd debug output.

shutdown.log.txt

I'm suffering from this problem also. There are times when I've returned to the room hours later to find the laptop stuck on "waiting for 2 jobs" i.e. mounted volumes.

The power management stack ought to have a low-level timeout feature that turns off the power no matter what, once the shutdown process has been started from the UI.

I think I've isolated this problem - In my case I have a proxy VM I use for VPN, and shutdown fails only when the proxy VM is running at the same time as other VMs that rely on it for networking. Seems like there should be some 'reverse shutdown order' so that dependent VMs are shut down first, and then the proxy VM.

Trying to shut down the proxy VM by hand fails saying 'there are other VMs connected to this VM' so maybe that's what's happening.

Could anyone try to replicate this? I can shut down the system reliably if I manually shut down the VMs in the correct reverse order first.

Hi, I can confirm you, I have the same problem and same temporary solution. Regards,

Le jeu. 12 mai 2016 10:33, Lorenzo G. notifications@github.com a écrit :

I think I've isolated this problem - In my case I have a proxy VM I use for VPN, and shutdown fails only when the proxy VM is running at the same time as other VMs that rely on it for networking. Seems like there should be some 'reverse shutdown order' so that dependent VMs are shut down first, and then the proxy VM.

Trying to shut down the proxy VM by hand fails saying 'there are other VMs connected to this VM' so maybe that's what's happening.

Could anyone try to replicate this? I can shut down the system reliably if I manually shut down the VMs in the correct reverse order first.

— You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub https://github.com/QubesOS/qubes-issues/issues/1581#issuecomment-218693602

Shutting down all VMs indeed solves the problem. But I don't have a proxyVM, the problem in my case is because sys-net's kernel crashes during shutdown (probably issue #1978.). Either I need to kill it, or wait for a timeout.

I have had this problem also. Haven't tried any workarounds yet.

A small update - running qvm-shutdown --all works intermittently - if I turn off the VPN first it works more reliably but it still hangs occasionally when trying to shutdown the 'VPN' VM, regarless of the VPN state.

@lorenzog adding --force to qvm-shutdown is supposed to shut them all down regardless of network dependency... But even that doesn't work. I get the same hang and logged issue #1826 for it. BTW, I also use a VPN VM extensively.

On 2016-11-16 13:27, Loren Rogers wrote:

On 11/16/2016 02:33 PM, Grzesiek Chodzicki wrote:

W dniu środa, 16 listopada 2016 20:04:14 UTC+1 użytkownik Loren Rogers napisał:

Hi all,

I've successfully installed Qubes on my Thinkpad X201 tablet, but it has issues shutting down. When I explicitly tell it to reboot or shutdown, it goes through the entire shutdown sequence, but hangs on an empty black screen. Occasionally, I see an unchanging white underscore (_) character displayed in the top left when it hangs.

I tried leaving it in this state for about an hour, and no change--I've always had to force-reset. I assume this is not normal?

Also, I find that the system randomly begins the shutdown sequence on its own. (And hangs on the black screen at the end.)

Thanks, Loren The same issue occurs on my system only if I shut the system down while a VM with a PCI device without FLR support is running

Also, I just confirmed that it shuts down cleanly with all VMs off and no USB devices plugged in.

I may backtrack my comment a little--I've since had one instance where it wouldn't shut down even with nothing plugged in. The sys-net VM is connected to a VPN, but I don't believe that this has been correlated with the shutdown issue.

Perhaps on a related note, I believe my machine may be having overheating issues, a known problem with non-Windows distros on the Lenovo X201t. It randomly shuts down completely without warning.

I believe the VPN shutdown delay is a consistent problem, but that its separate from the problem of the system not reaching power-off/reset. If I stop the openvpn process in VPN VM before I shutdown, the delay will still occur (whether I'm doing a regular shutdown, or a qvm-shutdown --all).

OTOH, if I have no VMs running a system shutdown can still hang.

With R3.2, the VPN shutdown delay always occurs but the failure to shutdown occurs only around 2% of the time (irregularly).

FWIW, I've been using simple shutdown and reboot scripts to work around this issue (I think since I first started using Qubes). Here's an example:

#!/bin/bash
qvm-shutdown --wait --all \
--exclude=sys-net \
--exclude=sys-firewall \
--exclude=sys-usb \
--exclude=sys-whonix \
qvm-shutdown --wait --all
sleep 3
shutdown now

Works every time. The idea is to exclude all service VMs from the first pass of qvm-shutdown so that it doesn't jam up (#1826), so if you use VPN VMs, exclude those too.

User requests to substitute scripts like the one above (https://github.com/QubesOS/qubes-issues/issues/1581#issuecomment-266266876) as the default reboot and shutdown scripts here.

Any chance of this happening for 4.0, @marmarek?

(Also see: #1826)

@andrewdavidwong Your script works great for me - very handy! Just confirming that this works on my machine. It would be great if we could have this as the default shutdown operation.

Actually - I've been using a simplified version of this, which has been fine for me:

#!/bin/bash
qvm-shutdown --all  --wait
shutdown now

I've not noticed it jamming up, but it may just be my particular installation setup.

Looks like the reason why --wait --all works, and just --wait (without --all) doesn't, is because --wait keeps retrying to shutdown the VMs every x seconds (where x=1 or 2?). Otherwise, if I have VM work which depends on sys-firewall which in turn depends on sys-net, with qvm-shutdown --all it will only shutdown the work one, so I have to rerun the command two more times for the other two dependent VMs to ensure all are shutdown - meanwhile qvm-shutdown --all --wait does all this on its own and it only takes it 11 seconds. After this, the dom0 shutdown happens under 10 seconds, instead of minutes like before.

In other words, --wait implies a --retry(not an actual option) which was highly unexpected. But hey, it does the job.

Can this --wait be added to the existing qvm-shutdown call that, I assume, happens when dom0 is being shutdown (when the purpose is to shutdown the computer), this would avoid all the epic delay(of at least 1 minute) that would otherwise happen due to not all VMs being shutdown by a, presumably, qvm-shutdown --all (without a --wait) that happens in the background. You get the picture.

Thanks.

EDIT: (I meant all this for R4.0) Maybe the --wait was already added recently, I just tested this and it did shutdown fast(ish) even with sys-net and sys-firewall VMs started. I haven't tested it since a few weeks ago. The only things that still appeared (compared to when no VMs were started before shutdown) are the luks spamming line from https://github.com/QubesOS/qubes-issues/issues/2593 EDIT2 I stand corrected, the delay is still there and it's at least 90 seconds more IFF I also have work VM started (so work <- sys-firewall <- sys-net are started, then shutdown from dom0 xfce's menu will take at least 90 seconds to complete)

There is already --wait option: https://github.com/QubesOS/qubes-core-admin/blob/master/linux/systemd/qubes-core.service#L13

This will fail and leave some VMs running (hence ~~the~~ a shutdown hang) if qubesd sends an empty response at any point because it threw an exception. DispVM destruction seems to be a common trigger - here's a random log:

qubesd[1318]: unhandled exception while calling src=b'dom0' meth=b'admin.vm.Kill' dest=b'disp8244' arg=b'' len(untrusted_payload)=0
qubesd[1318]: Traceback (most recent call last):
qubesd[1318]:   File "/usr/lib/python3.5/site-packages/qubes/api/__init__.py", line 260, in respond
qubesd[1318]:     self.send_event)
qubesd[1318]:   File "/usr/lib/python3.5/site-packages/qubes/api/__init__.py", line 127, in __init__
qubesd[1318]:     self.dest = self.app.domains[dest.decode('ascii')]
qubesd[1318]:   File "/usr/lib/python3.5/site-packages/qubes/app.py", line 465, in __getitem__
qubesd[1318]:     raise KeyError(key)
qubesd[1318]: KeyError: 'disp8244'
qubesd[1318]: socket.send() raised exception.

But there are many similar situations, where some qvm- tool or qui widget invokes an admin method on a VM that was just destroyed, and qubesd throws an exception instead of sending an error response.

There is already --wait option: https://github.com/QubesOS/qubes-core-admin/blob/master/linux/systemd/qubes-core.service#L13

I can confirm that is true on my system also(I checked, just in case).

Perhaps @rustybird above is on to something.

I don't know why qvm-shutdown -q --all --wait isn't able to do its job from qubes-core.service, (is a socket already closed?) but it seems as if that's the case. Or, maybe it's something else? @marmarek I'm hoping that the following partial contents from journalctl -b -1 and dmesg, where it takes at least 2 minutes to reboot(Start->Logout->Restart, from xfce), help you get an idea about what's going on:

from `journalctl -b -1`'s point of view

``` Sep 02 19:02:39 dom0 systemd-logind[1903]: System is rebooting. Sep 02 19:02:39 dom0 systemd[1]: Stopped target Graphical Interface. Sep 02 19:02:39 dom0 systemd[1]: Stopping Light Display Manager... Sep 02 19:02:39 dom0 systemd[1]: Stopping Manage Sound Card State (restore and store)... Sep 02 19:02:39 dom0 systemd[1]: Stopping User Manager for UID 1000... Sep 02 19:02:39 dom0 systemd[1]: Stopped target Multi-User System. Sep 02 19:02:39 dom0 systemd[1]: Stopping Command Scheduler... Sep 02 19:02:39 dom0 systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). Sep 02 19:02:39 dom0 systemd[1]: Stopping Restore /run/initramfs on shutdown... Sep 02 19:02:39 dom0 systemd[1]: Stopped target Timers. Sep 02 19:02:39 dom0 systemd[1]: Stopped Discard unused blocks once a week. Sep 02 19:02:39 dom0 systemd[1]: Stopped Daily Cleanup of Temporary Directories. Sep 02 19:02:39 dom0 systemd[1]: Stopping Accounts Service... Sep 02 19:02:39 dom0 systemd[1]: Removed slice system-getty.slice. Sep 02 19:02:39 dom0 systemd[1]: Stopping RealtimeKit Scheduling Policy Service... Sep 02 19:02:39 dom0 systemd[1]: Stopping Authorization Manager... Sep 02 19:02:39 dom0 systemd[1]: Stopped target Sound Card. Sep 02 19:02:39 dom0 systemd[1]: Stopped target Login Prompts. Sep 02 19:02:39 dom0 systemd[1]: Stopping Serial Getty on hvc0... Sep 02 19:02:39 dom0 systemd[1]: Stopping Daemon for power management... Sep 02 19:02:39 dom0 crond[3271]: (CRON) INFO (Shutting down) Sep 02 19:02:39 dom0 systemd[1]: Stopping Session 2 of user ctor. Sep 02 19:02:39 dom0 systemd[1]: Stopped Daemon for power management. Sep 02 19:02:39 dom0 systemd[1]: Stopped Command Scheduler. Sep 02 19:02:39 dom0 systemd[1]: Stopped Accounts Service. Sep 02 19:02:39 dom0 systemd[1]: Stopped Authorization Manager. Sep 02 19:02:39 dom0 systemd[1]: Stopped Serial Getty on hvc0. Sep 02 19:02:39 dom0 systemd[1]: Stopped RealtimeKit Scheduling Policy Service. Sep 02 19:02:39 dom0 systemd[1]: Removed slice system-serial\x2dgetty.slice. Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: Traceback (most recent call last): Sep 02 19:02:39 dom0 systemd[1]: Stopped Manage Sound Card State (restore and store). Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: return f(*args) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: self.invalid() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: raise ConnectionException(err) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: During handling of the above exception, another exception occurred: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: Traceback (most recent call last): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/qubes/icon-receiver", line 362, in Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: rcvd.handle_input() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: self.handle_events() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: for ev in iter(self.conn.poll_for_event, None): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: self.invalid() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: raise ConnectionException(err) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-untrusted-fdr28[4024]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 19:02:39 dom0 alsactl[1905]: alsactl daemon stopped Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: Traceback (most recent call last): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: return f(*args) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: self.invalid() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: raise ConnectionException(err) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: During handling of the above exception, another exception occurred: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: Traceback (most recent call last): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/qubes/icon-receiver", line 362, in Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: rcvd.handle_input() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: self.handle_events() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: for ev in iter(self.conn.poll_for_event, None): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: self.invalid() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: raise ConnectionException(err) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-net[3609]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: Traceback (most recent call last): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: return f(*args) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: self.invalid() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: raise ConnectionException(err) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: During handling of the above exception, another exception occurred: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: Traceback (most recent call last): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/qubes/icon-receiver", line 362, in Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: rcvd.handle_input() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: self.handle_events() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: for ev in iter(self.conn.poll_for_event, None): Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: self.invalid() Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: raise ConnectionException(err) Sep 02 19:02:39 dom0 qubes.WindowIconUpdater-sys-firewall[3602]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 19:02:39 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=52874042, total_mem_pref=2115242393.6, total_available_memory=30798680726.4) Sep 02 19:02:39 dom0 qmemman.daemon.algo[1935]: left_memory=3964837033 acceptors_count=1 Sep 02 19:02:39 dom0 systemd[3371]: Received SIGRTMIN+24 from PID 7567 (kill). Sep 02 19:02:39 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=52874042, total_mem_pref=2039177625.6, total_available_memory=30874745494.4) Sep 02 19:02:39 dom0 qmemman.daemon.algo[1935]: left_memory=4425641388 acceptors_count=1 Sep 02 19:02:39 dom0 systemd[1]: Stopped User Manager for UID 1000. Sep 02 19:02:39 dom0 systemd[1]: Stopped Light Display Manager. Sep 02 19:02:39 dom0 systemd[1]: Starting Show Plymouth Reboot Screen... Sep 02 19:02:39 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=52874042, total_mem_pref=1782303948.8000002, total_available_memory=31131619171.2) Sep 02 19:02:39 dom0 qmemman.daemon.algo[1935]: left_memory=6272488756 acceptors_count=1 Sep 02 19:02:39 dom0 systemd[1]: Started Show Plymouth Reboot Screen. Sep 02 19:02:39 dom0 systemd[1]: Stopped Restore /run/initramfs on shutdown. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:40 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:02:44 dom0 systemd[1]: Received SIGRTMIN+20 from PID 7572 (plymouthd). Sep 02 19:04:09 dom0 systemd[1]: session-2.scope: Stopping timed out. Killing. Sep 02 19:04:09 dom0 systemd[1]: session-2.scope: Killing process 3570 (qubes-guid) with signal SIGKILL. Sep 02 19:04:09 dom0 systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping /dev/disk/by-id/dm-uuid-CRYPT-LUKS1-9ed952b52aa84564b700fb23f5c9e94b-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. Sep 02 19:04:09 dom0 systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. Sep 02 19:04:09 dom0 systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop timed out. Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping /sys/devices/virtual/block/dm-0. Sep 02 19:04:09 dom0 systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop failed with result 'timeout'. Sep 02 19:04:09 dom0 systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop timed out. Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping /dev/disk/by-id/lvm-pv-uuid-pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m. Sep 02 19:04:09 dom0 systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop failed with result 'timeout'. Sep 02 19:04:09 dom0 systemd[1]: Stopped Session 2 of user ctor. Sep 02 19:04:09 dom0 systemd[1]: session-2.scope: Unit entered failed state. Sep 02 19:04:09 dom0 systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop timed out. Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping LVM PV pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m on /dev/dm-0. Sep 02 19:04:09 dom0 systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop failed with result 'timeout'. Sep 02 19:04:09 dom0 systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop timed out. Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping /dev/dm-0. Sep 02 19:04:09 dom0 systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop failed with result 'timeout'. Sep 02 19:04:09 dom0 systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping /dev/disk/by-id/dm-name-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. Sep 02 19:04:09 dom0 systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. Sep 02 19:04:09 dom0 systemd[1]: Removed slice User Slice of ctor. Sep 02 19:04:09 dom0 systemd[1]: Stopping Permit User Sessions... Sep 02 19:04:09 dom0 systemd[1]: Stopping Login Service... Sep 02 19:04:09 dom0 systemd[1]: Stopped Permit User Sessions. Sep 02 19:04:09 dom0 systemd[1]: Stopped Start Qubes VM sys-net. Sep 02 19:04:09 dom0 systemd[1]: Stopped Start Qubes VM sys-firewall. Sep 02 19:04:09 dom0 systemd[1]: Removed slice system-qubes\x2dvm.slice. Sep 02 19:04:09 dom0 systemd[1]: Stopping Qubes memory information reporter... Sep 02 19:04:09 dom0 systemd[1]: Stopped Qubes memory information reporter. Sep 02 19:04:09 dom0 systemd[1]: Stopping Qubes Dom0 startup setup... Sep 02 19:04:09 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:04:09 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:04:09 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:04:09 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:04:09 dom0 qubesd[1906]: socket.send() raised exception. Sep 02 19:04:09 dom0 systemd[1]: Stopped Login Service. Sep 02 19:04:09 dom0 systemd[1]: Stopped target User and Group Name Lookups. Sep 02 19:04:09 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=52874042, total_mem_pref=1683337216.0000002, total_available_memory=31230585904.0) Sep 02 19:04:09 dom0 qmemman.daemon.algo[1935]: left_memory=5201303975 acceptors_count=1 Sep 02 19:04:10 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=52874042, total_mem_pref=1683337216.0000002, total_available_memory=31230585904.0) Sep 02 19:04:10 dom0 qmemman.daemon.algo[1935]: left_memory=5201303975 acceptors_count=1 Sep 02 19:04:11 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=4246522375, total_mem_pref=1362917376.0, total_available_memory=31550350077.0) Sep 02 19:04:11 dom0 qmemman.daemon.algo[1935]: left_memory=4860119451 acceptors_count=1 Sep 02 19:04:11 dom0 qmemman.systemstate[1935]: stat: dom '0' act=24472441078 pref=987604172.8000001 last_target=24472441078 Sep 02 19:04:11 dom0 qmemman.systemstate[1935]: stat: dom '3' act=4194304000 pref=375313203.2 last_target=4194304000 Sep 02 19:04:11 dom0 qmemman.systemstate[1935]: stat: xenfree=4298951175 memset_reqs=[('0', 28681190065), ('3', 4194304000)] Sep 02 19:04:11 dom0 qmemman.systemstate[1935]: mem-set domain 0 to 28681190065 Sep 02 19:04:11 dom0 qmemman.systemstate[1935]: mem-set domain 3 to 4194304000 Sep 02 19:04:11 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:11 dom0 lvm[818]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:11 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:11 dom0 lvm[818]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:12 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=41831720, total_mem_pref=1263199846.4, total_available_memory=31654125938.600002) Sep 02 19:04:12 dom0 qmemman.daemon.algo[1935]: left_memory=2980174944 acceptors_count=1 Sep 02 19:04:14 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=41831720, total_mem_pref=1263199846.4, total_available_memory=31654125938.600002) Sep 02 19:04:14 dom0 qmemman.daemon.algo[1935]: left_memory=2980174944 acceptors_count=1 Sep 02 19:04:15 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=4233907184, total_mem_pref=987604172.8000001, total_available_memory=31927493076.2) Sep 02 19:04:15 dom0 qmemman.systemstate[1935]: stat: dom '0' act=28681190065 pref=987604172.8000001 last_target=28681190065 Sep 02 19:04:15 dom0 qmemman.systemstate[1935]: stat: xenfree=4286335984 memset_reqs=[('0', 32882182151)] Sep 02 19:04:15 dom0 qmemman.systemstate[1935]: mem-set domain 0 to 32882182151 Sep 02 19:04:15 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:15 dom0 lvm[818]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:15 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:16 dom0 lvm[818]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:19 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=38435498, total_mem_pref=987604172.8000001, total_available_memory=31933013476.2) Sep 02 19:04:19 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=188463524, total_mem_pref=987604172.8000001, total_available_memory=32083041502.2) Sep 02 19:04:19 dom0 qmemman.systemstate[1935]: stat: dom '0' act=32882182151 pref=987604172.8000001 last_target=32882182151 Sep 02 19:04:19 dom0 qmemman.systemstate[1935]: stat: xenfree=240892324 memset_reqs=[('0', 33037575029)] Sep 02 19:04:19 dom0 qmemman.systemstate[1935]: mem-set domain 0 to 33037575029 Sep 02 19:04:19 dom0 qmemman.daemon.algo[1935]: balance_when_enough_memory(xen_free_memory=439444537, total_mem_pref=987604172.8000001, total_available_memory=32489415393.2) Sep 02 19:04:19 dom0 qmemman.systemstate[1935]: stat: dom '0' act=33037575029 pref=987604172.8000001 last_target=33037575029 Sep 02 19:04:19 dom0 qmemman.systemstate[1935]: stat: xenfree=491873337 memset_reqs=[('0', 33443542546)] Sep 02 19:04:19 dom0 qmemman.systemstate[1935]: mem-set domain 0 to 33443542546 Sep 02 19:04:19 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:19 dom0 lvm[818]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:19 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:20 dom0 lvm[818]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:20 dom0 qubesdb-daemon[1936]: terminating Sep 02 19:04:20 dom0 systemd[1]: Stopped Qubes DB agent. Sep 02 19:04:20 dom0 systemd[1]: Stopped Qubes Dom0 startup setup. Sep 02 19:04:20 dom0 systemd[1]: Stopping Virtualization daemon... Sep 02 19:04:20 dom0 systemd[1]: Stopping Qubes memory management daemon... Sep 02 19:04:20 dom0 systemd[1]: Stopping Qubes OS daemon... Sep 02 19:04:20 dom0 systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... Sep 02 19:04:20 dom0 qubesd[1906]: caught SIGTERM, exiting Sep 02 19:04:20 dom0 systemd[1]: Stopped Qubes memory management daemon. Sep 02 19:04:20 dom0 systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. Sep 02 19:04:20 dom0 libvirtd[1960]: S3 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S4 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S3 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S4 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S3 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S4 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S3 disabled Sep 02 19:04:20 dom0 libvirtd[1960]: S4 disabled Sep 02 19:04:20 dom0 systemd[1]: Stopped Virtualization daemon. Sep 02 19:04:20 dom0 systemd[1]: Stopping The Xen xenstore... Sep 02 19:04:20 dom0 systemd[1]: Stopped target Remote File Systems. Sep 02 19:04:20 dom0 systemd[1]: Stopping D-Bus System Message Bus... Sep 02 19:04:20 dom0 systemd[1]: Stopped The Xen xenstore. Sep 02 19:04:20 dom0 systemd[1]: Unmounting mount xenstore file system... Sep 02 19:04:20 dom0 systemd[1]: Stopped D-Bus System Message Bus. Sep 02 19:04:20 dom0 systemd[1]: Unmounted mount xenstore file system. Sep 02 19:04:20 dom0 systemd[1]: Stopped Qubes OS daemon. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Basic System. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Slices. Sep 02 19:04:20 dom0 systemd[1]: Removed slice User and Session Slice. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Sockets. Sep 02 19:04:20 dom0 systemd[1]: Closed Virtual machine lock manager socket. Sep 02 19:04:20 dom0 systemd[1]: Closed D-Bus System Message Bus Socket. Sep 02 19:04:20 dom0 systemd[1]: Closed Virtual machine log manager socket. Sep 02 19:04:20 dom0 systemd[1]: Stopped target System Initialization. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Encrypted Volumes. Sep 02 19:04:20 dom0 systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... Sep 02 19:04:20 dom0 systemd[1]: Stopping Load/Save Random Seed... Sep 02 19:04:20 dom0 systemd[1]: Stopped Apply Kernel Variables. Sep 02 19:04:20 dom0 systemd[1]: Stopped Load legacy module configuration. Sep 02 19:04:20 dom0 systemd[1]: Stopping Update UTMP about System Boot/Shutdown... Sep 02 19:04:20 dom0 systemd[1]: Stopped Setup Virtual Console. Sep 02 19:04:20 dom0 systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Paths. Sep 02 19:04:20 dom0 systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. Sep 02 19:04:20 dom0 systemd[1]: Stopping LVM2 PV scan on device 253:0... Sep 02 19:04:20 dom0 systemd[1]: Stopped Load/Save Random Seed. Sep 02 19:04:20 dom0 systemd[1]: Stopped Update UTMP about System Boot/Shutdown. Sep 02 19:04:20 dom0 systemd[1]: Stopped Create Volatile Files and Directories. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Local File Systems. Sep 02 19:04:20 dom0 systemd[1]: Unmounting Configuration File System... Sep 02 19:04:20 dom0 systemd[1]: Unmounting /run/user/1000... Sep 02 19:04:20 dom0 systemd[1]: Unmounting /boot/efi... Sep 02 19:04:20 dom0 systemd[1]: Unmounting Temporary Directory... Sep 02 19:04:20 dom0 systemd[1]: Stopped Configure read-only root support. Sep 02 19:04:20 dom0 systemd[1]: Stopped LVM2 PV scan on device 253:0. Sep 02 19:04:20 dom0 systemd[1]: Unmounted Configuration File System. Sep 02 19:04:20 dom0 systemd[1]: Unmounted /run/user/1000. Sep 02 19:04:20 dom0 systemd[1]: Unmounted /boot/efi. Sep 02 19:04:20 dom0 systemd[1]: Unmounted Temporary Directory. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Swap. Sep 02 19:04:20 dom0 systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. Sep 02 19:04:20 dom0 systemd[1]: Removed slice system-systemd\x2dfsck.slice. Sep 02 19:04:20 dom0 systemd[1]: Stopped target Local File Systems (Pre). Sep 02 19:04:20 dom0 systemd[1]: Stopped Create Static Device Nodes in /dev. Sep 02 19:04:20 dom0 systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Sep 02 19:04:20 dom0 systemd[1]: Stopped Remount Root and Kernel File Systems. Sep 02 19:04:20 dom0 systemd[1]: Stopped Load Kernel Modules. Sep 02 19:04:20 dom0 systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. Sep 02 19:04:20 dom0 dmeventd[818]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:04:20 dom0 lvm[9037]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored Sep 02 19:04:20 dom0 lvmetad[817]: Failed to accept connection errno 11. Sep 02 19:04:20 dom0 systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Sep 02 19:04:20 dom0 systemd[1]: Stopping LVM2 metadata daemon... Sep 02 19:04:20 dom0 systemd[1]: Stopped LVM2 metadata daemon. Sep 02 19:04:25 dom0 systemd-cryptsetup[9016]: Failed to deactivate: Device or resource busy Sep 02 19:04:25 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 Sep 02 19:04:25 dom0 systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. Sep 02 19:04:25 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. Sep 02 19:04:25 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. Sep 02 19:04:25 dom0 systemd[1]: Reached target Unmount All Filesystems. Sep 02 19:04:25 dom0 systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. Sep 02 19:04:25 dom0 systemd[1]: Reached target Shutdown. Sep 02 19:04:25 dom0 systemd[1]: Reached target Final Step. Sep 02 19:04:25 dom0 systemd[1]: Starting Reboot... Sep 02 19:04:25 dom0 systemd[1]: Shutting down. Sep 02 19:04:25 dom0 systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 Sep 02 19:04:25 dom0 systemd[1]: Set hardware watchdog to 10min. Sep 02 19:04:25 dom0 kernel: watchdog: watchdog0: watchdog did not stop! Sep 02 19:04:25 dom0 systemd-shutdown[1]: Sending SIGTERM to remaining processes... Sep 02 19:04:25 dom0 dmeventd[818]: dmeventd detected break while being idle for 5 second(s), exiting. Sep 02 19:04:25 dom0 dmeventd[818]: dmeventd shutting down. Sep 02 19:04:25 dom0 systemd-journald[822]: Journal stopped ```

from dmesg's point of view

``` [ 309.286715] systemd[1]: Starting User Manager for UID 0... [ 309.287455] systemd-logind[1903]: New session 3 of user root. [ 309.288088] systemd[1]: Started Session 3 of user root. [ 309.314238] systemd[4890]: Starting D-Bus User Message Bus Socket. [ 309.314263] systemd[4890]: Reached target Timers. [ 309.314280] systemd[4890]: Reached target Paths. [ 309.319603] systemd[4890]: Listening on D-Bus User Message Bus Socket. [ 309.319653] systemd[4890]: Reached target Sockets. [ 309.319662] systemd[4890]: Reached target Basic System. [ 309.319671] systemd[4890]: Reached target Default. [ 309.319687] systemd[4890]: Startup finished in 21ms. [ 309.319754] systemd[1]: Started User Manager for UID 0. [ 726.212699] xen-blkback: backend/vbd/6/51712: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 726.250284] xen-blkback: backend/vbd/6/51728: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 726.289248] xen-blkback: backend/vbd/6/51744: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 726.300957] xen-blkback: backend/vbd/6/51760: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 790.489142] systemd-logind[1903]: Removed session 3. [ 790.490277] systemd[1]: Stopping User Manager for UID 0... [ 790.490657] systemd[4890]: Stopped target Default. [ 790.490667] systemd[4890]: Stopped target Basic System. [ 790.490673] systemd[4890]: Stopped target Timers. [ 790.490679] systemd[4890]: Stopped target Paths. [ 790.490685] systemd[4890]: Stopped target Sockets. [ 790.490892] systemd[4890]: Closed D-Bus User Message Bus Socket. [ 790.490906] systemd[4890]: Reached target Shutdown. [ 790.492326] systemd[4890]: Starting Exit the Session... [ 790.494573] systemd[4890]: Received SIGRTMIN+24 from PID 6028 (kill). [ 790.496974] systemd[1]: Stopped User Manager for UID 0. [ 790.498937] systemd[1]: Removed slice User Slice of root. [ 916.549719] systemd[1]: Starting Cleanup of Temporary Directories... [ 916.574458] systemd[1]: Started Cleanup of Temporary Directories. [ 934.242451] systemd[1]: Created slice User Slice of root. [ 934.243855] systemd[1]: Starting User Manager for UID 0... [ 934.244645] systemd-logind[1903]: New session 3 of user root. [ 934.245296] systemd[1]: Started Session 3 of user root. [ 934.270983] systemd[6175]: Reached target Timers. [ 934.272366] systemd[6175]: Starting D-Bus User Message Bus Socket. [ 934.272388] systemd[6175]: Reached target Paths. [ 934.277738] systemd[6175]: Listening on D-Bus User Message Bus Socket. [ 934.277781] systemd[6175]: Reached target Sockets. [ 934.277795] systemd[6175]: Reached target Basic System. [ 934.277808] systemd[6175]: Reached target Default. [ 934.277823] systemd[6175]: Startup finished in 22ms. [ 934.277897] systemd[1]: Started User Manager for UID 0. [ 979.579262] systemd-logind[1903]: Existing logind session ID 3 used by new audit session, ignoring [ 979.579928] systemd-logind[1903]: New session c2 of user root. [ 979.580463] systemd[1]: Started Session c2 of user root. [ 1002.908309] systemd-logind[1903]: Removed session c2. [ 1011.122080] systemd-logind[1903]: Existing logind session ID 3 used by new audit session, ignoring [ 1011.122791] systemd-logind[1903]: New session c3 of user root. [ 1011.123234] systemd[1]: Started Session c3 of user root. [ 1012.742107] systemd-logind[1903]: Removed session c3. [ 1016.511784] systemd[6175]: Time has been changed [ 1016.511786] systemd[1]: Time has been changed [ 1069.828953] systemd-logind[1903]: Existing logind session ID 3 used by new audit session, ignoring [ 1069.829671] systemd-logind[1903]: New session c4 of user root. [ 1069.830136] systemd[1]: Started Session c4 of user root. [ 1095.287031] systemd-logind[1903]: Removed session c4. [ 1106.019453] systemd-logind[1903]: Existing logind session ID 3 used by new audit session, ignoring [ 1106.020091] systemd-logind[1903]: New session c5 of user root. [ 1106.020537] systemd[1]: Started Session c5 of user root. [ 1106.033970] systemd-logind[1903]: Removed session c5. [ 1118.900051] systemd-logind[1903]: Existing logind session ID 3 used by new audit session, ignoring [ 1118.900602] systemd-logind[1903]: New session c6 of user root. [ 1118.901019] systemd[1]: Started Session c6 of user root. [ 1121.586449] systemd-logind[1903]: Removed session c6. [ 1137.676372] systemd-logind[1903]: Removed session 3. [ 1137.677968] systemd[1]: Stopping User Manager for UID 0... [ 1137.678329] systemd[6175]: Stopped target Default. [ 1137.678338] systemd[6175]: Stopped target Basic System. [ 1137.678344] systemd[6175]: Stopped target Timers. [ 1137.678350] systemd[6175]: Stopped target Paths. [ 1137.678355] systemd[6175]: Stopped target Sockets. [ 1137.678539] systemd[6175]: Closed D-Bus User Message Bus Socket. [ 1137.678549] systemd[6175]: Reached target Shutdown. [ 1137.679743] systemd[6175]: Starting Exit the Session... [ 1137.681599] systemd[6175]: Received SIGRTMIN+24 from PID 6557 (kill). [ 1137.683782] systemd[1]: Stopped User Manager for UID 0. [ 1137.685717] systemd[1]: Removed slice User Slice of root. [ 1174.820019] systemd-logind[1903]: System is rebooting. [ 1174.823998] systemd[1]: Stopped target Graphical Interface. [ 1174.824176] systemd[1]: Stopping Light Display Manager... [ 1174.825532] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 1174.826491] systemd[1]: Stopping User Manager for UID 1000... [ 1174.826506] systemd[1]: Stopped target Multi-User System. [ 1174.826673] systemd[1]: Stopping Command Scheduler... [ 1174.826972] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 1174.828461] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 1174.828615] systemd[1]: Stopped target Timers. [ 1174.828796] systemd[1]: Stopped Discard unused blocks once a week. [ 1174.828904] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 1174.829066] systemd[1]: Stopping Accounts Service... [ 1174.829209] systemd[1]: Removed slice system-getty.slice. [ 1174.829413] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 1174.829600] systemd[1]: Stopping Authorization Manager... [ 1174.829620] systemd[1]: Stopped target Sound Card. [ 1174.829662] systemd[1]: Stopped target Login Prompts. [ 1174.829749] systemd[1]: Stopping Serial Getty on hvc0... [ 1174.829863] systemd[1]: Stopping Daemon for power management... [ 1174.853846] systemd[1]: Stopping Session 2 of user ctor. [ 1174.861099] systemd[1]: Stopped Daemon for power management. [ 1174.861386] systemd[1]: Stopped Command Scheduler. [ 1174.861643] systemd[1]: Stopped Accounts Service. [ 1174.861905] systemd[1]: Stopped Authorization Manager. [ 1174.863043] systemd[1]: Stopped Serial Getty on hvc0. [ 1174.863534] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 1174.869054] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 1174.870174] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 1174.996332] systemd[1]: Stopped User Manager for UID 1000. [ 1175.083454] systemd[1]: Stopped Light Display Manager. [ 1175.084996] systemd[1]: Starting Show Plymouth Reboot Screen... [ 1175.116129] systemd[1]: Started Show Plymouth Reboot Screen. [ 1175.315160] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 1180.105405] systemd[1]: Received SIGRTMIN+20 from PID 7572 (plymouthd). [ 1264.894971] systemd[1]: session-2.scope: Stopping timed out. Killing. [ 1264.895064] systemd[1]: session-2.scope: Killing process 3570 (qubes-guid) with signal SIGKILL. [ 1264.895263] systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. [ 1264.895358] systemd[1]: Timed out stopping /dev/disk/by-id/dm-uuid-CRYPT-LUKS1-9ed952b52aa84564b700fb23f5c9e94b-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 1264.895444] systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. [ 1264.895611] systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop timed out. [ 1264.895642] systemd[1]: Timed out stopping /sys/devices/virtual/block/dm-0. [ 1264.895711] systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop failed with result 'timeout'. [ 1264.895759] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop timed out. [ 1264.895805] systemd[1]: Timed out stopping /dev/disk/by-id/lvm-pv-uuid-pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m. [ 1264.895865] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop failed with result 'timeout'. [ 1264.896116] systemd[1]: Stopped Session 2 of user ctor. [ 1264.896278] systemd[1]: session-2.scope: Unit entered failed state. [ 1264.896374] systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop timed out. [ 1264.896401] systemd[1]: Timed out stopping LVM PV pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m on /dev/dm-0. [ 1264.896455] systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop failed with result 'timeout'. [ 1264.896512] systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop timed out. [ 1264.896539] systemd[1]: Timed out stopping /dev/dm-0. [ 1264.896600] systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop failed with result 'timeout'. [ 1264.896649] systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. [ 1264.896696] systemd[1]: Timed out stopping /dev/disk/by-id/dm-name-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 1264.896751] systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. [ 1264.897507] systemd[1]: Removed slice User Slice of ctor. [ 1264.898905] systemd[1]: Stopping Permit User Sessions... [ 1264.899275] systemd[1]: Stopping Login Service... [ 1264.903392] systemd[1]: Stopped Permit User Sessions. [ 1264.903575] systemd[1]: Stopped Start Qubes VM sys-net. [ 1264.903647] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 1264.903802] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 1264.903960] systemd[1]: Stopping Qubes memory information reporter... [ 1264.904484] systemd[1]: Stopped Qubes memory information reporter. [ 1264.905816] systemd[1]: Stopping Qubes Dom0 startup setup... [ 1264.979667] systemd[1]: Stopped Login Service. [ 1264.980091] systemd[1]: Stopped target User and Group Name Lookups. [ 1276.060011] systemd[1]: Stopped Qubes DB agent. [ 1276.060507] systemd[1]: Stopped Qubes Dom0 startup setup. [ 1276.060783] systemd[1]: Stopping Virtualization daemon... [ 1276.060905] systemd[1]: Stopping Qubes memory management daemon... [ 1276.061008] systemd[1]: Stopping Qubes OS daemon... [ 1276.061152] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 1276.064741] systemd[1]: Stopped Qubes memory management daemon. [ 1276.065043] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 1276.070979] systemd[1]: Stopped Virtualization daemon. [ 1276.071197] systemd[1]: Stopping The Xen xenstore... [ 1276.071319] systemd[1]: Stopped target Remote File Systems. [ 1276.071471] systemd[1]: Stopping D-Bus System Message Bus... [ 1276.071920] systemd[1]: Stopped The Xen xenstore. [ 1276.073207] systemd[1]: Unmounting mount xenstore file system... [ 1276.074653] systemd[1]: Stopped D-Bus System Message Bus. [ 1276.082790] systemd[1]: Unmounted mount xenstore file system. [ 1276.107981] systemd[1]: Stopped Qubes OS daemon. [ 1276.108095] systemd[1]: Stopped target Basic System. [ 1276.108168] systemd[1]: Stopped target Slices. [ 1276.108672] systemd[1]: Removed slice User and Session Slice. [ 1276.108716] systemd[1]: Stopped target Sockets. [ 1276.108788] systemd[1]: Closed Virtual machine lock manager socket. [ 1276.112198] systemd[1]: Closed D-Bus System Message Bus Socket. [ 1276.113930] systemd[1]: Closed Virtual machine log manager socket. [ 1276.115610] systemd[1]: Stopped target System Initialization. [ 1276.118946] systemd[1]: Stopped target Encrypted Volumes. [ 1276.125451] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 1276.130614] systemd[1]: Stopping Load/Save Random Seed... [ 1276.135303] systemd[1]: Stopped Apply Kernel Variables. [ 1276.140456] systemd[1]: Stopped Load legacy module configuration. [ 1276.146535] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 1276.151006] systemd[1]: Stopped Setup Virtual Console. [ 1276.156007] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 1276.161123] systemd[1]: Stopped target Paths. [ 1276.170315] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 1276.176330] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 1276.181133] systemd[1]: Stopped Load/Save Random Seed. [ 1276.187431] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 1276.191450] systemd[1]: Stopped Create Volatile Files and Directories. [ 1276.196258] systemd[1]: Stopped target Local File Systems. [ 1276.202623] systemd[1]: Unmounting Configuration File System... [ 1276.207928] systemd[1]: Unmounting /run/user/1000... [ 1276.213297] systemd[1]: Unmounting /boot/efi... [ 1276.218755] systemd[1]: Unmounting Temporary Directory... [ 1276.223078] systemd[1]: Stopped Configure read-only root support. [ 1276.228836] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 1276.232819] systemd[1]: Unmounted Configuration File System. [ 1276.237562] systemd[1]: Unmounted /run/user/1000. [ 1276.242232] systemd[1]: Unmounted /boot/efi. [ 1276.246635] systemd[1]: Unmounted Temporary Directory. [ 1276.251464] systemd[1]: Stopped target Swap. [ 1276.255156] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 1276.256733] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 1276.260945] systemd[1]: Stopped target Local File Systems (Pre). [ 1276.265503] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 1276.270668] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 1276.274170] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 1276.278364] systemd[1]: Stopped Load Kernel Modules. [ 1276.282282] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 1276.305946] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 1276.307472] systemd[1]: Stopping LVM2 metadata daemon... [ 1276.312101] systemd[1]: Stopped LVM2 metadata daemon. [ 1280.935987] systemd-cryptsetup[9016]: Failed to deactivate: Device or resource busy [ 1280.938211] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 1280.939975] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 1280.941455] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 1280.942833] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 1280.942987] systemd[1]: Reached target Unmount All Filesystems. [ 1280.946004] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 1280.950329] systemd[1]: Reached target Shutdown. [ 1280.954815] systemd[1]: Reached target Final Step. [ 1280.956307] systemd[1]: Starting Reboot... [ 1280.961109] systemd[1]: Shutting down. [ 1280.978507] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 1280.979847] systemd[1]: Set hardware watchdog to 10min. [ 1280.981126] watchdog: watchdog0: watchdog did not stop! [ 1281.011206] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 1281.019439] systemd-journald[822]: Received SIGTERM from PID 1 (systemd-shutdow). [ 1281.047890] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 1281.052666] systemd-shutdown[1]: Process 7572 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 1281.054130] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 1281.055685] systemd-shutdown[1]: Unmounting file systems. [ 1281.057588] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 1281.069541] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 1281.074498] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 1281.075929] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 1281.077298] systemd-shutdown[1]: All filesystems unmounted. [ 1281.078660] systemd-shutdown[1]: Deactivating swaps. [ 1281.080064] systemd-shutdown[1]: All swaps deactivated. [ 1281.081426] systemd-shutdown[1]: Detaching loop devices. [ 1281.084210] systemd-shutdown[1]: All loop devices detached. [ 1281.085572] systemd-shutdown[1]: Detaching DM devices. [ 1281.091312] systemd-shutdown[1]: Detaching DM 253:9. [ 1281.104526] systemd-shutdown[1]: Detaching DM 253:8. [ 1281.118473] systemd-shutdown[1]: Detaching DM 253:7. [ 1281.132519] systemd-shutdown[1]: Detaching DM 253:6. [ 1281.144514] systemd-shutdown[1]: Detaching DM 253:59. [ 1281.158420] systemd-shutdown[1]: Detaching DM 253:56. [ 1281.170495] systemd-shutdown[1]: Detaching DM 253:53. [ 1281.183459] systemd-shutdown[1]: Detaching DM 253:50. [ 1281.196472] systemd-shutdown[1]: Detaching DM 253:5. [ 1281.205347] systemd-shutdown[1]: Detaching DM 253:47. [ 1281.218442] systemd-shutdown[1]: Detaching DM 253:46. [ 1281.230483] systemd-shutdown[1]: Detaching DM 253:45. [ 1281.243450] systemd-shutdown[1]: Detaching DM 253:44. [ 1281.254718] systemd-shutdown[1]: Detaching DM 253:43. [ 1281.268457] systemd-shutdown[1]: Detaching DM 253:42. [ 1281.282508] systemd-shutdown[1]: Detaching DM 253:39. [ 1281.294763] systemd-shutdown[1]: Detaching DM 253:38. [ 1281.310472] systemd-shutdown[1]: Detaching DM 253:37. [ 1281.325474] systemd-shutdown[1]: Detaching DM 253:36. [ 1281.336445] systemd-shutdown[1]: Detaching DM 253:35. [ 1281.351500] systemd-shutdown[1]: Detaching DM 253:34. [ 1281.363454] systemd-shutdown[1]: Detaching DM 253:33. [ 1281.379467] systemd-shutdown[1]: Detaching DM 253:32. [ 1281.392487] systemd-shutdown[1]: Detaching DM 253:31. [ 1281.403461] systemd-shutdown[1]: Detaching DM 253:30. [ 1281.417464] systemd-shutdown[1]: Detaching DM 253:3. [ 1281.418904] dev_remove: 15 callbacks suppressed [ 1281.418913] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 1281.421730] systemd-shutdown[1]: Detaching DM 253:29. [ 1281.438515] systemd-shutdown[1]: Detaching DM 253:28. [ 1281.451516] systemd-shutdown[1]: Detaching DM 253:27. [ 1281.463428] systemd-shutdown[1]: Detaching DM 253:26. [ 1281.478454] systemd-shutdown[1]: Detaching DM 253:23. [ 1281.494447] systemd-shutdown[1]: Detaching DM 253:22. [ 1281.515467] systemd-shutdown[1]: Detaching DM 253:21. [ 1281.532470] systemd-shutdown[1]: Detaching DM 253:20. [ 1281.543481] systemd-shutdown[1]: Detaching DM 253:2. [ 1281.544833] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 1281.546168] systemd-shutdown[1]: Detaching DM 253:19. [ 1281.559486] systemd-shutdown[1]: Detaching DM 253:18. [ 1281.576461] systemd-shutdown[1]: Detaching DM 253:16. [ 1281.592518] systemd-shutdown[1]: Detaching DM 253:15. [ 1281.604504] systemd-shutdown[1]: Detaching DM 253:14. [ 1281.616508] systemd-shutdown[1]: Detaching DM 253:13. [ 1281.629456] systemd-shutdown[1]: Detaching DM 253:12. [ 1281.646479] systemd-shutdown[1]: Detaching DM 253:11. [ 1281.658504] systemd-shutdown[1]: Detaching DM 253:10. [ 1281.669436] systemd-shutdown[1]: Detaching DM 253:1. [ 1281.670696] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 1281.671956] systemd-shutdown[1]: Detaching DM 253:0. [ 1281.673222] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 1281.674463] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 1281.675848] systemd-shutdown[1]: Detaching DM devices. [ 1281.677721] systemd-shutdown[1]: Detaching DM 253:3. [ 1281.678762] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 1281.679784] systemd-shutdown[1]: Detaching DM 253:2. [ 1281.680815] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 1281.681852] systemd-shutdown[1]: Detaching DM 253:1. [ 1281.682893] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 1281.683932] systemd-shutdown[1]: Detaching DM 253:0. [ 1281.684991] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 1281.686050] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 1281.687091] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 1281.710910] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 1281.712185] + echo 'Script args: reboot' [ 1281.713465] Script args: reboot [ 1281.714706] + set [ 1281.715934] BASH=/bin/bash [ 1281.717156] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 1281.718303] BASH_ALIASES=() [ 1281.719363] BASH_ARGC=([0]="1") [ 1281.720433] BASH_ARGV=([0]="reboot") [ 1281.721479] BASH_CMDS=() [ 1281.722517] BASH_LINENO=([0]="0") [ 1281.723555] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 1281.724596] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 1281.725645] BASH_VERSION='4.3.43(1)-release' [ 1281.726698] DIRSTACK=() [ 1281.727728] EUID=0 [ 1281.728756] GROUPS=() [ 1281.729778] HOME=/ [ 1281.730792] HOSTNAME=dom0 [ 1281.731802] HOSTTYPE=x86_64 [ 1281.732819] IFS=$' \t\n' [ 1281.733822] MACHTYPE=x86_64-redhat-linux-gnu [ 1281.734825] OPTERR=1 [ 1281.735809] OPTIND=1 [ 1281.736765] OSTYPE=linux-gnu [ 1281.737722] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 1281.738692] PIPESTATUS=([0]="0") [ 1281.739659] PPID=9049 [ 1281.740610] PS4='+ ' [ 1281.741546] PWD=/ [ 1281.742491] SHELL=/bin/bash [ 1281.743418] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 1281.744352] SHLVL=1 [ 1281.745278] TERM=linux [ 1281.746184] UID=0 [ 1281.747083] WATCHDOG_USEC=600000000 [ 1281.747991] _='Script args: reboot' [ 1281.748895] date_log_started='Sun Sep 2 19:04:26 CEST 2018' [ 1281.749804] pax_sanitize_slab=full [ 1281.750691] root_trim=yes [ 1281.751613] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 1281.752529] + sysctl kernel.sysrq=1 [ 1281.761701] kernel.sysrq = 1 [ 1281.769835] + mount -o remount,rw / [ 1281.775857] EXT4-fs (dm-4): re-mounted. Opts: discard [ 1281.777111] + df [ 1281.780494] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987880 0 1987880 0% /dev tmpfs 2001540 0 2001540 0% /dev/shm tmpfs 2001540 58748 1942792 3% /run tmpfs 2001540 0 2001540 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 11369516 190149680 6% / [ 1281.785819] + lsblk [ 1281.791006] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 1281.800093] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 1281.892504] real 0m0.092s user 0m0.053s [ 1281.894821] sys 0m0.021s [ 1281.895623] + echo 'exit code: 1' [ 1281.896403] exit code: 1 [ 1281.897884] + sysctl -a [ 1281.898073] + grep -i sysrq [ 1281.909120] sysctl: [ 1281.909122] reading key "vm.nr_hugepages" [ 1281.911516] sysctl: [ 1281.911517] reading key "vm.nr_hugepages_mempolicy" [ 1281.913929] sysctl: [ 1281.913931] reading key "vm.nr_overcommit_hugepages" [ 1281.916390] nr_pdflush_threads exported in /proc is scheduled for removal [ 1281.917550] kernel.sysrq = 1 [ 1281.918700] + sysctl -w kernel.sysrq=1 [ 1281.921879] kernel.sysrq = 1 [ 1281.923711] + sysctl -a [ 1281.923908] + grep -i sysrq [ 1281.934561] sysctl: [ 1281.934563] reading key "vm.nr_hugepages" [ 1281.937068] sysctl: [ 1281.937070] reading key "vm.nr_hugepages_mempolicy" [ 1281.939672] sysctl: [ 1281.939674] reading key "vm.nr_overcommit_hugepages" [ 1281.942511] kernel.sysrq = 1 [ 1281.943659] + echo d [ 1281.944538] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 1281.945509] + echo h [ 1281.946469] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 1281.947542] + echo m [ 1281.948602] sysrq: SysRq : Show Memory [ 1281.949650] Mem-Info: [ 1281.950676] active_anon:14530 inactive_anon:8455 isolated_anon:0 active_file:35769 inactive_file:60098 isolated_file:0 unevictable:2219 dirty:1 writeback:0 unstable:0 slab_reclaimable:8329 slab_unreclaimable:7625 mapped:2289 shmem:22820 pagetables:82 bounce:0 free:845751 free_pcp:1858 free_cma:0 [ 1281.956917] Node 0 active_anon:58120kB inactive_anon:33820kB active_file:143076kB inactive_file:240392kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9156kB dirty:4kB writeback:0kB shmem:91280kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 1281.958059] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 1281.959231] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 1281.960413] Node 0 DMA32 free:2569016kB min:5192kB low:7780kB high:10368kB active_anon:16kB inactive_anon:0kB active_file:3884kB inactive_file:33220kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:112kB pagetables:0kB bounce:0kB free_pcp:4032kB local_pcp:704kB free_cma:0kB [ 1281.961656] lowmem_reserve[]: 0 0 1337 1337 1337 [ 1281.962895] Node 0 Normal free:798084kB min:2744kB low:4112kB high:5480kB active_anon:58104kB inactive_anon:33820kB active_file:139192kB inactive_file:207172kB unevictable:8876kB writepending:4kB present:1437436kB managed:1369340kB mlocked:8876kB kernel_stack:2192kB pagetables:328kB bounce:0kB free_pcp:3400kB local_pcp:132kB free_cma:0kB [ 1281.964203] lowmem_reserve[]: 0 0 0 0 0 [ 1281.965520] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 1281.966862] Node 0 DMA32: 2150*4kB (UME) 1488*8kB (UME) 952*16kB (UME) 501*32kB (UME) 296*64kB (UME) 184*128kB (UME) 129*256kB (UME) 67*512kB (UME) 31*1024kB (UME) 20*2048kB (UME) 570*4096kB (M) = 2569016kB [ 1281.968234] Node 0 Normal: 6077*4kB (UME) 3128*8kB (UME) 2059*16kB (UME) 2467*32kB (UME) 1551*64kB (UME) 744*128kB (UME) 350*256kB (UME) 123*512kB (UME) 63*1024kB (UME) 34*2048kB (UME) 38*4096kB (UME) = 798084kB [ 1281.969619] 120642 total pagecache pages [ 1281.970994] 0 pages in swap cache [ 1281.972368] Swap cache stats: add 0, delete 0, find 0/0 [ 1281.973746] Free swap = 0kB [ 1281.975112] Total swap = 0kB [ 1281.976477] 1048575 pages RAM [ 1281.977846] 0 pages HighMem/MovableOnly [ 1281.979213] 47804 pages reserved [ 1281.980574] 0 pages cma reserved [ 1281.981920] 0 pages hwpoisoned [ 1281.983292] + echo w [ 1281.984664] sysrq: SysRq : Show Blocked State [ 1281.985987] task PC stack pid father [ 1281.987337] + echo 9 [ 1281.988708] sysrq: SysRq : Changing Loglevel [ 1281.990018] sysrq: Loglevel set to 9 [ 1281.991344] + echo -n Before: [ 1281.992656] Before: [ 1281.992661] + cat /sys/block/sda/device/queue_depth [ 1281.996416] 31 [ 1281.997975] + echo -n After: [ 1281.999300] After: [ 1281.999306] + cat /sys/block/sda/device/queue_depth [ 1282.003008] 31 [ 1282.004522] + hdparm -W /dev/sda [ 1282.010411] /dev/sda: write-caching = 1 (on) [ 1282.014656] + hdparm -C /dev/sda [ 1282.017238] /dev/sda: drive state is: active/idle [ 1282.021371] + hdparm -W /dev/sdb [ 1282.023762] /dev/sdb: No such file or directory [ 1282.025269] + hdparm -C /dev/sdb [ 1282.027649] /dev/sdb: No such file or directory [ 1282.029137] + echo 'sync first' [ 1282.030466] sync first [ 1282.031806] + sync [ 1282.037084] real 0m0.005s user 0m0.000s [ 1282.041649] sys 0m0.003s [ 1282.043233] + echo Before: [ 1282.044800] Before: [ 1282.046359] + echo m [ 1282.047931] sysrq: SysRq : Show Memory [ 1282.049471] Mem-Info: [ 1282.050999] active_anon:14521 inactive_anon:8455 isolated_anon:0 active_file:35838 inactive_file:60095 isolated_file:0 unevictable:2219 dirty:0 writeback:0 unstable:0 slab_reclaimable:8329 slab_unreclaimable:7624 mapped:2289 shmem:22820 pagetables:82 bounce:0 free:845749 free_pcp:1798 free_cma:0 [ 1282.059783] Node 0 active_anon:58084kB inactive_anon:33820kB active_file:143352kB inactive_file:240380kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9156kB dirty:0kB writeback:0kB shmem:91280kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 1282.061124] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 1282.062480] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 1282.063845] Node 0 DMA32 free:2569016kB min:5192kB low:7780kB high:10368kB active_anon:16kB inactive_anon:0kB active_file:3884kB inactive_file:33220kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:112kB pagetables:0kB bounce:0kB free_pcp:4032kB local_pcp:704kB free_cma:0kB [ 1282.065270] lowmem_reserve[]: 0 0 1337 1337 1337 [ 1282.066695] Node 0 Normal free:798076kB min:2744kB low:4112kB high:5480kB active_anon:58068kB inactive_anon:33820kB active_file:139468kB inactive_file:207160kB unevictable:8876kB writepending:0kB present:1437436kB managed:1369340kB mlocked:8876kB kernel_stack:2192kB pagetables:328kB bounce:0kB free_pcp:3160kB local_pcp:100kB free_cma:0kB [ 1282.068199] lowmem_reserve[]: 0 0 0 0 0 [ 1282.069684] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 1282.071204] Node 0 DMA32: 2150*4kB (UME) 1488*8kB (UME) 952*16kB (UME) 501*32kB (UME) 296*64kB (UME) 184*128kB (UME) 129*256kB (UME) 67*512kB (UME) 31*1024kB (UME) 20*2048kB (UME) 570*4096kB (M) = 2569016kB [ 1282.072773] Node 0 Normal: 5971*4kB (UME) 3130*8kB (UME) 2058*16kB (UME) 2470*32kB (UME) 1554*64kB (UME) 745*128kB (UME) 350*256kB (UME) 123*512kB (UME) 63*1024kB (UME) 34*2048kB (UME) 38*4096kB (UME) = 798076kB [ 1282.074337] 120708 total pagecache pages [ 1282.075910] 0 pages in swap cache [ 1282.077483] Swap cache stats: add 0, delete 0, find 0/0 [ 1282.079051] Free swap = 0kB [ 1282.080613] Total swap = 0kB [ 1282.082170] 1048575 pages RAM [ 1282.083730] 0 pages HighMem/MovableOnly [ 1282.085323] 47804 pages reserved [ 1282.086887] 0 pages cma reserved [ 1282.088480] 0 pages hwpoisoned [ 1282.090083] + echo 'manually Freeing pagecache pages' [ 1282.091688] manually Freeing pagecache pages [ 1282.093307] + echo --------------------------------------------------- [ 1282.094913] --------------------------------------------------- [ 1282.096526] + echo 3 [ 1282.131732] debug.sh (9051): drop_caches: 3 [ 1282.133361] real 0m0.037s user 0m0.000s [ 1282.138564] sys 0m0.036s [ 1282.140173] + echo --------------------------------------------------- [ 1282.142696] --------------------------------------------------- [ 1282.144319] + echo 'After :' [ 1282.145933] After : [ 1282.147541] + echo m [ 1282.149246] sysrq: SysRq : Show Memory [ 1282.150837] Mem-Info: [ 1282.152426] active_anon:202 inactive_anon:22811 isolated_anon:0 active_file:318 inactive_file:155 isolated_file:0 unevictable:2219 dirty:0 writeback:0 unstable:0 slab_reclaimable:4956 slab_unreclaimable:7315 mapped:2289 shmem:22820 pagetables:82 bounce:0 free:945563 free_pcp:1919 free_cma:0 [ 1282.161969] Node 0 active_anon:808kB inactive_anon:91244kB active_file:1272kB inactive_file:620kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9156kB dirty:0kB writeback:0kB shmem:91280kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 1282.163635] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 1282.165323] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 1282.167017] Node 0 DMA32 free:2609788kB min:5192kB low:7780kB high:10368kB active_anon:16kB inactive_anon:0kB active_file:36kB inactive_file:68kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:112kB pagetables:0kB bounce:0kB free_pcp:3972kB local_pcp:644kB free_cma:0kB [ 1282.168777] lowmem_reserve[]: 0 0 1337 1337 1337 [ 1282.170539] Node 0 Normal free:1156560kB min:2744kB low:4112kB high:5480kB active_anon:780kB inactive_anon:91232kB active_file:1208kB inactive_file:700kB unevictable:8876kB writepending:0kB present:1437436kB managed:1369340kB mlocked:8876kB kernel_stack:2192kB pagetables:328kB bounce:0kB free_pcp:3704kB local_pcp:644kB free_cma:0kB [ 1282.172387] lowmem_reserve[]: 0 0 0 0 0 [ 1282.174234] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 1282.176125] Node 0 DMA32: 889*4kB (UME) 764*8kB (UME) 641*16kB (UME) 446*32kB (UME) 283*64kB (UME) 155*128kB (UME) 95*256kB (UME) 57*512kB (UME) 34*1024kB (UME) 22*2048kB (UME) 587*4096kB (M) = 2609876kB [ 1282.178042] Node 0 Normal: 6338*4kB (UME) 4993*8kB (UME) 3947*16kB (UME) 3450*32kB (UME) 2283*64kB (UME) 1237*128kB (UME) 586*256kB (UME) 233*512kB (UME) 92*1024kB (UME) 40*2048kB (UME) 41*4096kB (UME) = 1156672kB [ 1282.179960] 25248 total pagecache pages [ 1282.181891] 0 pages in swap cache [ 1282.183815] Swap cache stats: add 0, delete 0, find 0/0 [ 1282.185656] Free swap = 0kB [ 1282.187492] Total swap = 0kB [ 1282.189371] 1048575 pages RAM [ 1282.191140] 0 pages HighMem/MovableOnly [ 1282.192895] 47804 pages reserved [ 1282.194596] 0 pages cma reserved [ 1282.196301] 0 pages hwpoisoned [ 1282.198018] + echo 'end of log' [ 1282.199728] end of log [ 1282.201463] + logfile=/dmesg_shutdown.log [ 1282.204635] ++ TMPDIR= [ 1282.204871] ++ /usr/bin/cut -f2 -d/ [ 1282.208402] ++ /usr/bin/mktemp --dry-run '--tmpdir='\''' -t --quiet XXXXXXXXXXXXXX [ 1282.220459] + rnd_log_tag=4kwOyNp0pdBTgi [ 1282.222698] + echo '//--- /usr/lib/systemd/system-shutdown/debug.sh started execution on: '\''Sun Sep 2 19:04:26 CEST 2018'\'' tag:4kwOyNp0pdBTgi' [ 1282.224863] + dmesg //--- /usr/lib/systemd/system-shutdown/debug.sh generated '/dmesg_shutdown.log' on: 'Sun Sep 2 19:04:26 CEST 2018' tag:4kwOyNp0pdBTgi ```

With systemd.log_target=kmsg in /proc/cmdline (via /boot/efi/EFI/qubes/xen.cfg) I notice that on the first console (Alt+F1) it says that systemd is waiting for 8 jobs to finish and I believe that none finish and the above journalctl -b -1 shows that they timed out and they were killed.

Sep 02 19:04:09 dom0 systemd[1]: session-2.scope: Stopping timed out. Killing. Sep 02 19:04:09 dom0 systemd[1]: session-2.scope: Killing process 3570 (qubes-guid) with signal SIGKILL.

That's interesting, what happens if you manually kill all qubes-guid processes, then initiate shutdown/reboot?

For comparison(with the above), please allow me to post the partial logs from when the reboot does not stall(for 2min) but rather, finishes in what seems to be like 6 seconds (I already ran a qvm-shutdown --all --wait which took 13 sec before the Start->Logout->Restart):

from `journalctl -b -1`'s point of view

``` Sep 02 19:55:29 dom0 systemd-logind[1869]: System is rebooting. Sep 02 19:55:29 dom0 systemd[1]: Removed slice system-getty.slice. Sep 02 19:55:29 dom0 systemd[1]: Stopping Accounts Service... Sep 02 19:55:29 dom0 systemd[1]: Stopping Session 2 of user ctor. Sep 02 19:55:29 dom0 systemd[1]: Stopped target Timers. Sep 02 19:55:29 dom0 systemd[1]: Stopped Discard unused blocks once a week. Sep 02 19:55:29 dom0 systemd[1]: Stopping RealtimeKit Scheduling Policy Service... Sep 02 19:55:29 dom0 systemd[1]: Stopped target Graphical Interface. Sep 02 19:55:29 dom0 systemd[1]: Stopped target Multi-User System. Sep 02 19:55:29 dom0 systemd[1]: Stopping Command Scheduler... Sep 02 19:55:29 dom0 systemd[1]: Stopped target Login Prompts. Sep 02 19:55:29 dom0 systemd[1]: Stopping Light Display Manager... Sep 02 19:55:29 dom0 systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). Sep 02 19:55:29 dom0 systemd[1]: Stopping User Manager for UID 1000... Sep 02 19:55:29 dom0 lightdm[3215]: Error opening audit socket: Protocol not supported Sep 02 19:55:29 dom0 crond[3217]: (CRON) INFO (Shutting down) Sep 02 19:55:29 dom0 kernel: traps: xss-lock[3403] trap int3 ip:7970dc248a31 sp:7ffd16e309e0 error:0 in libglib-2.0.so.0.5000.3[7970dc1f9000+110000] Sep 02 19:55:29 dom0 systemd[1]: Stopping Restore /run/initramfs on shutdown... Sep 02 19:55:29 dom0 systemd[1]: Stopping Serial Getty on hvc0... Sep 02 19:55:29 dom0 systemd[1]: Stopped Daily Cleanup of Temporary Directories. Sep 02 19:55:29 dom0 systemd[1]: Stopping Daemon for power management... Sep 02 19:55:29 dom0 systemd[1]: Stopped target Sound Card. Sep 02 19:55:29 dom0 systemd[1]: Stopping Manage Sound Card State (restore and store)... Sep 02 19:55:29 dom0 alsactl[1872]: alsactl daemon stopped Sep 02 19:55:29 dom0 systemd[1]: Stopping Authorization Manager... Sep 02 19:55:29 dom0 systemd[1]: Stopped Daemon for power management. Sep 02 19:55:29 dom0 systemd[1]: Stopped Command Scheduler. Sep 02 19:55:29 dom0 systemd[1]: Stopped Accounts Service. Sep 02 19:55:29 dom0 systemd[1]: Stopped Authorization Manager. Sep 02 19:55:29 dom0 systemd[1]: Stopped Serial Getty on hvc0. Sep 02 19:55:29 dom0 systemd[1]: Stopped RealtimeKit Scheduling Policy Service. Sep 02 19:55:29 dom0 systemd[1]: Stopped Manage Sound Card State (restore and store). Sep 02 19:55:29 dom0 systemd[1]: Requested transaction contradicts existing jobs: Transaction is destructive. Sep 02 19:55:29 dom0 systemd[1]: systemd-coredump.socket: Failed to queue service startup job (Maybe the service file is missing or not a non-template unit?): Transaction is destructive. Sep 02 19:55:29 dom0 systemd[1]: systemd-coredump.socket: Unit entered failed state. Sep 02 19:55:29 dom0 systemd[1]: Removed slice system-serial\x2dgetty.slice. Sep 02 19:55:29 dom0 lightdm[3301]: pam_unix(lightdm:session): session closed for user ctor Sep 02 19:55:29 dom0 qmemman.daemon.algo[1876]: balance_when_enough_memory(xen_free_memory=42202477, total_mem_pref=1298929254.4, total_available_memory=32178125906.6) Sep 02 19:55:29 dom0 systemd[3316]: Received SIGRTMIN+24 from PID 9507 (kill). Sep 02 19:55:29 dom0 systemd[3324]: pam_unix(systemd-user:session): session closed for user ctor Sep 02 19:55:30 dom0 qmemman.daemon.algo[1876]: balance_when_enough_memory(xen_free_memory=42202477, total_mem_pref=1229770752.0, total_available_memory=32247284409.0) Sep 02 19:55:30 dom0 systemd[1]: Stopped User Manager for UID 1000. Sep 02 19:55:30 dom0 systemd[1]: Stopped Session 2 of user ctor. Sep 02 19:55:30 dom0 systemd[1]: Removed slice User Slice of ctor. Sep 02 19:55:30 dom0 systemd[1]: Stopping Login Service... Sep 02 19:55:30 dom0 systemd[1]: Stopped Light Display Manager. Sep 02 19:55:30 dom0 systemd[1]: Starting Show Plymouth Reboot Screen... Sep 02 19:55:30 dom0 systemd[1]: Stopping Permit User Sessions... Sep 02 19:55:30 dom0 systemd[1]: Stopped Permit User Sessions. Sep 02 19:55:30 dom0 systemd[1]: Stopped Start Qubes VM sys-net. Sep 02 19:55:30 dom0 systemd[1]: Stopped Start Qubes VM sys-firewall. Sep 02 19:55:30 dom0 systemd[1]: Removed slice system-qubes\x2dvm.slice. Sep 02 19:55:30 dom0 systemd[1]: Stopping Qubes memory information reporter... Sep 02 19:55:30 dom0 systemd[1]: Stopped Qubes memory information reporter. Sep 02 19:55:30 dom0 systemd[1]: Stopping Qubes Dom0 startup setup... Sep 02 19:55:30 dom0 systemd[1]: Started Show Plymouth Reboot Screen. Sep 02 19:55:30 dom0 systemd[1]: Stopped Login Service. Sep 02 19:55:30 dom0 systemd[1]: Stopped target User and Group Name Lookups. Sep 02 19:55:30 dom0 qvm-shutdown[9522]: 2018-09-02 19:55:30,147 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector Sep 02 19:55:30 dom0 qubesdb-daemon[1878]: terminating Sep 02 19:55:30 dom0 systemd[1]: Stopped Qubes DB agent. Sep 02 19:55:30 dom0 systemd[1]: Stopped Qubes Dom0 startup setup. Sep 02 19:55:30 dom0 systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... Sep 02 19:55:30 dom0 systemd[1]: Stopping Qubes memory management daemon... Sep 02 19:55:30 dom0 systemd[1]: Stopping Virtualization daemon... Sep 02 19:55:30 dom0 systemd[1]: Stopping Qubes OS daemon... Sep 02 19:55:30 dom0 qubesd[1868]: caught SIGTERM, exiting Sep 02 19:55:30 dom0 systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. Sep 02 19:55:30 dom0 systemd[1]: Stopped Qubes memory management daemon. Sep 02 19:55:30 dom0 libvirtd[1893]: S3 disabled Sep 02 19:55:30 dom0 libvirtd[1893]: S4 disabled Sep 02 19:55:30 dom0 libvirtd[1893]: S3 disabled Sep 02 19:55:30 dom0 libvirtd[1893]: S4 disabled Sep 02 19:55:30 dom0 libvirtd[1893]: S3 disabled Sep 02 19:55:30 dom0 libvirtd[1893]: S4 disabled Sep 02 19:55:30 dom0 systemd[1]: Stopped Virtualization daemon. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Remote File Systems. Sep 02 19:55:30 dom0 systemd[1]: Stopping The Xen xenstore... Sep 02 19:55:30 dom0 systemd[1]: Stopping D-Bus System Message Bus... Sep 02 19:55:30 dom0 systemd[1]: Stopped The Xen xenstore. Sep 02 19:55:30 dom0 systemd[1]: Unmounting mount xenstore file system... Sep 02 19:55:30 dom0 systemd[1]: Stopped D-Bus System Message Bus. Sep 02 19:55:30 dom0 systemd[1]: Unmounted mount xenstore file system. Sep 02 19:55:30 dom0 systemd[1]: Stopped Qubes OS daemon. Sep 02 19:55:30 dom0 systemd[1]: Stopping LVM2 PV scan on device 253:0... Sep 02 19:55:30 dom0 systemd[1]: Stopped target Basic System. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Slices. Sep 02 19:55:30 dom0 systemd[1]: Removed slice User and Session Slice. Sep 02 19:55:30 dom0 systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Sockets. Sep 02 19:55:30 dom0 systemd[1]: Closed Virtual machine log manager socket. Sep 02 19:55:30 dom0 systemd[1]: Closed Virtual machine lock manager socket. Sep 02 19:55:30 dom0 systemd[1]: Closed D-Bus System Message Bus Socket. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Paths. Sep 02 19:55:30 dom0 systemd[1]: Stopped target System Initialization. Sep 02 19:55:30 dom0 systemd[1]: Stopped Setup Virtual Console. Sep 02 19:55:30 dom0 systemd[1]: Stopping Load/Save Random Seed... Sep 02 19:55:30 dom0 systemd[1]: Stopping Update UTMP about System Boot/Shutdown... Sep 02 19:55:30 dom0 systemd[1]: Stopped Apply Kernel Variables. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Encrypted Volumes. Sep 02 19:55:30 dom0 systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. Sep 02 19:55:30 dom0 systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... Sep 02 19:55:30 dom0 systemd[1]: Stopped Load legacy module configuration. Sep 02 19:55:30 dom0 systemd[1]: Stopped Load/Save Random Seed. Sep 02 19:55:30 dom0 systemd[1]: Stopped Update UTMP about System Boot/Shutdown. Sep 02 19:55:30 dom0 systemd[1]: Stopped Create Volatile Files and Directories. Sep 02 19:55:30 dom0 systemd[1]: Stopped LVM2 PV scan on device 253:0. Sep 02 19:55:30 dom0 systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. Sep 02 19:55:30 dom0 systemd[1]: Stopped Restore /run/initramfs on shutdown. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Local File Systems. Sep 02 19:55:30 dom0 systemd[1]: Stopped Configure read-only root support. Sep 02 19:55:30 dom0 systemd[1]: Unmounting Temporary Directory... Sep 02 19:55:30 dom0 systemd[1]: Unmounting /run/user/1000... Sep 02 19:55:30 dom0 systemd[1]: Unmounting Configuration File System... Sep 02 19:55:30 dom0 systemd[1]: Unmounting /boot/efi... Sep 02 19:55:30 dom0 systemd[1]: Unmounted /run/user/1000. Sep 02 19:55:30 dom0 systemd[1]: Unmounted Configuration File System. Sep 02 19:55:30 dom0 systemd[1]: Stopped Load Kernel Modules. Sep 02 19:55:30 dom0 systemd[1]: Unmounted Temporary Directory. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Swap. Sep 02 19:55:30 dom0 systemd[1]: Unmounted /boot/efi. Sep 02 19:55:30 dom0 systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. Sep 02 19:55:30 dom0 systemd[1]: Removed slice system-systemd\x2dfsck.slice. Sep 02 19:55:30 dom0 systemd[1]: Stopped target Local File Systems (Pre). Sep 02 19:55:30 dom0 systemd[1]: Stopped Create Static Device Nodes in /dev. Sep 02 19:55:30 dom0 systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Sep 02 19:55:30 dom0 systemd[1]: Stopped Remount Root and Kernel File Systems. Sep 02 19:55:30 dom0 dmeventd[758]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 19:55:30 dom0 lvm[9566]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored Sep 02 19:55:30 dom0 lvmetad[757]: Failed to accept connection errno 11. Sep 02 19:55:30 dom0 systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Sep 02 19:55:30 dom0 systemd[1]: Stopping LVM2 metadata daemon... Sep 02 19:55:30 dom0 systemd[1]: Stopped LVM2 metadata daemon. Sep 02 19:55:32 dom0 kernel: usb 5-1: USB disconnect, device number 2 Sep 02 19:55:32 dom0 systemd-udevd[9575]: Process '/usr/lib/qubes/udev-usb-remove' failed with exit code 1. Sep 02 19:55:32 dom0 systemd-udevd[9575]: Process '/usr/lib/qubes/udev-usb-remove' failed with exit code 1. Sep 02 19:55:32 dom0 kernel: usb 5-1: new low-speed USB device number 4 using xhci_hcd Sep 02 19:55:32 dom0 kernel: usb 5-1: New USB device found, idVendor=1c4f, idProduct=0034 Sep 02 19:55:32 dom0 kernel: usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 Sep 02 19:55:32 dom0 kernel: usb 5-1: Product: Usb Mouse Sep 02 19:55:32 dom0 kernel: usb 5-1: Manufacturer: SIGMACHIP Sep 02 19:55:32 dom0 kernel: input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:1c.7/0000:04:00.0/usb5/5-1/5-1:1.0/0003:1C4F:0034.0006/input/input19 Sep 02 19:55:32 dom0 kernel: hid-generic 0003:1C4F:0034.0006: input,hidraw1: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:04:00.0-1/input0 Sep 02 19:55:35 dom0 systemd-cryptsetup[9548]: Failed to deactivate: Device or resource busy Sep 02 19:55:35 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 Sep 02 19:55:35 dom0 systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. Sep 02 19:55:35 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. Sep 02 19:55:35 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. Sep 02 19:55:35 dom0 systemd[1]: Reached target Unmount All Filesystems. Sep 02 19:55:35 dom0 systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. Sep 02 19:55:35 dom0 systemd[1]: Reached target Shutdown. Sep 02 19:55:35 dom0 systemd[1]: Reached target Final Step. Sep 02 19:55:35 dom0 systemd[1]: Starting Reboot... Sep 02 19:55:35 dom0 systemd[1]: Shutting down. Sep 02 19:55:35 dom0 systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 Sep 02 19:55:35 dom0 systemd[1]: Set hardware watchdog to 10min. Sep 02 19:55:35 dom0 kernel: watchdog: watchdog0: watchdog did not stop! Sep 02 19:55:35 dom0 systemd-shutdown[1]: Sending SIGTERM to remaining processes... Sep 02 19:55:35 dom0 dmeventd[758]: dmeventd detected break while being idle for 5 second(s), exiting. Sep 02 19:55:35 dom0 dmeventd[758]: dmeventd shutting down. Sep 02 19:55:35 dom0 systemd-journald[756]: Journal stopped ```

from dmesg's point of view

``` [ 2468.846999] systemd[6617]: Reached target Sockets. [ 2468.847014] systemd[6617]: Reached target Basic System. [ 2468.847029] systemd[6617]: Reached target Default. [ 2468.847047] systemd[6617]: Startup finished in 21ms. [ 2468.847114] systemd[1]: Started User Manager for UID 0. [ 2626.152821] systemd-logind[1869]: Removed session 3. [ 2626.154364] systemd[1]: Stopping User Manager for UID 0... [ 2626.154640] systemd[6617]: Stopped target Default. [ 2626.154648] systemd[6617]: Stopped target Basic System. [ 2626.154654] systemd[6617]: Stopped target Timers. [ 2626.154659] systemd[6617]: Stopped target Sockets. [ 2626.154832] systemd[6617]: Closed D-Bus User Message Bus Socket. [ 2626.154840] systemd[6617]: Stopped target Paths. [ 2626.154847] systemd[6617]: Reached target Shutdown. [ 2626.156010] systemd[6617]: Starting Exit the Session... [ 2626.157866] systemd[6617]: Received SIGRTMIN+24 from PID 6770 (kill). [ 2626.160017] systemd[1]: Stopped User Manager for UID 0. [ 2626.161885] systemd[1]: Removed slice User Slice of root. [ 2719.095143] xen-blkback: backend/vbd/5/51712: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 2719.126335] xen-blkback: backend/vbd/5/51728: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 2719.161789] xen-blkback: backend/vbd/5/51744: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 2719.172389] xen-blkback: backend/vbd/5/51760: using 2 queues, protocol 1 (x86_64-abi) persistent grants [ 2998.346752] systemd-logind[1869]: System is rebooting. [ 2998.350652] systemd[1]: Removed slice system-getty.slice. [ 2998.350790] systemd[1]: Stopping Accounts Service... [ 2998.355084] systemd[1]: Stopping Session 2 of user ctor. [ 2998.355100] systemd[1]: Stopped target Timers. [ 2998.355150] systemd[1]: Stopped Discard unused blocks once a week. [ 2998.355338] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 2998.355350] systemd[1]: Stopped target Graphical Interface. [ 2998.355378] systemd[1]: Stopped target Multi-User System. [ 2998.355541] systemd[1]: Stopping Command Scheduler... [ 2998.355548] systemd[1]: Stopped target Login Prompts. [ 2998.355823] systemd[1]: Stopping Light Display Manager... [ 2998.356098] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 2998.356760] systemd[1]: Stopping User Manager for UID 1000... [ 2998.364697] traps: xss-lock[3403] trap int3 ip:7970dc248a31 sp:7ffd16e309e0 error:0 in libglib-2.0.so.0.5000.3[7970dc1f9000+110000] [ 2998.365011] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 2998.365470] systemd[1]: Stopping Serial Getty on hvc0... [ 2998.365494] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 2998.366149] systemd[1]: Stopping Daemon for power management... [ 2998.366192] systemd[1]: Stopped target Sound Card. [ 2998.368456] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 2998.374358] systemd[1]: Stopping Authorization Manager... [ 2998.376503] systemd[1]: Stopped Daemon for power management. [ 2998.376846] systemd[1]: Stopped Command Scheduler. [ 2998.377107] systemd[1]: Stopped Accounts Service. [ 2998.379710] systemd[1]: Stopped Authorization Manager. [ 2998.381108] systemd[1]: Stopped Serial Getty on hvc0. [ 2998.381754] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 2998.384587] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 2998.390016] systemd[1]: Requested transaction contradicts existing jobs: Transaction is destructive. [ 2998.390045] systemd[1]: systemd-coredump.socket: Failed to queue service startup job (Maybe the service file is missing or not a non-template unit?): Transaction is destructive. [ 2998.390095] systemd[1]: systemd-coredump.socket: Unit entered failed state. [ 2998.390745] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 2998.478381] systemd[1]: Stopped User Manager for UID 1000. [ 2998.508423] systemd[1]: Stopped Session 2 of user ctor. [ 2998.509164] systemd[1]: Removed slice User Slice of ctor. [ 2998.509289] systemd[1]: Stopping Login Service... [ 2998.566367] systemd[1]: Stopped Light Display Manager. [ 2998.567953] systemd[1]: Starting Show Plymouth Reboot Screen... [ 2998.569265] systemd[1]: Stopping Permit User Sessions... [ 2998.573928] systemd[1]: Stopped Permit User Sessions. [ 2998.574127] systemd[1]: Stopped Start Qubes VM sys-net. [ 2998.574169] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 2998.574330] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 2998.574480] systemd[1]: Stopping Qubes memory information reporter... [ 2998.574975] systemd[1]: Stopped Qubes memory information reporter. [ 2998.576306] systemd[1]: Stopping Qubes Dom0 startup setup... [ 2998.590637] systemd[1]: Started Show Plymouth Reboot Screen. [ 2998.608625] systemd[1]: Stopped Login Service. [ 2998.609162] systemd[1]: Stopped target User and Group Name Lookups. [ 2998.692117] systemd[1]: Stopped Qubes DB agent. [ 2998.692534] systemd[1]: Stopped Qubes Dom0 startup setup. [ 2998.692769] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 2998.692879] systemd[1]: Stopping Qubes memory management daemon... [ 2998.692969] systemd[1]: Stopping Virtualization daemon... [ 2998.693079] systemd[1]: Stopping Qubes OS daemon... [ 2998.694533] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 2998.695616] systemd[1]: Stopped Qubes memory management daemon. [ 2998.703897] systemd[1]: Stopped Virtualization daemon. [ 2998.703999] systemd[1]: Stopped target Remote File Systems. [ 2998.704124] systemd[1]: Stopping The Xen xenstore... [ 2998.704284] systemd[1]: Stopping D-Bus System Message Bus... [ 2998.704934] systemd[1]: Stopped The Xen xenstore. [ 2998.706117] systemd[1]: Unmounting mount xenstore file system... [ 2998.708656] systemd[1]: Stopped D-Bus System Message Bus. [ 2998.716792] systemd[1]: Unmounted mount xenstore file system. [ 2998.737690] systemd[1]: Stopped Qubes OS daemon. [ 2998.739193] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 2998.739260] systemd[1]: Stopped target Basic System. [ 2998.739346] systemd[1]: Stopped target Slices. [ 2998.739833] systemd[1]: Removed slice User and Session Slice. [ 2998.739902] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 2998.739939] systemd[1]: Stopped target Sockets. [ 2998.740015] systemd[1]: Closed Virtual machine log manager socket. [ 2998.740062] systemd[1]: Closed Virtual machine lock manager socket. [ 2998.740112] systemd[1]: Closed D-Bus System Message Bus Socket. [ 2998.740136] systemd[1]: Stopped target Paths. [ 2998.740162] systemd[1]: Stopped target System Initialization. [ 2998.740581] systemd[1]: Stopped Setup Virtual Console. [ 2998.741787] systemd[1]: Stopping Load/Save Random Seed... [ 2998.743224] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 2998.743722] systemd[1]: Stopped Apply Kernel Variables. [ 2998.743798] systemd[1]: Stopped target Encrypted Volumes. [ 2998.748913] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 2998.750333] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 2998.750788] systemd[1]: Stopped Load legacy module configuration. [ 2998.751936] systemd[1]: Stopped Load/Save Random Seed. [ 2998.755681] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 2998.757274] systemd[1]: Stopped Create Volatile Files and Directories. [ 2998.763422] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 2998.763592] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 2998.844996] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 2998.845117] systemd[1]: Stopped target Local File Systems. [ 2998.845426] systemd[1]: Stopped Configure read-only root support. [ 2998.846574] systemd[1]: Unmounting Temporary Directory... [ 2998.847720] systemd[1]: Unmounting /run/user/1000... [ 2998.848940] systemd[1]: Unmounting Configuration File System... [ 2998.850122] systemd[1]: Unmounting /boot/efi... [ 2998.856800] systemd[1]: Unmounted /run/user/1000. [ 2998.857134] systemd[1]: Unmounted Configuration File System. [ 2998.857999] systemd[1]: Stopped Load Kernel Modules. [ 2998.858243] systemd[1]: Unmounted Temporary Directory. [ 2998.858338] systemd[1]: Stopped target Swap. [ 2998.867990] systemd[1]: Unmounted /boot/efi. [ 2998.868054] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 2998.868172] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 2998.868198] systemd[1]: Stopped target Local File Systems (Pre). [ 2998.868507] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 2998.869692] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 2998.870119] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 2998.904613] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 2998.904800] systemd[1]: Stopping LVM2 metadata daemon... [ 2998.905761] systemd[1]: Stopped LVM2 metadata daemon. [ 3000.572097] usb 5-1: USB disconnect, device number 2 [ 3000.601791] systemd-udevd[9575]: Process '/usr/lib/qubes/udev-usb-remove' failed with exit code 1. [ 3000.612378] systemd-udevd[9575]: Process '/usr/lib/qubes/udev-usb-remove' failed with exit code 1. [ 3000.811334] usb 5-1: new low-speed USB device number 4 using xhci_hcd [ 3000.965660] usb 5-1: New USB device found, idVendor=1c4f, idProduct=0034 [ 3000.965677] usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 3000.965699] usb 5-1: Product: Usb Mouse [ 3000.965709] usb 5-1: Manufacturer: SIGMACHIP [ 3000.975829] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:1c.7/0000:04:00.0/usb5/5-1/5-1:1.0/0003:1C4F:0034.0006/input/input19 [ 3000.976119] hid-generic 0003:1C4F:0034.0006: input,hidraw1: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:04:00.0-1/input0 [ 3003.564641] systemd-cryptsetup[9548]: Failed to deactivate: Device or resource busy [ 3003.565402] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 3003.565824] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 3003.565863] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 3003.565894] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 3003.566003] systemd[1]: Reached target Unmount All Filesystems. [ 3003.566155] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 3003.566195] systemd[1]: Reached target Shutdown. [ 3003.567591] systemd[1]: Reached target Final Step. [ 3003.570567] systemd[1]: Starting Reboot... [ 3003.575935] systemd[1]: Shutting down. [ 3003.594535] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 3003.595699] systemd[1]: Set hardware watchdog to 10min. [ 3003.597034] watchdog: watchdog0: watchdog did not stop! [ 3003.626722] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 3003.635056] systemd-journald[756]: Received SIGTERM from PID 1 (systemd-shutdow). [ 3003.665147] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 3003.670673] systemd-shutdown[1]: Process 9520 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 3003.672157] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 3003.673609] systemd-shutdown[1]: Unmounting file systems. [ 3003.674885] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 3003.687277] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 3003.691723] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 3003.692973] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 3003.694392] systemd-shutdown[1]: All filesystems unmounted. [ 3003.695806] systemd-shutdown[1]: Deactivating swaps. [ 3003.697240] systemd-shutdown[1]: All swaps deactivated. [ 3003.698624] systemd-shutdown[1]: Detaching loop devices. [ 3003.701557] systemd-shutdown[1]: All loop devices detached. [ 3003.702953] systemd-shutdown[1]: Detaching DM devices. [ 3003.709634] systemd-shutdown[1]: Detaching DM 253:9. [ 3003.721492] systemd-shutdown[1]: Detaching DM 253:8. [ 3003.734497] systemd-shutdown[1]: Detaching DM 253:7. [ 3003.746382] systemd-shutdown[1]: Detaching DM 253:6. [ 3003.761479] systemd-shutdown[1]: Detaching DM 253:58. [ 3003.778438] systemd-shutdown[1]: Detaching DM 253:55. [ 3003.793499] systemd-shutdown[1]: Detaching DM 253:52. [ 3003.806468] systemd-shutdown[1]: Detaching DM 253:5. [ 3003.819357] systemd-shutdown[1]: Detaching DM 253:49. [ 3003.834507] systemd-shutdown[1]: Detaching DM 253:46. [ 3003.848464] systemd-shutdown[1]: Detaching DM 253:45. [ 3003.864493] systemd-shutdown[1]: Detaching DM 253:44. [ 3003.884522] systemd-shutdown[1]: Detaching DM 253:43. [ 3003.897493] systemd-shutdown[1]: Detaching DM 253:42. [ 3003.908466] systemd-shutdown[1]: Detaching DM 253:41. [ 3003.924526] systemd-shutdown[1]: Detaching DM 253:38. [ 3003.937444] systemd-shutdown[1]: Detaching DM 253:37. [ 3003.948492] systemd-shutdown[1]: Detaching DM 253:36. [ 3003.959411] systemd-shutdown[1]: Detaching DM 253:35. [ 3003.976506] systemd-shutdown[1]: Detaching DM 253:34. [ 3003.991489] systemd-shutdown[1]: Detaching DM 253:33. [ 3004.003501] systemd-shutdown[1]: Detaching DM 253:31. [ 3004.020505] systemd-shutdown[1]: Detaching DM 253:30. [ 3004.037496] systemd-shutdown[1]: Detaching DM 253:3. [ 3004.038704] dev_remove: 15 callbacks suppressed [ 3004.038717] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 3004.041115] systemd-shutdown[1]: Detaching DM 253:29. [ 3004.057496] systemd-shutdown[1]: Detaching DM 253:28. [ 3004.070508] systemd-shutdown[1]: Detaching DM 253:27. [ 3004.081490] systemd-shutdown[1]: Detaching DM 253:26. [ 3004.094467] systemd-shutdown[1]: Detaching DM 253:25. [ 3004.111500] systemd-shutdown[1]: Detaching DM 253:24. [ 3004.123488] systemd-shutdown[1]: Detaching DM 253:22. [ 3004.134471] systemd-shutdown[1]: Detaching DM 253:21. [ 3004.150471] systemd-shutdown[1]: Detaching DM 253:20. [ 3004.166483] systemd-shutdown[1]: Detaching DM 253:2. [ 3004.167660] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 3004.168824] systemd-shutdown[1]: Detaching DM 253:19. [ 3004.186507] systemd-shutdown[1]: Detaching DM 253:18. [ 3004.202414] systemd-shutdown[1]: Detaching DM 253:17. [ 3004.218502] systemd-shutdown[1]: Detaching DM 253:16. [ 3004.231465] systemd-shutdown[1]: Detaching DM 253:15. [ 3004.247482] systemd-shutdown[1]: Detaching DM 253:14. [ 3004.263465] systemd-shutdown[1]: Detaching DM 253:13. [ 3004.279506] systemd-shutdown[1]: Detaching DM 253:12. [ 3004.291460] systemd-shutdown[1]: Detaching DM 253:11. [ 3004.306472] systemd-shutdown[1]: Detaching DM 253:10. [ 3004.319509] systemd-shutdown[1]: Detaching DM 253:1. [ 3004.320645] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 3004.321768] systemd-shutdown[1]: Detaching DM 253:0. [ 3004.322894] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 3004.324013] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 3004.325278] systemd-shutdown[1]: Detaching DM devices. [ 3004.327015] systemd-shutdown[1]: Detaching DM 253:3. [ 3004.328142] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 3004.329258] systemd-shutdown[1]: Detaching DM 253:2. [ 3004.330390] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 3004.331524] systemd-shutdown[1]: Detaching DM 253:1. [ 3004.332655] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 3004.333623] systemd-shutdown[1]: Detaching DM 253:0. [ 3004.334592] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 3004.335574] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 3004.336542] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 3004.359045] + echo 'Hello, this is '\''/usr/lib/systemd/system-shutdown/debug.sh'\'' or '\''/usr/lib/systemd/system-shutdown/debug.sh'\''' [ 3004.360075] Hello, this is '/usr/lib/systemd/system-shutdown/debug.sh' or '/usr/lib/systemd/system-shutdown/debug.sh' [ 3004.361147] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 3004.362173] + echo 'Script args: reboot' [ 3004.363195] Script args: reboot [ 3004.364202] + set [ 3004.365195] BASH=/bin/bash [ 3004.366198] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 3004.367231] BASH_ALIASES=() [ 3004.368287] BASH_ARGC=([0]="1") [ 3004.369301] BASH_ARGV=([0]="reboot") [ 3004.370311] BASH_CMDS=() [ 3004.371313] BASH_LINENO=([0]="0") [ 3004.372311] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 3004.373354] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 3004.374414] BASH_VERSION='4.3.43(1)-release' [ 3004.375475] DIRSTACK=() [ 3004.376480] EUID=0 [ 3004.377503] GROUPS=() [ 3004.378516] HOME=/ [ 3004.379523] HOSTNAME=dom0 [ 3004.380531] HOSTTYPE=x86_64 [ 3004.381534] IFS=$' \t\n' [ 3004.382510] MACHTYPE=x86_64-redhat-linux-gnu [ 3004.383523] OPTERR=1 [ 3004.384517] OPTIND=1 [ 3004.385511] OSTYPE=linux-gnu [ 3004.386496] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 3004.387472] PIPESTATUS=([0]="0") [ 3004.388441] PPID=9627 [ 3004.389420] PS4='+ ' [ 3004.390384] PWD=/ [ 3004.391338] SHELL=/bin/bash [ 3004.392289] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 3004.393245] SHLVL=1 [ 3004.394197] TERM=linux [ 3004.395145] UID=0 [ 3004.396088] WATCHDOG_USEC=600000000 [ 3004.397025] _='Script args: reboot' [ 3004.397957] date_log_started='Sun Sep 2 19:55:35 CEST 2018' [ 3004.398878] pax_sanitize_slab=full [ 3004.399804] root_trim=yes [ 3004.400768] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 3004.401713] + sysctl kernel.sysrq=1 [ 3004.410792] kernel.sysrq = 1 [ 3004.412050] + mount -o remount,rw / [ 3004.418855] EXT4-fs (dm-4): re-mounted. Opts: discard [ 3004.420086] + df [ 3004.423676] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987880 0 1987880 0% /dev tmpfs 2001540 0 2001540 0% /dev/shm tmpfs 2001540 58732 1942808 3% /run tmpfs 2001540 0 2001540 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 11371260 190147936 6% / [ 3004.429061] + lsblk [ 3004.434439] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 3004.443744] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 3004.535235] real 0m0.091s user 0m0.057s [ 3004.537597] sys 0m0.016s [ 3004.538397] + echo 'exit code: 1' [ 3004.539158] exit code: 1 [ 3004.540630] + sysctl -a [ 3004.540809] + grep -i sysrq [ 3004.552413] sysctl: [ 3004.552415] reading key "vm.nr_hugepages" [ 3004.554819] sysctl: [ 3004.554821] reading key "vm.nr_hugepages_mempolicy" [ 3004.557168] sysctl: [ 3004.557170] reading key "vm.nr_overcommit_hugepages" [ 3004.559560] nr_pdflush_threads exported in /proc is scheduled for removal [ 3004.560697] kernel.sysrq = 1 [ 3004.561859] + sysctl -w kernel.sysrq=1 [ 3004.565001] kernel.sysrq = 1 [ 3004.567071] + grep -i sysrq [ 3004.567091] + sysctl -a [ 3004.576545] sysctl: [ 3004.576547] reading key "vm.nr_hugepages" [ 3004.579100] sysctl: [ 3004.579102] reading key "vm.nr_hugepages_mempolicy" [ 3004.581680] sysctl: [ 3004.581682] reading key "vm.nr_overcommit_hugepages" [ 3004.584553] kernel.sysrq = 1 [ 3004.585662] + echo d [ 3004.586539] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 3004.587507] + echo h [ 3004.588467] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 3004.589530] + echo m [ 3004.590608] sysrq: SysRq : Show Memory [ 3004.591619] Mem-Info: [ 3004.592675] active_anon:14509 inactive_anon:8453 isolated_anon:0 active_file:54716 inactive_file:60366 isolated_file:0 unevictable:2219 dirty:1 writeback:0 unstable:0 slab_reclaimable:8495 slab_unreclaimable:7841 mapped:2285 shmem:22816 pagetables:84 bounce:0 free:826101 free_pcp:1856 free_cma:0 [ 3004.598858] Node 0 active_anon:58036kB inactive_anon:33812kB active_file:218864kB inactive_file:241464kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9140kB dirty:4kB writeback:0kB shmem:91264kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 3004.599968] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 3004.601108] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 3004.602276] Node 0 DMA32 free:2542768kB min:5192kB low:7780kB high:10368kB active_anon:12kB inactive_anon:0kB active_file:33896kB inactive_file:28820kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:208kB pagetables:0kB bounce:0kB free_pcp:4032kB local_pcp:620kB free_cma:0kB [ 3004.603517] lowmem_reserve[]: 0 0 1337 1337 1337 [ 3004.604750] Node 0 Normal free:745732kB min:2744kB low:4112kB high:5480kB active_anon:58024kB inactive_anon:33812kB active_file:184968kB inactive_file:212644kB unevictable:8876kB writepending:4kB present:1437436kB managed:1369208kB mlocked:8876kB kernel_stack:2112kB pagetables:336kB bounce:0kB free_pcp:3392kB local_pcp:156kB free_cma:0kB [ 3004.606049] lowmem_reserve[]: 0 0 0 0 0 [ 3004.607384] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 3004.608710] Node 0 DMA32: 1796*4kB (UME) 1394*8kB (UME) 981*16kB (UME) 594*32kB (UME) 316*64kB (UME) 193*128kB (UM) 156*256kB (UM) 93*512kB (UME) 32*1024kB (UME) 21*2048kB (UME) 557*4096kB (M) = 2542768kB [ 3004.610063] Node 0 Normal: 4601*4kB (UME) 2112*8kB (UME) 3524*16kB (UME) 2443*32kB (UM) 1502*64kB (UME) 758*128kB (UME) 337*256kB (UME) 149*512kB (ME) 55*1024kB (ME) 22*2048kB (ME) 29*4096kB (ME) = 745732kB [ 3004.611476] 139858 total pagecache pages [ 3004.612839] 0 pages in swap cache [ 3004.614204] Swap cache stats: add 0, delete 0, find 0/0 [ 3004.615583] Free swap = 0kB [ 3004.616942] Total swap = 0kB [ 3004.618322] 1048575 pages RAM [ 3004.619663] 0 pages HighMem/MovableOnly [ 3004.621010] 47837 pages reserved [ 3004.622369] 0 pages cma reserved [ 3004.623704] 0 pages hwpoisoned [ 3004.625063] + echo w [ 3004.626453] sysrq: SysRq : Show Blocked State [ 3004.627781] task PC stack pid father [ 3004.629134] + echo 9 [ 3004.630477] sysrq: SysRq : Changing Loglevel [ 3004.631766] sysrq: Loglevel set to 9 [ 3004.633112] + echo -n Before: [ 3004.634442] Before: [ 3004.634448] + cat /sys/block/sda/device/queue_depth [ 3004.638297] 31 [ 3004.639841] + echo -n After: [ 3004.641161] After: [ 3004.641167] + cat /sys/block/sda/device/queue_depth [ 3004.644962] 31 [ 3004.646490] + hdparm -W /dev/sda [ 3004.651860] /dev/sda: write-caching = 1 (on) [ 3004.655955] + hdparm -C /dev/sda [ 3004.658439] /dev/sda: drive state is: active/idle [ 3004.662555] + hdparm -W /dev/sdb [ 3004.664943] /dev/sdb: No such file or directory [ 3004.666387] + hdparm -C /dev/sdb [ 3004.668762] /dev/sdb: No such file or directory [ 3004.670252] + echo 'sync first' [ 3004.671615] sync first [ 3004.672921] + sync [ 3004.676122] real 0m0.003s user 0m0.001s [ 3004.679966] sys 0m0.002s [ 3004.681279] + echo Before: [ 3004.682563] Before: [ 3004.683845] + echo m [ 3004.685136] sysrq: SysRq : Show Memory [ 3004.686413] Mem-Info: [ 3004.687688] active_anon:14510 inactive_anon:8453 isolated_anon:0 active_file:54748 inactive_file:60405 isolated_file:0 unevictable:2219 dirty:1 writeback:0 unstable:0 slab_reclaimable:8495 slab_unreclaimable:7821 mapped:2309 shmem:22816 pagetables:108 bounce:0 free:826093 free_pcp:1816 free_cma:0 [ 3004.695378] Node 0 active_anon:58040kB inactive_anon:33812kB active_file:218992kB inactive_file:241620kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9236kB dirty:4kB writeback:0kB shmem:91264kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 3004.696723] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 3004.698102] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 3004.699478] Node 0 DMA32 free:2542892kB min:5192kB low:7780kB high:10368kB active_anon:12kB inactive_anon:0kB active_file:33896kB inactive_file:28820kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:208kB pagetables:0kB bounce:0kB free_pcp:3916kB local_pcp:620kB free_cma:0kB [ 3004.700921] lowmem_reserve[]: 0 0 1337 1337 1337 [ 3004.702373] Node 0 Normal free:745576kB min:2744kB low:4112kB high:5480kB active_anon:58052kB inactive_anon:33812kB active_file:185220kB inactive_file:212800kB unevictable:8876kB writepending:4kB present:1437436kB managed:1369208kB mlocked:8876kB kernel_stack:2128kB pagetables:432kB bounce:0kB free_pcp:3348kB local_pcp:204kB free_cma:0kB [ 3004.703903] lowmem_reserve[]: 0 0 0 0 0 [ 3004.705425] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 3004.706998] Node 0 DMA32: 1797*4kB (UME) 1391*8kB (UME) 984*16kB (UME) 593*32kB (UME) 316*64kB (UME) 192*128kB (UM) 157*256kB (UM) 93*512kB (UME) 32*1024kB (UME) 21*2048kB (UME) 557*4096kB (M) = 2542892kB [ 3004.708591] Node 0 Normal: 4486*4kB (UME) 2117*8kB (UME) 3536*16kB (UME) 2444*32kB (UM) 1503*64kB (UME) 758*128kB (UME) 337*256kB (UME) 149*512kB (ME) 55*1024kB (ME) 22*2048kB (ME) 29*4096kB (ME) = 745600kB [ 3004.710189] 139929 total pagecache pages [ 3004.711784] 0 pages in swap cache [ 3004.713383] Swap cache stats: add 0, delete 0, find 0/0 [ 3004.714970] Free swap = 0kB [ 3004.716553] Total swap = 0kB [ 3004.718148] 1048575 pages RAM [ 3004.719728] 0 pages HighMem/MovableOnly [ 3004.721305] 47837 pages reserved [ 3004.722882] 0 pages cma reserved [ 3004.724464] 0 pages hwpoisoned [ 3004.726068] + echo 'manually Freeing pagecache pages' [ 3004.727657] manually Freeing pagecache pages [ 3004.729276] + echo --------------------------------------------------- [ 3004.730877] --------------------------------------------------- [ 3004.732466] + echo 3 [ 3004.770567] debug.sh (9629): drop_caches: 3 [ 3004.772239] real 0m0.040s user 0m0.000s [ 3004.776993] sys 0m0.039s [ 3004.779505] + echo --------------------------------------------------- [ 3004.781105] --------------------------------------------------- [ 3004.783155] + echo 'After :' [ 3004.784761] After : [ 3004.786395] + echo m [ 3004.788003] sysrq: SysRq : Show Memory [ 3004.789601] Mem-Info: [ 3004.791196] active_anon:147 inactive_anon:22816 isolated_anon:0 active_file:291 inactive_file:141 isolated_file:0 unevictable:2219 dirty:0 writeback:0 unstable:0 slab_reclaimable:5199 slab_unreclaimable:7554 mapped:2285 shmem:22816 pagetables:84 bounce:0 free:945033 free_pcp:1970 free_cma:0 [ 3004.800721] Node 0 active_anon:588kB inactive_anon:91264kB active_file:1164kB inactive_file:564kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9140kB dirty:0kB writeback:0kB shmem:91264kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 3004.802392] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 3004.804080] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 3004.805772] Node 0 DMA32 free:2609860kB min:5192kB low:7780kB high:10368kB active_anon:0kB inactive_anon:12kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:208kB pagetables:0kB bounce:0kB free_pcp:4032kB local_pcp:736kB free_cma:0kB [ 3004.807542] lowmem_reserve[]: 0 0 1337 1337 1337 [ 3004.809304] Node 0 Normal free:1154368kB min:2744kB low:4112kB high:5480kB active_anon:588kB inactive_anon:91252kB active_file:1164kB inactive_file:564kB unevictable:8876kB writepending:0kB present:1437436kB managed:1369208kB mlocked:8876kB kernel_stack:2112kB pagetables:336kB bounce:0kB free_pcp:3848kB local_pcp:704kB free_cma:0kB [ 3004.811148] lowmem_reserve[]: 0 0 0 0 0 [ 3004.812990] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 3004.814860] Node 0 DMA32: 715*4kB (UME) 591*8kB (UME) 514*16kB (UME) 381*32kB (UME) 267*64kB (UME) 158*128kB (UME) 112*256kB (UM) 70*512kB (UME) 44*1024kB (UME) 23*2048kB (UME) 583*4096kB (M) = 2609956kB [ 3004.816753] Node 0 Normal: 7810*4kB (UME) 5799*8kB (UME) 5534*16kB (UME) 3870*32kB (UME) 2477*64kB (UME) 1285*128kB (UME) 519*256kB (UME) 206*512kB (ME) 78*1024kB (ME) 29*2048kB (ME) 40*4096kB (ME) = 1154464kB [ 3004.818696] 25203 total pagecache pages [ 3004.820609] 0 pages in swap cache [ 3004.822531] Swap cache stats: add 0, delete 0, find 0/0 [ 3004.824448] Free swap = 0kB [ 3004.826370] Total swap = 0kB [ 3004.828299] 1048575 pages RAM [ 3004.830171] 0 pages HighMem/MovableOnly [ 3004.831988] 47837 pages reserved [ 3004.833725] 0 pages cma reserved [ 3004.835431] 0 pages hwpoisoned [ 3004.837223] + echo 'end of log' [ 3004.838892] end of log [ 3004.840615] + logfile=/dmesg_shutdown.log [ 3004.843766] ++ TMPDIR= [ 3004.843984] ++ /usr/bin/cut -f2 -d/ [ 3004.847581] ++ /usr/bin/mktemp --dry-run '--tmpdir='\''' -t --quiet XXXXXXXXXXXXXX [ 3004.859109] + rnd_log_tag=7hVfuUCrKWeFmy [ 3004.861553] + echo '//--- /usr/lib/systemd/system-shutdown/debug.sh started execution on: '\''Sun Sep 2 19:55:35 CEST 2018'\'' tag:7hVfuUCrKWeFmy' [ 3004.863871] + dmesg //--- /usr/lib/systemd/system-shutdown/debug.sh generated '/dmesg_shutdown.log' on: 'Sun Sep 2 19:55:36 CEST 2018' tag:7hVfuUCrKWeFmy ```

That's interesting, what happens if you manually kill all qubes-guid processes, then initiate shutdown/reboot?

The delay seems to be greatly reduced (down to 18 seconds - looking at journal's time between System is rebooting. and Journal stopped). EDIT looks like this 18seconds boot was a fluke because it sometimes is fast(er) and sometimes is slower (like 50 seconds).

I used ps auxw|grep -i qubes-guid to see how many there were (3), then pkill qubes-guid, then checked that all 3 were gone via ps auxw|grep -i qubes-guid.

from `journalctl -b -1`'s point of view

``` Sep 02 20:08:36 dom0 systemd-logind[1879]: System is rebooting. Sep 02 20:08:36 dom0 systemd[1]: Stopping User Manager for UID 1000... Sep 02 20:08:36 dom0 systemd[1]: Stopping Session 2 of user ctor. Sep 02 20:08:36 dom0 systemd[1]: Stopped target Sound Card. Sep 02 20:08:36 dom0 systemd[1]: Stopping Authorization Manager... Sep 02 20:08:36 dom0 systemd[1]: Stopping Manage Sound Card State (restore and store)... Sep 02 20:08:36 dom0 lightdm[3200]: Error opening audit socket: Protocol not supported Sep 02 20:08:36 dom0 lightdm[3286]: pam_unix(lightdm:session): session closed for user ctor Sep 02 20:08:36 dom0 alsactl[1880]: alsactl daemon stopped Sep 02 20:08:36 dom0 systemd[1]: Stopping RealtimeKit Scheduling Policy Service... Sep 02 20:08:36 dom0 systemd[1]: Stopped target Graphical Interface. Sep 02 20:08:36 dom0 systemd[1]: Stopping Light Display Manager... Sep 02 20:08:36 dom0 systemd[1]: Stopped target Multi-User System. Sep 02 20:08:36 dom0 systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). Sep 02 20:08:36 dom0 systemd[1]: Stopping Command Scheduler... Sep 02 20:08:36 dom0 systemd[1]: Stopping Daemon for power management... Sep 02 20:08:36 dom0 systemd[1]: Stopped target Timers. Sep 02 20:08:36 dom0 systemd[1]: Stopped Daily Cleanup of Temporary Directories. Sep 02 20:08:36 dom0 systemd[1]: Stopping Restore /run/initramfs on shutdown... Sep 02 20:08:36 dom0 systemd[1]: Stopped target Login Prompts. Sep 02 20:08:36 dom0 crond[3202]: (CRON) INFO (Shutting down) Sep 02 20:08:36 dom0 systemd[1]: Stopping Serial Getty on hvc0... Sep 02 20:08:36 dom0 systemd[1]: Stopped Discard unused blocks once a week. Sep 02 20:08:36 dom0 systemd[1]: Stopping Accounts Service... Sep 02 20:08:36 dom0 systemd[1]: Removed slice system-getty.slice. Sep 02 20:08:36 dom0 systemd[1]: Stopped Daemon for power management. Sep 02 20:08:36 dom0 systemd[1]: Stopped Command Scheduler. Sep 02 20:08:36 dom0 systemd[1]: Stopped Accounts Service. Sep 02 20:08:36 dom0 systemd[1]: Stopped Authorization Manager. Sep 02 20:08:36 dom0 systemd[1]: Stopped Serial Getty on hvc0. Sep 02 20:08:36 dom0 systemd[1]: Stopped RealtimeKit Scheduling Policy Service. Sep 02 20:08:36 dom0 systemd[1]: Stopped Manage Sound Card State (restore and store). Sep 02 20:08:36 dom0 systemd[1]: Removed slice system-serial\x2dgetty.slice. Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: Traceback (most recent call last): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: Traceback (most recent call last): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: return f(*args) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: return f(*args) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: self.invalid() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: self.invalid() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: raise ConnectionException(err) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: raise ConnectionException(err) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: During handling of the above exception, another exception occurred: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: During handling of the above exception, another exception occurred: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: Traceback (most recent call last): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: Traceback (most recent call last): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/qubes/icon-receiver", line 362, in Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/qubes/icon-receiver", line 362, in Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: rcvd.handle_input() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: rcvd.handle_input() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: self.handle_events() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: self.handle_events() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: for ev in iter(self.conn.poll_for_event, None): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: for ev in iter(self.conn.poll_for_event, None): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: self.invalid() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: self.invalid() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: raise ConnectionException(err) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: raise ConnectionException(err) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-firewall[3523]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-sys-net[3530]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: Traceback (most recent call last): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: return f(*args) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: self.invalid() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: raise ConnectionException(err) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: During handling of the above exception, another exception occurred: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: Traceback (most recent call last): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/qubes/icon-receiver", line 362, in Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: rcvd.handle_input() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: self.handle_events() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: for ev in iter(self.conn.poll_for_event, None): Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: self.invalid() Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: raise ConnectionException(err) Sep 02 20:08:36 dom0 qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[3949]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. Sep 02 20:08:36 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=48046485, total_mem_pref=2190481817.6, total_available_memory=30723591638.4) Sep 02 20:08:36 dom0 qmemman.daemon.algo[1881]: left_memory=4348425425 acceptors_count=1 Sep 02 20:08:36 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=48046485, total_mem_pref=2148815257.6, total_available_memory=30765258198.4) Sep 02 20:08:36 dom0 qmemman.daemon.algo[1881]: left_memory=4595402621 acceptors_count=1 Sep 02 20:08:36 dom0 systemd[3302]: Received SIGRTMIN+24 from PID 4909 (kill). Sep 02 20:08:36 dom0 systemd[3309]: pam_unix(systemd-user:session): session closed for user ctor Sep 02 20:08:36 dom0 systemd[1]: Stopped User Manager for UID 1000. Sep 02 20:08:36 dom0 systemd[1]: Stopped Session 2 of user ctor. Sep 02 20:08:36 dom0 systemd[1]: Removed slice User Slice of ctor. Sep 02 20:08:36 dom0 systemd[1]: Stopping Login Service... Sep 02 20:08:36 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=48046485, total_mem_pref=1786334822.4, total_available_memory=31127738633.6) Sep 02 20:08:36 dom0 qmemman.daemon.algo[1881]: left_memory=7230098962 acceptors_count=1 Sep 02 20:08:36 dom0 systemd[1]: Stopped Light Display Manager. Sep 02 20:08:36 dom0 systemd[1]: Starting Show Plymouth Reboot Screen... Sep 02 20:08:36 dom0 systemd[1]: Stopping Permit User Sessions... Sep 02 20:08:36 dom0 systemd[1]: Stopped Permit User Sessions. Sep 02 20:08:36 dom0 systemd[1]: Stopped Start Qubes VM sys-net. Sep 02 20:08:36 dom0 systemd[1]: Stopped Start Qubes VM sys-firewall. Sep 02 20:08:36 dom0 systemd[1]: Removed slice system-qubes\x2dvm.slice. Sep 02 20:08:36 dom0 systemd[1]: Stopping Qubes memory information reporter... Sep 02 20:08:36 dom0 systemd[1]: Stopped Qubes memory information reporter. Sep 02 20:08:36 dom0 systemd[1]: Stopping Qubes Dom0 startup setup... Sep 02 20:08:36 dom0 systemd[1]: Started Show Plymouth Reboot Screen. Sep 02 20:08:36 dom0 systemd[1]: Stopped Login Service. Sep 02 20:08:36 dom0 systemd[1]: Stopped target User and Group Name Lookups. Sep 02 20:08:36 dom0 qvm-shutdown[4926]: 2018-09-02 20:08:36,803 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector Sep 02 20:08:36 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:36 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:36 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:36 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:36 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:36 dom0 systemd[1]: Stopped Restore /run/initramfs on shutdown. Sep 02 20:08:37 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=48051598, total_mem_pref=1683353190.4, total_available_memory=31230725378.6) Sep 02 20:08:37 dom0 qmemman.daemon.algo[1881]: left_memory=6174045055 acceptors_count=1 Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qubesd[1857]: socket.send() raised exception. Sep 02 20:08:39 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=48040992, total_mem_pref=1683353190.4, total_available_memory=31230714772.6) Sep 02 20:08:39 dom0 qmemman.daemon.algo[1881]: left_memory=6174040363 acceptors_count=1 Sep 02 20:08:39 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=4237686030, total_mem_pref=1314733260.8000002, total_available_memory=31594675740.2) Sep 02 20:08:39 dom0 qmemman.daemon.algo[1881]: left_memory=5230936874 acceptors_count=1 Sep 02 20:08:39 dom0 qmemman.systemstate[1881]: stat: dom '3' act=4194304000 pref=376915968.0 last_target=4194304000 Sep 02 20:08:39 dom0 qmemman.systemstate[1881]: stat: dom '0' act=24477418971 pref=937817292.8000001 last_target=24477418971 Sep 02 20:08:39 dom0 qmemman.systemstate[1881]: stat: xenfree=4290114830 memset_reqs=[('0', 28676964654), ('3', 4194304000)] Sep 02 20:08:39 dom0 qmemman.systemstate[1881]: mem-set domain 0 to 28676964654 Sep 02 20:08:39 dom0 qmemman.systemstate[1881]: mem-set domain 3 to 4194304000 Sep 02 20:08:40 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:40 dom0 lvm[749]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:40 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:40 dom0 lvm[749]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:41 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=46102696, total_mem_pref=1223343718.4, total_available_memory=31694027631.600002) Sep 02 20:08:41 dom0 qmemman.daemon.algo[1881]: left_memory=3480873843 acceptors_count=1 Sep 02 20:08:41 dom0 systemd[1]: Received SIGRTMIN+20 from PID 4927 (plymouthd). Sep 02 20:08:43 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=46102696, total_mem_pref=1223343718.4, total_available_memory=31694027631.600002) Sep 02 20:08:43 dom0 qmemman.daemon.algo[1881]: left_memory=3480873843 acceptors_count=1 Sep 02 20:08:44 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=4242035142, total_mem_pref=937817292.8000001, total_available_memory=31981182503.2) Sep 02 20:08:44 dom0 qmemman.systemstate[1881]: stat: dom '0' act=28676964654 pref=937817292.8000001 last_target=28676964654 Sep 02 20:08:44 dom0 qmemman.systemstate[1881]: stat: xenfree=4294463942 memset_reqs=[('0', 32886080796)] Sep 02 20:08:44 dom0 qmemman.systemstate[1881]: mem-set domain 0 to 32886080796 Sep 02 20:08:44 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:44 dom0 lvm[749]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:45 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:45 dom0 lvm[749]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:48 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=34585974, total_mem_pref=937817292.8000001, total_available_memory=31982849477.2) Sep 02 20:08:48 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=184609935, total_mem_pref=937817292.8000001, total_available_memory=32132873438.2) Sep 02 20:08:48 dom0 qmemman.systemstate[1881]: stat: dom '0' act=32886080796 pref=937817292.8000001 last_target=32886080796 Sep 02 20:08:48 dom0 qmemman.systemstate[1881]: stat: xenfree=237038735 memset_reqs=[('0', 33037620040)] Sep 02 20:08:48 dom0 qmemman.systemstate[1881]: mem-set domain 0 to 33037620040 Sep 02 20:08:48 dom0 qmemman.daemon.algo[1881]: balance_when_enough_memory(xen_free_memory=438598868, total_mem_pref=937817292.8000001, total_available_memory=32538401615.2) Sep 02 20:08:48 dom0 qmemman.systemstate[1881]: stat: dom '0' act=33037620040 pref=937817292.8000001 last_target=33037620040 Sep 02 20:08:48 dom0 qmemman.systemstate[1881]: stat: xenfree=491027668 memset_reqs=[('0', 33442742689)] Sep 02 20:08:48 dom0 qmemman.systemstate[1881]: mem-set domain 0 to 33442742689 Sep 02 20:08:49 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:49 dom0 lvm[749]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:49 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:49 dom0 lvm[749]: Monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:49 dom0 qubesdb-daemon[1853]: terminating Sep 02 20:08:49 dom0 systemd[1]: Stopped Qubes DB agent. Sep 02 20:08:49 dom0 systemd[1]: Stopped Qubes Dom0 startup setup. Sep 02 20:08:49 dom0 systemd[1]: Stopping Qubes OS daemon... Sep 02 20:08:49 dom0 systemd[1]: Stopping Qubes memory management daemon... Sep 02 20:08:49 dom0 systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... Sep 02 20:08:49 dom0 systemd[1]: Stopping Virtualization daemon... Sep 02 20:08:49 dom0 qubesd[1857]: caught SIGTERM, exiting Sep 02 20:08:49 dom0 systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. Sep 02 20:08:49 dom0 systemd[1]: Stopped Qubes memory management daemon. Sep 02 20:08:49 dom0 libvirtd[1896]: S3 disabled Sep 02 20:08:49 dom0 libvirtd[1896]: S4 disabled Sep 02 20:08:49 dom0 libvirtd[1896]: S3 disabled Sep 02 20:08:49 dom0 libvirtd[1896]: S4 disabled Sep 02 20:08:49 dom0 systemd[1]: Stopped Virtualization daemon. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Remote File Systems. Sep 02 20:08:49 dom0 systemd[1]: Stopping D-Bus System Message Bus... Sep 02 20:08:49 dom0 systemd[1]: Stopping The Xen xenstore... Sep 02 20:08:49 dom0 systemd[1]: Stopped The Xen xenstore. Sep 02 20:08:49 dom0 systemd[1]: Unmounting mount xenstore file system... Sep 02 20:08:49 dom0 systemd[1]: Stopped D-Bus System Message Bus. Sep 02 20:08:49 dom0 systemd[1]: Unmounted mount xenstore file system. Sep 02 20:08:49 dom0 systemd[1]: Stopped Qubes OS daemon. Sep 02 20:08:49 dom0 systemd[1]: Stopping LVM2 PV scan on device 253:0... Sep 02 20:08:49 dom0 systemd[1]: Stopped target Basic System. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Sockets. Sep 02 20:08:49 dom0 systemd[1]: Closed Virtual machine lock manager socket. Sep 02 20:08:49 dom0 systemd[1]: Closed D-Bus System Message Bus Socket. Sep 02 20:08:49 dom0 systemd[1]: Closed Virtual machine log manager socket. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Paths. Sep 02 20:08:49 dom0 systemd[1]: Stopped target System Initialization. Sep 02 20:08:49 dom0 systemd[1]: Stopping Update UTMP about System Boot/Shutdown... Sep 02 20:08:49 dom0 systemd[1]: Stopped Load legacy module configuration. Sep 02 20:08:49 dom0 systemd[1]: Stopping Load/Save Random Seed... Sep 02 20:08:49 dom0 systemd[1]: Stopped target Encrypted Volumes. Sep 02 20:08:49 dom0 systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. Sep 02 20:08:49 dom0 systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... Sep 02 20:08:49 dom0 systemd[1]: Stopped Apply Kernel Variables. Sep 02 20:08:49 dom0 systemd[1]: Stopped Setup Virtual Console. Sep 02 20:08:49 dom0 systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Slices. Sep 02 20:08:49 dom0 systemd[1]: Removed slice User and Session Slice. Sep 02 20:08:49 dom0 systemd[1]: Stopped Load/Save Random Seed. Sep 02 20:08:49 dom0 systemd[1]: Stopped Update UTMP about System Boot/Shutdown. Sep 02 20:08:49 dom0 systemd[1]: Stopped Create Volatile Files and Directories. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Local File Systems. Sep 02 20:08:49 dom0 systemd[1]: Unmounting /run/user/1000... Sep 02 20:08:49 dom0 systemd[1]: Unmounting /boot/efi... Sep 02 20:08:49 dom0 systemd[1]: Stopped Configure read-only root support. Sep 02 20:08:49 dom0 systemd[1]: Unmounting Configuration File System... Sep 02 20:08:49 dom0 systemd[1]: Unmounting Temporary Directory... Sep 02 20:08:49 dom0 systemd[1]: Stopped LVM2 PV scan on device 253:0. Sep 02 20:08:49 dom0 systemd[1]: Unmounted /run/user/1000. Sep 02 20:08:49 dom0 systemd[1]: Unmounted /boot/efi. Sep 02 20:08:49 dom0 systemd[1]: Unmounted Configuration File System. Sep 02 20:08:49 dom0 systemd[1]: Unmounted Temporary Directory. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Swap. Sep 02 20:08:49 dom0 systemd[1]: Stopped Load Kernel Modules. Sep 02 20:08:49 dom0 systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. Sep 02 20:08:49 dom0 systemd[1]: Removed slice system-systemd\x2dfsck.slice. Sep 02 20:08:49 dom0 systemd[1]: Stopped target Local File Systems (Pre). Sep 02 20:08:49 dom0 systemd[1]: Stopped Create Static Device Nodes in /dev. Sep 02 20:08:49 dom0 systemd[1]: Stopped Remount Root and Kernel File Systems. Sep 02 20:08:49 dom0 systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Sep 02 20:08:49 dom0 systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. Sep 02 20:08:49 dom0 dmeventd[749]: No longer monitoring thin pool qubes_dom0-pool00-tpool. Sep 02 20:08:49 dom0 lvm[6383]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored Sep 02 20:08:49 dom0 lvmetad[745]: Failed to accept connection errno 11. Sep 02 20:08:49 dom0 systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. Sep 02 20:08:49 dom0 systemd[1]: Stopping LVM2 metadata daemon... Sep 02 20:08:49 dom0 systemd[1]: Stopped LVM2 metadata daemon. Sep 02 20:08:54 dom0 systemd-cryptsetup[6365]: Failed to deactivate: Device or resource busy Sep 02 20:08:54 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 Sep 02 20:08:54 dom0 systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. Sep 02 20:08:54 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. Sep 02 20:08:54 dom0 systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. Sep 02 20:08:54 dom0 systemd[1]: Reached target Unmount All Filesystems. Sep 02 20:08:54 dom0 systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. Sep 02 20:08:54 dom0 systemd[1]: Reached target Shutdown. Sep 02 20:08:54 dom0 systemd[1]: Reached target Final Step. Sep 02 20:08:54 dom0 systemd[1]: Starting Reboot... Sep 02 20:08:54 dom0 systemd[1]: Shutting down. Sep 02 20:08:54 dom0 systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 Sep 02 20:08:54 dom0 systemd[1]: Set hardware watchdog to 10min. Sep 02 20:08:54 dom0 kernel: watchdog: watchdog0: watchdog did not stop! Sep 02 20:08:54 dom0 systemd-shutdown[1]: Sending SIGTERM to remaining processes... Sep 02 20:08:54 dom0 dmeventd[749]: dmeventd detected break while being idle for 5 second(s), exiting. Sep 02 20:08:54 dom0 dmeventd[749]: dmeventd shutting down. Sep 02 20:08:54 dom0 systemd-journald[742]: Journal stopped ```

from `dmesg`'s point of view

``` [ 697.449313] systemd[4807]: Reached target Sockets. [ 697.449326] systemd[4807]: Reached target Basic System. [ 697.449335] systemd[4807]: Reached target Default. [ 697.449352] systemd[4807]: Startup finished in 21ms. [ 697.449426] systemd[1]: Started User Manager for UID 0. [ 718.326395] systemd-logind[1879]: Removed session 3. [ 718.327775] systemd[1]: Stopping User Manager for UID 0... [ 718.328174] systemd[4807]: Stopped target Default. [ 718.328183] systemd[4807]: Stopped target Basic System. [ 718.328190] systemd[4807]: Stopped target Timers. [ 718.328196] systemd[4807]: Stopped target Paths. [ 718.328202] systemd[4807]: Stopped target Sockets. [ 718.328396] systemd[4807]: Closed D-Bus User Message Bus Socket. [ 718.328405] systemd[4807]: Reached target Shutdown. [ 718.329744] systemd[4807]: Starting Exit the Session... [ 718.332383] systemd[4807]: Received SIGRTMIN+24 from PID 4860 (kill). [ 718.334846] systemd[1]: Stopped User Manager for UID 0. [ 718.336867] systemd[1]: Removed slice User Slice of root. [ 721.996403] systemd-logind[1879]: System is rebooting. [ 722.008867] systemd[1]: Stopping User Manager for UID 1000... [ 722.010701] systemd[1]: Stopping Session 2 of user ctor. [ 722.010716] systemd[1]: Stopped target Sound Card. [ 722.011215] systemd[1]: Stopping Authorization Manager... [ 722.012518] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 722.017903] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 722.017922] systemd[1]: Stopped target Graphical Interface. [ 722.018711] systemd[1]: Stopping Light Display Manager... [ 722.018721] systemd[1]: Stopped target Multi-User System. [ 722.019285] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 722.019464] systemd[1]: Stopping Command Scheduler... [ 722.020379] systemd[1]: Stopping Daemon for power management... [ 722.020394] systemd[1]: Stopped target Timers. [ 722.020421] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 722.021600] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 722.021645] systemd[1]: Stopped target Login Prompts. [ 722.027156] systemd[1]: Stopping Serial Getty on hvc0... [ 722.027191] systemd[1]: Stopped Discard unused blocks once a week. [ 722.027311] systemd[1]: Stopping Accounts Service... [ 722.027441] systemd[1]: Removed slice system-getty.slice. [ 722.035720] systemd[1]: Stopped Daemon for power management. [ 722.036428] systemd[1]: Stopped Command Scheduler. [ 722.036707] systemd[1]: Stopped Accounts Service. [ 722.037071] systemd[1]: Stopped Authorization Manager. [ 722.039360] systemd[1]: Stopped Serial Getty on hvc0. [ 722.039847] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 722.041261] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 722.046467] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 722.187406] systemd[1]: Stopped User Manager for UID 1000. [ 722.259557] systemd[1]: Stopped Session 2 of user ctor. [ 722.260368] systemd[1]: Removed slice User Slice of ctor. [ 722.260486] systemd[1]: Stopping Login Service... [ 722.276989] systemd[1]: Stopped Light Display Manager. [ 722.278510] systemd[1]: Starting Show Plymouth Reboot Screen... [ 722.279789] systemd[1]: Stopping Permit User Sessions... [ 722.284171] systemd[1]: Stopped Permit User Sessions. [ 722.284458] systemd[1]: Stopped Start Qubes VM sys-net. [ 722.284517] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 722.284654] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 722.284794] systemd[1]: Stopping Qubes memory information reporter... [ 722.285328] systemd[1]: Stopped Qubes memory information reporter. [ 722.286698] systemd[1]: Stopping Qubes Dom0 startup setup... [ 722.309251] systemd[1]: Started Show Plymouth Reboot Screen. [ 722.315214] systemd[1]: Stopped Login Service. [ 722.315725] systemd[1]: Stopped target User and Group Name Lookups. [ 722.510927] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 727.298617] systemd[1]: Received SIGRTMIN+20 from PID 4927 (plymouthd). [ 735.381680] systemd[1]: Stopped Qubes DB agent. [ 735.382197] systemd[1]: Stopped Qubes Dom0 startup setup. [ 735.382421] systemd[1]: Stopping Qubes OS daemon... [ 735.382562] systemd[1]: Stopping Qubes memory management daemon... [ 735.382731] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 735.382853] systemd[1]: Stopping Virtualization daemon... [ 735.386576] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 735.387545] systemd[1]: Stopped Qubes memory management daemon. [ 735.391638] systemd[1]: Stopped Virtualization daemon. [ 735.391751] systemd[1]: Stopped target Remote File Systems. [ 735.391908] systemd[1]: Stopping D-Bus System Message Bus... [ 735.392028] systemd[1]: Stopping The Xen xenstore... [ 735.392690] systemd[1]: Stopped The Xen xenstore. [ 735.393989] systemd[1]: Unmounting mount xenstore file system... [ 735.395371] systemd[1]: Stopped D-Bus System Message Bus. [ 735.402381] systemd[1]: Unmounted mount xenstore file system. [ 735.427231] systemd[1]: Stopped Qubes OS daemon. [ 735.428777] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 735.428872] systemd[1]: Stopped target Basic System. [ 735.428963] systemd[1]: Stopped target Sockets. [ 735.429042] systemd[1]: Closed Virtual machine lock manager socket. [ 735.429117] systemd[1]: Closed D-Bus System Message Bus Socket. [ 735.429190] systemd[1]: Closed Virtual machine log manager socket. [ 735.429229] systemd[1]: Stopped target Paths. [ 735.429286] systemd[1]: Stopped target System Initialization. [ 735.430648] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 735.431167] systemd[1]: Stopped Load legacy module configuration. [ 735.432460] systemd[1]: Stopping Load/Save Random Seed... [ 735.432559] systemd[1]: Stopped target Encrypted Volumes. [ 735.432680] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 735.434220] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 735.434745] systemd[1]: Stopped Apply Kernel Variables. [ 735.435268] systemd[1]: Stopped Setup Virtual Console. [ 735.438855] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 735.438919] systemd[1]: Stopped target Slices. [ 735.439444] systemd[1]: Removed slice User and Session Slice. [ 735.440270] systemd[1]: Stopped Load/Save Random Seed. [ 735.442248] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 735.442658] systemd[1]: Stopped Create Volatile Files and Directories. [ 735.442763] systemd[1]: Stopped target Local File Systems. [ 735.444132] systemd[1]: Unmounting /run/user/1000... [ 735.445555] systemd[1]: Unmounting /boot/efi... [ 735.448255] systemd[1]: Stopped Configure read-only root support. [ 735.454355] systemd[1]: Unmounting Configuration File System... [ 735.459771] systemd[1]: Unmounting Temporary Directory... [ 735.464508] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 735.467943] systemd[1]: Unmounted /run/user/1000. [ 735.472221] systemd[1]: Unmounted /boot/efi. [ 735.476493] systemd[1]: Unmounted Configuration File System. [ 735.480709] systemd[1]: Unmounted Temporary Directory. [ 735.485680] systemd[1]: Stopped target Swap. [ 735.489262] systemd[1]: Stopped Load Kernel Modules. [ 735.493120] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 735.494568] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 735.498480] systemd[1]: Stopped target Local File Systems (Pre). [ 735.500114] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 735.504221] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 735.509200] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 735.512512] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 735.544535] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 735.546058] systemd[1]: Stopping LVM2 metadata daemon... [ 735.550554] systemd[1]: Stopped LVM2 metadata daemon. [ 740.247029] systemd-cryptsetup[6365]: Failed to deactivate: Device or resource busy [ 740.249351] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 740.251339] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 740.253026] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 740.254643] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 740.254767] systemd[1]: Reached target Unmount All Filesystems. [ 740.257952] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 740.262317] systemd[1]: Reached target Shutdown. [ 740.263765] systemd[1]: Reached target Final Step. [ 740.265176] systemd[1]: Starting Reboot... [ 740.269840] systemd[1]: Shutting down. [ 740.291082] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 740.292465] systemd[1]: Set hardware watchdog to 10min. [ 740.293805] watchdog: watchdog0: watchdog did not stop! [ 740.327811] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 740.335910] systemd-journald[742]: Received SIGTERM from PID 1 (systemd-shutdow). [ 740.368028] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 740.372953] systemd-shutdown[1]: Process 4927 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 740.374402] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 740.376624] systemd-shutdown[1]: Unmounting file systems. [ 740.378151] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 740.390327] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 740.395006] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 740.396409] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 740.397786] systemd-shutdown[1]: All filesystems unmounted. [ 740.399157] systemd-shutdown[1]: Deactivating swaps. [ 740.400549] systemd-shutdown[1]: All swaps deactivated. [ 740.401940] systemd-shutdown[1]: Detaching loop devices. [ 740.404754] systemd-shutdown[1]: All loop devices detached. [ 740.406180] systemd-shutdown[1]: Detaching DM devices. [ 740.411911] systemd-shutdown[1]: Detaching DM 253:9. [ 740.423358] systemd-shutdown[1]: Detaching DM 253:8. [ 740.435106] systemd-shutdown[1]: Detaching DM 253:7. [ 740.446033] systemd-shutdown[1]: Detaching DM 253:6. [ 740.460098] systemd-shutdown[1]: Detaching DM 253:55. [ 740.471011] systemd-shutdown[1]: Detaching DM 253:52. [ 740.488038] systemd-shutdown[1]: Detaching DM 253:5. [ 740.497944] systemd-shutdown[1]: Detaching DM 253:49. [ 740.511074] systemd-shutdown[1]: Detaching DM 253:46. [ 740.523106] systemd-shutdown[1]: Detaching DM 253:45. [ 740.534029] systemd-shutdown[1]: Detaching DM 253:44. [ 740.549100] systemd-shutdown[1]: Detaching DM 253:43. [ 740.559062] systemd-shutdown[1]: Detaching DM 253:42. [ 740.573060] systemd-shutdown[1]: Detaching DM 253:41. [ 740.584049] systemd-shutdown[1]: Detaching DM 253:40. [ 740.599108] systemd-shutdown[1]: Detaching DM 253:37. [ 740.612065] systemd-shutdown[1]: Detaching DM 253:35. [ 740.628063] systemd-shutdown[1]: Detaching DM 253:34. [ 740.645081] systemd-shutdown[1]: Detaching DM 253:33. [ 740.657069] systemd-shutdown[1]: Detaching DM 253:32. [ 740.667068] systemd-shutdown[1]: Detaching DM 253:31. [ 740.677049] systemd-shutdown[1]: Detaching DM 253:30. [ 740.689057] systemd-shutdown[1]: Detaching DM 253:3. [ 740.690523] dev_remove: 15 callbacks suppressed [ 740.690532] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 740.693417] systemd-shutdown[1]: Detaching DM 253:29. [ 740.706089] systemd-shutdown[1]: Detaching DM 253:28. [ 740.718084] systemd-shutdown[1]: Detaching DM 253:27. [ 740.734081] systemd-shutdown[1]: Detaching DM 253:26. [ 740.747061] systemd-shutdown[1]: Detaching DM 253:25. [ 740.762096] systemd-shutdown[1]: Detaching DM 253:24. [ 740.778051] systemd-shutdown[1]: Detaching DM 253:23. [ 740.795076] systemd-shutdown[1]: Detaching DM 253:22. [ 740.807091] systemd-shutdown[1]: Detaching DM 253:21. [ 740.818059] systemd-shutdown[1]: Detaching DM 253:20. [ 740.831944] systemd-shutdown[1]: Detaching DM 253:2. [ 740.833327] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 740.834679] systemd-shutdown[1]: Detaching DM 253:19. [ 740.851088] systemd-shutdown[1]: Detaching DM 253:18. [ 740.864070] systemd-shutdown[1]: Detaching DM 253:17. [ 740.877098] systemd-shutdown[1]: Detaching DM 253:16. [ 740.894100] systemd-shutdown[1]: Detaching DM 253:15. [ 740.907080] systemd-shutdown[1]: Detaching DM 253:14. [ 740.922086] systemd-shutdown[1]: Detaching DM 253:13. [ 740.934082] systemd-shutdown[1]: Detaching DM 253:12. [ 740.947109] systemd-shutdown[1]: Detaching DM 253:11. [ 740.965083] systemd-shutdown[1]: Detaching DM 253:10. [ 740.976079] systemd-shutdown[1]: Detaching DM 253:1. [ 740.977354] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 740.978614] systemd-shutdown[1]: Detaching DM 253:0. [ 740.979869] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 740.981115] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 740.982518] systemd-shutdown[1]: Detaching DM devices. [ 740.984396] systemd-shutdown[1]: Detaching DM 253:3. [ 740.985655] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 740.986912] systemd-shutdown[1]: Detaching DM 253:2. [ 740.988167] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 740.989438] systemd-shutdown[1]: Detaching DM 253:1. [ 740.990707] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 740.991957] systemd-shutdown[1]: Detaching DM 253:0. [ 740.993205] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 740.994461] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 740.995710] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 741.019926] + echo 'Hello, this is '\''/usr/lib/systemd/system-shutdown/debug.sh'\'' or '\''/usr/lib/systemd/system-shutdown/debug.sh'\''' [ 741.021069] Hello, this is '/usr/lib/systemd/system-shutdown/debug.sh' or '/usr/lib/systemd/system-shutdown/debug.sh' [ 741.022207] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 741.023346] + echo 'Script args: reboot' [ 741.024465] Script args: reboot [ 741.025568] + set [ 741.026676] BASH=/bin/bash [ 741.027748] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 741.028911] BASH_ALIASES=() [ 741.029999] BASH_ARGC=([0]="1") [ 741.031090] BASH_ARGV=([0]="reboot") [ 741.032178] BASH_CMDS=() [ 741.033247] BASH_LINENO=([0]="0") [ 741.034313] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 741.035385] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 741.036478] BASH_VERSION='4.3.43(1)-release' [ 741.037552] DIRSTACK=() [ 741.038633] EUID=0 [ 741.039695] GROUPS=() [ 741.040751] HOME=/ [ 741.041802] HOSTNAME=dom0 [ 741.042828] HOSTTYPE=x86_64 [ 741.043875] IFS=$' \t\n' [ 741.044919] MACHTYPE=x86_64-redhat-linux-gnu [ 741.045959] OPTERR=1 [ 741.046995] OPTIND=1 [ 741.048014] OSTYPE=linux-gnu [ 741.049026] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 741.050026] PIPESTATUS=([0]="0") [ 741.051015] PPID=6395 [ 741.052007] PS4='+ ' [ 741.052980] PWD=/ [ 741.053931] SHELL=/bin/bash [ 741.054886] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 741.055838] SHLVL=1 [ 741.056785] TERM=linux [ 741.057726] UID=0 [ 741.058648] WATCHDOG_USEC=600000000 [ 741.059572] _='Script args: reboot' [ 741.060485] date_log_started='Sun Sep 2 20:08:55 CEST 2018' [ 741.061394] pax_sanitize_slab=full [ 741.062283] root_trim=yes [ 741.063223] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 741.064152] + sysctl kernel.sysrq=1 [ 741.072628] kernel.sysrq = 1 [ 741.073895] + mount -o remount,rw / [ 741.080211] EXT4-fs (dm-4): re-mounted. Opts: discard [ 741.081493] + df [ 741.084789] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987880 0 1987880 0% /dev tmpfs 2001540 0 2001540 0% /dev/shm tmpfs 2001540 58732 1942808 3% /run tmpfs 2001540 0 2001540 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 11372668 190146528 6% / [ 741.090286] + lsblk [ 741.095542] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 741.104910] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 741.198025] real 0m0.093s user 0m0.052s [ 741.200331] sys 0m0.023s [ 741.201127] + echo 'exit code: 1' [ 741.201904] exit code: 1 [ 741.203371] + sysctl -a [ 741.203586] + grep -i sysrq [ 741.214966] sysctl: [ 741.214969] reading key "vm.nr_hugepages" [ 741.217339] sysctl: [ 741.217341] reading key "vm.nr_hugepages_mempolicy" [ 741.219723] sysctl: [ 741.219725] reading key "vm.nr_overcommit_hugepages" [ 741.222140] nr_pdflush_threads exported in /proc is scheduled for removal [ 741.223297] kernel.sysrq = 1 [ 741.224451] + sysctl -w kernel.sysrq=1 [ 741.227588] kernel.sysrq = 1 [ 741.229330] + sysctl -a [ 741.229562] + grep -i sysrq [ 741.240056] sysctl: [ 741.240058] reading key "vm.nr_hugepages" [ 741.242548] sysctl: [ 741.242550] reading key "vm.nr_hugepages_mempolicy" [ 741.245068] sysctl: [ 741.245070] reading key "vm.nr_overcommit_hugepages" [ 741.247898] kernel.sysrq = 1 [ 741.248997] + echo d [ 741.249871] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 741.250828] + echo h [ 741.251786] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 741.252846] + echo m [ 741.253894] sysrq: SysRq : Show Memory [ 741.254916] Mem-Info: [ 741.255953] active_anon:14512 inactive_anon:8452 isolated_anon:0 active_file:46359 inactive_file:67546 isolated_file:0 unevictable:2222 dirty:1 writeback:0 unstable:0 slab_reclaimable:8058 slab_unreclaimable:7337 mapped:2285 shmem:22816 pagetables:84 bounce:0 free:828607 free_pcp:1652 free_cma:0 [ 741.262155] Node 0 active_anon:58048kB inactive_anon:33808kB active_file:185436kB inactive_file:270184kB unevictable:8888kB isolated(anon):0kB isolated(file):0kB mapped:9140kB dirty:4kB writeback:0kB shmem:91264kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 741.263286] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 741.264452] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 741.265613] Node 0 DMA32 free:2518600kB min:5192kB low:7780kB high:10368kB active_anon:0kB inactive_anon:0kB active_file:25636kB inactive_file:67764kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:48kB pagetables:0kB bounce:0kB free_pcp:3528kB local_pcp:692kB free_cma:0kB [ 741.266856] lowmem_reserve[]: 0 0 1337 1337 1337 [ 741.268095] Node 0 Normal free:779924kB min:2744kB low:4112kB high:5480kB active_anon:58048kB inactive_anon:33808kB active_file:159800kB inactive_file:202420kB unevictable:8888kB writepending:4kB present:1437436kB managed:1369340kB mlocked:8888kB kernel_stack:2208kB pagetables:336kB bounce:0kB free_pcp:3080kB local_pcp:112kB free_cma:0kB [ 741.269420] lowmem_reserve[]: 0 0 0 0 0 [ 741.270736] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 741.272086] Node 0 DMA32: 740*4kB (UME) 599*8kB (UME) 384*16kB (UME) 226*32kB (UME) 135*64kB (UME) 70*128kB (ME) 51*256kB (UM) 40*512kB (ME) 27*1024kB (UM) 13*2048kB (UM) 584*4096kB (M) = 2518600kB [ 741.273452] Node 0 Normal: 5481*4kB (UME) 3834*8kB (UME) 2060*16kB (UME) 2465*32kB (UME) 1597*64kB (UME) 792*128kB (UME) 341*256kB (UME) 134*512kB (UME) 46*1024kB (UME) 24*2048kB (UME) 39*4096kB (ME) = 779924kB [ 741.274831] 138677 total pagecache pages [ 741.276198] 0 pages in swap cache [ 741.277600] Swap cache stats: add 0, delete 0, find 0/0 [ 741.278982] Free swap = 0kB [ 741.280360] Total swap = 0kB [ 741.281734] 1048575 pages RAM [ 741.283096] 0 pages HighMem/MovableOnly [ 741.284459] 47804 pages reserved [ 741.285831] 0 pages cma reserved [ 741.287197] 0 pages hwpoisoned [ 741.288575] + echo w [ 741.289957] sysrq: SysRq : Show Blocked State [ 741.291309] task PC stack pid father [ 741.292668] + echo 9 [ 741.293996] sysrq: SysRq : Changing Loglevel [ 741.295321] sysrq: Loglevel set to 9 [ 741.296669] + echo -n Before: [ 741.297997] Before: [ 741.298003] + cat /sys/block/sda/device/queue_depth [ 741.301793] 31 [ 741.303332] + echo -n After: [ 741.304649] After: [ 741.304655] + cat /sys/block/sda/device/queue_depth [ 741.308368] 31 [ 741.309901] + hdparm -W /dev/sda [ 741.315651] /dev/sda: write-caching = 1 (on) [ 741.319790] + hdparm -C /dev/sda [ 741.322179] /dev/sda: drive state is: active/idle [ 741.326231] + hdparm -W /dev/sdb [ 741.328627] /dev/sdb: No such file or directory [ 741.330108] + hdparm -C /dev/sdb [ 741.332491] /dev/sdb: No such file or directory [ 741.334037] + echo 'sync first' [ 741.335346] sync first [ 741.336657] + sync [ 741.339690] real 0m0.003s user 0m0.001s [ 741.343517] sys 0m0.002s [ 741.344840] + echo Before: [ 741.346154] Before: [ 741.347440] + echo m [ 741.348731] sysrq: SysRq : Show Memory [ 741.350051] Mem-Info: [ 741.351332] active_anon:14513 inactive_anon:8452 isolated_anon:0 active_file:46411 inactive_file:67558 isolated_file:0 unevictable:2222 dirty:0 writeback:0 unstable:0 slab_reclaimable:8058 slab_unreclaimable:7347 mapped:2285 shmem:22816 pagetables:84 bounce:0 free:828663 free_pcp:1523 free_cma:0 [ 741.358933] Node 0 active_anon:58052kB inactive_anon:33808kB active_file:185644kB inactive_file:270232kB unevictable:8888kB isolated(anon):0kB isolated(file):0kB mapped:9140kB dirty:0kB writeback:0kB shmem:91264kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 741.360254] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 741.361612] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 741.362967] Node 0 DMA32 free:2518600kB min:5192kB low:7780kB high:10368kB active_anon:0kB inactive_anon:0kB active_file:25636kB inactive_file:67764kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:48kB pagetables:0kB bounce:0kB free_pcp:3528kB local_pcp:484kB free_cma:0kB [ 741.364390] lowmem_reserve[]: 0 0 1337 1337 1337 [ 741.365817] Node 0 Normal free:780148kB min:2744kB low:4112kB high:5480kB active_anon:58052kB inactive_anon:33808kB active_file:160008kB inactive_file:202468kB unevictable:8888kB writepending:0kB present:1437436kB managed:1369340kB mlocked:8888kB kernel_stack:2208kB pagetables:336kB bounce:0kB free_pcp:2564kB local_pcp:224kB free_cma:0kB [ 741.367315] lowmem_reserve[]: 0 0 0 0 0 [ 741.368799] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 741.370336] Node 0 DMA32: 740*4kB (UME) 599*8kB (UME) 384*16kB (UME) 226*32kB (UME) 135*64kB (UME) 70*128kB (ME) 51*256kB (UM) 40*512kB (ME) 27*1024kB (UM) 13*2048kB (UM) 584*4096kB (M) = 2518600kB [ 741.371886] Node 0 Normal: 5451*4kB (UME) 3853*8kB (UME) 2058*16kB (UME) 2468*32kB (UME) 1599*64kB (UME) 792*128kB (UME) 341*256kB (UME) 134*512kB (UME) 46*1024kB (UME) 24*2048kB (UME) 39*4096kB (ME) = 780148kB [ 741.373457] 138748 total pagecache pages [ 741.375012] 0 pages in swap cache [ 741.376565] Swap cache stats: add 0, delete 0, find 0/0 [ 741.378134] Free swap = 0kB [ 741.379688] Total swap = 0kB [ 741.381248] 1048575 pages RAM [ 741.382795] 0 pages HighMem/MovableOnly [ 741.384352] 47804 pages reserved [ 741.385905] 0 pages cma reserved [ 741.387449] 0 pages hwpoisoned [ 741.389018] + echo 'manually Freeing pagecache pages' [ 741.390597] manually Freeing pagecache pages [ 741.392172] + echo --------------------------------------------------- [ 741.393727] --------------------------------------------------- [ 741.395296] + echo 3 [ 741.431804] debug.sh (6397): drop_caches: 3 [ 741.433422] real 0m0.038s user 0m0.000s [ 741.438077] sys 0m0.038s [ 741.440059] + echo --------------------------------------------------- [ 741.441620] --------------------------------------------------- [ 741.443977] + echo 'After :' [ 741.445544] After : [ 741.447121] + echo m [ 741.448704] sysrq: SysRq : Show Memory [ 741.450272] Mem-Info: [ 741.451839] active_anon:157 inactive_anon:22808 isolated_anon:0 active_file:309 inactive_file:144 isolated_file:0 unevictable:2222 dirty:0 writeback:0 unstable:0 slab_reclaimable:4918 slab_unreclaimable:7155 mapped:2285 shmem:22816 pagetables:84 bounce:0 free:946124 free_pcp:1692 free_cma:0 [ 741.461163] Node 0 active_anon:628kB inactive_anon:91232kB active_file:1236kB inactive_file:576kB unevictable:8888kB isolated(anon):0kB isolated(file):0kB mapped:9140kB dirty:0kB writeback:0kB shmem:91264kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 741.462776] Node 0 DMA free:15904kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 741.464429] lowmem_reserve[]: 0 2556 3893 3893 3893 [ 741.466082] Node 0 DMA32 free:2613248kB min:5192kB low:7780kB high:10368kB active_anon:0kB inactive_anon:0kB active_file:32kB inactive_file:128kB unevictable:0kB writepending:0kB present:2740876kB managed:2617840kB mlocked:0kB kernel_stack:48kB pagetables:0kB bounce:0kB free_pcp:3704kB local_pcp:660kB free_cma:0kB [ 741.467825] lowmem_reserve[]: 0 0 1337 1337 1337 [ 741.469552] Node 0 Normal free:1155344kB min:2744kB low:4112kB high:5480kB active_anon:640kB inactive_anon:91220kB active_file:1288kB inactive_file:596kB unevictable:8888kB writepending:0kB present:1437436kB managed:1369340kB mlocked:8888kB kernel_stack:2208kB pagetables:336kB bounce:0kB free_pcp:3064kB local_pcp:724kB free_cma:0kB [ 741.471368] lowmem_reserve[]: 0 0 0 0 0 [ 741.473167] Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB [ 741.475026] Node 0 DMA32: 314*4kB (UME) 279*8kB (UME) 228*16kB (UME) 163*32kB (UME) 115*64kB (UME) 48*128kB (UME) 25*256kB (UME) 23*512kB (ME) 25*1024kB (UM) 16*2048kB (UM) 613*4096kB (M) = 2613248kB [ 741.476888] Node 0 Normal: 6172*4kB (UME) 5088*8kB (UME) 3869*16kB (UME) 3472*32kB (UME) 2404*64kB (UME) 1326*128kB (UME) 592*256kB (UME) 239*512kB (UME) 80*1024kB (UME) 28*2048kB (UME) 44*4096kB (ME) = 1155392kB [ 741.478777] 25232 total pagecache pages [ 741.480656] 0 pages in swap cache [ 741.482535] Swap cache stats: add 0, delete 0, find 0/0 [ 741.484428] Free swap = 0kB [ 741.486307] Total swap = 0kB [ 741.488195] 1048575 pages RAM [ 741.490028] 0 pages HighMem/MovableOnly [ 741.491822] 47804 pages reserved [ 741.493576] 0 pages cma reserved [ 741.495276] 0 pages hwpoisoned [ 741.497087] + echo 'end of log' [ 741.498803] end of log [ 741.500504] + logfile=/dmesg_shutdown.log [ 741.503686] ++ TMPDIR= [ 741.503965] ++ /usr/bin/cut -f2 -d/ [ 741.507351] ++ /usr/bin/mktemp --dry-run '--tmpdir='\''' -t --quiet XXXXXXXXXXXXXX [ 741.520404] + rnd_log_tag=yEfaPnLv1JPr21 [ 741.522511] + echo '//--- /usr/lib/systemd/system-shutdown/debug.sh started execution on: '\''Sun Sep 2 20:08:55 CEST 2018'\'' tag:yEfaPnLv1JPr21' [ 741.525131] + dmesg //--- /usr/lib/systemd/system-shutdown/debug.sh generated '/dmesg_shutdown.log' on: 'Sun Sep 2 20:08:55 CEST 2018' tag:yEfaPnLv1JPr21 ```

Ok, see if https://github.com/QubesOS/qubes-core-admin/pull/227 helps.

I wonder why device-mapper still complains, now when all domains are properly terminated, DM cleanup should also work. Maybe some other process keep it busy? Can you list processes at that time? And domains with xl list (maybe some is left there anyway?).

Can you list processes at that time? And domains with xl list (maybe some is left there anyway?).

I did it like this:

[Unit]
Description=Qubes Dom0 startup setup
After=qubes-db-dom0.service libvirtd.service xenconsoled.service qubesd.service qubes-qmemman.service
# Cover legacy init.d script

[Service]
Type=oneshot
StandardOutput=syslog
RemainAfterExit=yes
# Needed to avoid rebooting before all VMs have shut down.
TimeoutStopSec=180
ExecStart=/usr/lib/qubes/startup-misc.sh
ExecStop=-/usr/bin/pkill qubes-guid
ExecStop=/usr/bin/qvm-shutdown --verbose --all --wait
# QubesDB daemons stop after 60s timeout in worst case; speed it up, since no
# VMs are running now
ExecStop=-/usr/bin/pkill qubesdb-daemon
ExecStopPost=-/usr/bin/ps axuw
ExecStopPost=-/usr/bin/xl list

[Install]
WantedBy=multi-user.target
Also=qubes-meminfo-writer-dom0.service qubes-qmemman.service
Alias=qubes_core.service

I didn't know how else to do it (and not risk bricking my system).

I can't figure out why the outputs from ps, xl and others are intermingled - I doubt they are all executed at the same time (I mean, I hope they aren't). I firstly tried with just ExecStop instead of ExecStopPost, but got the same intermingled output.

dmesg of when the boot is fast(6 sec?) because I manually shutdown every VM prior to going for a Restart

``` [ 594.520909] systemd-logind[1893]: System is rebooting. [ 594.525391] systemd[1]: Stopping User Manager for UID 1000... [ 594.525507] systemd[1]: Stopping Accounts Service... [ 594.525515] systemd[1]: Stopped target Sound Card. [ 594.525535] systemd[1]: Stopped target Graphical Interface. [ 594.525639] systemd[1]: Stopping Light Display Manager... [ 594.525737] systemd[1]: Stopping Authorization Manager... [ 594.525813] systemd[1]: Stopping Daemon for power management... [ 594.525820] systemd[1]: Stopped target Multi-User System. [ 594.526102] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 594.526175] systemd[1]: Stopping Command Scheduler... [ 594.526182] systemd[1]: Stopped target Timers. [ 594.526200] systemd[1]: Stopped Discard unused blocks once a week. [ 594.526216] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 594.526318] systemd[1]: Removed slice system-getty.slice. [ 594.526447] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 594.527359] systemd[1]: Stopping Session 2 of user ctor. [ 594.527369] systemd[1]: Stopped target Login Prompts. [ 594.527481] systemd[1]: Stopping Serial Getty on hvc0... [ 594.529131] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 594.530901] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 594.537251] systemd[1]: Stopped Daemon for power management. [ 594.537646] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 594.543186] systemd[1]: Stopped Accounts Service. [ 594.543476] systemd[1]: Stopped Command Scheduler. [ 594.543991] systemd[1]: Stopped Serial Getty on hvc0. [ 594.544389] crond[3228]: (CRON) INFO (Shutting down) [ 594.545204] systemd[1]: Stopped Authorization Manager. [ 594.545707] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 594.546937] lightdm[3229]: Error opening audit socket: Protocol not supported [ 594.549008] lightdm[3313]: pam_unix(lightdm:session): session closed for user ctor [ 594.577038] alsactl[1892]: alsactl daemon stopped [ 594.577543] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 594.584360] qubes.WindowIconUpdater-sys-net[3553]: Traceback (most recent call last): [ 594.586927] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 594.587140] qubes.WindowIconUpdater-sys-net[3553]: return f(*args) [ 594.587326] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 594.587507] qubes.WindowIconUpdater-sys-net[3553]: self.invalid() [ 594.587674] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 594.587946] qubes.WindowIconUpdater-sys-net[3553]: raise ConnectionException(err) [ 594.588120] qubes.WindowIconUpdater-sys-net[3553]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 594.588309] qubes.WindowIconUpdater-sys-net[3553]: [ 594.588470] qubes.WindowIconUpdater-sys-net[3553]: During handling of the above exception, another exception occurred: [ 594.588637] qubes.WindowIconUpdater-sys-net[3553]: [ 594.588876] qubes.WindowIconUpdater-sys-net[3553]: Traceback (most recent call last): [ 594.589041] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 594.589256] qubes.WindowIconUpdater-sys-net[3553]: rcvd.handle_input() [ 594.589452] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 594.589636] qubes.WindowIconUpdater-sys-net[3553]: self.handle_events() [ 594.589876] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 594.590048] qubes.WindowIconUpdater-sys-net[3553]: for ev in iter(self.conn.poll_for_event, None): [ 594.590212] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 594.590375] qubes.WindowIconUpdater-sys-net[3553]: self.invalid() [ 594.590535] qubes.WindowIconUpdater-sys-net[3553]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 594.591201] qubes.WindowIconUpdater-sys-net[3553]: raise ConnectionException(err) [ 594.591419] qubes.WindowIconUpdater-sys-net[3553]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 594.607583] qmemman.daemon.algo[1890]: balance_when_enough_memory(xen_free_memory=50400022, total_mem_pref=1234648268.8000002, total_available_memory=32242421054.2) [ 594.692993] systemd[3326]: Received SIGRTMIN+24 from PID 6322 (kill). [ 594.694976] systemd[1]: Stopped User Manager for UID 1000. [ 594.723395] systemd[1]: Stopped Session 2 of user ctor. [ 594.724142] systemd[1]: Removed slice User Slice of ctor. [ 594.724252] systemd[1]: Stopping Login Service... [ 594.758617] qmemman.daemon.algo[1890]: balance_when_enough_memory(xen_free_memory=50400022, total_mem_pref=1177268224.0, total_available_memory=32299801099.0) [ 594.784916] systemd[1]: Stopped Light Display Manager. [ 594.786507] systemd[1]: Starting Show Plymouth Reboot Screen... [ 594.787831] systemd[1]: Stopping Permit User Sessions... [ 594.792452] systemd[1]: Stopped Permit User Sessions. [ 594.792635] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 594.792679] systemd[1]: Stopped Start Qubes VM sys-net. [ 594.792824] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 594.792972] systemd[1]: Stopping Qubes memory information reporter... [ 594.793502] systemd[1]: Stopped Qubes memory information reporter. [ 594.797104] systemd[1]: Stopping Qubes Dom0 startup setup... [ 594.808341] systemd[1]: Started Show Plymouth Reboot Screen. [ 594.820062] systemd[1]: Stopped Login Service. [ 594.820629] systemd[1]: Stopped target User and Group Name Lookups. [ 594.876480] qvm-shutdown[6341]: 2018-09-03 00:25:37,378 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector [ 594.922723] qubesdb-daemon[1895]: terminating [ 594.924620] systemd[1]: Stopped Qubes DB agent. [ 594.930566] ps[6349]: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND [ 594.930796] ps[6349]: root 1 0.0 0.1 220540 7460 ? Ss 00:15 0:00 /usr/lib/systemd/systemd --switched-root --system --deserialize 23 [ 594.930969] ps[6349]: root 2 0.0 0.0 0 0 ? S 00:15 0:00 [kthreadd] [ 594.931118] ps[6349]: root 4 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/0:0H] [ 594.931267] ps[6349]: root 6 0.0 0.0 0 0 ? I< 00:15 0:00 [mm_percpu_wq] [ 594.931415] ps[6349]: root 7 0.0 0.0 0 0 ? S 00:15 0:00 [ksoftirqd/0] [ 594.931560] ps[6349]: root 8 0.0 0.0 0 0 ? I 00:15 0:00 [rcu_sched] [ 594.931724] ps[6349]: root 9 0.0 0.0 0 0 ? I 00:15 0:00 [rcu_bh] [ 594.931873] ps[6349]: root 10 0.0 0.0 0 0 ? S 00:15 0:00 [migration/0] [ 594.932021] ps[6349]: root 11 0.0 0.0 0 0 ? S 00:15 0:00 [watchdog/0] [ 594.932167] ps[6349]: root 12 0.0 0.0 0 0 ? S 00:15 0:00 [cpuhp/0] [ 594.932308] ps[6349]: root 13 0.0 0.0 0 0 ? S 00:15 0:00 [cpuhp/1] [ 594.932454] ps[6349]: root 14 0.0 0.0 0 0 ? S 00:15 0:00 [watchdog/1] [ 594.932599] ps[6349]: root 15 0.0 0.0 0 0 ? S 00:15 0:00 [migration/1] [ 594.932754] ps[6349]: root 16 0.0 0.0 0 0 ? S 00:15 0:00 [ksoftirqd/1] [ 594.932904] ps[6349]: root 18 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/1:0H] [ 594.933049] ps[6349]: root 19 0.0 0.0 0 0 ? S 00:15 0:00 [cpuhp/2] [ 594.933194] ps[6349]: root 20 0.0 0.0 0 0 ? S 00:15 0:00 [watchdog/2] [ 594.933340] ps[6349]: root 21 0.0 0.0 0 0 ? S 00:15 0:00 [migration/2] [ 594.933485] ps[6349]: root 22 0.0 0.0 0 0 ? S 00:15 0:00 [ksoftirqd/2] [ 594.933630] ps[6349]: root 23 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/2:0] [ 594.933788] ps[6349]: root 24 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/2:0H] [ 594.933939] ps[6349]: root 25 0.0 0.0 0 0 ? S 00:15 0:00 [cpuhp/3] [ 594.934080] ps[6349]: root 26 0.0 0.0 0 0 ? S 00:15 0:00 [watchdog/3] [ 594.934226] ps[6349]: root 27 0.0 0.0 0 0 ? S 00:15 0:00 [migration/3] [ 594.934640] ps[6349]: root 28 0.0 0.0 0 0 ? S 00:15 0:00 [ksoftirqd/3] [ 594.934802] ps[6349]: root 30 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/3:0H] [ 594.934948] ps[6349]: root 31 0.0 0.0 0 0 ? S 00:15 0:00 [cpuhp/4] [ 594.935091] ps[6349]: root 32 0.0 0.0 0 0 ? S 00:15 0:00 [watchdog/4] [ 594.935246] ps[6349]: root 33 0.0 0.0 0 0 ? S 00:15 0:00 [migration/4] [ 594.935394] ps[6349]: root 34 0.0 0.0 0 0 ? S 00:15 0:00 [ksoftirqd/4] [ 594.935542] ps[6349]: root 36 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/4:0H] [ 594.935697] ps[6349]: root 37 0.0 0.0 0 0 ? S 00:15 0:00 [cpuhp/5] [ 594.935847] ps[6349]: root 38 0.0 0.0 0 0 ? S 00:15 0:00 [watchdog/5] [ 594.935993] ps[6349]: root 39 0.0 0.0 0 0 ? S 00:15 0:00 [migration/5] [ 594.936138] ps[6349]: root 40 0.0 0.0 0 0 ? S 00:15 0:00 [ksoftirqd/5] [ 594.936282] ps[6349]: root 42 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/5:0H] [ 594.936469] ps[6349]: root 43 0.0 0.0 0 0 ? S 00:15 0:00 [kdevtmpfs] [ 594.936613] ps[6349]: root 44 0.0 0.0 0 0 ? I< 00:15 0:00 [netns] [ 594.936793] ps[6349]: root 45 0.0 0.0 0 0 ? S 00:15 0:00 [xenbus] [ 594.936936] ps[6349]: root 46 0.0 0.0 0 0 ? S 00:15 0:00 [xenwatch] [ 594.937083] ps[6349]: root 47 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/0:1] [ 594.937229] ps[6349]: root 48 0.0 0.0 0 0 ? S 00:15 0:00 [oom_reaper] [ 594.937381] ps[6349]: root 49 0.0 0.0 0 0 ? I< 00:15 0:00 [writeback] [ 594.937547] ps[6349]: root 50 0.0 0.0 0 0 ? S 00:15 0:00 [kcompactd0] [ 594.937730] ps[6349]: root 51 0.0 0.0 0 0 ? SN 00:15 0:00 [ksmd] [ 594.937878] ps[6349]: root 52 0.0 0.0 0 0 ? I< 00:15 0:00 [crypto] [ 594.938014] ps[6349]: root 53 0.0 0.0 0 0 ? I< 00:15 0:00 [kintegrityd] [ 594.938109] ps[6349]: root 54 0.0 0.0 0 0 ? I< 00:15 0:00 [kblockd] [ 594.938222] ps[6349]: root 57 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/4:1] [ 594.938316] ps[6349]: root 58 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/5:1] [ 594.938767] ps[6349]: root 60 0.0 0.0 0 0 ? I< 00:15 0:00 [ata_sff] [ 594.938884] ps[6349]: root 61 0.0 0.0 0 0 ? I< 00:15 0:00 [md] [ 594.939038] ps[6349]: root 62 0.0 0.0 0 0 ? I< 00:15 0:00 [edac-poller] [ 594.939143] ps[6349]: root 63 0.0 0.0 0 0 ? I< 00:15 0:00 [devfreq_wq] [ 594.939260] ps[6349]: root 64 0.0 0.0 0 0 ? I< 00:15 0:00 [watchdogd] [ 594.939372] ps[6349]: root 66 0.0 0.0 0 0 ? S 00:15 0:00 [kswapd0] [ 594.939513] ps[6349]: root 115 0.0 0.0 0 0 ? I< 00:15 0:00 [kthrotld] [ 594.939625] ps[6349]: root 116 0.0 0.0 0 0 ? I< 00:15 0:00 [acpi_thermal_pm] [ 594.939742] ps[6349]: root 117 0.0 0.0 0 0 ? S 00:15 0:00 [khvcd] [ 594.939847] ps[6349]: root 118 0.0 0.0 0 0 ? S 00:15 0:00 [scsi_eh_0] [ 594.939952] ps[6349]: root 119 0.0 0.0 0 0 ? I< 00:15 0:00 [scsi_tmf_0] [ 594.940060] ps[6349]: root 120 0.0 0.0 0 0 ? S 00:15 0:00 [scsi_eh_1] [ 594.940165] ps[6349]: root 121 0.0 0.0 0 0 ? I< 00:15 0:00 [scsi_tmf_1] [ 594.940269] ps[6349]: root 122 0.0 0.0 0 0 ? S 00:15 0:00 [scsi_eh_2] [ 594.940378] ps[6349]: root 123 0.0 0.0 0 0 ? I< 00:15 0:00 [scsi_tmf_2] [ 594.940482] ps[6349]: root 124 0.0 0.0 0 0 ? S 00:15 0:00 [scsi_eh_3] [ 594.940587] ps[6349]: root 125 0.0 0.0 0 0 ? I< 00:15 0:00 [scsi_tmf_3] [ 594.940724] ps[6349]: root 126 0.0 0.0 0 0 ? S 00:15 0:00 [scsi_eh_4] [ 594.940829] ps[6349]: root 127 0.0 0.0 0 0 ? I< 00:15 0:00 [scsi_tmf_4] [ 594.940935] ps[6349]: root 128 0.0 0.0 0 0 ? S 00:15 0:00 [scsi_eh_5] [ 594.941041] ps[6349]: root 129 0.0 0.0 0 0 ? I< 00:15 0:00 [scsi_tmf_5] [ 594.942123] ps[6349]: root 131 0.1 0.0 0 0 ? I 00:15 0:00 [kworker/u12:3] [ 594.943160] ps[6349]: root 132 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/u12:4] [ 594.943953] systemd[1]: Stopped Qubes Dom0 startup setup. [ 594.944126] systemd[1]: Stopping Virtualization daemon... [ 594.944229] systemd[1]: Stopping Qubes memory management daemon... [ 594.944301] systemd[1]: Stopping Qubes OS daemon... [ 594.944387] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 594.945293] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 594.947049] systemd[1]: Stopped Qubes memory management daemon. [ 594.952004] ps[6349]: root 133 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/u12:5] [ 594.958747] systemd[1]: Stopped Virtualization daemon. [ 594.959893] systemd[1]: Stopping D-Bus System Message Bus... [ 594.960995] systemd[1]: Stopping The Xen xenstore... [ 594.962044] systemd[1]: Stopped target Remote File Systems. [ 594.963287] systemd[1]: Stopped The Xen xenstore. [ 594.964404] ps[6349]: root 134 0.0 0.0 0 0 ? I< 00:15 0:00 [dm_bufio_cache] [ 594.964577] systemd[1]: Stopped D-Bus System Message Bus. [ 594.964878] systemd[1]: Failed to propagate agent release message: Connection reset by peer [ 594.965074] systemd[1]: Failed to propagate agent release message: Transport endpoint is not connected [ 594.966405] systemd[1]: Unmounting mount xenstore file system... [ 594.969359] ps[6349]: root 135 0.0 0.0 0 0 ? I< 00:15 0:00 [kstrp] [ 594.970958] xl[6352]: Name ID Mem VCPUs State Time(s) [ 594.972034] xl[6352]: Domain-0 0 4095 6 r----- 119.7 [ 594.973155] ps[6349]: root 230 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/1:2] [ 594.974225] ps[6349]: root 264 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/5:2] [ 594.975260] ps[6349]: root 267 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/4:2] [ 594.976259] systemd[1]: Unmounted mount xenstore file system. [ 594.977286] ps[6349]: root 399 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/0:1H] [ 594.978336] ps[6349]: root 512 0.0 0.0 0 0 ? S 00:15 0:00 [i915/signal:0] [ 594.979407] ps[6349]: root 513 0.0 0.0 0 0 ? S 00:15 0:00 [i915/signal:1] [ 594.980432] ps[6349]: root 514 0.0 0.0 0 0 ? S 00:15 0:00 [i915/signal:2] [ 594.981453] ps[6349]: root 515 0.0 0.0 0 0 ? S 00:15 0:00 [i915/signal:4] [ 594.982465] ps[6349]: root 516 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/3:2] [ 594.983477] ps[6349]: root 564 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/5:1H] [ 594.984455] ps[6349]: root 571 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 594.985450] ps[6349]: root 575 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 594.986432] ps[6349]: root 576 0.0 0.0 0 0 ? I< 00:15 0:00 [kcryptd_io] [ 594.987416] ps[6349]: root 577 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/u13:0] [ 594.988378] ps[6349]: root 578 0.0 0.0 0 0 ? I< 00:15 0:00 [kcryptd] [ 594.989341] ps[6349]: root 579 0.0 0.0 0 0 ? S 00:15 0:00 [dmcrypt_write] [ 594.990296] ps[6349]: root 580 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 594.991251] ps[6349]: root 582 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/u13:1] [ 594.992198] ps[6349]: root 646 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 594.993133] ps[6349]: root 647 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 594.994276] ps[6349]: root 648 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 594.995205] ps[6349]: root 649 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 594.996115] ps[6349]: root 662 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/u13:2] [ 594.996477] systemd[1]: Stopped Qubes OS daemon. [ 594.996564] systemd[1]: Stopped target Basic System. [ 594.996667] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 594.996680] systemd[1]: Stopped target Sockets. [ 594.996719] systemd[1]: Closed Virtual machine log manager socket. [ 594.996748] systemd[1]: Closed Virtual machine lock manager socket. [ 594.996774] systemd[1]: Closed D-Bus System Message Bus Socket. [ 594.996785] systemd[1]: Stopped target Slices. [ 594.997183] systemd[1]: Removed slice User and Session Slice. [ 594.997200] systemd[1]: Stopped target Paths. [ 594.997211] systemd[1]: Stopped target System Initialization. [ 594.997497] systemd[1]: Stopped Load legacy module configuration. [ 594.998695] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 594.998721] systemd[1]: Stopped target Encrypted Volumes. [ 594.998791] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 595.000242] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 595.001490] systemd[1]: Stopping Load/Save Random Seed... [ 595.002264] systemd[1]: Stopped Setup Virtual Console. [ 595.002642] systemd[1]: Stopped Apply Kernel Variables. [ 595.004095] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 595.006445] systemd[1]: Stopped Load/Save Random Seed. [ 595.012573] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 595.012901] systemd[1]: Stopped Create Volatile Files and Directories. [ 595.016178] ps[6349]: root 663 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/u13:3] [ 595.017096] ps[6349]: root 666 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.017988] ps[6349]: root 667 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.019541] libvirtd[1923]: S3 disabled [ 595.020451] libvirtd[1923]: S4 disabled [ 595.021341] libvirtd[1923]: S3 disabled [ 595.022217] libvirtd[1923]: S4 disabled [ 595.023160] qubesd[1897]: caught SIGTERM, exiting [ 595.024179] ps[6349]: root 670 0.0 0.0 0 0 ? I< 00:15 0:00 [kcopyd] [ 595.024949] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 595.025109] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 595.026846] ps[6349]: root 671 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.027789] ps[6349]: root 672 0.0 0.0 0 0 ? I< 00:15 0:00 [dm-thin] [ 595.028723] ps[6349]: root 673 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.029668] ps[6349]: root 674 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.030593] ps[6349]: root 680 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.031593] ps[6349]: root 700 0.0 0.0 0 0 ? S 00:15 0:00 [jbd2/dm-4-8] [ 595.032519] ps[6349]: root 701 0.0 0.0 0 0 ? I< 00:15 0:00 [ext4-rsv-conver] [ 595.033441] ps[6349]: root 705 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/0:2] [ 595.034348] ps[6349]: root 769 0.0 0.3 78296 15220 ? Rs 00:15 0:00 /usr/lib/systemd/systemd-journald [ 595.035288] ps[6349]: root 776 0.0 0.0 200292 2600 ? Ssl 00:15 0:00 /usr/sbin/lvmetad -f -t 3600 [ 595.036233] ps[6349]: root 782 0.0 0.5 120812 20524 ? SLsl 00:15 0:00 /usr/sbin/dmeventd -f [ 595.037163] ps[6349]: root 801 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/4:1H] [ 595.038093] ps[6349]: root 812 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/3:1H] [ 595.039024] ps[6349]: root 815 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/2:1H] [ 595.039944] ps[6349]: root 818 0.0 0.1 45208 4528 ? Ss 00:15 0:00 /usr/lib/systemd/systemd-udevd [ 595.040884] ps[6349]: root 831 0.0 0.0 0 0 ? I< 00:15 0:00 [kworker/1:1H] [ 595.041823] ps[6349]: root 954 0.0 0.0 0 0 ? S 00:15 0:00 [irq/181-mei_me] [ 595.042776] ps[6349]: root 1158 0.0 0.0 0 0 ? I 00:15 0:00 [kworker/4:3] [ 595.043733] ps[6349]: root 1452 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.044683] ps[6349]: root 1453 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.045633] ps[6349]: root 1454 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.046608] ps[6349]: root 1464 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.047566] ps[6349]: root 1466 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.048525] ps[6349]: root 1475 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.049927] ps[6349]: root 1476 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.050875] ps[6349]: root 1482 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.051842] ps[6349]: root 1484 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.052791] ps[6349]: root 1493 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.053735] ps[6349]: root 1496 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.054712] ps[6349]: root 1502 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.055682] ps[6349]: root 1503 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.056628] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 595.056671] ps[6349]: root 1518 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.058488] ps[6349]: root 1520 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.058496] systemd[1]: Stopped target Local File Systems. [ 595.059626] systemd[1]: Unmounting /run/user/1000... [ 595.060816] systemd[1]: Unmounting Temporary Directory... [ 595.061298] systemd[1]: Stopped Configure read-only root support. [ 595.062476] systemd[1]: Unmounting /boot/efi... [ 595.063681] systemd[1]: Unmounting Configuration File System... [ 595.065306] ps[6349]: root 1526 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.066433] ps[6349]: root 1529 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.067413] ps[6349]: root 1539 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.068397] ps[6349]: root 1542 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.069432] ps[6349]: root 1547 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.070423] ps[6349]: root 1548 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.071410] ps[6349]: root 1556 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.072404] ps[6349]: root 1560 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.073194] systemd[1]: Unmounted /run/user/1000. [ 595.073367] systemd[1]: Unmounted Temporary Directory. [ 595.073509] systemd[1]: Stopped target Swap. [ 595.075113] systemd[1]: Unmounted Configuration File System. [ 595.075442] systemd[1]: Stopped Load Kernel Modules. [ 595.078232] ps[6349]: root 1568 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.079256] ps[6349]: root 1571 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.080267] ps[6349]: root 1581 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.080798] systemd[1]: Unmounted /boot/efi. [ 595.080850] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 595.080954] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 595.080964] systemd[1]: Stopped target Local File Systems (Pre). [ 595.082173] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 595.082605] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 595.082919] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 595.087982] ps[6349]: root 1582 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.089022] ps[6349]: root 1588 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.090062] ps[6349]: root 1590 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.091088] ps[6349]: root 1599 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.092107] ps[6349]: root 1601 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.093168] ps[6349]: root 1608 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.094165] ps[6349]: root 1611 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.095805] ps[6349]: root 1618 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.096806] ps[6349]: root 1621 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.097785] ps[6349]: root 1627 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.098806] ps[6349]: root 1630 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.099743] ps[6349]: root 1639 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.100648] ps[6349]: root 1640 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.101626] ps[6349]: root 1649 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.102578] ps[6349]: root 1653 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.103528] ps[6349]: root 1658 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.104519] ps[6349]: root 1659 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.105475] ps[6349]: root 1669 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.106394] ps[6349]: root 1670 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.107316] ps[6349]: root 1677 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.108263] ps[6349]: root 1678 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.109203] ps[6349]: root 1685 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.110142] ps[6349]: root 1687 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.111060] ps[6349]: root 1697 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.111998] ps[6349]: root 1699 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.112904] ps[6349]: root 1708 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.113805] ps[6349]: root 1711 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.114710] ps[6349]: root 1718 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.115619] ps[6349]: root 1723 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.116647] ps[6349]: root 1727 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.117365] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 595.117544] systemd[1]: Stopping LVM2 metadata daemon... [ 595.118437] systemd[1]: Stopped LVM2 metadata daemon. [ 595.120326] ps[6349]: root 1733 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.121351] ps[6349]: root 1737 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.122316] ps[6349]: root 1739 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.123267] ps[6349]: root 1741 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.124703] ps[6349]: root 1743 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.125647] ps[6349]: root 1746 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.126610] ps[6349]: root 1747 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.127534] ps[6349]: root 1751 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.128492] ps[6349]: root 1752 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.129389] ps[6349]: root 1757 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.130313] ps[6349]: root 1768 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.131208] ps[6349]: root 1772 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.132094] ps[6349]: root 1774 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.132979] ps[6349]: root 1778 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.133847] ps[6349]: root 1780 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.134744] ps[6349]: root 1781 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.135596] ps[6349]: root 1783 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.136516] ps[6349]: root 1792 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.137385] ps[6349]: root 1795 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.138276] ps[6349]: root 1802 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.139165] ps[6349]: root 1805 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.140059] ps[6349]: root 1809 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.140964] ps[6349]: dbus 1867 0.0 0.1 46756 4600 ? Ss 00:15 0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only [ 595.141958] ps[6349]: root 1890 0.0 1.0 429704 41120 ? SLsl 00:15 0:00 /usr/bin/python3 /usr/bin/qmemmand [ 595.142867] ps[6349]: root 1897 0.4 1.3 704228 53872 ? SLsl 00:15 0:02 /usr/bin/python3 /usr/bin/qubesd [ 595.143683] ps[6349]: root 1914 0.1 0.0 47732 3424 ? SL 00:15 0:01 /usr/sbin/xenstored --pid-file /var/run/xen/xenstored.pid [ 595.144589] ps[6349]: root 1923 0.3 1.5 1261280 61340 ? SLsl 00:15 0:01 /usr/sbin/libvirtd [ 595.145787] dmeventd[782]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 595.146926] ps[6349]: root 1932 0.0 0.0 119404 3604 ? SLsl 00:15 0:00 /usr/sbin/xenconsoled -i --log=all --log-dir=/var/log/xen/console [ 595.147945] ps[6349]: root 2711 0.0 0.0 0 0 ? I< 00:15 0:00 [kdmflush] [ 595.148883] ps[6349]: root 2714 0.0 0.0 0 0 ? I< 00:15 0:00 [bioset] [ 595.149789] ps[6349]: root 3090 0.0 0.0 0 0 ? I< 00:16 0:00 [kdmflush] [ 595.150626] ps[6349]: root 3093 0.0 0.0 0 0 ? I< 00:16 0:00 [bioset] [ 595.151579] ps[6349]: root 3337 0.0 0.0 0 0 ? I 00:16 0:00 [kworker/3:3] [ 595.152488] ps[6349]: root 3663 0.0 0.0 0 0 ? I 00:16 0:00 [kworker/2:3] [ 595.153398] ps[6349]: root 3664 0.0 0.0 0 0 ? I 00:16 0:00 [kworker/1:3] [ 595.154301] ps[6349]: root 4096 0.0 0.0 0 0 ? I< 00:19 0:00 [kdmflush] [ 595.155178] ps[6349]: root 4100 0.0 0.0 0 0 ? I< 00:19 0:00 [bioset] [ 595.156056] ps[6349]: root 4590 0.0 0.0 0 0 ? I 00:22 0:00 [kworker/0:0] [ 595.156946] ps[6349]: root 4597 0.0 0.0 0 0 ? I 00:22 0:00 [kworker/1:0] [ 595.157820] ps[6349]: root 4608 0.0 0.0 0 0 ? I 00:22 0:00 [kworker/2:1] [ 595.158654] ps[6349]: root 4610 0.0 0.0 0 0 ? I 00:22 0:00 [kworker/2:2] [ 595.159516] ps[6349]: root 4847 0.0 0.0 0 0 ? I< 00:25 0:00 [kworker/u13:4] [ 595.160412] ps[6349]: root 4848 0.1 0.0 0 0 ? I< 00:25 0:00 [kworker/u13:5] [ 595.161284] ps[6349]: root 6284 0.0 0.0 13408 3172 ? Ss 00:25 0:00 /bin/bash /usr/lib/dracut/dracut-initramfs-restore [ 595.162138] ps[6349]: root 6286 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/0:3] [ 595.163017] ps[6349]: root 6287 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/5:0] [ 595.163863] ps[6349]: root 6288 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/u12:0] [ 595.164712] ps[6349]: root 6289 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/u12:1] [ 595.165565] ps[6349]: root 6293 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/u12:2] [ 595.166404] ps[6349]: root 6298 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/0:4] [ 595.167214] ps[6349]: root 6302 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/2:4] [ 595.168307] lvmetad[776]: Failed to accept connection errno 11. [ 595.169329] ps[6349]: root 6304 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/2:5] [ 595.170216] ps[6349]: root 6307 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/u12:6] [ 595.171091] ps[6349]: root 6308 0.0 0.0 0 0 ? I 00:25 0:00 [kworker/5:3] [ 595.171989] ps[6349]: root 6314 0.0 0.0 0 0 ? I< 00:25 0:00 [kworker/u13:6] [ 595.172868] ps[6349]: root 6318 0.0 0.0 4340 672 ? S 00:25 0:00 /usr/lib/dracut/skipcpio /boot/initramfs-4.14.57-2.pvops.qubes.x86_64.img [ 595.173728] ps[6349]: root 6319 0.0 0.0 4740 780 ? R 00:25 0:00 gzip -cd [ 595.174588] ps[6349]: root 6320 0.0 0.0 6088 708 ? R 00:25 0:00 cpio -id --no-absolute-filenames --quiet [ 595.175497] ps[6349]: root 6325 0.0 0.0 0 0 ? R 00:25 0:00 [kworker/3:0] [ 595.176393] ps[6349]: root 6334 0.0 0.0 31460 2324 ? S 00:25 0:00 @usr/sbin/plymouthd --mode=shutdown --attach-to-session [ 595.177328] ps[6349]: root 6349 0.0 0.0 41588 3544 ? Rs 00:25 0:00 /usr/bin/ps axuw [ 595.178844] lvm[6389]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored [ 596.606145] usb 5-1: USB disconnect, device number 2 [ 596.707963] systemd-udevd[6398]: Process '/usr/lib/qubes/udev-usb-remove' failed with exit code 1. [ 596.719291] systemd-udevd[6398]: Process '/usr/lib/qubes/udev-usb-remove' failed with exit code 1. [ 596.847796] usb 5-1: new low-speed USB device number 4 using xhci_hcd [ 597.002768] usb 5-1: New USB device found, idVendor=1c4f, idProduct=0034 [ 597.003798] usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 597.004822] usb 5-1: Product: Usb Mouse [ 597.005839] usb 5-1: Manufacturer: SIGMACHIP [ 597.017012] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:1c.7/0000:04:00.0/usb5/5-1/5-1:1.0/0003:1C4F:0034.0006/input/input19 [ 597.018241] hid-generic 0003:1C4F:0034.0006: input,hidraw1: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:04:00.0-1/input0 [ 599.796678] systemd[1]: Received SIGRTMIN+20 from PID 6334 (plymouthd). [ 599.820706] systemd-cryptsetup[6366]: Failed to deactivate: Device or resource busy [ 599.822497] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 599.824013] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 599.825146] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 599.826263] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 599.826396] systemd[1]: Reached target Unmount All Filesystems. [ 599.828540] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 599.830521] systemd[1]: Reached target Shutdown. [ 599.831579] systemd[1]: Reached target Final Step. [ 599.833055] systemd[1]: Starting Reboot... [ 599.837884] systemd[1]: Shutting down. [ 599.852908] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 599.853940] systemd[1]: Set hardware watchdog to 10min. [ 599.854975] watchdog: watchdog0: watchdog did not stop! [ 599.953776] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 599.959524] systemd-journald[769]: Received SIGTERM from PID 1 (systemd-shutdow). [ 599.974658] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 599.979183] systemd-shutdown[1]: Process 6334 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 599.980301] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 599.981528] systemd-shutdown[1]: Unmounting file systems. [ 599.982647] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 599.994980] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 599.999607] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 600.000853] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 600.002105] systemd-shutdown[1]: All filesystems unmounted. [ 600.003338] systemd-shutdown[1]: Deactivating swaps. [ 600.004629] systemd-shutdown[1]: All swaps deactivated. [ 600.005815] systemd-shutdown[1]: Detaching loop devices. [ 600.008396] systemd-shutdown[1]: All loop devices detached. [ 600.009507] systemd-shutdown[1]: Detaching DM devices. [ 600.015016] systemd-shutdown[1]: Detaching DM 253:9. [ 600.032938] systemd-shutdown[1]: Detaching DM 253:8. [ 600.045926] systemd-shutdown[1]: Detaching DM 253:7. [ 600.058272] systemd-shutdown[1]: Detaching DM 253:6. [ 600.070944] systemd-shutdown[1]: Detaching DM 253:55. [ 600.082335] systemd-shutdown[1]: Detaching DM 253:52. [ 600.090918] systemd-shutdown[1]: Detaching DM 253:5. [ 600.102814] systemd-shutdown[1]: Detaching DM 253:49. [ 600.115291] systemd-shutdown[1]: Detaching DM 253:46. [ 600.126931] systemd-shutdown[1]: Detaching DM 253:45. [ 600.140921] systemd-shutdown[1]: Detaching DM 253:44. [ 600.153936] systemd-shutdown[1]: Detaching DM 253:43. [ 600.165941] systemd-shutdown[1]: Detaching DM 253:42. [ 600.181930] systemd-shutdown[1]: Detaching DM 253:41. [ 600.194959] systemd-shutdown[1]: Detaching DM 253:38. [ 600.206919] systemd-shutdown[1]: Detaching DM 253:37. [ 600.223936] systemd-shutdown[1]: Detaching DM 253:36. [ 600.234945] systemd-shutdown[1]: Detaching DM 253:35. [ 600.249956] systemd-shutdown[1]: Detaching DM 253:34. [ 600.262960] systemd-shutdown[1]: Detaching DM 253:32. [ 600.274978] systemd-shutdown[1]: Detaching DM 253:31. [ 600.287947] systemd-shutdown[1]: Detaching DM 253:30. [ 600.299921] systemd-shutdown[1]: Detaching DM 253:3. [ 600.301120] dev_remove: 15 callbacks suppressed [ 600.301135] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 600.303517] systemd-shutdown[1]: Detaching DM 253:29. [ 600.318967] systemd-shutdown[1]: Detaching DM 253:28. [ 600.331991] systemd-shutdown[1]: Detaching DM 253:27. [ 600.347970] systemd-shutdown[1]: Detaching DM 253:26. [ 600.360908] systemd-shutdown[1]: Detaching DM 253:25. [ 600.376901] systemd-shutdown[1]: Detaching DM 253:24. [ 600.389940] systemd-shutdown[1]: Detaching DM 253:23. [ 600.403940] systemd-shutdown[1]: Detaching DM 253:22. [ 600.418968] systemd-shutdown[1]: Detaching DM 253:21. [ 600.434966] systemd-shutdown[1]: Detaching DM 253:20. [ 600.447949] systemd-shutdown[1]: Detaching DM 253:2. [ 600.449151] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 600.450325] systemd-shutdown[1]: Detaching DM 253:19. [ 600.466943] systemd-shutdown[1]: Detaching DM 253:18. [ 600.478941] systemd-shutdown[1]: Detaching DM 253:17. [ 600.494982] systemd-shutdown[1]: Detaching DM 253:16. [ 600.506961] systemd-shutdown[1]: Detaching DM 253:15. [ 600.523966] systemd-shutdown[1]: Detaching DM 253:14. [ 600.535957] systemd-shutdown[1]: Detaching DM 253:13. [ 600.547969] systemd-shutdown[1]: Detaching DM 253:12. [ 600.559910] systemd-shutdown[1]: Detaching DM 253:11. [ 600.576946] systemd-shutdown[1]: Detaching DM 253:10. [ 600.587908] systemd-shutdown[1]: Detaching DM 253:1. [ 600.589087] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 600.590257] systemd-shutdown[1]: Detaching DM 253:0. [ 600.591418] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 600.592585] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 600.593867] systemd-shutdown[1]: Detaching DM devices. [ 600.595619] systemd-shutdown[1]: Detaching DM 253:3. [ 600.596764] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 600.597873] systemd-shutdown[1]: Detaching DM 253:2. [ 600.598993] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 600.600110] systemd-shutdown[1]: Detaching DM 253:1. [ 600.601225] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 600.602366] systemd-shutdown[1]: Detaching DM 253:0. [ 600.603520] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 600.604688] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 600.605807] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 600.626839] + echo 'Hello, this is '\''/usr/lib/systemd/system-shutdown/debug.sh'\'' or '\''/usr/lib/systemd/system-shutdown/debug.sh'\''' [ 600.627890] Hello, this is '/usr/lib/systemd/system-shutdown/debug.sh' or '/usr/lib/systemd/system-shutdown/debug.sh' [ 600.628977] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 600.630035] + echo 'Script args: reboot' [ 600.631094] Script args: reboot [ 600.632155] + set [ 600.633209] BASH=/bin/bash [ 600.634236] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 600.635299] BASH_ALIASES=() [ 600.636367] BASH_ARGC=([0]="1") [ 600.637409] BASH_ARGV=([0]="reboot") [ 600.638462] BASH_CMDS=() [ 600.639509] BASH_LINENO=([0]="0") [ 600.640553] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 600.641615] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 600.642682] BASH_VERSION='4.3.43(1)-release' [ 600.643730] DIRSTACK=() [ 600.644784] EUID=0 [ 600.645843] GROUPS=() [ 600.646889] HOME=/ [ 600.647931] HOSTNAME=dom0 [ 600.648960] HOSTTYPE=x86_64 [ 600.649988] IFS=$' \t\n' [ 600.651001] MACHTYPE=x86_64-redhat-linux-gnu [ 600.652009] OPTERR=1 [ 600.653029] OPTIND=1 [ 600.654029] OSTYPE=linux-gnu [ 600.655034] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 600.656023] PIPESTATUS=([0]="0") [ 600.657015] PPID=6450 [ 600.658010] PS4='+ ' [ 600.658984] PWD=/ [ 600.659948] SHELL=/bin/bash [ 600.660904] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 600.661894] SHLVL=1 [ 600.662860] TERM=linux [ 600.663805] UID=0 [ 600.664745] WATCHDOG_USEC=600000000 [ 600.665669] _='Script args: reboot' [ 600.666587] date_log_started='Mon Sep 3 00:25:43 CEST 2018' [ 600.667482] pax_sanitize_slab=full [ 600.668384] root_trim=yes [ 600.669332] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 600.670275] + sysctl kernel.sysrq=1 [ 600.678444] kernel.sysrq = 1 [ 600.679714] + mount -o remount,rw / [ 600.687650] EXT4-fs (dm-4): re-mounted. Opts: discard [ 600.691284] + df [ 600.694808] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987880 0 1987880 0% /dev tmpfs 2001540 0 2001540 0% /dev/shm tmpfs 2001540 58736 1942804 3% /run tmpfs 2001540 0 2001540 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 11408108 190111088 6% / [ 600.700338] + lsblk [ 600.705522] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 600.714870] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 600.805342] real 0m0.090s user 0m0.057s [ 600.807623] sys 0m0.015s [ 600.808424] + echo 'exit code: 1' [ 600.809222] exit code: 1 [ 600.810027] + /usr/bin/ps axuw [ 600.817940] /usr/bin/ps: [ 600.817942] write error [ 600.818714] : Invalid argument ... blah blah snipped ... ```

Note that in the logs from this post(and any future ones) I decreased the systemd default timeouts from 90 to 30 seconds: DefaultTimeoutStartSec=30s DefaultTimeoutStopSec=30s in /etc/systemd/system.conf

So the following reboot took at least 47 seconds to finish: Not sure why it did NOT take only 18 seconds like the last time.

dmesg of when the next boot which was slow (at least 47 sec) because I left 3 VMs on, prior to going for a Restart

``` -------- [ 1287.104517] systemd-logind[1911]: System is rebooting. [ 1287.108657] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 1287.108871] systemd[1]: Removed slice system-getty.slice. [ 1287.109075] systemd[1]: Stopping Accounts Service... [ 1287.110434] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 1287.110489] systemd[1]: Stopped target Sound Card. [ 1287.111225] systemd[1]: Stopping User Manager for UID 1000... [ 1287.121943] lightdm[3244]: Error opening audit socket: Protocol not supported [ 1287.122881] lightdm[3329]: pam_unix(lightdm:session): session closed for user ctor [ 1287.123938] systemd[1]: Stopping Session 2 of user ctor. [ 1287.126062] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 1287.126089] systemd[1]: Stopped target Timers. [ 1287.126172] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 1287.126245] systemd[1]: Stopped Discard unused blocks once a week. [ 1287.126285] systemd[1]: Stopped target Graphical Interface. [ 1287.126331] systemd[1]: Stopped target Multi-User System. [ 1287.126367] systemd[1]: Stopped target Login Prompts. [ 1287.126516] systemd[1]: Stopping Serial Getty on hvc0... [ 1287.127025] systemd[1]: Stopping Command Scheduler... [ 1287.127317] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 1287.127426] systemd[1]: Stopping Daemon for power management... [ 1287.128888] systemd[1]: Stopping Light Display Manager... [ 1287.129054] systemd[1]: Stopping Authorization Manager... [ 1287.130870] systemd[1]: Stopped Daemon for power management. [ 1287.131122] crond[3243]: (CRON) INFO (Shutting down) [ 1287.137244] systemd[1]: Stopped Accounts Service. [ 1287.137539] systemd[1]: Stopped Command Scheduler. [ 1287.137897] systemd[1]: Stopped Authorization Manager. [ 1287.140884] systemd[1]: Stopped Serial Getty on hvc0. [ 1287.141529] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 1287.148882] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 1287.156922] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: Traceback (most recent call last): [ 1287.158273] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 1287.162351] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 1287.162553] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: return f(*args) [ 1287.180188] qubes.WindowIconUpdater-sys-net[3576]: Traceback (most recent call last): [ 1287.180445] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 1287.180614] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: self.invalid() [ 1287.180770] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 1287.180958] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 1287.181178] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: raise ConnectionException(err) [ 1287.181332] qubes.WindowIconUpdater-sys-net[3576]: return f(*args) [ 1287.181483] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 1287.181662] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 1287.181812] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: [ 1287.181954] qubes.WindowIconUpdater-sys-net[3576]: self.invalid() [ 1287.182171] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: During handling of the above exception, another exception occurred: [ 1287.182320] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 1287.182464] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: [ 1287.182608] qubes.WindowIconUpdater-sys-net[3576]: raise ConnectionException(err) [ 1287.182750] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: Traceback (most recent call last): [ 1287.182900] qubes.WindowIconUpdater-sys-net[3576]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 1287.183120] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 1287.183264] qubes.WindowIconUpdater-sys-net[3576]: [ 1287.183406] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: rcvd.handle_input() [ 1287.183543] qubes.WindowIconUpdater-sys-net[3576]: During handling of the above exception, another exception occurred: [ 1287.183686] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 1287.183829] qubes.WindowIconUpdater-sys-net[3576]: [ 1287.183978] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: self.handle_events() [ 1287.184206] qubes.WindowIconUpdater-sys-net[3576]: Traceback (most recent call last): [ 1287.184350] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 1287.184493] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 1287.184651] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: for ev in iter(self.conn.poll_for_event, None): [ 1287.184838] qubes.WindowIconUpdater-sys-net[3576]: rcvd.handle_input() [ 1287.185007] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 1287.185247] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 1287.185400] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: self.invalid() [ 1287.185556] qubes.WindowIconUpdater-sys-net[3576]: self.handle_events() [ 1287.185712] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 1287.185864] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: raise ConnectionException(err) [ 1287.186075] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 1287.186226] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[4730]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 1287.186376] qubes.WindowIconUpdater-sys-net[3576]: for ev in iter(self.conn.poll_for_event, None): [ 1287.186526] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 1287.186688] qubes.WindowIconUpdater-sys-net[3576]: self.invalid() [ 1287.186836] qubes.WindowIconUpdater-sys-net[3576]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 1287.187077] qubes.WindowIconUpdater-sys-net[3576]: raise ConnectionException(err) [ 1287.187227] qubes.WindowIconUpdater-sys-net[3576]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 1287.187386] alsactl[1919]: alsactl daemon stopped [ 1287.187490] qubes.WindowIconUpdater-sys-firewall[3569]: Traceback (most recent call last): [ 1287.187664] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 1287.187814] qubes.WindowIconUpdater-sys-firewall[3569]: return f(*args) [ 1287.187969] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 1287.188203] qubes.WindowIconUpdater-sys-firewall[3569]: self.invalid() [ 1287.188351] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 1287.188501] qubes.WindowIconUpdater-sys-firewall[3569]: raise ConnectionException(err) [ 1287.188648] qubes.WindowIconUpdater-sys-firewall[3569]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 1287.188791] qubes.WindowIconUpdater-sys-firewall[3569]: [ 1287.188946] qubes.WindowIconUpdater-sys-firewall[3569]: During handling of the above exception, another exception occurred: [ 1287.189186] qubes.WindowIconUpdater-sys-firewall[3569]: [ 1287.189349] qubes.WindowIconUpdater-sys-firewall[3569]: Traceback (most recent call last): [ 1287.189499] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 1287.189648] qubes.WindowIconUpdater-sys-firewall[3569]: rcvd.handle_input() [ 1287.189796] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 1287.189945] qubes.WindowIconUpdater-sys-firewall[3569]: self.handle_events() [ 1287.190162] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 1287.190312] qubes.WindowIconUpdater-sys-firewall[3569]: for ev in iter(self.conn.poll_for_event, None): [ 1287.190468] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 1287.190617] qubes.WindowIconUpdater-sys-firewall[3569]: self.invalid() [ 1287.190764] qubes.WindowIconUpdater-sys-firewall[3569]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 1287.190913] qubes.WindowIconUpdater-sys-firewall[3569]: raise ConnectionException(err) [ 1287.191149] qubes.WindowIconUpdater-sys-firewall[3569]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 1287.203721] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=64804248, total_mem_pref=2391919001.6, total_available_memory=30522162264.399998) [ 1287.203960] qmemman.daemon.algo[1912]: left_memory=5323945808 acceptors_count=1 [ 1287.270449] qubesd[1915]: socket.send() raised exception. [ 1287.270699] qubesd[1915]: socket.send() raised exception. [ 1287.270833] qubesd[1915]: socket.send() raised exception. [ 1287.270959] qubesd[1915]: socket.send() raised exception. [ 1287.271092] qubesd[1915]: socket.send() raised exception. [ 1287.271287] qubesd[1915]: socket.send() raised exception. [ 1287.271411] qubesd[1915]: socket.send() raised exception. [ 1287.271535] qubesd[1915]: socket.send() raised exception. [ 1287.271656] qubesd[1915]: socket.send() raised exception. [ 1287.271782] qubesd[1915]: socket.send() raised exception. [ 1287.271904] qubesd[1915]: socket.send() raised exception. [ 1287.272035] qubesd[1915]: socket.send() raised exception. [ 1287.272158] qubesd[1915]: socket.send() raised exception. [ 1287.272288] qubesd[1915]: socket.send() raised exception. [ 1287.272412] qubesd[1915]: socket.send() raised exception. [ 1287.272535] qubesd[1915]: socket.send() raised exception. [ 1287.272657] qubesd[1915]: socket.send() raised exception. [ 1287.272779] qubesd[1915]: socket.send() raised exception. [ 1287.272902] qubesd[1915]: socket.send() raised exception. [ 1287.273050] qubesd[1915]: socket.send() raised exception. [ 1287.273346] qubesd[1915]: socket.send() raised exception. [ 1287.273469] qubesd[1915]: socket.send() raised exception. [ 1287.273596] qubesd[1915]: socket.send() raised exception. [ 1287.273737] qubesd[1915]: socket.send() raised exception. [ 1287.273859] qubesd[1915]: socket.send() raised exception. [ 1287.273987] qubesd[1915]: socket.send() raised exception. [ 1287.274142] qubesd[1915]: socket.send() raised exception. [ 1287.274266] qubesd[1915]: socket.send() raised exception. [ 1287.274387] qubesd[1915]: socket.send() raised exception. [ 1287.274516] qubesd[1915]: socket.send() raised exception. [ 1287.274639] qubesd[1915]: socket.send() raised exception. [ 1287.274780] qubesd[1915]: socket.send() raised exception. [ 1287.274908] qubesd[1915]: socket.send() raised exception. [ 1287.275049] qubesd[1915]: socket.send() raised exception. [ 1287.275175] qubesd[1915]: socket.send() raised exception. [ 1287.275297] qubesd[1915]: socket.send() raised exception. [ 1287.275419] qubesd[1915]: socket.send() raised exception. [ 1287.275541] qubesd[1915]: socket.send() raised exception. [ 1287.275663] qubesd[1915]: socket.send() raised exception. [ 1287.275792] qubesd[1915]: socket.send() raised exception. [ 1287.276019] qubesd[1915]: socket.send() raised exception. [ 1287.276289] qubesd[1915]: socket.send() raised exception. [ 1287.276463] qubesd[1915]: socket.send() raised exception. [ 1287.276588] qubesd[1915]: socket.send() raised exception. [ 1287.276710] qubesd[1915]: socket.send() raised exception. [ 1287.276832] qubesd[1915]: socket.send() raised exception. [ 1287.276954] qubesd[1915]: socket.send() raised exception. [ 1287.277102] qubesd[1915]: socket.send() raised exception. [ 1287.277233] qubesd[1915]: socket.send() raised exception. [ 1287.277361] qubesd[1915]: socket.send() raised exception. [ 1287.277490] qubesd[1915]: socket.send() raised exception. [ 1287.277658] qubesd[1915]: socket.send() raised exception. [ 1287.277870] qubesd[1915]: socket.send() raised exception. [ 1287.278010] qubesd[1915]: socket.send() raised exception. [ 1287.298596] systemd[3344]: Received SIGRTMIN+24 from PID 5571 (kill). [ 1287.300651] systemd[1]: Stopped User Manager for UID 1000. [ 1287.367933] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=64804248, total_mem_pref=2246008832.0, total_available_memory=30668072434.0) [ 1287.368211] qmemman.daemon.algo[1912]: left_memory=6214770912 acceptors_count=1 [ 1287.394183] systemd[1]: Stopped Light Display Manager. [ 1287.395972] systemd[1]: Starting Show Plymouth Reboot Screen... [ 1287.404416] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=64804248, total_mem_pref=1957937152.0, total_available_memory=30956144114.0) [ 1287.404661] qmemman.daemon.algo[1912]: left_memory=8363368937 acceptors_count=1 [ 1287.423876] systemd[1]: Started Show Plymouth Reboot Screen. [ 1287.621486] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 1292.411524] systemd[1]: Received SIGRTMIN+20 from PID 5578 (plymouthd). [ 1317.308213] systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop timed out. [ 1317.308253] systemd[1]: Timed out stopping /dev/dm-0. [ 1317.308347] systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop failed with result 'timeout'. [ 1317.308388] systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop timed out. [ 1317.308407] systemd[1]: Timed out stopping LVM PV pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m on /dev/dm-0. [ 1317.308531] systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop failed with result 'timeout'. [ 1317.308581] systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. [ 1317.308673] systemd[1]: Timed out stopping /dev/disk/by-id/dm-uuid-CRYPT-LUKS1-9ed952b52aa84564b700fb23f5c9e94b-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 1317.308757] systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. [ 1317.308872] systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop timed out. [ 1317.308877] systemd[1]: Timed out stopping /sys/devices/virtual/block/dm-0. [ 1317.309021] systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop failed with result 'timeout'. [ 1317.309063] systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. [ 1317.309068] systemd[1]: Timed out stopping /dev/disk/by-id/dm-name-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 1317.309227] systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. [ 1317.309248] systemd[1]: session-2.scope: Stopping timed out. Killing. [ 1317.309351] systemd[1]: session-2.scope: Killing process 3540 (qubes-guid) with signal SIGKILL. [ 1317.309543] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop timed out. [ 1317.309622] systemd[1]: Timed out stopping /dev/disk/by-id/lvm-pv-uuid-pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m. [ 1317.309690] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop failed with result 'timeout'. [ 1317.310369] systemd[1]: Stopped Session 2 of user ctor. [ 1317.310538] systemd[1]: session-2.scope: Unit entered failed state. [ 1317.311301] systemd[1]: Removed slice User Slice of ctor. [ 1317.312616] systemd[1]: Stopping Permit User Sessions... [ 1317.312912] systemd[1]: Stopping Login Service... [ 1317.317442] systemd[1]: Stopped Permit User Sessions. [ 1317.317669] systemd[1]: Stopped Start Qubes VM sys-net. [ 1317.317730] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 1317.317870] systemd[1]: Stopping Qubes memory information reporter... [ 1317.318055] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 1317.318545] systemd[1]: Stopped Qubes memory information reporter. [ 1317.319849] systemd[1]: Stopping Qubes Dom0 startup setup... [ 1317.382479] systemd[1]: Stopped Login Service. [ 1317.383080] systemd[1]: Stopped target User and Group Name Lookups. [ 1317.405233] qvm-shutdown[5595]: 2018-09-03 00:48:15,906 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector [ 1317.407670] qubesd[1915]: socket.send() raised exception. [ 1317.407852] qubesd[1915]: socket.send() raised exception. [ 1317.408001] qubesd[1915]: socket.send() raised exception. [ 1317.408186] qubesd[1915]: socket.send() raised exception. [ 1317.408323] qubesd[1915]: socket.send() raised exception. [ 1317.619947] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=64804248, total_mem_pref=1738566041.6000001, total_available_memory=31175515224.4) [ 1317.620239] qmemman.daemon.algo[1912]: left_memory=6328198405 acceptors_count=1 [ 1318.901683] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=64804248, total_mem_pref=1738566041.6000001, total_available_memory=31175515224.4) [ 1318.902061] qmemman.daemon.algo[1912]: left_memory=6328198405 acceptors_count=1 [ 1319.362471] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=4257078861, total_mem_pref=1417443328.0, total_available_memory=31494608551.0) [ 1319.362757] qmemman.daemon.algo[1912]: left_memory=6406700916 acceptors_count=1 [ 1319.362949] qmemman.systemstate[1912]: stat: dom '0' act=24460669018 pref=960426393.6 last_target=24460669018 [ 1319.363167] qmemman.systemstate[1912]: stat: dom '3' act=4194304000 pref=457016934.40000004 last_target=4194304000 [ 1319.363345] qmemman.systemstate[1912]: stat: xenfree=4309507661 memset_reqs=[('0', 28678429125), ('3', 4194304000)] [ 1319.363510] qmemman.systemstate[1912]: mem-set domain 0 to 28678429125 [ 1319.363675] qmemman.systemstate[1912]: mem-set domain 3 to 4194304000 [ 1319.768677] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1319.881915] lvm[789]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 1320.004003] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1320.123335] lvm[789]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 1320.390955] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=44650956, total_mem_pref=1296900505.6, total_available_memory=31620483575.4) [ 1320.391294] qmemman.daemon.algo[1912]: left_memory=4337400384 acceptors_count=1 [ 1321.797402] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=44650956, total_mem_pref=1296900505.6, total_available_memory=31620483575.4) [ 1321.797696] qmemman.daemon.algo[1912]: left_memory=4337400384 acceptors_count=1 [ 1322.298818] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=4234856862, total_mem_pref=960426393.6, total_available_memory=31952859593.4) [ 1322.299151] qmemman.systemstate[1912]: stat: dom '0' act=28678429125 pref=960426393.6 last_target=28678429125 [ 1322.299361] qmemman.systemstate[1912]: stat: xenfree=4287285662 memset_reqs=[('0', 32880372701)] [ 1322.299531] qmemman.systemstate[1912]: mem-set domain 0 to 32880372701 [ 1322.632179] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1322.809785] lvm[789]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 1322.916860] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1323.028833] lvm[789]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 1326.140094] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=40305054, total_mem_pref=960426393.6, total_available_memory=31960251361.4) [ 1326.545582] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=190333079, total_mem_pref=960426393.6, total_available_memory=32110279386.4) [ 1326.545887] qmemman.systemstate[1912]: stat: dom '0' act=32880372701 pref=960426393.6 last_target=32880372701 [ 1326.546100] qmemman.systemstate[1912]: stat: xenfree=242761879 memset_reqs=[('0', 33037635074)] [ 1326.548228] qmemman.systemstate[1912]: mem-set domain 0 to 33037635074 [ 1326.609179] qmemman.daemon.algo[1912]: balance_when_enough_memory(xen_free_memory=438591962, total_mem_pref=960426393.6, total_available_memory=32515800642.4) [ 1326.611480] qmemman.systemstate[1912]: stat: dom '0' act=33037635074 pref=960426393.6 last_target=33037635074 [ 1326.613578] qmemman.systemstate[1912]: stat: xenfree=491020762 memset_reqs=[('0', 33442750808)] [ 1326.615643] qmemman.systemstate[1912]: mem-set domain 0 to 33442750808 [ 1326.968800] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1327.080351] lvm[789]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 1327.199268] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1327.324767] lvm[789]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 1327.572059] qubesdb-daemon[1913]: terminating [ 1327.574029] systemd[1]: Stopped Qubes DB agent. [ 1327.580105] ps[7001]: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND [ 1327.582390] ps[7001]: root 1 0.0 0.1 146808 7412 ? Rs 00:26 0:00 /usr/lib/systemd/systemd --switched-root --system --deserialize 23 [ 1327.584647] ps[7001]: root 2 0.0 0.0 0 0 ? S 00:26 0:00 [kthreadd] [ 1327.586930] ps[7001]: root 4 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/0:0H] [ 1327.589147] ps[7001]: root 6 0.0 0.0 0 0 ? I< 00:26 0:00 [mm_percpu_wq] [ 1327.591363] ps[7001]: root 7 0.0 0.0 0 0 ? S 00:26 0:00 [ksoftirqd/0] [ 1327.593493] ps[7001]: root 8 0.0 0.0 0 0 ? I 00:26 0:00 [rcu_sched] [ 1327.594190] systemd[1]: Stopped Qubes Dom0 startup setup. [ 1327.598231] systemd[1]: Stopping Qubes memory management daemon... [ 1327.603707] systemd[1]: Stopping Virtualization daemon... [ 1327.603708] ps[7001]: root 9 0.0 0.0 0 0 ? I 00:26 0:00 [rcu_bh] [ 1327.611268] ps[7001]: root 10 0.0 0.0 0 0 ? S 00:26 0:00 [migration/0] [ 1327.611304] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 1327.618925] ps[7001]: root 11 0.0 0.0 0 0 ? S 00:26 0:00 [watchdog/0] [ 1327.618939] systemd[1]: Stopping Qubes OS daemon... [ 1327.626475] ps[7001]: root 12 0.0 0.0 0 0 ? S 00:26 0:00 [cpuhp/0] [ 1327.626680] systemd[1]: Stopped Qubes memory management daemon. [ 1327.632399] ps[7001]: root 13 0.0 0.0 0 0 ? S 00:26 0:00 [cpuhp/1] [ 1327.632575] systemd[1]: Stopped Virtualization daemon. [ 1327.639923] ps[7001]: root 14 0.0 0.0 0 0 ? S 00:26 0:00 [watchdog/1] [ 1327.640127] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 1327.647352] ps[7001]: root 15 0.0 0.0 0 0 ? S 00:26 0:00 [migration/1] [ 1327.648149] systemd[1]: Stopped target Remote File Systems. [ 1327.654873] ps[7001]: root 16 0.0 0.0 0 0 ? S 00:26 0:00 [ksoftirqd/1] [ 1327.654919] systemd[1]: Stopping D-Bus System Message Bus... [ 1327.655133] gdbus[2017]: segfault at 0 ip 00007796538cda84 sp 00007796401d2bc0 error 4 in libpthread-2.24.so[7796538be000+18000] [ 1327.664728] ps[7001]: root 18 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/1:0H] [ 1327.664752] systemd[1]: Stopping The Xen xenstore... [ 1327.672444] ps[7001]: root 19 0.0 0.0 0 0 ? S 00:26 0:00 [cpuhp/2] [ 1327.672622] systemd[1]: Stopped D-Bus System Message Bus. [ 1327.679948] ps[7001]: root 20 0.0 0.0 0 0 ? S 00:26 0:00 [watchdog/2] [ 1327.680180] systemd[1]: Stopped The Xen xenstore. [ 1327.687097] ps[7001]: root 21 0.0 0.0 0 0 ? S 00:26 0:00 [migration/2] [ 1327.687292] systemd[1]: Failed to propagate agent release message: Connection reset by peer [ 1327.687450] systemd[1]: Failed to propagate agent release message: Transport endpoint is not connected [ 1327.687530] systemd[1]: Requested transaction contradicts existing jobs: Transaction is destructive. [ 1327.687575] systemd[1]: systemd-coredump.socket: Failed to queue service startup job (Maybe the service file is missing or not a non-template unit?): Transaction is destructive. [ 1327.687591] systemd[1]: systemd-coredump.socket: Unit entered failed state. [ 1327.689182] systemd[1]: Unmounting mount xenstore file system... [ 1327.703531] ps[7001]: root 22 0.0 0.0 0 0 ? S 00:26 0:00 [ksoftirqd/2] [ 1327.704237] systemd[1]: qubesd.service: Main process exited, code=killed, status=11/SEGV [ 1327.704392] systemd[1]: Stopped Qubes OS daemon. [ 1327.712062] systemd[1]: qubesd.service: Unit entered failed state. [ 1327.712097] ps[7001]: root 24 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/2:0H] [ 1327.715215] systemd[1]: qubesd.service: Failed with result 'signal'. [ 1327.715381] systemd[1]: Unmounted mount xenstore file system. [ 1327.721902] ps[7001]: root 25 0.0 0.0 0 0 ? S 00:26 0:00 [cpuhp/3] [ 1327.723473] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 1327.728639] systemd[1]: Stopped target Basic System. [ 1327.728684] ps[7001]: root 26 0.0 0.0 0 0 ? S 00:26 0:00 [watchdog/3] [ 1327.735386] systemd[1]: Stopped target Paths. [ 1327.737088] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 1327.742252] systemd[1]: Stopped target Sockets. [ 1327.744048] systemd[1]: Closed Virtual machine log manager socket. [ 1327.749304] systemd[1]: Closed D-Bus System Message Bus Socket. [ 1327.750983] systemd[1]: Closed Virtual machine lock manager socket. [ 1327.756192] systemd[1]: Stopped target Slices. [ 1327.757864] ps[7001]: root 27 0.0 0.0 0 0 ? S 00:26 0:00 [migration/3] [ 1327.758239] systemd[1]: Removed slice User and Session Slice. [ 1327.768038] systemd[1]: Stopped target System Initialization. [ 1327.770856] systemd[1]: Stopping Load/Save Random Seed... [ 1327.776331] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 1327.780814] systemd[1]: Stopped target Encrypted Volumes. [ 1327.786052] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 1327.787850] ps[7001]: root 28 0.0 0.0 0 0 ? S 00:26 0:00 [ksoftirqd/3] [ 1327.789085] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 1327.798922] systemd[1]: Stopped Load legacy module configuration. [ 1327.804259] systemd[1]: Stopped Apply Kernel Variables. [ 1327.809478] systemd[1]: Stopped Setup Virtual Console. [ 1327.810249] ps[7001]: root 30 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/3:0H] [ 1327.816501] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 1327.825116] systemd[1]: Stopped Load/Save Random Seed. [ 1327.831111] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 1327.835579] ps[7001]: root 31 0.0 0.0 0 0 ? S 00:26 0:00 [cpuhp/4] [ 1327.835912] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 1327.846625] systemd[1]: Stopped Create Volatile Files and Directories. [ 1327.850950] systemd[1]: Stopped target Local File Systems. [ 1327.852794] systemd[1]: Stopped Configure read-only root support. [ 1327.858750] systemd[1]: Unmounting /run/user/1000... [ 1327.864065] systemd[1]: Unmounting /boot/efi... [ 1327.868399] ps[7001]: root 32 0.0 0.0 0 0 ? S 00:26 0:00 [watchdog/4] [ 1327.869482] systemd[1]: Unmounting Configuration File System... [ 1327.880099] systemd[1]: Unmounting Temporary Directory... [ 1327.885093] systemd[1]: Unmounted /run/user/1000. [ 1327.889476] ps[7001]: root 33 0.0 0.0 0 0 ? S 00:26 0:00 [migration/4] [ 1327.889602] systemd[1]: Unmounted /boot/efi. [ 1327.899785] systemd[1]: Unmounted Configuration File System. [ 1327.904840] systemd[1]: Unmounted Temporary Directory. [ 1327.909714] ps[7001]: root 34 0.0 0.0 0 0 ? S 00:26 0:00 [ksoftirqd/4] [ 1327.914665] ps[7001]: root 36 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/4:0H] [ 1327.915056] systemd[1]: Stopped target Swap. [ 1327.921120] ps[7001]: root 37 0.0 0.0 0 0 ? S 00:26 0:00 [cpuhp/5] [ 1327.921340] systemd[1]: Stopped Load Kernel Modules. [ 1327.927541] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 1327.927571] ps[7001]: root 38 0.0 0.0 0 0 ? S 00:26 0:00 [watchdog/5] [ 1327.934195] ps[7001]: root 39 0.0 0.0 0 0 ? S 00:26 0:00 [migration/5] [ 1327.934219] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 1327.940649] systemd[1]: Stopped target Local File Systems (Pre). [ 1327.940651] ps[7001]: root 40 0.0 0.0 0 0 ? S 00:26 0:00 [ksoftirqd/5] [ 1327.944798] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 1327.949061] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 1327.954073] ps[7001]: root 42 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/5:0H] [ 1327.954395] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 1327.967864] ps[7001]: root 43 0.0 0.0 0 0 ? S 00:26 0:00 [kdevtmpfs] [ 1327.969451] ps[7001]: root 44 0.0 0.0 0 0 ? I< 00:26 0:00 [netns] [ 1327.971035] ps[7001]: root 45 0.0 0.0 0 0 ? S 00:26 0:00 [xenbus] [ 1327.972578] ps[7001]: root 46 0.0 0.0 0 0 ? S 00:26 0:00 [xenwatch] [ 1327.974146] ps[7001]: root 48 0.0 0.0 0 0 ? S 00:26 0:00 [oom_reaper] [ 1327.975691] ps[7001]: root 49 0.0 0.0 0 0 ? I< 00:26 0:00 [writeback] [ 1327.977269] ps[7001]: root 50 0.0 0.0 0 0 ? S 00:26 0:00 [kcompactd0] [ 1327.978784] ps[7001]: root 51 0.0 0.0 0 0 ? SN 00:26 0:00 [ksmd] [ 1327.980356] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 1327.981985] ps[7001]: root 52 0.0 0.0 0 0 ? I< 00:26 0:00 [crypto] [ 1327.982073] systemd[1]: Stopping LVM2 metadata daemon... [ 1327.988546] ps[7001]: root 53 0.0 0.0 0 0 ? I< 00:26 0:00 [kintegrityd] [ 1327.988718] systemd[1]: Stopped LVM2 metadata daemon. [ 1327.994744] ps[7001]: root 54 0.0 0.0 0 0 ? I< 00:26 0:00 [kblockd] [ 1327.999634] ps[7001]: root 55 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/1:1] [ 1328.001115] ps[7001]: root 59 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/5:1] [ 1328.002603] ps[7001]: root 60 0.0 0.0 0 0 ? I< 00:26 0:00 [ata_sff] [ 1328.004064] ps[7001]: root 61 0.0 0.0 0 0 ? I< 00:26 0:00 [md] [ 1328.006104] qubesd[1915]: caught SIGTERM, exiting [ 1328.007647] libvirtd[1938]: S3 disabled [ 1328.009093] libvirtd[1938]: S4 disabled [ 1328.010504] libvirtd[1938]: S3 disabled [ 1328.011896] libvirtd[1938]: S4 disabled [ 1328.013394] dmeventd[789]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 1328.014930] ps[7001]: root 62 0.0 0.0 0 0 ? I< 00:26 0:00 [edac-poller] [ 1328.016340] ps[7001]: root 63 0.0 0.0 0 0 ? I< 00:26 0:00 [devfreq_wq] [ 1328.017733] ps[7001]: root 64 0.0 0.0 0 0 ? I< 00:26 0:00 [watchdogd] [ 1328.019134] ps[7001]: root 66 0.0 0.0 0 0 ? S 00:26 0:00 [kswapd0] [ 1328.020521] ps[7001]: root 115 0.0 0.0 0 0 ? I< 00:26 0:00 [kthrotld] [ 1328.021899] ps[7001]: root 116 0.0 0.0 0 0 ? I< 00:26 0:00 [acpi_thermal_pm] [ 1328.023281] ps[7001]: root 117 0.0 0.0 0 0 ? S 00:26 0:00 [khvcd] [ 1328.024649] ps[7001]: root 118 0.0 0.0 0 0 ? S 00:26 0:00 [scsi_eh_0] [ 1328.026010] ps[7001]: root 119 0.0 0.0 0 0 ? I< 00:26 0:00 [scsi_tmf_0] [ 1328.027385] ps[7001]: root 120 0.0 0.0 0 0 ? S 00:26 0:00 [scsi_eh_1] [ 1328.028715] ps[7001]: root 121 0.0 0.0 0 0 ? I< 00:26 0:00 [scsi_tmf_1] [ 1328.030044] ps[7001]: root 122 0.0 0.0 0 0 ? S 00:26 0:00 [scsi_eh_2] [ 1328.031377] ps[7001]: root 123 0.0 0.0 0 0 ? I< 00:26 0:00 [scsi_tmf_2] [ 1328.032693] ps[7001]: root 124 0.0 0.0 0 0 ? S 00:26 0:00 [scsi_eh_3] [ 1328.034013] ps[7001]: root 125 0.0 0.0 0 0 ? I< 00:26 0:00 [scsi_tmf_3] [ 1328.035339] ps[7001]: root 126 0.0 0.0 0 0 ? S 00:26 0:00 [scsi_eh_4] [ 1328.036643] ps[7001]: root 127 0.0 0.0 0 0 ? I< 00:26 0:00 [scsi_tmf_4] [ 1328.037964] ps[7001]: root 128 0.0 0.0 0 0 ? S 00:26 0:00 [scsi_eh_5] [ 1328.039279] ps[7001]: root 129 0.0 0.0 0 0 ? I< 00:26 0:00 [scsi_tmf_5] [ 1328.040564] ps[7001]: root 131 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/u12:3] [ 1328.041846] ps[7001]: root 132 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/u12:4] [ 1328.043134] ps[7001]: root 133 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/u12:5] [ 1328.044411] ps[7001]: root 134 0.0 0.0 0 0 ? I< 00:26 0:00 [dm_bufio_cache] [ 1328.045684] ps[7001]: root 135 0.0 0.0 0 0 ? I< 00:26 0:00 [kstrp] [ 1328.046944] ps[7001]: root 220 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/5:2] [ 1328.048210] ps[7001]: root 222 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/3:2] [ 1328.049839] xl[7012]: Name ID Mem VCPUs State Time(s) [ 1328.051102] xl[7012]: Domain-0 0 4096 6 r----- 256.8 [ 1328.052418] lvmetad[799]: Failed to accept connection errno 11. [ 1328.053730] ps[7001]: root 284 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/0:2] [ 1328.054990] ps[7001]: root 370 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/4:2] [ 1328.056258] ps[7001]: root 409 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/0:1H] [ 1328.057512] ps[7001]: root 532 0.0 0.0 0 0 ? S 00:26 0:00 [i915/signal:0] [ 1328.058750] ps[7001]: root 533 0.0 0.0 0 0 ? S 00:26 0:00 [i915/signal:1] [ 1328.059990] ps[7001]: root 534 0.0 0.0 0 0 ? S 00:26 0:00 [i915/signal:2] [ 1328.061219] ps[7001]: root 535 0.0 0.0 0 0 ? S 00:26 0:00 [i915/signal:4] [ 1328.062440] ps[7001]: root 536 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/1:3] [ 1328.063638] ps[7001]: root 584 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/2:1H] [ 1328.064842] ps[7001]: root 591 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.066017] ps[7001]: root 595 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.067202] ps[7001]: root 596 0.0 0.0 0 0 ? I< 00:26 0:00 [kcryptd_io] [ 1328.068385] ps[7001]: root 598 0.0 0.0 0 0 ? I< 00:26 0:00 [kcryptd] [ 1328.069542] ps[7001]: root 599 0.0 0.0 0 0 ? S 00:26 0:00 [dmcrypt_write] [ 1328.070699] ps[7001]: root 600 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.071878] ps[7001]: root 666 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.073049] ps[7001]: root 667 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.074210] ps[7001]: root 668 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.075345] ps[7001]: root 669 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.076481] ps[7001]: root 683 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/u13:4] [ 1328.077603] ps[7001]: root 685 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/u13:6] [ 1328.078706] ps[7001]: root 686 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.079816] ps[7001]: root 687 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.080909] ps[7001]: root 690 0.0 0.0 0 0 ? I< 00:26 0:00 [kcopyd] [ 1328.082024] ps[7001]: root 691 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.083124] ps[7001]: root 692 0.0 0.0 0 0 ? I< 00:26 0:00 [dm-thin] [ 1328.084611] ps[7001]: root 693 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.085686] ps[7001]: root 694 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.086759] ps[7001]: root 699 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.087831] ps[7001]: root 720 0.0 0.0 0 0 ? S 00:26 0:00 [jbd2/dm-4-8] [ 1328.088894] ps[7001]: root 721 0.0 0.0 0 0 ? I< 00:26 0:00 [ext4-rsv-conver] [ 1328.089962] ps[7001]: root 789 0.0 0.5 120812 20520 ? SLsl 00:26 0:00 /usr/sbin/dmeventd -f [ 1328.091002] ps[7001]: root 794 0.0 0.4 86484 18016 ? Rs 00:26 0:00 /usr/lib/systemd/systemd-journald [ 1328.092047] ps[7001]: root 799 0.0 0.0 200292 2628 ? Ssl 00:26 0:00 /usr/sbin/lvmetad -f -t 3600 [ 1328.093099] ps[7001]: root 819 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/5:1H] [ 1328.094135] ps[7001]: root 827 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/1:1H] [ 1328.095141] ps[7001]: root 836 0.0 0.1 45412 4772 ? Ss 00:26 0:00 /usr/lib/systemd/systemd-udevd [ 1328.096183] ps[7001]: root 880 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/4:1H] [ 1328.097207] ps[7001]: root 884 0.0 0.0 0 0 ? S 00:26 0:00 [irq/181-mei_me] [ 1328.098241] ps[7001]: root 891 0.0 0.0 0 0 ? I< 00:26 0:00 [kworker/3:1H] [ 1328.099258] ps[7001]: root 1475 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.100275] ps[7001]: root 1476 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.101283] ps[7001]: root 1477 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.102304] ps[7001]: root 1484 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.103296] ps[7001]: root 1487 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.104301] ps[7001]: root 1493 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.105295] ps[7001]: root 1497 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.106282] ps[7001]: root 1505 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.107244] ps[7001]: root 1507 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.108219] ps[7001]: root 1516 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.109195] ps[7001]: root 1518 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.110526] ps[7001]: root 1521 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.111486] ps[7001]: root 1524 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.112444] ps[7001]: root 1527 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.113389] ps[7001]: root 1530 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.114326] ps[7001]: root 1539 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.115253] ps[7001]: root 1542 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.116172] ps[7001]: root 1549 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.117088] ps[7001]: root 1553 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.118006] ps[7001]: root 1562 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.118912] ps[7001]: root 1563 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.119829] ps[7001]: root 1576 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.120733] ps[7001]: root 1579 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.121618] ps[7001]: root 1586 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.122500] ps[7001]: root 1588 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.123364] ps[7001]: root 1597 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.124213] ps[7001]: root 1603 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.125072] ps[7001]: root 1606 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.125903] ps[7001]: root 1607 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.126761] ps[7001]: root 1621 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.127582] ps[7001]: root 1623 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.128382] ps[7001]: root 1631 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.129181] ps[7001]: root 1633 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.129969] ps[7001]: root 1639 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.130752] ps[7001]: root 1641 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.131532] ps[7001]: root 1653 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.132304] ps[7001]: root 1654 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.133056] ps[7001]: root 1663 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.134203] ps[7001]: root 1666 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.134958] ps[7001]: root 1675 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.135712] ps[7001]: root 1676 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.136470] ps[7001]: root 1686 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.137217] ps[7001]: root 1689 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.137956] ps[7001]: root 1694 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.138701] ps[7001]: root 1698 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.139488] ps[7001]: root 1705 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.140235] ps[7001]: root 1707 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.140970] ps[7001]: root 1716 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.141689] ps[7001]: root 1718 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.142406] ps[7001]: root 1725 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.143119] ps[7001]: root 1729 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.143826] ps[7001]: root 1736 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.144525] ps[7001]: root 1739 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.145218] ps[7001]: root 1748 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.145914] ps[7001]: root 1751 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.146603] ps[7001]: root 1755 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.147287] ps[7001]: root 1756 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.147964] ps[7001]: root 1759 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.148655] ps[7001]: root 1761 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.149339] ps[7001]: root 1764 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.150019] ps[7001]: root 1765 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.150681] ps[7001]: root 1769 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.151370] ps[7001]: root 1771 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.152063] ps[7001]: root 1775 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.152729] ps[7001]: root 1776 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.153794] ps[7001]: root 1778 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.154450] ps[7001]: root 1786 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.155103] ps[7001]: root 1790 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.155749] ps[7001]: root 1792 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.156417] ps[7001]: root 1795 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.157078] ps[7001]: root 1808 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.157732] ps[7001]: root 1817 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.158390] ps[7001]: root 1818 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.159036] ps[7001]: root 1823 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.159681] ps[7001]: root 1827 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.160335] ps[7001]: root 1831 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.160974] ps[7001]: root 1832 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.161600] ps[7001]: root 1836 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.162251] ps[7001]: dbus 1890 0.0 0.1 46760 4708 ? Ss 00:26 0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only [ 1328.162917] ps[7001]: root 1912 0.0 1.0 429704 40848 ? SLsl 00:26 0:00 /usr/bin/python3 /usr/bin/qmemmand [ 1328.163601] ps[7001]: root 1915 0.2 1.3 704376 53784 ? SLsl 00:26 0:03 /usr/bin/python3 /usr/bin/qubesd [ 1328.164278] ps[7001]: root 1933 0.0 0.0 47772 3320 ? SL 00:26 0:01 /usr/sbin/xenstored --pid-file /var/run/xen/xenstored.pid [ 1328.164971] ps[7001]: root 1938 0.1 1.5 1187548 61048 ? SLsl 00:26 0:01 /usr/sbin/libvirtd [ 1328.165670] ps[7001]: root 1946 0.0 0.0 119404 3464 ? SLsl 00:26 0:00 /usr/sbin/xenconsoled -i --log=all --log-dir=/var/log/xen/console [ 1328.166388] ps[7001]: root 2727 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.167107] ps[7001]: root 2730 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.167822] ps[7001]: root 3106 0.0 0.0 0 0 ? I< 00:26 0:00 [kdmflush] [ 1328.168558] ps[7001]: root 3109 0.0 0.0 0 0 ? I< 00:26 0:00 [bioset] [ 1328.169637] ps[7001]: root 3673 0.0 0.0 0 0 ? I 00:26 0:00 [kworker/2:3] [ 1328.170361] ps[7001]: root 4321 0.0 0.0 0 0 ? I< 00:34 0:00 [kworker/u13:2] [ 1328.171086] ps[7001]: root 4574 0.0 0.0 0 0 ? I< 00:35 0:00 [kdmflush] [ 1328.171803] ps[7001]: root 4578 0.0 0.0 0 0 ? I< 00:35 0:00 [bioset] [ 1328.172526] ps[7001]: root 5097 0.0 0.0 0 0 ? I 00:40 0:00 [kworker/3:0] [ 1328.173241] ps[7001]: root 5105 0.0 0.0 0 0 ? I 00:40 0:00 [kworker/4:1] [ 1328.173941] ps[7001]: root 5126 0.0 0.0 0 0 ? I< 00:41 0:00 [kworker/u13:1] [ 1328.174643] ps[7001]: root 5127 0.0 0.0 0 0 ? I< 00:41 0:00 [kworker/u13:3] [ 1328.175344] ps[7001]: root 5157 0.0 0.0 0 0 ? I 00:41 0:00 [kworker/2:0] [ 1328.176037] ps[7001]: root 5158 0.0 0.0 0 0 ? I 00:41 0:00 [kworker/0:1] [ 1328.176734] ps[7001]: root 5497 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/0:0] [ 1328.177439] ps[7001]: root 5513 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/1:0] [ 1328.178122] ps[7001]: root 5516 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/4:0] [ 1328.178808] ps[7001]: root 5518 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/5:0] [ 1328.179507] ps[7001]: root 5520 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/3:1] [ 1328.180217] ps[7001]: root 5521 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/5:3] [ 1328.180905] ps[7001]: root 5542 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/u12:0] [ 1328.181602] ps[7001]: root 5545 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/2:1] [ 1328.182296] ps[7001]: root 5553 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/u12:1] [ 1328.182970] ps[7001]: root 5554 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/0:3] [ 1328.183656] ps[7001]: root 5555 0.0 0.0 0 0 ? I 00:47 0:00 [kworker/0:4] [ 1328.184347] ps[7001]: root 5568 0.0 0.0 0 0 ? R 00:47 0:00 [kworker/4:3] [ 1328.185026] ps[7001]: root 5578 0.0 0.0 31460 2372 ? S 00:47 0:00 @usr/sbin/plymouthd --mode=shutdown --attach-to-session [ 1328.185711] ps[7001]: root 6060 0.1 0.0 0 0 ? I< 00:48 0:00 [kworker/u13:0] [ 1328.186408] ps[7001]: root 6935 0.0 0.0 45412 3308 ? S 00:48 0:00 /usr/lib/systemd/systemd-udevd [ 1328.187453] ps[7001]: root 6936 0.0 0.0 12152 2856 ? R 00:48 0:00 /bin/bash /usr/lib/qubes/udev-block-add-change [ 1328.188180] ps[7001]: root 7001 0.0 0.0 41588 3584 ? Rs 00:48 0:00 /usr/bin/ps axuw [ 1328.189306] lvm[7053]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored [ 1332.601290] systemd-cryptsetup[7039]: Failed to deactivate: Device or resource busy [ 1332.602716] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 1332.603911] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 1332.604737] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 1332.605581] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 1332.605717] systemd[1]: Reached target Unmount All Filesystems. [ 1332.607397] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 1332.608878] systemd[1]: Reached target Shutdown. [ 1332.610447] systemd[1]: Reached target Final Step. [ 1332.612580] systemd[1]: Starting Reboot... [ 1332.617530] systemd[1]: Shutting down. [ 1332.633727] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 1332.634510] systemd[1]: Set hardware watchdog to 10min. [ 1332.635294] watchdog: watchdog0: watchdog did not stop! [ 1332.668725] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 1332.673379] dmeventd[789]: dmeventd detected break while being idle for 5 second(s), exiting. [ 1332.677432] dmeventd[789]: dmeventd shutting down. [ 1332.678374] systemd-journald[794]: Received SIGTERM from PID 1 (systemd-shutdow). [ 1332.689652] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 1332.693887] systemd-shutdown[1]: Process 5578 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 1332.694774] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 1332.695798] systemd-shutdown[1]: Unmounting file systems. [ 1332.697217] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 1332.708418] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 1332.713113] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 1332.714020] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 1332.714895] systemd-shutdown[1]: All filesystems unmounted. [ 1332.715780] systemd-shutdown[1]: Deactivating swaps. [ 1332.716689] systemd-shutdown[1]: All swaps deactivated. [ 1332.717643] systemd-shutdown[1]: Detaching loop devices. [ 1332.719878] systemd-shutdown[1]: All loop devices detached. [ 1332.720787] systemd-shutdown[1]: Detaching DM devices. [ 1332.726863] systemd-shutdown[1]: Detaching DM 253:9. [ 1332.738272] systemd-shutdown[1]: Detaching DM 253:8. [ 1332.749259] systemd-shutdown[1]: Detaching DM 253:7. [ 1332.762275] systemd-shutdown[1]: Detaching DM 253:6. [ 1332.774221] systemd-shutdown[1]: Detaching DM 253:55. [ 1332.785231] systemd-shutdown[1]: Detaching DM 253:52. [ 1332.798216] systemd-shutdown[1]: Detaching DM 253:5. [ 1332.810168] systemd-shutdown[1]: Detaching DM 253:49. [ 1332.823236] systemd-shutdown[1]: Detaching DM 253:46. [ 1332.835234] systemd-shutdown[1]: Detaching DM 253:45. [ 1332.849206] systemd-shutdown[1]: Detaching DM 253:44. [ 1332.867225] systemd-shutdown[1]: Detaching DM 253:43. [ 1332.882268] systemd-shutdown[1]: Detaching DM 253:40. [ 1332.898242] systemd-shutdown[1]: Detaching DM 253:39. [ 1332.914216] systemd-shutdown[1]: Detaching DM 253:37. [ 1332.930221] systemd-shutdown[1]: Detaching DM 253:36. [ 1332.946270] systemd-shutdown[1]: Detaching DM 253:35. [ 1332.959218] systemd-shutdown[1]: Detaching DM 253:34. [ 1332.971228] systemd-shutdown[1]: Detaching DM 253:33. [ 1332.988222] systemd-shutdown[1]: Detaching DM 253:32. [ 1333.000257] systemd-shutdown[1]: Detaching DM 253:31. [ 1333.011233] systemd-shutdown[1]: Detaching DM 253:30. [ 1333.026258] systemd-shutdown[1]: Detaching DM 253:3. [ 1333.027295] dev_remove: 15 callbacks suppressed [ 1333.027304] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 1333.029343] systemd-shutdown[1]: Detaching DM 253:29. [ 1333.043272] systemd-shutdown[1]: Detaching DM 253:28. [ 1333.054256] systemd-shutdown[1]: Detaching DM 253:27. [ 1333.066270] systemd-shutdown[1]: Detaching DM 253:26. [ 1333.079234] systemd-shutdown[1]: Detaching DM 253:25. [ 1333.094205] systemd-shutdown[1]: Detaching DM 253:24. [ 1333.107221] systemd-shutdown[1]: Detaching DM 253:23. [ 1333.119255] systemd-shutdown[1]: Detaching DM 253:22. [ 1333.135259] systemd-shutdown[1]: Detaching DM 253:21. [ 1333.148192] systemd-shutdown[1]: Detaching DM 253:20. [ 1333.160229] systemd-shutdown[1]: Detaching DM 253:2. [ 1333.161274] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 1333.162305] systemd-shutdown[1]: Detaching DM 253:19. [ 1333.176239] systemd-shutdown[1]: Detaching DM 253:18. [ 1333.192290] systemd-shutdown[1]: Detaching DM 253:17. [ 1333.204294] systemd-shutdown[1]: Detaching DM 253:16. [ 1333.220212] systemd-shutdown[1]: Detaching DM 253:15. [ 1333.233236] systemd-shutdown[1]: Detaching DM 253:14. [ 1333.249240] systemd-shutdown[1]: Detaching DM 253:13. [ 1333.261229] systemd-shutdown[1]: Detaching DM 253:12. [ 1333.277240] systemd-shutdown[1]: Detaching DM 253:11. [ 1333.293268] systemd-shutdown[1]: Detaching DM 253:10. [ 1333.307216] systemd-shutdown[1]: Detaching DM 253:1. [ 1333.308257] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 1333.309291] systemd-shutdown[1]: Detaching DM 253:0. [ 1333.310346] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 1333.311378] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 1333.312565] systemd-shutdown[1]: Detaching DM devices. [ 1333.314242] systemd-shutdown[1]: Detaching DM 253:3. [ 1333.315312] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 1333.316396] systemd-shutdown[1]: Detaching DM 253:2. [ 1333.317482] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 1333.318555] systemd-shutdown[1]: Detaching DM 253:1. [ 1333.319639] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 1333.320737] systemd-shutdown[1]: Detaching DM 253:0. [ 1333.321836] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 1333.322770] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 1333.323690] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 1333.346593] + echo 'Hello, this is '\''/usr/lib/systemd/system-shutdown/debug.sh'\'' or '\''/usr/lib/systemd/system-shutdown/debug.sh'\''' [ 1333.347562] Hello, this is '/usr/lib/systemd/system-shutdown/debug.sh' or '/usr/lib/systemd/system-shutdown/debug.sh' [ 1333.348531] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 1333.349524] + echo 'Script args: reboot' [ 1333.350467] Script args: reboot [ 1333.351415] + set [ 1333.352375] BASH=/bin/bash [ 1333.353324] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 1333.354292] BASH_ALIASES=() [ 1333.355272] BASH_ARGC=([0]="1") [ 1333.356258] BASH_ARGV=([0]="reboot") [ 1333.357231] BASH_CMDS=() [ 1333.358170] BASH_LINENO=([0]="0") [ 1333.359128] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 1333.360091] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 1333.361054] BASH_VERSION='4.3.43(1)-release' [ 1333.362031] DIRSTACK=() [ 1333.363002] EUID=0 [ 1333.363962] GROUPS=() [ 1333.364938] HOME=/ [ 1333.365906] HOSTNAME=dom0 [ 1333.366883] HOSTTYPE=x86_64 [ 1333.367849] IFS=$' \t\n' [ 1333.368840] MACHTYPE=x86_64-redhat-linux-gnu [ 1333.369817] OPTERR=1 [ 1333.370791] OPTIND=1 [ 1333.371788] OSTYPE=linux-gnu [ 1333.372769] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 1333.373761] PIPESTATUS=([0]="0") [ 1333.374764] PPID=7065 [ 1333.375743] PS4='+ ' [ 1333.376718] PWD=/ [ 1333.377680] SHELL=/bin/bash [ 1333.378629] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 1333.379606] SHLVL=1 [ 1333.380563] TERM=linux [ 1333.381506] UID=0 [ 1333.382440] WATCHDOG_USEC=600000000 [ 1333.383359] _='Script args: reboot' [ 1333.384261] date_log_started='Mon Sep 3 00:48:31 CEST 2018' [ 1333.385173] pax_sanitize_slab=full [ 1333.386074] root_trim=yes [ 1333.387021] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 1333.387960] + sysctl kernel.sysrq=1 [ 1333.396183] kernel.sysrq = 1 [ 1333.397439] + mount -o remount,rw / [ 1333.403138] EXT4-fs (dm-4): re-mounted. Opts: discard [ 1333.404381] + df [ 1333.407785] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987880 0 1987880 0% /dev tmpfs 2001540 0 2001540 0% /dev/shm tmpfs 2001540 58736 1942804 3% /run tmpfs 2001540 0 2001540 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 11417660 190101536 6% / [ 1333.413248] + lsblk [ 1333.418372] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 1333.427772] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 1333.517766] real 0m0.090s user 0m0.054s [ 1333.520113] sys 0m0.019s [ 1333.520914] + echo 'exit code: 1' [ 1333.521706] exit code: 1 [ 1333.522537] + /usr/bin/ps axuw [ 1333.530207] /usr/bin/ps: [ 1333.530209] write error [ 1333.531020] : Invalid argument ... blah blah snipped ... ```

EDIT:

all that I've changed (from their defaults basically) in /etc/systemd/

``` coredump.conf:13: coredump.conf:14:[Coredump] journald.conf:13: journald.conf:14:[Journal] journald.conf:21:RateLimitIntervalSec=0 journald.conf:24: journald.conf:36:ForwardToSyslog=yes journald.conf:38:ForwardToKMsg=yes journald.conf:40:ForwardToConsole=yes journald.conf:42:ForwardToWall=yes journald.conf:44:TTYPath=/dev/tty12 journald.conf:46:MaxLevelStore=debug journald.conf:48:MaxLevelSyslog=debug journald.conf:50:MaxLevelKMsg=debug journald.conf:52:MaxLevelConsole=debug journald.conf:54:MaxLevelWall=emerg logind.conf:13: logind.conf:14:[Login] resolved.conf:13: resolved.conf:14:[Resolve] resolved.conf:16:DNS= resolved.conf:18:FallbackDNS= resolved.conf:21:LLMNR=no resolved.conf:23:DNSSEC=no resolved.conf:25:Cache=yes resolved.conf:26: resolved.conf:28:MulticastDNS=no resolved.conf:29: system.conf:13: system.conf:14:[Manager] system.conf:22:CrashChangeVT=yes system.conf:24:CrashShell=yes system.conf:26:CrashReboot=no system.conf:27: system.conf:29:CtrlAltDelBurstAction=reboot-force system.conf:30: system.conf:40:DefaultStandardOutput=journal+console system.conf:42:DefaultStandardError=journal+console system.conf:44:DefaultTimeoutStartSec=30s system.conf:46:DefaultTimeoutStopSec=30s timesyncd.conf:13: timesyncd.conf:14:[Time] user.conf:12: user.conf:13:[Manager] ```

/proc/cmdline

``` $ cat /proc/cmdline root=/dev/mapper/qubes_dom0-root rd.luks.uuid=luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b rd.lvm.lv=qubes_dom0/root i915.alpha_support=1 rhgb rd.luks.options=discard audit=0 root_trim=yes rd.luks.allow-discards ipv6.disable=1 loglevel=15 log_buf_len=16M printk.always_kmsg_dump=y printk.time=y printk.devkmsg=on mminit_loglevel=0 memory_corruption_check=1 fbcon=scrollback:4096k fbcon=font:ProFont6x11 net.ifnames=1 pax_sanitize_slab=full console=tty1 earlyprintk=vga systemd.log_target=kmsg udev.children-max=1256 rd.udev.children-max=1256 ```

I'm not sure how relevant this is but, xl list reports some (null) VMs(apparently sys-net and sys-firewall leftovers!) after qvm-shutdown --all --wait finishes, for a few more seconds, like:

$ ./preshutdown 
Name                                        ID   Mem VCPUs  State   Time(s)
Domain-0                                     0  4077     6     r-----     333.8
sys-net                                      1   384     2     -b----       9.4
sys-net-dm                                   2   144     1     -b----      72.7
sys-firewall                                 3  3648     2     -b----      32.4
gitsites-baseon-w-s-f-fdr28                  4  3983     2     -b----     126.8
gmail-basedon-w-s-f-fdr28                    5  3671     2     -b----      30.0
stackexchangelogins-w-s-f-fdr28              6  3655     2     -b----      14.9
2018-09-03 01:20:02,820 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector

real    0m14.026s
user    0m0.066s
sys 0m0.021s
exitcode: '0'
Name                                        ID   Mem VCPUs  State   Time(s)
Domain-0                                     0  4095     6     r-----     348.5
(null)                                       1     0     1     --ps-d      10.2
(null)                                       3     0     0     --ps-d      33.4
[ctor@dom0 ~]$ xl list
Name                                        ID   Mem VCPUs  State   Time(s)
Domain-0                                     0  4095     6     r-----     349.4
(null)                                       1     0     1     --ps-d      10.2
[ctor@dom0 ~]$ xl list
Name                                        ID   Mem VCPUs  State   Time(s)
Domain-0                                     0  4095     6     r-----     349.7
(null)                                       1     0     1     --ps-d      10.2
[ctor@dom0 ~]$ xl list
Name                                        ID   Mem VCPUs  State   Time(s)
Domain-0                                     0  4095     6     r-----     349.8
[ctor@dom0 ~]$ xl list
Name                                        ID   Mem VCPUs  State   Time(s)
Domain-0                                     0  4095     6     r-----     350.3
[ctor@dom0 ~]$

where preshutdown is:

#!/bin/bash

xl list
time qvm-shutdown --verbose --all --wait; echo "exitcode: '$?'"
xl list

Something seems wrong with the ~~(reported?)~~order of execution here:

[ 2264.120719] systemd-logind[1887]: System is rebooting.
...
[ 2264.128178] systemd[1]: Stopping Session 2 of user ctor.
...
[ 2294.230402] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop timed out.
...
[ 2294.233143] systemd[1]: Timed out stopping /sys/devices/virtual/block/dm-0.
...
[ 2294.245285] systemd[1]: session-2.scope: Stopping timed out. Killing.
...
[ 2294.249906] systemd[1]: Stopped Session 2 of user ctor.
...
[ 2294.286218] systemd[1]: Stopping Qubes Dom0 startup setup...
...
[ 2306.406772] echo[12427]: will sleep for 5 sec
[ 2311.415800] echo[12456]: done sleeping for 5 sec
...
[ 2311.444059] ps[12463]: root         8  0.0  0.0      0     0 ?        I    00:49   0:00 [rcu_sched]
[ 2311.445569] systemd[1]: Stopped Qubes Dom0 startup setup.
[ 2311.448041] ps[12463]: root         9  0.0  0.0      0     0 ?        I    00:49   0:00 [rcu_bh]
...

all that while using the following qubes-core.service (note: I did do the required sudo systemctl daemon-reload after modifying the file with the echos):

[Unit]
Description=Qubes Dom0 startup setup
After=qubes-db-dom0.service libvirtd.service xenconsoled.service qubesd.service qubes-qmemman.service
# Cover legacy init.d script

[Service]
Type=oneshot
StandardOutput=syslog
RemainAfterExit=yes
# Needed to avoid rebooting before all VMs have shut down.
TimeoutStopSec=180
ExecStart=/usr/lib/qubes/startup-misc.sh
ExecStop=-/usr/bin/pkill qubes-guid
ExecStop=/usr/bin/qvm-shutdown --verbose --all --wait
# QubesDB daemons stop after 60s timeout in worst case; speed it up, since no
# VMs are running now
ExecStop=/usr/bin/echo "will sleep for 5 sec"
ExecStop=/usr/bin/sleep 5
ExecStop=/usr/bin/echo "done sleeping for 5 sec"
ExecStop=-/usr/bin/pkill qubesdb-daemon
ExecStopPost=-/usr/bin/ps axuw
ExecStopPost=-/usr/bin/xl list

[Install]
WantedBy=multi-user.target
Also=qubes-meminfo-writer-dom0.service qubes-qmemman.service
Alias=qubes_core.service

full(sort of) log here(click me) (**EDIT** took at least 53 seconds to Restart):

``` [ 2264.120719] systemd-logind[1887]: System is rebooting. [ 2264.126381] systemd[1]: Stopping Accounts Service... [ 2264.126616] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 2264.126790] systemd[1]: Removed slice system-getty.slice. [ 2264.128178] systemd[1]: Stopping Session 2 of user ctor. [ 2264.128202] systemd[1]: Stopped target Timers. [ 2264.128234] systemd[1]: Stopped Discard unused blocks once a week. [ 2264.128256] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 2264.135180] lightdm[3245]: Error opening audit socket: Protocol not supported [ 2264.137469] lightdm[3329]: pam_unix(lightdm:session): session closed for user ctor [ 2264.138865] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 2264.139255] systemd[1]: Stopping Authorization Manager... [ 2264.141575] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 2264.141751] systemd[1]: Stopped target Sound Card. [ 2264.141851] systemd[1]: Stopped target Graphical Interface. [ 2264.142065] systemd[1]: Stopping Daemon for power management... [ 2264.142204] systemd[1]: Stopping Light Display Manager... [ 2264.142222] systemd[1]: Stopped target Multi-User System. [ 2264.142412] systemd[1]: Stopping Command Scheduler... [ 2264.142944] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 2264.144053] systemd[1]: Stopping User Manager for UID 1000... [ 2264.144091] systemd[1]: Stopped target Login Prompts. [ 2264.146189] systemd[1]: Stopping Serial Getty on hvc0... [ 2264.149768] alsactl[1914]: alsactl daemon stopped [ 2264.155552] crond[3244]: (CRON) INFO (Shutting down) [ 2264.170367] systemd[1]: Stopped Daemon for power management. [ 2264.170730] systemd[1]: Stopped Command Scheduler. [ 2264.170986] systemd[1]: Stopped Accounts Service. [ 2264.171245] systemd[1]: Stopped Authorization Manager. [ 2264.171682] systemd[1]: Stopped Serial Getty on hvc0. [ 2264.172245] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 2264.173042] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 2264.177383] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 2264.196155] qubes.WindowIconUpdater-sys-firewall[10409]: Traceback (most recent call last): [ 2264.196485] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 2264.196647] qubes.WindowIconUpdater-sys-firewall[10409]: return f(*args) [ 2264.196850] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 2264.197010] qubes.WindowIconUpdater-sys-firewall[10409]: self.invalid() [ 2264.197165] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 2264.197315] qubes.WindowIconUpdater-sys-firewall[10409]: raise ConnectionException(err) [ 2264.197497] qubes.WindowIconUpdater-sys-firewall[10409]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 2264.197651] qubes.WindowIconUpdater-sys-firewall[10409]: [ 2264.197929] qubes.WindowIconUpdater-sys-firewall[10409]: During handling of the above exception, another exception occurred: [ 2264.198082] qubes.WindowIconUpdater-sys-firewall[10409]: [ 2264.198232] qubes.WindowIconUpdater-sys-firewall[10409]: Traceback (most recent call last): [ 2264.198390] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 2264.198549] qubes.WindowIconUpdater-sys-firewall[10409]: rcvd.handle_input() [ 2264.198701] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 2264.199102] qubes.WindowIconUpdater-sys-firewall[10409]: self.handle_events() [ 2264.200324] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 2264.200520] qubes.WindowIconUpdater-sys-firewall[10409]: for ev in iter(self.conn.poll_for_event, None): [ 2264.200705] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 2264.200896] qubes.WindowIconUpdater-sys-firewall[10409]: self.invalid() [ 2264.201050] qubes.WindowIconUpdater-sys-firewall[10409]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 2264.201201] qubes.WindowIconUpdater-sys-firewall[10409]: raise ConnectionException(err) [ 2264.201359] qubes.WindowIconUpdater-sys-firewall[10409]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 2264.201511] qubes.WindowIconUpdater-sys-net[10063]: Traceback (most recent call last): [ 2264.201706] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 2264.201927] qubes.WindowIconUpdater-sys-net[10063]: return f(*args) [ 2264.202072] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 2264.202217] qubes.WindowIconUpdater-sys-net[10063]: self.invalid() [ 2264.202360] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 2264.202506] qubes.WindowIconUpdater-sys-net[10063]: raise ConnectionException(err) [ 2264.202656] qubes.WindowIconUpdater-sys-net[10063]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 2264.202882] qubes.WindowIconUpdater-sys-net[10063]: [ 2264.203034] qubes.WindowIconUpdater-sys-net[10063]: During handling of the above exception, another exception occurred: [ 2264.203189] qubes.WindowIconUpdater-sys-net[10063]: [ 2264.203340] qubes.WindowIconUpdater-sys-net[10063]: Traceback (most recent call last): [ 2264.203496] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 2264.203645] qubes.WindowIconUpdater-sys-net[10063]: rcvd.handle_input() [ 2264.203912] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 2264.204066] qubes.WindowIconUpdater-sys-net[10063]: self.handle_events() [ 2264.204216] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 2264.204376] qubes.WindowIconUpdater-sys-net[10063]: for ev in iter(self.conn.poll_for_event, None): [ 2264.204526] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 2264.204679] qubes.WindowIconUpdater-sys-net[10063]: self.invalid() [ 2264.204902] qubes.WindowIconUpdater-sys-net[10063]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 2264.205054] qubes.WindowIconUpdater-sys-net[10063]: raise ConnectionException(err) [ 2264.205205] qubes.WindowIconUpdater-sys-net[10063]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 2264.211584] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: Traceback (most recent call last): [ 2264.211883] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 2264.212046] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: return f(*args) [ 2264.212203] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 2264.212354] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: self.invalid() [ 2264.212509] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 2264.212663] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: raise ConnectionException(err) [ 2264.212894] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 2264.213045] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: [ 2264.213201] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: During handling of the above exception, another exception occurred: [ 2264.213370] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: [ 2264.213552] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: Traceback (most recent call last): [ 2264.213886] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 2264.214045] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: rcvd.handle_input() [ 2264.214195] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 2264.214352] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: self.handle_events() [ 2264.214502] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 2264.214647] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: for ev in iter(self.conn.poll_for_event, None): [ 2264.214894] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 2264.215053] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: self.invalid() [ 2264.215245] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 2264.215400] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: raise ConnectionException(err) [ 2264.215549] qubes.WindowIconUpdater-gitsites-baseon-w-s-f-fdr28[10456]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 2264.230935] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=52945916, total_mem_pref=2423798579.2, total_available_memory=30490226644.800003) [ 2264.231242] qmemman.daemon.algo[1918]: left_memory=5237833083 acceptors_count=1 [ 2264.311119] systemd[3342]: Received SIGRTMIN+24 from PID 10954 (kill). [ 2264.313132] systemd[1]: Stopped User Manager for UID 1000. [ 2264.379765] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=52945916, total_mem_pref=2320950067.2000003, total_available_memory=30593075156.800003) [ 2264.380012] qmemman.daemon.algo[1918]: left_memory=5841663044 acceptors_count=1 [ 2264.405995] systemd[1]: Stopped Light Display Manager. [ 2264.407652] systemd[1]: Starting Show Plymouth Reboot Screen... [ 2264.431351] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=52945916, total_mem_pref=2032276684.8000002, total_available_memory=30881748539.2) [ 2264.431635] qmemman.daemon.algo[1918]: left_memory=7862992377 acceptors_count=1 [ 2264.436078] systemd[1]: Started Show Plymouth Reboot Screen. [ 2264.646394] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 2266.443855] usb 5-1: USB disconnect, device number 2 [ 2266.474998] qubesd[1912]: socket.send() raised exception. [ 2266.475271] qubesd[1912]: socket.send() raised exception. [ 2266.475432] qubesd[1912]: socket.send() raised exception. [ 2266.475617] qubesd[1912]: socket.send() raised exception. [ 2266.475790] qubesd[1912]: socket.send() raised exception. [ 2266.475940] qubesd[1912]: socket.send() raised exception. [ 2266.476174] qubesd[1912]: socket.send() raised exception. [ 2266.476325] qubesd[1912]: socket.send() raised exception. [ 2266.476481] qubesd[1912]: socket.send() raised exception. [ 2266.476631] qubesd[1912]: socket.send() raised exception. [ 2266.476785] qubesd[1912]: socket.send() raised exception. [ 2266.476932] qubesd[1912]: socket.send() raised exception. [ 2266.477079] qubesd[1912]: socket.send() raised exception. [ 2266.477252] qubesd[1912]: socket.send() raised exception. [ 2266.477435] qubesd[1912]: socket.send() raised exception. [ 2266.477599] qubesd[1912]: socket.send() raised exception. [ 2266.477769] qubesd[1912]: socket.send() raised exception. [ 2266.477925] qubesd[1912]: socket.send() raised exception. [ 2266.478075] qubesd[1912]: socket.send() raised exception. [ 2266.478260] qubesd[1912]: socket.send() raised exception. [ 2266.478413] qubesd[1912]: socket.send() raised exception. [ 2266.478565] qubesd[1912]: socket.send() raised exception. [ 2266.478724] qubesd[1912]: socket.send() raised exception. [ 2266.478900] qubesd[1912]: socket.send() raised exception. [ 2266.479060] qubesd[1912]: socket.send() raised exception. [ 2266.479209] qubesd[1912]: socket.send() raised exception. [ 2266.479356] qubesd[1912]: socket.send() raised exception. [ 2266.479786] qubesd[1912]: socket.send() raised exception. [ 2266.479943] qubesd[1912]: socket.send() raised exception. [ 2266.480099] qubesd[1912]: socket.send() raised exception. [ 2266.683701] usb 5-1: new low-speed USB device number 4 using xhci_hcd [ 2266.823473] qubesd[1912]: socket.send() raised exception. [ 2266.823749] qubesd[1912]: socket.send() raised exception. [ 2266.823916] qubesd[1912]: socket.send() raised exception. [ 2266.824061] qubesd[1912]: socket.send() raised exception. [ 2266.824204] qubesd[1912]: socket.send() raised exception. [ 2266.824345] qubesd[1912]: socket.send() raised exception. [ 2266.824510] qubesd[1912]: socket.send() raised exception. [ 2266.824653] qubesd[1912]: socket.send() raised exception. [ 2266.824834] qubesd[1912]: socket.send() raised exception. [ 2266.824975] qubesd[1912]: socket.send() raised exception. [ 2266.825117] qubesd[1912]: socket.send() raised exception. [ 2266.825264] qubesd[1912]: socket.send() raised exception. [ 2266.825416] qubesd[1912]: socket.send() raised exception. [ 2266.825556] qubesd[1912]: socket.send() raised exception. [ 2266.825720] qubesd[1912]: socket.send() raised exception. [ 2266.825888] qubesd[1912]: socket.send() raised exception. [ 2266.826026] qubesd[1912]: socket.send() raised exception. [ 2266.826163] qubesd[1912]: socket.send() raised exception. [ 2266.826301] qubesd[1912]: socket.send() raised exception. [ 2266.826438] qubesd[1912]: socket.send() raised exception. [ 2266.826576] qubesd[1912]: socket.send() raised exception. [ 2266.826736] qubesd[1912]: socket.send() raised exception. [ 2266.826896] qubesd[1912]: socket.send() raised exception. [ 2266.827040] qubesd[1912]: socket.send() raised exception. [ 2266.827181] qubesd[1912]: socket.send() raised exception. [ 2266.827319] qubesd[1912]: socket.send() raised exception. [ 2266.827801] qubesd[1912]: socket.send() raised exception. [ 2266.827970] qubesd[1912]: socket.send() raised exception. [ 2266.828107] qubesd[1912]: socket.send() raised exception. [ 2266.828252] qubesd[1912]: socket.send() raised exception. [ 2266.828390] qubesd[1912]: socket.send() raised exception. [ 2266.828528] qubesd[1912]: socket.send() raised exception. [ 2266.828665] qubesd[1912]: socket.send() raised exception. [ 2266.828846] qubesd[1912]: socket.send() raised exception. [ 2266.829019] qubesd[1912]: socket.send() raised exception. [ 2266.829157] qubesd[1912]: socket.send() raised exception. [ 2266.829304] qubesd[1912]: socket.send() raised exception. [ 2266.829455] qubesd[1912]: socket.send() raised exception. [ 2266.829593] qubesd[1912]: socket.send() raised exception. [ 2266.829809] qubesd[1912]: socket.send() raised exception. [ 2266.829982] qubesd[1912]: socket.send() raised exception. [ 2266.830121] qubesd[1912]: socket.send() raised exception. [ 2266.830258] qubesd[1912]: socket.send() raised exception. [ 2266.830395] qubesd[1912]: socket.send() raised exception. [ 2266.830533] qubesd[1912]: socket.send() raised exception. [ 2266.830670] qubesd[1912]: socket.send() raised exception. [ 2266.830843] qubesd[1912]: socket.send() raised exception. [ 2266.830980] qubesd[1912]: socket.send() raised exception. [ 2266.831117] qubesd[1912]: socket.send() raised exception. [ 2266.831254] qubesd[1912]: socket.send() raised exception. [ 2266.831391] qubesd[1912]: socket.send() raised exception. [ 2266.831535] qubesd[1912]: socket.send() raised exception. [ 2266.831727] qubesd[1912]: socket.send() raised exception. [ 2266.831893] qubesd[1912]: socket.send() raised exception. [ 2266.837892] usb 5-1: New USB device found, idVendor=1c4f, idProduct=0034 [ 2266.837906] usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 2266.837918] usb 5-1: Product: Usb Mouse [ 2266.837926] usb 5-1: Manufacturer: SIGMACHIP [ 2266.848074] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:1c.7/0000:04:00.0/usb5/5-1/5-1:1.0/0003:1C4F:0034.0006/input/input19 [ 2266.849180] hid-generic 0003:1C4F:0034.0006: input,hidraw1: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:04:00.0-1/input0 [ 2269.420376] systemd[1]: Received SIGRTMIN+20 from PID 10961 (plymouthd). [ 2286.896468] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=52945916, total_mem_pref=1989385420.8000002, total_available_memory=30924639803.2) [ 2286.897655] qmemman.daemon.algo[1918]: left_memory=7504459168 acceptors_count=1 [ 2294.230402] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop timed out. [ 2294.231222] systemd[1]: Timed out stopping /dev/disk/by-id/lvm-pv-uuid-pxC3ch-0MF0-OzJs-Jogd-9rOz-JkSt-Cf8G7m. [ 2294.232131] systemd[1]: dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device: Job dev-disk-by\x2did-lvm\x2dpv\x2duuid\x2dpxC3ch\x2d0MF0\x2dOzJs\x2dJogd\x2d9rOz\x2dJkSt\x2dCf8G7m.device/stop failed with result 'timeout'. [ 2294.233138] systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop timed out. [ 2294.233143] systemd[1]: Timed out stopping /sys/devices/virtual/block/dm-0. [ 2294.236580] systemd[1]: sys-devices-virtual-block-dm\x2d0.device: Job sys-devices-virtual-block-dm\x2d0.device/stop failed with result 'timeout'. [ 2294.237526] systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. [ 2294.237532] systemd[1]: Timed out stopping /dev/disk/by-id/dm-name-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 2294.239403] systemd[1]: dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2dname\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. [ 2294.239423] systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop timed out. [ 2294.239428] systemd[1]: Timed out stopping /dev/dm-0. [ 2294.244245] systemd[1]: dev-dm\x2d0.device: Job dev-dm\x2d0.device/stop failed with result 'timeout'. [ 2294.245285] systemd[1]: session-2.scope: Stopping timed out. Killing. [ 2294.245342] systemd[1]: session-2.scope: Killing process 9711 (qubes-guid) with signal SIGKILL. [ 2294.245548] systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop timed out. [ 2294.245556] systemd[1]: Timed out stopping /dev/disk/by-id/dm-uuid-CRYPT-LUKS1-9ed952b52aa84564b700fb23f5c9e94b-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 2294.249681] systemd[1]: dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device: Job dev-disk-by\x2did-dm\x2duuid\x2dCRYPT\x2dLUKS1\x2d9ed952b52aa84564b700fb23f5c9e94b\x2dluks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.device/stop failed with result 'timeout'. [ 2294.249906] systemd[1]: Stopped Session 2 of user ctor. [ 2294.254041] systemd[1]: session-2.scope: Unit entered failed state. [ 2294.254871] systemd[1]: Removed slice User Slice of ctor. [ 2294.259793] systemd[1]: Stopping Permit User Sessions... [ 2294.262141] systemd[1]: Stopping Login Service... [ 2294.266121] systemd[1]: Stopped Permit User Sessions. [ 2294.269506] systemd[1]: Stopped Start Qubes VM sys-net. [ 2294.271961] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 2294.275165] systemd[1]: Stopping Qubes memory information reporter... [ 2294.278445] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 2294.281975] systemd[1]: Stopped Qubes memory information reporter. [ 2294.286218] systemd[1]: Stopping Qubes Dom0 startup setup... [ 2294.337162] systemd[1]: Stopped Login Service. [ 2294.338889] systemd[1]: Stopped target User and Group Name Lookups. [ 2294.367105] qvm-shutdown[11027]: 2018-09-03 01:27:23,775 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector [ 2296.835236] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=52945916, total_mem_pref=1989385420.8000002, total_available_memory=30924639803.2) [ 2296.837052] qmemman.daemon.algo[1918]: left_memory=7504459168 acceptors_count=1 [ 2297.307406] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=4242574697, total_mem_pref=1484349440.0, total_available_memory=31425000565.0) [ 2297.308938] qmemman.daemon.algo[1918]: left_memory=5917303964 acceptors_count=1 [ 2297.310392] qmemman.systemstate[1918]: stat: dom '0' act=24472471308 pref=1027817062.4 last_target=24472471308 [ 2297.311865] qmemman.systemstate[1918]: stat: dom '9' act=4194304000 pref=456532377.6 last_target=4194304000 [ 2297.313289] qmemman.systemstate[1918]: stat: xenfree=4295003497 memset_reqs=[('9', 4194304000), ('0', 28676219350)] [ 2297.314790] qmemman.systemstate[1918]: mem-set domain 9 to 4194304000 [ 2297.316230] qmemman.systemstate[1918]: mem-set domain 0 to 28676219350 [ 2297.609812] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2297.845640] lvm[774]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 2297.979317] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2298.215888] lvm[774]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 2298.740772] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=46806372, total_mem_pref=1352741683.2, total_available_memory=31564588038.8) [ 2298.742535] qmemman.daemon.algo[1918]: left_memory=3704436283 acceptors_count=1 [ 2301.147404] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=46806372, total_mem_pref=1352741683.2, total_available_memory=31564588038.8) [ 2301.149294] qmemman.daemon.algo[1918]: left_memory=3704436283 acceptors_count=1 [ 2301.646097] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=4237861708, total_mem_pref=1027817062.4, total_available_memory=31886263995.6) [ 2301.647845] qmemman.systemstate[1918]: stat: dom '0' act=28676219350 pref=1027817062.4 last_target=28676219350 [ 2301.649466] qmemman.systemstate[1918]: stat: xenfree=4290290508 memset_reqs=[('0', 32881166976)] [ 2301.651120] qmemman.systemstate[1918]: mem-set domain 0 to 32881166976 [ 2301.896803] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2302.119963] lvm[774]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 2302.255522] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2302.477198] lvm[774]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 2304.684086] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=39455595, total_mem_pref=1027817062.4, total_available_memory=31892805508.6) [ 2305.099439] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=189479556, total_mem_pref=1027817062.4, total_available_memory=32042829469.6) [ 2305.101338] qmemman.systemstate[1918]: stat: dom '0' act=32881166976 pref=1027817062.4 last_target=32881166976 [ 2305.103118] qmemman.systemstate[1918]: stat: xenfree=241908356 memset_reqs=[('0', 33037575885)] [ 2305.104900] qmemman.systemstate[1918]: mem-set domain 0 to 33037575885 [ 2305.174387] qmemman.daemon.algo[1918]: balance_when_enough_memory(xen_free_memory=438606444, total_mem_pref=1027817062.4, total_available_memory=32448365266.6) [ 2305.176452] qmemman.systemstate[1918]: stat: dom '0' act=33037575885 pref=1027817062.4 last_target=33037575885 [ 2305.178239] qmemman.systemstate[1918]: stat: xenfree=491035244 memset_reqs=[('0', 33442706146)] [ 2305.179995] qmemman.systemstate[1918]: mem-set domain 0 to 33442706146 [ 2305.434059] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2305.644958] lvm[774]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 2305.758603] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2305.966645] lvm[774]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 2306.406772] echo[12427]: will sleep for 5 sec [ 2311.415800] echo[12456]: done sleeping for 5 sec [ 2311.424726] qubesdb-daemon[1913]: terminating [ 2311.427140] systemd[1]: Stopped Qubes DB agent. [ 2311.432752] ps[12463]: USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND [ 2311.434638] ps[12463]: root 1 0.0 0.1 212548 7552 ? Ss 00:49 0:00 /usr/lib/systemd/systemd --switched-root --system --deserialize 22 [ 2311.436479] ps[12463]: root 2 0.0 0.0 0 0 ? S 00:49 0:00 [kthreadd] [ 2311.438369] ps[12463]: root 4 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/0:0H] [ 2311.440254] ps[12463]: root 6 0.0 0.0 0 0 ? I< 00:49 0:00 [mm_percpu_wq] [ 2311.442214] ps[12463]: root 7 0.0 0.0 0 0 ? S 00:49 0:00 [ksoftirqd/0] [ 2311.444059] ps[12463]: root 8 0.0 0.0 0 0 ? I 00:49 0:00 [rcu_sched] [ 2311.445569] systemd[1]: Stopped Qubes Dom0 startup setup. [ 2311.448041] ps[12463]: root 9 0.0 0.0 0 0 ? I 00:49 0:00 [rcu_bh] [ 2311.448592] systemd[1]: Stopping Virtualization daemon... [ 2311.455033] ps[12463]: root 10 0.0 0.0 0 0 ? S 00:49 0:00 [migration/0] [ 2311.455041] systemd[1]: Stopping Qubes OS daemon... [ 2311.461921] ps[12463]: root 11 0.0 0.0 0 0 ? S 00:49 0:00 [watchdog/0] [ 2311.461949] systemd[1]: Stopping Qubes memory management daemon... [ 2311.469165] ps[12463]: root 12 0.0 0.0 0 0 ? S 00:49 0:00 [cpuhp/0] [ 2311.469182] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 2311.476439] ps[12463]: root 13 0.0 0.0 0 0 ? S 00:49 0:00 [cpuhp/1] [ 2311.476681] systemd[1]: Stopped Qubes memory management daemon. [ 2311.483753] ps[12463]: root 14 0.0 0.0 0 0 ? S 00:49 0:00 [watchdog/1] [ 2311.483966] systemd[1]: Stopped Virtualization daemon. [ 2311.491274] ps[12463]: root 15 0.0 0.0 0 0 ? S 00:49 0:00 [migration/1] [ 2311.491510] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 2311.499211] ps[12463]: root 16 0.0 0.0 0 0 ? S 00:49 0:00 [ksoftirqd/1] [ 2311.499370] systemd[1]: Stopped Qubes OS daemon. [ 2311.507020] ps[12463]: root 18 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/1:0H] [ 2311.509315] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 2311.514831] systemd[1]: Stopped target Remote File Systems. [ 2311.514867] ps[12463]: root 19 0.0 0.0 0 0 ? S 00:49 0:00 [cpuhp/2] [ 2311.522557] ps[12463]: root 20 0.0 0.0 0 0 ? S 00:49 0:00 [watchdog/2] [ 2311.522655] systemd[1]: Stopping D-Bus System Message Bus... [ 2311.530450] ps[12463]: root 21 0.0 0.0 0 0 ? S 00:49 0:00 [migration/2] [ 2311.530516] systemd[1]: Stopping The Xen xenstore... [ 2311.538289] ps[12463]: root 22 0.0 0.0 0 0 ? S 00:49 0:00 [ksoftirqd/2] [ 2311.538525] systemd[1]: Stopped D-Bus System Message Bus. [ 2311.545711] ps[12463]: root 24 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/2:0H] [ 2311.545994] systemd[1]: Stopped The Xen xenstore. [ 2311.549798] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 2311.555324] systemd[1]: Failed to propagate agent release message: Connection reset by peer [ 2311.555529] systemd[1]: Failed to propagate agent release message: Transport endpoint is not connected [ 2311.555744] systemd[1]: Failed to propagate agent release message: Transport endpoint is not connected [ 2311.555786] systemd[1]: Failed to propagate agent release message: Transport endpoint is not connected [ 2311.555821] systemd[1]: Failed to propagate agent release message: Transport endpoint is not connected [ 2311.556017] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 2311.568887] ps[12463]: root 25 0.0 0.0 0 0 ? S 00:49 0:00 [cpuhp/3] [ 2311.573905] systemd[1]: Stopped target Basic System. [ 2311.575638] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 2311.580482] systemd[1]: Stopped target Paths. [ 2311.582073] systemd[1]: Stopped target Slices. [ 2311.584049] systemd[1]: Removed slice User and Session Slice. [ 2311.588572] systemd[1]: Stopped target Sockets. [ 2311.590150] systemd[1]: Closed Virtual machine log manager socket. [ 2311.591780] systemd[1]: Closed Virtual machine lock manager socket. [ 2311.596760] systemd[1]: Closed D-Bus System Message Bus Socket. [ 2311.598593] systemd[1]: Stopped target System Initialization. [ 2311.601433] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 2311.605468] ps[12463]: root 26 0.0 0.0 0 0 ? S 00:49 0:00 [watchdog/3] [ 2311.605784] systemd[1]: Stopped Load legacy module configuration. [ 2311.615833] systemd[1]: Stopped Setup Virtual Console. [ 2311.620887] systemd[1]: Stopped Apply Kernel Variables. [ 2311.625877] systemd[1]: Stopped Load Kernel Modules. [ 2311.630613] systemd[1]: Stopped target Encrypted Volumes. [ 2311.633571] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 2311.637498] ps[12463]: root 27 0.0 0.0 0 0 ? S 00:49 0:00 [migration/3] [ 2311.641720] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 2311.648892] systemd[1]: Stopping Load/Save Random Seed... [ 2311.653813] systemd[1]: Stopped Load/Save Random Seed. [ 2311.660053] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 2311.663939] systemd[1]: Stopped Create Volatile Files and Directories. [ 2311.668507] systemd[1]: Stopped target Local File Systems. [ 2311.668572] ps[12463]: root 28 0.0 0.0 0 0 ? S 00:49 0:00 [ksoftirqd/3] [ 2311.676210] systemd[1]: Unmounting mount xenstore file system... [ 2311.680618] systemd[1]: Stopped Configure read-only root support. [ 2311.686405] systemd[1]: Unmounting /boot/efi... [ 2311.691710] systemd[1]: Unmounting Temporary Directory... [ 2311.696765] qubesd[1912]: caught SIGTERM, exiting [ 2311.696842] systemd[1]: Unmounting /run/user/1000... [ 2311.706569] systemd[1]: Unmounted mount xenstore file system. [ 2311.710817] ps[12463]: root 30 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/3:0H] [ 2311.710861] systemd[1]: Unmounted /boot/efi. [ 2311.717127] systemd[1]: Unmounted Temporary Directory. [ 2311.721852] systemd[1]: Unmounted /run/user/1000. [ 2311.726995] systemd[1]: Stopped target Swap. [ 2311.731285] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 2311.732824] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 2311.737539] ps[12463]: root 31 0.0 0.0 0 0 ? S 00:49 0:00 [cpuhp/4] [ 2311.738556] systemd[1]: Unmounting Mount /proc/xen files... [ 2311.743692] systemd[1]: Stopped target Local File Systems (Pre). [ 2311.749619] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 2311.753887] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 2311.758724] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 2311.763950] systemd[1]: Unmounted Mount /proc/xen files. [ 2311.768235] ps[12463]: root 32 0.0 0.0 0 0 ? S 00:49 0:00 [watchdog/4] [ 2311.785049] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 2311.788726] systemd[1]: Stopping LVM2 metadata daemon... [ 2311.793603] ps[12463]: root 33 0.0 0.0 0 0 ? S 00:49 0:00 [migration/4] [ 2311.793779] systemd[1]: Stopped LVM2 metadata daemon. [ 2311.809932] ps[12463]: root 34 0.0 0.0 0 0 ? S 00:49 0:00 [ksoftirqd/4] [ 2311.811399] ps[12463]: root 36 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/4:0H] [ 2311.812879] ps[12463]: root 37 0.0 0.0 0 0 ? S 00:49 0:00 [cpuhp/5] [ 2311.814338] ps[12463]: root 38 0.0 0.0 0 0 ? S 00:49 0:00 [watchdog/5] [ 2311.815804] ps[12463]: root 39 0.0 0.0 0 0 ? S 00:49 0:00 [migration/5] [ 2311.817271] ps[12463]: root 40 0.0 0.0 0 0 ? S 00:49 0:00 [ksoftirqd/5] [ 2311.818714] ps[12463]: root 42 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/5:0H] [ 2311.820157] ps[12463]: root 43 0.0 0.0 0 0 ? S 00:49 0:00 [kdevtmpfs] [ 2311.821584] ps[12463]: root 44 0.0 0.0 0 0 ? I< 00:49 0:00 [netns] [ 2311.822979] ps[12463]: root 45 0.0 0.0 0 0 ? S 00:49 0:00 [xenbus] [ 2311.824389] ps[12463]: root 46 0.0 0.0 0 0 ? S 00:49 0:00 [xenwatch] [ 2311.825786] ps[12463]: root 48 0.0 0.0 0 0 ? S 00:49 0:00 [oom_reaper] [ 2311.827182] ps[12463]: root 49 0.0 0.0 0 0 ? I< 00:49 0:00 [writeback] [ 2311.828576] ps[12463]: root 50 0.0 0.0 0 0 ? S 00:49 0:00 [kcompactd0] [ 2311.830011] ps[12463]: root 51 0.0 0.0 0 0 ? SN 00:49 0:00 [ksmd] [ 2311.831629] ps[12463]: root 52 0.0 0.0 0 0 ? I< 00:49 0:00 [crypto] [ 2311.833247] ps[12463]: root 53 0.0 0.0 0 0 ? I< 00:49 0:00 [kintegrityd] [ 2311.834847] ps[12463]: root 54 0.0 0.0 0 0 ? I< 00:49 0:00 [kblockd] [ 2311.836447] ps[12463]: root 60 0.0 0.0 0 0 ? I< 00:49 0:00 [ata_sff] [ 2311.837930] ps[12463]: root 61 0.0 0.0 0 0 ? I< 00:49 0:00 [md] [ 2311.839257] ps[12463]: root 62 0.0 0.0 0 0 ? I< 00:49 0:00 [edac-poller] [ 2311.840582] ps[12463]: root 63 0.0 0.0 0 0 ? I< 00:49 0:00 [devfreq_wq] [ 2311.842343] libvirtd[1935]: S3 disabled [ 2311.843681] libvirtd[1935]: S4 disabled [ 2311.844962] libvirtd[1935]: S3 disabled [ 2311.846216] libvirtd[1935]: S4 disabled [ 2311.847493] libvirtd[1935]: S3 disabled [ 2311.848728] libvirtd[1935]: S4 disabled [ 2311.849985] libvirtd[1935]: S3 disabled [ 2311.851220] libvirtd[1935]: S4 disabled [ 2311.852436] libvirtd[1935]: S3 disabled [ 2311.853657] libvirtd[1935]: S4 disabled [ 2311.854877] libvirtd[1935]: S3 disabled [ 2311.856077] libvirtd[1935]: S4 disabled [ 2311.857504] ps[12463]: root 64 0.0 0.0 0 0 ? I< 00:49 0:00 [watchdogd] [ 2311.858739] ps[12463]: root 66 0.0 0.0 0 0 ? S 00:49 0:00 [kswapd0] [ 2311.859970] ps[12463]: root 115 0.0 0.0 0 0 ? I< 00:49 0:00 [kthrotld] [ 2311.861190] ps[12463]: root 116 0.0 0.0 0 0 ? I< 00:49 0:00 [acpi_thermal_pm] [ 2311.862406] ps[12463]: root 117 0.0 0.0 0 0 ? S 00:49 0:00 [khvcd] [ 2311.863621] ps[12463]: root 118 0.0 0.0 0 0 ? S 00:49 0:00 [scsi_eh_0] [ 2311.864830] ps[12463]: root 119 0.0 0.0 0 0 ? I< 00:49 0:00 [scsi_tmf_0] [ 2311.866029] ps[12463]: root 120 0.0 0.0 0 0 ? S 00:49 0:00 [scsi_eh_1] [ 2311.867226] ps[12463]: root 121 0.0 0.0 0 0 ? I< 00:49 0:00 [scsi_tmf_1] [ 2311.868408] ps[12463]: root 122 0.0 0.0 0 0 ? S 00:49 0:00 [scsi_eh_2] [ 2311.869583] ps[12463]: root 123 0.0 0.0 0 0 ? I< 00:49 0:00 [scsi_tmf_2] [ 2311.870777] ps[12463]: root 124 0.0 0.0 0 0 ? S 00:49 0:00 [scsi_eh_3] [ 2311.871963] ps[12463]: root 125 0.0 0.0 0 0 ? I< 00:49 0:00 [scsi_tmf_3] [ 2311.873134] ps[12463]: root 126 0.0 0.0 0 0 ? S 00:49 0:00 [scsi_eh_4] [ 2311.874314] ps[12463]: root 127 0.0 0.0 0 0 ? I< 00:49 0:00 [scsi_tmf_4] [ 2311.875487] ps[12463]: root 128 0.0 0.0 0 0 ? S 00:49 0:00 [scsi_eh_5] [ 2311.876651] ps[12463]: root 129 0.0 0.0 0 0 ? I< 00:49 0:00 [scsi_tmf_5] [ 2311.877816] ps[12463]: root 130 0.0 0.0 0 0 ? I 00:49 0:00 [kworker/u12:2] [ 2311.878964] ps[12463]: root 132 0.0 0.0 0 0 ? I 00:49 0:01 [kworker/u12:4] [ 2311.880112] ps[12463]: root 133 0.0 0.0 0 0 ? I 00:49 0:01 [kworker/u12:5] [ 2311.881239] ps[12463]: root 134 0.0 0.0 0 0 ? I< 00:49 0:00 [dm_bufio_cache] [ 2311.882372] ps[12463]: root 135 0.0 0.0 0 0 ? I< 00:49 0:00 [kstrp] [ 2311.883486] ps[12463]: root 221 0.0 0.0 0 0 ? I 00:49 0:00 [kworker/5:2] [ 2311.884598] ps[12463]: root 263 0.0 0.0 0 0 ? I 00:49 0:00 [kworker/2:2] [ 2311.885721] ps[12463]: root 283 0.0 0.0 0 0 ? I 00:49 0:00 [kworker/0:2] [ 2311.886830] ps[12463]: root 482 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/0:1H] [ 2311.888246] dmeventd[774]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 2311.889512] xl[12466]: Name ID Mem VCPUs State Time(s) [ 2311.890638] xl[12466]: Domain-0 0 4096 6 r----- 461.5 [ 2311.891824] ps[12463]: root 523 0.0 0.0 0 0 ? S 00:49 0:00 [i915/signal:0] [ 2311.892945] ps[12463]: root 524 0.0 0.0 0 0 ? S 00:49 0:00 [i915/signal:1] [ 2311.894087] ps[12463]: root 525 0.0 0.0 0 0 ? S 00:49 0:00 [i915/signal:2] [ 2311.895197] ps[12463]: root 526 0.0 0.0 0 0 ? S 00:49 0:00 [i915/signal:4] [ 2311.896290] ps[12463]: root 576 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.897366] ps[12463]: root 580 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.898443] ps[12463]: root 581 0.0 0.0 0 0 ? I< 00:49 0:00 [kcryptd_io] [ 2311.899511] ps[12463]: root 583 0.0 0.0 0 0 ? I< 00:49 0:00 [kcryptd] [ 2311.900574] ps[12463]: root 584 0.0 0.0 0 0 ? S 00:49 0:00 [dmcrypt_write] [ 2311.901633] ps[12463]: root 585 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.902678] ps[12463]: root 598 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/2:1H] [ 2311.903725] ps[12463]: root 652 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.904789] ps[12463]: root 653 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.905817] ps[12463]: root 654 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.906827] ps[12463]: root 657 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.907853] ps[12463]: root 669 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/u13:4] [ 2311.908875] ps[12463]: root 671 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.909877] ps[12463]: root 672 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.910876] ps[12463]: root 675 0.0 0.0 0 0 ? I< 00:49 0:00 [kcopyd] [ 2311.911875] ps[12463]: root 676 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.912883] ps[12463]: root 677 0.0 0.0 0 0 ? I< 00:49 0:00 [dm-thin] [ 2311.913875] ps[12463]: root 678 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.914841] ps[12463]: root 679 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.915821] ps[12463]: root 686 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.916790] ps[12463]: root 705 0.0 0.0 0 0 ? S 00:49 0:00 [jbd2/dm-4-8] [ 2311.917753] ps[12463]: root 706 0.0 0.0 0 0 ? I< 00:49 0:00 [ext4-rsv-conver] [ 2311.918995] lvmetad[785]: Failed to accept connection errno 11. [ 2311.920111] ps[12463]: root 774 0.0 0.5 120812 20536 ? SLsl 00:49 0:00 /usr/sbin/dmeventd -f [ 2311.921097] ps[12463]: root 776 0.0 0.5 86536 22336 ? Rs 00:49 0:00 /usr/lib/systemd/systemd-journald [ 2311.922072] ps[12463]: root 785 0.0 0.0 200292 2584 ? Ssl 00:49 0:00 /usr/sbin/lvmetad -f -t 3600 [ 2311.923035] ps[12463]: root 808 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/3:1H] [ 2311.924011] ps[12463]: root 816 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/1:1H] [ 2311.924983] ps[12463]: root 821 0.0 0.1 45288 4692 ? Ss 00:49 0:00 /usr/lib/systemd/systemd-udevd [ 2311.925958] ps[12463]: root 844 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/4:1H] [ 2311.926938] ps[12463]: root 865 0.0 0.0 0 0 ? S 00:49 0:00 [irq/181-mei_me] [ 2311.927894] ps[12463]: root 1484 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.928857] ps[12463]: root 1485 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.929827] ps[12463]: root 1488 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.930767] ps[12463]: root 1495 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.931724] ps[12463]: root 1496 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.932655] ps[12463]: root 1503 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.933602] ps[12463]: root 1504 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.934531] ps[12463]: root 1515 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.935464] ps[12463]: root 1517 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.936372] ps[12463]: root 1527 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.937280] ps[12463]: root 1530 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.938183] ps[12463]: root 1542 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.939076] ps[12463]: root 1543 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.939933] ps[12463]: root 1552 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.940815] ps[12463]: root 1553 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.941675] ps[12463]: root 1562 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.942516] ps[12463]: root 1563 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.943366] ps[12463]: root 1569 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.944557] ps[12463]: root 1573 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.945434] ps[12463]: root 1581 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.946255] ps[12463]: root 1583 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.947096] ps[12463]: root 1593 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.947924] ps[12463]: root 1595 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.948709] ps[12463]: root 1604 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.949477] ps[12463]: root 1606 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.950313] ps[12463]: root 1615 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.951064] ps[12463]: root 1618 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.951812] ps[12463]: root 1625 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.952529] ps[12463]: root 1627 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.953319] ps[12463]: root 1633 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.954022] ps[12463]: root 1634 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.954755] ps[12463]: root 1646 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.955450] ps[12463]: root 1647 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.956160] ps[12463]: root 1653 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.956917] ps[12463]: root 1655 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.957591] ps[12463]: root 1665 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.958268] ps[12463]: root 1667 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.958959] ps[12463]: root 1677 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.959615] ps[12463]: root 1679 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.960283] ps[12463]: root 1684 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.960990] ps[12463]: root 1689 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.961645] ps[12463]: root 1697 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.962310] ps[12463]: root 1698 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.962988] ps[12463]: root 1708 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.963631] ps[12463]: root 1710 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.964731] ps[12463]: root 1720 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.965426] ps[12463]: root 1721 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.966109] ps[12463]: root 1729 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.966787] ps[12463]: root 1740 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.967441] ps[12463]: root 1745 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.968132] ps[12463]: root 1746 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.968862] ps[12463]: root 1750 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.969503] ps[12463]: root 1752 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.970169] ps[12463]: root 1755 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.970875] ps[12463]: root 1756 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.971512] ps[12463]: root 1760 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.972195] ps[12463]: root 1761 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.972883] ps[12463]: root 1765 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.973533] ps[12463]: root 1766 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.974246] ps[12463]: root 1771 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.974955] ps[12463]: root 1777 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.975592] ps[12463]: root 1781 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.976268] ps[12463]: root 1783 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.976963] ps[12463]: root 1786 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.977626] ps[12463]: root 1788 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.978323] ps[12463]: root 1790 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.978987] ps[12463]: root 1807 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.979653] ps[12463]: root 1810 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.980380] ps[12463]: dbus 1889 0.0 0.1 46752 4616 ? Ss 00:49 0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only [ 2311.981167] ps[12463]: root 1912 0.2 1.3 1073012 53636 ? SLsl 00:49 0:05 /usr/bin/python3 /usr/bin/qubesd [ 2311.982202] ps[12463]: root 1918 0.0 1.0 429692 40932 ? SLsl 00:49 0:00 /usr/bin/python3 /usr/bin/qmemmand [ 2311.983002] ps[12463]: root 1930 0.1 0.0 47824 3204 ? SL 00:49 0:03 /usr/sbin/xenstored --pid-file /var/run/xen/xenstored.pid [ 2311.983703] ps[12463]: root 1935 0.2 2.6 1274708 104784 ? SLsl 00:49 0:04 /usr/sbin/libvirtd [ 2311.984443] ps[12463]: root 1942 0.0 0.0 119404 3600 ? SLsl 00:49 0:00 /usr/sbin/xenconsoled -i --log=all --log-dir=/var/log/xen/console [ 2311.985209] ps[12463]: root 2639 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.985958] ps[12463]: root 2642 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.986683] ps[12463]: root 2908 0.0 0.0 0 0 ? I< 00:49 0:00 [kworker/5:1H] [ 2311.987409] ps[12463]: root 3019 0.0 0.0 0 0 ? I< 00:49 0:00 [kdmflush] [ 2311.988181] ps[12463]: root 3022 0.0 0.0 0 0 ? I< 00:49 0:00 [bioset] [ 2311.988952] ps[12463]: root 4068 0.0 0.0 0 0 ? I< 00:53 0:00 [kdmflush] [ 2311.989634] ps[12463]: root 4072 0.0 0.0 0 0 ? I< 00:53 0:00 [bioset] [ 2311.990365] ps[12463]: root 4938 0.0 0.0 0 0 ? I 01:04 0:00 [kworker/1:0] [ 2311.991077] ps[12463]: root 4941 0.0 0.0 0 0 ? R 01:04 0:00 [kworker/4:2] [ 2311.991831] ps[12463]: root 5074 0.0 0.0 0 0 ? I< 01:06 0:00 [kworker/u13:3] [ 2311.992536] ps[12463]: root 5673 0.0 0.0 0 0 ? I 01:14 0:00 [kworker/3:0] [ 2311.993285] ps[12463]: root 5765 0.0 0.0 0 0 ? I 01:14 0:00 [kworker/1:1] [ 2311.994049] ps[12463]: root 5769 0.0 0.0 0 0 ? I 01:14 0:00 [kworker/2:1] [ 2311.994801] ps[12463]: root 5793 0.0 0.0 0 0 ? I 01:15 0:00 [kworker/4:1] [ 2311.995508] ps[12463]: root 5845 0.0 0.0 0 0 ? I 01:15 0:00 [kworker/5:1] [ 2311.996222] ps[12463]: root 6103 0.0 0.0 0 0 ? I 01:18 0:00 [kworker/0:0] [ 2311.996965] ps[12463]: root 6213 0.0 0.0 0 0 ? I< 01:18 0:00 [kworker/u13:0] [ 2311.997671] ps[12463]: root 6221 0.0 0.0 0 0 ? I< 01:18 0:00 [kdmflush] [ 2311.998384] ps[12463]: root 6224 0.0 0.0 0 0 ? I< 01:18 0:00 [bioset] [ 2311.999102] ps[12463]: root 6440 0.0 0.0 0 0 ? I< 01:18 0:00 [kworker/u13:2] [ 2312.000179] ps[12463]: root 6445 0.1 0.0 0 0 ? I< 01:18 0:00 [kworker/u13:6] [ 2312.000962] ps[12463]: root 6615 0.0 0.0 0 0 ? I< 01:19 0:00 [kdmflush] [ 2312.001697] ps[12463]: root 6619 0.0 0.0 0 0 ? I< 01:19 0:00 [bioset] [ 2312.002407] ps[12463]: root 8787 0.0 0.0 0 0 ? I 01:20 0:00 [kworker/3:2] [ 2312.003141] ps[12463]: root 9449 0.0 0.0 0 0 ? I< 01:20 0:00 [kdmflush] [ 2312.003931] ps[12463]: root 9453 0.0 0.0 0 0 ? I< 01:20 0:00 [bioset] [ 2312.004621] ps[12463]: root 9827 0.0 0.0 0 0 ? I< 01:21 0:00 [kdmflush] [ 2312.005368] ps[12463]: root 9831 0.0 0.0 0 0 ? I< 01:21 0:00 [bioset] [ 2312.006093] ps[12463]: root 10202 0.0 0.0 0 0 ? I< 01:21 0:00 [kdmflush] [ 2312.006813] ps[12463]: root 10206 0.0 0.0 0 0 ? I< 01:21 0:00 [bioset] [ 2312.007488] ps[12463]: root 10841 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/1:2] [ 2312.008175] ps[12463]: root 10848 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/0:1] [ 2312.008910] ps[12463]: root 10875 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/2:0] [ 2312.009599] ps[12463]: root 10900 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/4:0] [ 2312.010325] ps[12463]: root 10911 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/3:1] [ 2312.011027] ps[12463]: root 10913 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/4:3] [ 2312.011716] ps[12463]: root 10924 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/u12:0] [ 2312.012397] ps[12463]: root 10928 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/5:0] [ 2312.013173] ps[12463]: root 10932 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/u12:1] [ 2312.013856] ps[12463]: root 10934 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/1:3] [ 2312.014550] ps[12463]: root 10942 0.0 0.0 0 0 ? I 01:26 0:00 [kworker/5:3] [ 2312.015227] ps[12463]: root 10961 0.1 0.0 31460 2360 ? S 01:26 0:00 @usr/sbin/plymouthd --mode=shutdown --attach-to-session [ 2312.015916] ps[12463]: root 11018 0.0 0.0 0 0 ? I 01:27 0:00 [kworker/2:3] [ 2312.016600] ps[12463]: root 11528 0.1 0.0 0 0 ? I< 01:27 0:00 [kworker/u13:1] [ 2312.017334] ps[12463]: root 12463 0.0 0.0 41588 3564 ? Rs 01:27 0:00 /usr/bin/ps axuw [ 2312.018835] lvm[12498]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored [ 2316.446346] systemd-cryptsetup[12483]: Failed to deactivate: Device or resource busy [ 2316.447841] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 2316.449033] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 2316.449892] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 2316.450743] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 2316.450862] systemd[1]: Reached target Unmount All Filesystems. [ 2316.452778] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 2316.456023] systemd[1]: Reached target Shutdown. [ 2316.456912] systemd[1]: Reached target Final Step. [ 2316.458439] systemd[1]: Starting Reboot... [ 2316.463478] systemd[1]: Shutting down. [ 2316.480871] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 2316.481743] systemd[1]: Set hardware watchdog to 10min. [ 2316.482583] watchdog: watchdog0: watchdog did not stop! [ 2316.515155] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 2316.519886] dmeventd[774]: dmeventd detected break while being idle for 4 second(s), exiting. [ 2316.523237] dmeventd[774]: dmeventd shutting down. [ 2316.524155] systemd-journald[776]: Received SIGTERM from PID 1 (systemd-shutdow). [ 2316.535527] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 2316.540033] systemd-shutdown[1]: Process 10961 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 2316.540988] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 2316.542035] systemd-shutdown[1]: Unmounting file systems. [ 2316.542981] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 2316.554823] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 2316.559719] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32,data=ordered'. [ 2316.560614] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32,data=ordered [ 2316.561493] systemd-shutdown[1]: All filesystems unmounted. [ 2316.562869] systemd-shutdown[1]: Deactivating swaps. [ 2316.563778] systemd-shutdown[1]: All swaps deactivated. [ 2316.564665] systemd-shutdown[1]: Detaching loop devices. [ 2316.566906] systemd-shutdown[1]: All loop devices detached. [ 2316.567789] systemd-shutdown[1]: Detaching DM devices. [ 2316.573069] systemd-shutdown[1]: Detaching DM 253:9. [ 2316.587942] systemd-shutdown[1]: Detaching DM 253:8. [ 2316.600964] systemd-shutdown[1]: Detaching DM 253:7. [ 2316.612893] systemd-shutdown[1]: Detaching DM 253:60. [ 2316.629947] systemd-shutdown[1]: Detaching DM 253:6. [ 2316.640875] systemd-shutdown[1]: Detaching DM 253:57. [ 2316.653265] systemd-shutdown[1]: Detaching DM 253:54. [ 2316.666930] systemd-shutdown[1]: Detaching DM 253:51. [ 2316.678924] systemd-shutdown[1]: Detaching DM 253:50. [ 2316.689930] systemd-shutdown[1]: Detaching DM 253:5. [ 2316.700789] systemd-shutdown[1]: Detaching DM 253:48. [ 2316.716894] systemd-shutdown[1]: Detaching DM 253:43. [ 2316.732954] systemd-shutdown[1]: Detaching DM 253:42. [ 2316.748941] systemd-shutdown[1]: Detaching DM 253:39. [ 2316.757166] systemd-shutdown[1]: Detaching DM 253:38. [ 2316.768836] systemd-shutdown[1]: Detaching DM 253:37. [ 2316.785943] systemd-shutdown[1]: Detaching DM 253:36. [ 2316.797863] systemd-shutdown[1]: Detaching DM 253:35. [ 2316.808838] systemd-shutdown[1]: Detaching DM 253:34. [ 2316.825941] systemd-shutdown[1]: Detaching DM 253:33. [ 2316.837917] systemd-shutdown[1]: Detaching DM 253:32. [ 2316.854913] systemd-shutdown[1]: Detaching DM 253:31. [ 2316.867168] systemd-shutdown[1]: Detaching DM 253:30. [ 2316.878895] systemd-shutdown[1]: Detaching DM 253:3. [ 2316.879902] dev_remove: 15 callbacks suppressed [ 2316.879911] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 2316.881921] systemd-shutdown[1]: Detaching DM 253:28. [ 2316.899931] systemd-shutdown[1]: Detaching DM 253:27. [ 2316.916932] systemd-shutdown[1]: Detaching DM 253:26. [ 2316.928926] systemd-shutdown[1]: Detaching DM 253:25. [ 2316.939887] systemd-shutdown[1]: Detaching DM 253:24. [ 2316.952930] systemd-shutdown[1]: Detaching DM 253:23. [ 2316.963931] systemd-shutdown[1]: Detaching DM 253:22. [ 2316.976930] systemd-shutdown[1]: Detaching DM 253:21. [ 2316.988903] systemd-shutdown[1]: Detaching DM 253:20. [ 2317.000929] systemd-shutdown[1]: Detaching DM 253:2. [ 2317.001965] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 2317.002998] systemd-shutdown[1]: Detaching DM 253:19. [ 2317.014928] systemd-shutdown[1]: Detaching DM 253:18. [ 2317.025872] systemd-shutdown[1]: Detaching DM 253:17. [ 2317.042950] systemd-shutdown[1]: Detaching DM 253:16. [ 2317.055907] systemd-shutdown[1]: Detaching DM 253:15. [ 2317.066907] systemd-shutdown[1]: Detaching DM 253:14. [ 2317.079886] systemd-shutdown[1]: Detaching DM 253:13. [ 2317.095867] systemd-shutdown[1]: Detaching DM 253:12. [ 2317.108903] systemd-shutdown[1]: Detaching DM 253:11. [ 2317.123899] systemd-shutdown[1]: Detaching DM 253:10. [ 2317.139932] systemd-shutdown[1]: Detaching DM 253:1. [ 2317.140926] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 2317.141913] systemd-shutdown[1]: Detaching DM 253:0. [ 2317.142887] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 2317.143863] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 2317.144964] systemd-shutdown[1]: Detaching DM devices. [ 2317.146544] systemd-shutdown[1]: Detaching DM 253:3. [ 2317.147517] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 2317.148486] systemd-shutdown[1]: Detaching DM 253:2. [ 2317.149458] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 2317.150442] systemd-shutdown[1]: Detaching DM 253:1. [ 2317.151443] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 2317.152437] systemd-shutdown[1]: Detaching DM 253:0. [ 2317.153437] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 2317.154435] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 2317.155454] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 2317.177620] + echo 'Hello, this is '\''/usr/lib/systemd/system-shutdown/debug.sh'\'' or '\''/usr/lib/systemd/system-shutdown/debug.sh'\''' [ 2317.178558] Hello, this is '/usr/lib/systemd/system-shutdown/debug.sh' or '/usr/lib/systemd/system-shutdown/debug.sh' [ 2317.179495] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 2317.180438] + echo 'Script args: reboot' [ 2317.181381] Script args: reboot [ 2317.182315] + set [ 2317.183251] BASH=/bin/bash [ 2317.184180] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 2317.185138] BASH_ALIASES=() [ 2317.186071] BASH_ARGC=([0]="1") [ 2317.187003] BASH_ARGV=([0]="reboot") [ 2317.187935] BASH_CMDS=() [ 2317.188868] BASH_LINENO=([0]="0") [ 2317.189777] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 2317.190729] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 2317.191682] BASH_VERSION='4.3.43(1)-release' [ 2317.192627] DIRSTACK=() [ 2317.193577] EUID=0 [ 2317.194531] GROUPS=() [ 2317.195503] HOME=/ [ 2317.196445] HOSTNAME=dom0 [ 2317.197408] HOSTTYPE=x86_64 [ 2317.198355] IFS=$' \t\n' [ 2317.199304] MACHTYPE=x86_64-redhat-linux-gnu [ 2317.200277] OPTERR=1 [ 2317.201231] OPTIND=1 [ 2317.202187] OSTYPE=linux-gnu [ 2317.203151] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 2317.204119] PIPESTATUS=([0]="0") [ 2317.205096] PPID=12511 [ 2317.206057] PS4='+ ' [ 2317.207004] PWD=/ [ 2317.207960] SHELL=/bin/bash [ 2317.208914] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 2317.209866] SHLVL=1 [ 2317.210825] TERM=linux [ 2317.211771] UID=0 [ 2317.212696] WATCHDOG_USEC=600000000 [ 2317.213605] _='Script args: reboot' [ 2317.214513] date_log_started='Mon Sep 3 01:27:46 CEST 2018' [ 2317.215431] pax_sanitize_slab=full [ 2317.216330] root_trim=yes [ 2317.217261] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 2317.218205] + sysctl kernel.sysrq=1 [ 2317.226263] kernel.sysrq = 1 [ 2317.227520] + mount -o remount,rw / [ 2317.234107] EXT4-fs (dm-4): re-mounted. Opts: discard [ 2317.235362] + df [ 2317.239048] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987880 0 1987880 0% /dev tmpfs 2001540 0 2001540 0% /dev/shm tmpfs 2001540 58736 1942804 3% /run tmpfs 2001540 0 2001540 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 11422036 190097160 6% / [ 2317.244455] + lsblk [ 2317.249687] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 2317.259140] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 2317.348709] real 0m0.090s user 0m0.052s [ 2317.351044] sys 0m0.021s [ 2317.351833] + echo 'exit code: 1' [ 2317.352616] exit code: 1 [ 2317.353423] + /usr/bin/ps axuw [ 2317.361154] /usr/bin/ps: [ 2317.361157] write error [ 2317.361951] : Invalid argument ...snip... ```

So is it trying to stop the DM stuff before even running the Stop for qubes-core.service or is there some glitch with the order in which the messages are being reported due to all those ForwardTo* that I've changed in journald.conf? I'll answer this with No here because a previous log here which is pure journalctl -b -1 generated, shows the same wicked order:

...
Sep 02 19:04:09 dom0 systemd[1]: Timed out stopping /sys/devices/virtual/block/dm-0.
...
Sep 02 19:04:09 dom0 systemd[1]: Stopping Qubes Dom0 startup setup...
...
Sep 02 19:04:20 dom0 systemd[1]: Stopped Qubes Dom0 startup setup.
...

EDIT: ~~I must be missing something or are all these services seemingly shut down in alphabetical order (if not even, some, also concurrently):~~

``` $ systemctl list-dependencies --after shutdown.target shutdown.target ● ├─accounts-daemon.service ● ├─alsa-restore.service ● ├─alsa-state.service ● ├─auditd.service ● ├─crond.service ● ├─dbus.service ● ├─dbus.socket ● ├─dmraid-activation.service ● ├─emergency.service ● ├─fedora-import-state.service ● ├─fedora-loadmodules.service ● ├─fedora-readonly.service ● ├─fstrim.service ● ├─fstrim.timer ● ├─getty@tty1.service ● ├─ldconfig.service ● ├─libvirt-guests.service ● ├─libvirtd.service ● ├─lightdm.service ● ├─lvm2-pvscan@253:0.service ● ├─polkit.service ● ├─qubes-core.service ● ├─qubes-db-dom0.service ● ├─qubes-meminfo-writer-dom0.service ● ├─qubes-qmemman.service ● ├─qubes-vm@sys-firewall.service ● ├─qubes-vm@sys-net.service ● ├─qubes-vm@sys-whonix.service ● ├─qubesd.service ● ├─rc-local.service ● ├─rescue.service ● ├─rtkit-daemon.service ● ├─selinux-autorelabel-mark.service ● ├─serial-getty@hvc0.service ● ├─session-2.scope ● ├─syslog.socket ● ├─system-getty.slice ● ├─system-lvm2\x2dpvscan.slice ● ├─system-qubes\x2dvm.slice ● ├─system-serial\x2dgetty.slice ● ├─system-systemd\x2dcoredump.slice ● ├─system-systemd\x2dcryptsetup.slice ● ├─system-systemd\x2dfsck.slice ● ├─systemd-ask-password-console.path ● ├─systemd-ask-password-console.service ● ├─systemd-ask-password-wall.path ● ├─systemd-ask-password-wall.service ● ├─systemd-binfmt.service ● ├─systemd-coredump@0.service ● ├─systemd-firstboot.service ● ├─systemd-fsck-root.service ● ├─systemd-fsck@dev-disk-by\x2duuid-181A\x2dD5EF.service ● ├─systemd-hwdb-update.service ● ├─systemd-journal-catalog-update.service ● ├─systemd-logind.service ● ├─systemd-machine-id-commit.service ● ├─systemd-modules-load.service ● ├─systemd-quotacheck.service ● ├─systemd-random-seed.service ● ├─systemd-remount-fs.service ● ├─systemd-sysctl.service ● ├─systemd-sysusers.service ● ├─systemd-tmpfiles-clean.service ● ├─systemd-tmpfiles-clean.timer ● ├─systemd-tmpfiles-setup-dev.service ● ├─systemd-tmpfiles-setup.service ● ├─systemd-update-done.service ● ├─systemd-update-utmp-runlevel.service ● ├─systemd-update-utmp.service ● ├─systemd-user-sessions.service ● ├─systemd-vconsole-setup.service ● ├─upower.service ● ├─user-1000.slice ● ├─user.slice ● ├─user@1000.service ● ├─virtlockd.service ● ├─virtlockd.socket ● ├─virtlogd.service ● ├─virtlogd.socket ● ├─xen-init-dom0.service ● ├─xenconsoled.service ● └─xenstored.service ```

nevermind i was wrong about this.

EDIT: I'm continuing to try figuring this out here: https://gist.github.com/constantoverride/78a3dfced04234cbe0f91f91a1bc99db Meanwhile this is what I use(run) as a workaround(before doing the Restart from menu):

#!/bin/bash

xl list
time qvm-shutdown --verbose --all --wait; ec="$?"
echo "exitcode: '$ec'"
time while xl list|grep -q -F '(null)'; do xl list;sleep 1; done
exit $ec

I wonder why device-mapper still complains, now when all domains are properly terminated, DM cleanup should also work.

Maybe it's a systemd bug? Or I simply do not know how to ensure that qubes-core.service stops AFTER those DM devices are attempting to stop.

For example, I've had 3 consecutive reboots and without changing anything, the 3rd one decided to fail with the timeout because systemd decided to reverse the stop order:

First reboot, all good, achieving expected stop order:

[ 67.643774] systemd[1]: dev-block-253:0.device: Installed new job dev-block-253:0.device/stop as 777
[ 67.643982] systemd[1]: qubes-core.service: Installed new job qubes-core.service/stop as 860
[   68.032308] systemd[1]: qubes-core.service: About to execute: /usr/bin/pkill qubes-guid
[ 68.033396] systemd[1]: Stopping Qubes Dom0 startup setup...
[ 76.932065] systemd[1]: Stopped Qubes Dom0 startup setup.
[ 76.985423] systemd[1]: dev-block-253:0.device: Redirecting stop request from dev-block-253:0.device to sys-devices-virtual-block-dm\x2d0.device.
[ 82.205556] systemd[1]: dev-block-253:0.device: Failed to send unit remove signal for dev-block-253:0.device: Transport endpoint is not connected

Second reboot, all good, achieving expected stop order:

[ 147.675870] systemd[1]: dev-block-253:0.device: Installed new job dev-block-253:0.device/stop as 875
[ 147.675940] systemd[1]: qubes-core.service: Installed new job qubes-core.service/stop as 943
[ 148.079458] systemd[1]: qubes-core.service: About to execute: /usr/bin/pkill qubes-guid
[ 148.081959] systemd[1]: Stopping Qubes Dom0 startup setup...
[ 162.058060] systemd[1]: Stopped Qubes Dom0 startup setup.
[ 162.107938] systemd[1]: dev-block-253:0.device: Redirecting stop request from dev-block-253:0.device to sys-devices-virtual-block-dm\x2d0.device.

Third reboot, bad, the stop order is reversed(no idea why, I didn't change anything, I only rebooted):

[ 443.660340] systemd[1]: qubes-core.service: Installed new job qubes-core.service/stop as 797
[ 443.660426] systemd[1]: dev-block-253:0.device: Installed new job dev-block-253:0.device/stop as 867
[ 533.755109] systemd[1]: dev-block-253:0.device: Job dev-block-253:0.device/stop timed out.
[ 534.047847] systemd[1]: qubes-core.service: About to execute: /usr/bin/pkill qubes-guid
[ 534.048939] systemd[1]: Stopping Qubes Dom0 startup setup...
[ 542.648718] systemd[1]: Stopped Qubes Dom0 startup setup.
[ 547.940019] systemd[1]: dev-block-253:0.device: Failed to send unit remove signal for dev-block-253:0.device: Transport endpoint is not connected

Full details here: https://gist.github.com/constantoverride/61207ebf622263d25fb1e5b1f11d0148/9443ef0babe29b32622dd0f17a2435a9e0f1df92#gistcomment-2696607

Since dom0 is stuck at Fedora 25 (latest being Fedora 28?), is there some way that I can update dom0's systemd ? it was at systemd 231 while I tested all these, but 240 is latest. Otherwise, assume that I stopped trying to fix this, as I am out of ideas or something...

I've found a workaround, details here: https://unix.stackexchange.com/a/468356/306023

In short, pkill -9 qubes-guid is needed when graphical.target is stopped, else qubes-core.service's ExecStop only gets to run after the 90 second timeout incurred by whatever wants to stop *.devices like /dev/dm-0(which seems to happen concurrently with that pkill, and yet prior to qubes-core.service's ExecStop).

According to this by a systemd dev., I posit that if we would know which service starts up those devices (like /dev/dm-0) then, I guess, we could put that pkill -9 qubes-guid on its ExecPreStop or something, or even better, put there also the whole shutdown-all-running-VMs. But I'm not sure.

Great find! Anyway, for the correct solution we need to find why those qubes-guid processes hang and fix this. Could you collect backtrace of such process? For example:

gdb --batch -ex bt -p $(pidof qubes-guid|head -1)

we need to find why those qubes-guid processes hang and fix this. Could you collect backtrace of such process?

I forgot to mention anywhere(else) that there is only one PID of qubes-guid that hangs (and requires that pkill -9 instead of just pkill SIGTERM) at reboot/shutdown and that is: [ 779.184064] ps[5699]: ctor 3585 0.0 0.1 160856 5884 ? RLs 02:26 0:00 /usr/bin/qubes-guid -N sys-net -c 0xcc0000 -i /usr/share/icons/hicolor/128x128/devices/appvm-red.png -l 1 -q -d 1 -n

Its backtrace is:

Thread 1 (Thread 0x7565905228c0 (LWP 3585)):
#0  0x00007565900aeb70 in _XReply () from /lib64/libX11.so.6
#1  0x00007565900aa6cd in XSync () from /lib64/libX11.so.6
#2  0x00005a1feed97cf2 in release_mapped_mfns.part.3.constprop ()
#3  0x00005a1feed97d87 in release_all_mapped_mfns ()
#4  0x000075658e45c3d0 in __run_exit_handlers () from /lib64/libc.so.6
#5  0x000075658e45c42a in exit () from /lib64/libc.so.6
#6  0x00005a1feed9507b in dummy_signal_handler ()
#7  <signal handler called>
#8  0x00005a1feed95060 in sighup_signal_handler ()
#9  <signal handler called>
#10 0x000075658e51df3d in poll () from /lib64/libc.so.6
#11 0x000075658e205d10 in _xcb_conn_wait () from /lib64/libxcb.so.1
#12 0x000075658e2077cf in wait_for_reply () from /lib64/libxcb.so.1
#13 0x000075658e207941 in xcb_wait_for_reply64 () from /lib64/libxcb.so.1
#14 0x00007565900aebc8 in _XReply () from /lib64/libX11.so.6
#15 0x000075659009424d in XGetImage () from /lib64/libX11.so.6
#16 0x00005a1feed98d7a in tint_tray_and_update ()
#17 0x00005a1feed97932 in do_shm_update.constprop ()
#18 0x00005a1feed927db in main ()

how i got its bracktrace

In `redsparrow.service` I added, as first `ExecStop=` line: ``` ExecStop=-/usr/bin/bash -c 'echo "PIDof: $(pidof qubes-guid)"; /usr/bin/gdb --batch -x "/home/ctor/gdb_cmds" -p "$(pidof qubes-guid)"' ``` Since there is (for sure) only one `qubes-guid` PID, I didn't bother piping the output of `pidof` through `tr ' ' '\n' | head -1`, which would also serve as a double check because if there's more than one pid gdb will fail with something like `Illegal process-id:` or, if no double quotes, with `: No such file or directory.` `/home/ctor/gdb_cmds` file is: ``` set pagination off show pagination disable frame-filter all set print raw frame-arguments off set print frame-arguments all set print symbol-filename on set print symbol on set print array on set print array-indexes on set print pretty on set print union on set print demangle on set print object on set print static-members on set print vtbl on set filename-display absolute #run > /home/ctor/gdb_cmds.out.log 2>&1 set logging file /home/ctor/gdb_cmds.out.log #Set the current logfile. #The logfile is used when directing GDB's output. set logging on #set logging on -- Enable logging set logging redirect off #Set the logging output mode. #If redirect is off, output will go to both the screen and the log file. #If redirect is on, output will go only to the log file. thread apply all bt no-filters full -100 frame 1 frame 2 frame 3 frame 4 frame 5 frame 6 frame 7 frame 8 frame 9 frame 10 frame 11 frame 12 frame 13 frame 14 frame 15 frame 16 frame 17 frame 18 ``` After a restart, `/home/ctor/gdb_cmds.out.log` contains: ``` Thread 1 (Thread 0x7565905228c0 (LWP 3585)): #0 0x00007565900aeb70 in _XReply () from /lib64/libX11.so.6 No symbol table info available. #1 0x00007565900aa6cd in XSync () from /lib64/libX11.so.6 No symbol table info available. #2 0x00005a1feed97cf2 in release_mapped_mfns.part.3.constprop () No symbol table info available. #3 0x00005a1feed97d87 in release_all_mapped_mfns () No symbol table info available. #4 0x000075658e45c3d0 in __run_exit_handlers () from /lib64/libc.so.6 No symbol table info available. #5 0x000075658e45c42a in exit () from /lib64/libc.so.6 No symbol table info available. #6 0x00005a1feed9507b in dummy_signal_handler () No symbol table info available. #7 No symbol table info available. #8 0x00005a1feed95060 in sighup_signal_handler () No symbol table info available. #9 No symbol table info available. #10 0x000075658e51df3d in poll () from /lib64/libc.so.6 No symbol table info available. #11 0x000075658e205d10 in _xcb_conn_wait () from /lib64/libxcb.so.1 No symbol table info available. #12 0x000075658e2077cf in wait_for_reply () from /lib64/libxcb.so.1 No symbol table info available. #13 0x000075658e207941 in xcb_wait_for_reply64 () from /lib64/libxcb.so.1 No symbol table info available. #14 0x00007565900aebc8 in _XReply () from /lib64/libX11.so.6 No symbol table info available. #15 0x000075659009424d in XGetImage () from /lib64/libX11.so.6 No symbol table info available. #16 0x00005a1feed98d7a in tint_tray_and_update () No symbol table info available. #17 0x00005a1feed97932 in do_shm_update.constprop () No symbol table info available. #18 0x00005a1feed927db in main () No symbol table info available. #1 0x00007565900aa6cd in XSync () from /lib64/libX11.so.6 #2 0x00005a1feed97cf2 in release_mapped_mfns.part.3.constprop () #3 0x00005a1feed97d87 in release_all_mapped_mfns () #4 0x000075658e45c3d0 in __run_exit_handlers () from /lib64/libc.so.6 #5 0x000075658e45c42a in exit () from /lib64/libc.so.6 #6 0x00005a1feed9507b in dummy_signal_handler () #7 #8 0x00005a1feed95060 in sighup_signal_handler () #9 #10 0x000075658e51df3d in poll () from /lib64/libc.so.6 #11 0x000075658e205d10 in _xcb_conn_wait () from /lib64/libxcb.so.1 #12 0x000075658e2077cf in wait_for_reply () from /lib64/libxcb.so.1 #13 0x000075658e207941 in xcb_wait_for_reply64 () from /lib64/libxcb.so.1 #14 0x00007565900aebc8 in _XReply () from /lib64/libX11.so.6 #15 0x000075659009424d in XGetImage () from /lib64/libX11.so.6 #16 0x00005a1feed98d7a in tint_tray_and_update () #17 0x00005a1feed97932 in do_shm_update.constprop () #18 0x00005a1feed927db in main () ``` (just a note: for each restart, new backtrace is appended, not overwritten; but there's only one pasted above) Warning: Looks like I forgot to also paste `frame 0` in `gdb_cmds` (so it starts from `frame 1` for the second part of the output; I fixed it on file for the future, but not fixed above.

I forgot to mention (other than in an edit) that I'm only testing these under Qubes 4.0 (instead of 3.1 as the OP mentions this issue is for). I was hoping that maybe it's the same issue for both versions(but mainly I only read the title Systemd shutdown hang, and later figured out the issue is for 3.1 only). Let me know if I should switch to the proper issue for 4.0 instead.

qubes-guid is mostly the same on both versions, so it's fine here too. Looking at the backtrace, there was very similar bug in the past: #1406. That one was about X error handler, this one is about signal handler. I'll prepare very similar fix for this case.

See pull request linked above. I've also built the package with it and uploaded to qubes-dom0-unstable repository, it's qubes-gui-dom0-4.0.8-1.29.fc25.

That works! I've tried several reboots even without redsparrow.service! qubes-guid is no longer lingering and

all VMs seem to be in shutting down safely now.

Side note: I consider these to be natural: ``` [ 487.888467] systemd-cryptsetup[6906]: Failed to deactivate: Device or resource busy [ 487.898259] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 487.907380] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 487.914977] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 487.922136] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. ``` because `luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b` is, well, the parent of root(`/`) and it can't be stopped, so there's nothing to fix here: ``` [ctor@dom0 ~]$ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT loop0 7:0 0 500M 0 loop sda 8:0 0 223.6G 0 disk ├─sda2 8:2 0 222.8G 0 part │ └─luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt │ ├─qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm │ │ └─qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm │ │ ├─qubes_dom0-vm--fedora--28--clone--1--dev--root--1536629435--back 253:20 0 10G 0 lvm ... │ │ ├─qubes_dom0-root 253:4 0 206.8G 0 lvm / ... │ │ └─qubes_dom0-vm--fedora--28--clone--1--oldstuff--root 253:30 0 10G 0 lvm │ └─qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm │ └─qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm │ ├─qubes_dom0-vm--fedora--28--clone--1--dev--root--1536629435--back 253:20 0 10G 0 lvm ... │ ├─qubes_dom0-root 253:4 0 206.8G 0 lvm / ... │ └─qubes_dom0-vm--fedora--28--clone--1--oldstuff--root 253:30 0 10G 0 lvm └─sda1 8:1 0 800M 0 part /boot/efi ``` There are still some annoying messages like: ``` [ 458.724459] qubes.WindowIconUpdater-sys-net[3538]: Traceback (most recent call last): [ 458.724837] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 458.725228] qubes.WindowIconUpdater-sys-net[3538]: return f(*args) [ 458.725509] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event ... ``` and ``` [ 459.108599] qubesd[1780]: socket.send() raised exception. [ 459.110508] qubesd[1780]: socket.send() raised exception. [ 459.112268] qubesd[1780]: socket.send() raised exception. [ 459.114020] qubesd[1780]: socket.send() raised exception. [ 459.115757] qubesd[1780]: socket.send() raised exception. ``` but those are unrelated (to the shutdown hang) should probably be in their own issue, if want to get rid of them, ever. There's also the matter of my USB mouse waking up every 2 seconds but only when moved: ``` [ 463.692734] usb 1-13: USB disconnect, device number 5 [ 463.944033] usb 1-13: new low-speed USB device number 6 using xhci_hcd [ 463.999398] systemd[1]: Received SIGRTMIN+20 from PID 4842 (plymouthd). [ 464.079995] usb 1-13: New USB device found, idVendor=1c4f, idProduct=0034, bcdDevice= 1.10 [ 464.080100] usb 1-13: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 464.080185] usb 1-13: Product: Usb Mouse [ 464.080235] usb 1-13: Manufacturer: SIGMACHIP [ 464.084673] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-13/1-13:1.0/0003:1C4F:0034.0007/input/input21 ``` which should also be another issue. I don't know if these DMs should be unmounted(they are probably depending on root `/` ? at least dm-0 should be root itself): ``` [ 488.637725] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 488.891217] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 489.136832] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 489.148173] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 489.153853] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 489.172737] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. ```

sample log with `qubes-gui-dom0-4.0.8-1.29.fc25` and no redsparrow

`rebooting` log: ``` [ 458.665361] systemd-logind[1778]: System is rebooting. [ 458.669465] systemd[1]: Stopping RealtimeKit Scheduling Policy Service... [ 458.669608] systemd[1]: Removed slice system-getty.slice. [ 458.669629] systemd[1]: Stopped target Sound Card. [ 458.670831] systemd[1]: Stopping Manage Sound Card State (restore and store)... [ 458.673669] systemd[1]: Stopping Restore /run/initramfs on shutdown... [ 458.673722] systemd[1]: Stopped target Timers. [ 458.673807] systemd[1]: Stopped Discard unused blocks once a week. [ 458.673874] systemd[1]: Stopped Daily Cleanup of Temporary Directories. [ 458.674624] systemd[1]: Stopping User Manager for UID 1000... [ 458.674654] systemd[1]: Stopped target Graphical Interface. [ 458.679220] systemd[1]: Stopping Daemon for power management... [ 458.680255] systemd[1]: Stopping Light Display Manager... [ 458.680268] systemd[1]: Stopped target Multi-User System. [ 458.680388] systemd[1]: Stopped target Login Prompts. [ 458.680568] systemd[1]: Stopping Serial Getty on hvc0... [ 458.680897] systemd[1]: Stopped xen-init-dom0, initialise Dom0 configuration (xenstore nodes, JSON configuration stub). [ 458.681070] systemd[1]: Stopping Command Scheduler... [ 458.682131] systemd[1]: Stopping Authorization Manager... [ 458.682297] systemd[1]: Stopping Accounts Service... [ 458.682558] alsactl[1779]: alsactl daemon stopped [ 458.685629] systemd[1]: Stopping Session 2 of user ctor. [ 458.688214] crond[3210]: (CRON) INFO (Shutting down) [ 458.688837] systemd[1]: Stopped Daemon for power management. [ 458.690198] systemd[1]: Stopped Command Scheduler. [ 458.692216] systemd[1]: Stopped Serial Getty on hvc0. [ 458.692646] systemd[1]: Stopped RealtimeKit Scheduling Policy Service. [ 458.693260] systemd[1]: Stopped Manage Sound Card State (restore and store). [ 458.693545] systemd[1]: Stopped Accounts Service. [ 458.700492] systemd[1]: Stopped Authorization Manager. [ 458.705613] systemd[1]: Removed slice system-serial\x2dgetty.slice. [ 458.706340] lightdm[3212]: Error opening audit socket: Protocol not supported [ 458.724042] systemd[3311]: Received SIGRTMIN+24 from PID 4828 (kill). [ 458.724459] qubes.WindowIconUpdater-sys-net[3538]: Traceback (most recent call last): [ 458.724837] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 458.725228] qubes.WindowIconUpdater-sys-net[3538]: return f(*args) [ 458.725509] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 458.725770] qubes.WindowIconUpdater-sys-net[3538]: self.invalid() [ 458.726122] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.726393] qubes.WindowIconUpdater-sys-net[3538]: raise ConnectionException(err) [ 458.726657] qubes.WindowIconUpdater-sys-net[3538]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.726932] qubes.WindowIconUpdater-sys-net[3538]: [ 458.727279] qubes.WindowIconUpdater-sys-net[3538]: During handling of the above exception, another exception occurred: [ 458.727528] qubes.WindowIconUpdater-sys-net[3538]: [ 458.727774] qubes.WindowIconUpdater-sys-net[3538]: Traceback (most recent call last): [ 458.728159] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 458.728421] qubes.WindowIconUpdater-sys-net[3538]: rcvd.handle_input() [ 458.728677] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 458.729029] qubes.WindowIconUpdater-sys-net[3538]: self.handle_events() [ 458.729297] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 458.729551] qubes.WindowIconUpdater-sys-net[3538]: for ev in iter(self.conn.poll_for_event, None): [ 458.729826] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 458.730255] qubes.WindowIconUpdater-sys-net[3538]: self.invalid() [ 458.730529] qubes.WindowIconUpdater-sys-net[3538]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.730782] qubes.WindowIconUpdater-sys-net[3538]: raise ConnectionException(err) [ 458.731123] qubes.WindowIconUpdater-sys-net[3538]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.731376] qubes.WindowIconUpdater-sys-firewall[3617]: Traceback (most recent call last): [ 458.731663] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 458.731942] qubes.WindowIconUpdater-sys-firewall[3617]: return f(*args) [ 458.732350] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 458.732607] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: Traceback (most recent call last): [ 458.732719] systemd[1]: Stopped User Manager for UID 1000. [ 458.734293] qubes.WindowIconUpdater-sys-firewall[3617]: self.invalid() [ 458.734600] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.734880] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 458.735363] qubes.WindowIconUpdater-sys-firewall[3617]: raise ConnectionException(err) [ 458.735607] qubes.WindowIconUpdater-sys-firewall[3617]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.735860] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: return f(*args) [ 458.736194] qubes.WindowIconUpdater-sys-firewall[3617]: [ 458.736484] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 458.736736] qubes.WindowIconUpdater-sys-firewall[3617]: During handling of the above exception, another exception occurred: [ 458.737067] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: self.invalid() [ 458.737319] qubes.WindowIconUpdater-sys-firewall[3617]: [ 458.737570] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.737817] qubes.WindowIconUpdater-sys-firewall[3617]: Traceback (most recent call last): [ 458.738217] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: raise ConnectionException(err) [ 458.738487] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 458.738756] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.739163] qubes.WindowIconUpdater-sys-firewall[3617]: rcvd.handle_input() [ 458.739427] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: [ 458.739686] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 458.740135] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: During handling of the above exception, another exception occurred: [ 458.740271] systemd[1]: Stopped Session 2 of user ctor. [ 458.740398] qubes.WindowIconUpdater-sys-firewall[3617]: self.handle_events() [ 458.740661] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: [ 458.740732] systemd[1]: Removed slice User Slice of ctor. [ 458.740840] systemd[1]: Stopping Login Service... [ 458.740964] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 458.741457] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: Traceback (most recent call last): [ 458.742662] qubes.WindowIconUpdater-sys-firewall[3617]: for ev in iter(self.conn.poll_for_event, None): [ 458.743037] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 458.743309] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 458.743557] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: rcvd.handle_input() [ 458.743801] qubes.WindowIconUpdater-sys-firewall[3617]: self.invalid() [ 458.744171] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 458.744436] qubes.WindowIconUpdater-sys-firewall[3617]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.744685] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: self.handle_events() [ 458.745086] qubes.WindowIconUpdater-sys-firewall[3617]: raise ConnectionException(err) [ 458.745352] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 458.745619] qubes.WindowIconUpdater-sys-firewall[3617]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.745887] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: for ev in iter(self.conn.poll_for_event, None): [ 458.746261] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 458.746514] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: self.invalid() [ 458.746755] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.747090] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: raise ConnectionException(err) [ 458.747347] qubes.WindowIconUpdater-stackexchangelogins-w-s-f-fdr28[4123]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.747642] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: Traceback (most recent call last): [ 458.747929] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 557, in wrapper [ 458.748284] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: return f(*args) [ 458.748533] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 596, in poll_for_event [ 458.748783] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: self.invalid() [ 458.749118] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.749370] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: raise ConnectionException(err) [ 458.749621] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.749881] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: [ 458.750238] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: During handling of the above exception, another exception occurred: [ 458.750488] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: [ 458.750732] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: Traceback (most recent call last): [ 458.751252] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/qubes/icon-receiver", line 362, in [ 458.754837] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: rcvd.handle_input() [ 458.757595] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/qubes/icon-receiver", line 347, in handle_input [ 458.758774] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: self.handle_events() [ 458.759154] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/qubes/icon-receiver", line 259, in handle_events [ 458.759425] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: for ev in iter(self.conn.poll_for_event, None): [ 458.759746] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 559, in wrapper [ 458.760090] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: self.invalid() [ 458.760336] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: File "/usr/lib/python3.5/site-packages/xcffib/__init__.py", line 545, in invalid [ 458.760587] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: raise ConnectionException(err) [ 458.760836] qubes.WindowIconUpdater-gmail-basedon-w-s-f-fdr28[4758]: xcffib.ConnectionException: xcb connection errors because of socket, pipe and other stream errors. [ 458.761224] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=50014321, total_mem_pref=2698973491.2000003, total_available_memory=28954589568.8) [ 458.761559] qmemman.daemon.algo[1776]: left_memory=4015410467 acceptors_count=1 [ 458.800248] systemd[1]: Stopped Login Service. [ 458.855972] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=50014321, total_mem_pref=2609852313.6, total_available_memory=29043710746.4) [ 458.856298] qmemman.daemon.algo[1776]: left_memory=4582209606 acceptors_count=1 [ 458.956207] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=50014321, total_mem_pref=2565715046.4, total_available_memory=29087848013.6) [ 458.960153] qmemman.daemon.algo[1776]: left_memory=4877496318 acceptors_count=1 [ 458.984026] systemd[1]: Stopped Light Display Manager. [ 458.986995] systemd[1]: Starting Show Plymouth Reboot Screen... [ 458.989851] systemd[1]: Stopping Permit User Sessions... [ 458.994160] systemd[1]: Stopped Permit User Sessions. [ 458.995867] systemd[1]: Stopped Start Qubes VM sys-net. [ 458.997443] systemd[1]: Stopped target User and Group Name Lookups. [ 458.999015] systemd[1]: Stopped Start Qubes VM sys-firewall. [ 459.000665] systemd[1]: Stopping Qubes memory information reporter... [ 459.000797] systemd[1]: Removed slice system-qubes\x2dvm.slice. [ 459.001070] systemd[1]: Stopped Qubes memory information reporter. [ 459.011628] systemd[1]: Stopping Qubes Dom0 startup setup... [ 459.020100] preshutdown[4849]: [42mStarting /home/ctor/bin/preshutdown Thu Sep 13 18:52:14 CEST 2018 459.01 2578.18 [ 459.022267] systemd[1]: Started Show Plymouth Reboot Screen. [ 459.026458] preshutdown[4849]: (B[mName ID Mem VCPUs State Time(s) [ 459.028399] preshutdown[4849]: Domain-0 0 4084 6 r----- 192.5 [ 459.030216] preshutdown[4849]: sys-net 1 1584 2 -b---- 9.9 [ 459.032002] preshutdown[4849]: sys-net-dm 2 144 1 -b---- 61.2 [ 459.033780] preshutdown[4849]: sys-firewall 3 3983 2 -b---- 24.7 [ 459.035570] preshutdown[4849]: stackexchangelogins-w-s-f-fdr28 4 3983 2 -b---- 47.5 [ 459.037346] preshutdown[4849]: gmail-basedon-w-s-f-fdr28 5 3983 2 -b---- 23.7 [ 459.099063] preshutdown[4849]: 2018-09-13 18:52:14,442 [MainProcess selector_events.__init__:65] asyncio: Using selector: EpollSelector [ 459.108599] qubesd[1780]: socket.send() raised exception. [ 459.110508] qubesd[1780]: socket.send() raised exception. [ 459.112268] qubesd[1780]: socket.send() raised exception. [ 459.114020] qubesd[1780]: socket.send() raised exception. [ 459.115757] qubesd[1780]: socket.send() raised exception. [ 459.134883] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=50014321, total_mem_pref=2471423488.0, total_available_memory=29182139572.0) [ 459.136735] qmemman.daemon.algo[1776]: left_memory=4337196356 acceptors_count=1 [ 459.186049] systemd[1]: Stopped Restore /run/initramfs on shutdown. [ 459.324217] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=50014321, total_mem_pref=2375704883.2, total_available_memory=29277858176.8) [ 459.326164] qmemman.daemon.algo[1776]: left_memory=3744851783 acceptors_count=1 [ 460.887580] usb 1-13: USB disconnect, device number 3 [ 461.139036] usb 1-13: new low-speed USB device number 5 using xhci_hcd [ 461.278839] usb 1-13: New USB device found, idVendor=1c4f, idProduct=0034, bcdDevice= 1.10 [ 461.286638] usb 1-13: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 461.294384] usb 1-13: Product: Usb Mouse [ 461.302102] usb 1-13: Manufacturer: SIGMACHIP [ 461.306732] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-13/1-13:1.0/0003:1C4F:0034.0006/input/input20 [ 461.308451] hid-generic 0003:1C4F:0034.0006: input,hidraw3: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:00:14.0-13/input0 [ 461.634648] qubesd[1780]: socket.send() raised exception. [ 461.636423] qubesd[1780]: socket.send() raised exception. [ 461.638201] qubesd[1780]: socket.send() raised exception. [ 461.639868] qubesd[1780]: socket.send() raised exception. [ 461.641521] qubesd[1780]: socket.send() raised exception. [ 461.643167] qubesd[1780]: socket.send() raised exception. [ 461.644859] qubesd[1780]: socket.send() raised exception. [ 461.646505] qubesd[1780]: socket.send() raised exception. [ 461.648181] qubesd[1780]: socket.send() raised exception. [ 461.649822] qubesd[1780]: socket.send() raised exception. [ 461.651453] qubesd[1780]: socket.send() raised exception. [ 461.653079] qubesd[1780]: socket.send() raised exception. [ 461.654698] qubesd[1780]: socket.send() raised exception. [ 461.656373] qubesd[1780]: socket.send() raised exception. [ 461.657977] qubesd[1780]: socket.send() raised exception. [ 461.659572] qubesd[1780]: socket.send() raised exception. [ 461.661158] qubesd[1780]: socket.send() raised exception. [ 461.662768] qubesd[1780]: socket.send() raised exception. [ 461.664342] qubesd[1780]: socket.send() raised exception. [ 461.665891] qubesd[1780]: socket.send() raised exception. [ 461.667437] qubesd[1780]: socket.send() raised exception. [ 461.668974] qubesd[1780]: socket.send() raised exception. [ 461.670497] qubesd[1780]: socket.send() raised exception. [ 461.672108] qubesd[1780]: socket.send() raised exception. [ 461.673706] qubesd[1780]: socket.send() raised exception. [ 461.675227] qubesd[1780]: socket.send() raised exception. [ 461.676745] qubesd[1780]: socket.send() raised exception. [ 461.678263] qubesd[1780]: socket.send() raised exception. [ 461.679731] qubesd[1780]: socket.send() raised exception. [ 461.681222] qubesd[1780]: socket.send() raised exception. [ 461.682673] qubesd[1780]: socket.send() raised exception. [ 461.684120] qubesd[1780]: socket.send() raised exception. [ 461.685566] qubesd[1780]: socket.send() raised exception. [ 461.687065] qubesd[1780]: socket.send() raised exception. [ 461.688490] qubesd[1780]: socket.send() raised exception. [ 461.689907] qubesd[1780]: socket.send() raised exception. [ 461.691320] qubesd[1780]: socket.send() raised exception. [ 461.692731] qubesd[1780]: socket.send() raised exception. [ 461.694135] qubesd[1780]: socket.send() raised exception. [ 461.695529] qubesd[1780]: socket.send() raised exception. [ 461.696905] qubesd[1780]: socket.send() raised exception. [ 461.698274] qubesd[1780]: socket.send() raised exception. [ 461.699640] qubesd[1780]: socket.send() raised exception. [ 461.701010] qubesd[1780]: socket.send() raised exception. [ 461.702370] qubesd[1780]: socket.send() raised exception. [ 461.703716] qubesd[1780]: socket.send() raised exception. [ 461.705057] qubesd[1780]: socket.send() raised exception. [ 461.706368] qubesd[1780]: socket.send() raised exception. [ 461.707681] qubesd[1780]: socket.send() raised exception. [ 461.708977] qubesd[1780]: socket.send() raised exception. [ 461.710260] qubesd[1780]: socket.send() raised exception. [ 461.711520] qubesd[1780]: socket.send() raised exception. [ 461.712756] qubesd[1780]: socket.send() raised exception. [ 461.713990] qubesd[1780]: socket.send() raised exception. [ 461.715215] qubesd[1780]: socket.send() raised exception. [ 461.716431] qubesd[1780]: socket.send() raised exception. [ 461.717637] qubesd[1780]: socket.send() raised exception. [ 461.718836] qubesd[1780]: socket.send() raised exception. [ 461.720057] qubesd[1780]: socket.send() raised exception. [ 461.721235] qubesd[1780]: socket.send() raised exception. [ 461.722406] qubesd[1780]: socket.send() raised exception. [ 461.723558] qubesd[1780]: socket.send() raised exception. [ 461.724700] qubesd[1780]: socket.send() raised exception. [ 461.725842] qubesd[1780]: socket.send() raised exception. [ 461.727053] qubesd[1780]: socket.send() raised exception. [ 461.728193] qubesd[1780]: socket.send() raised exception. [ 461.730901] qubesd[1780]: socket.send() raised exception. [ 461.732037] qubesd[1780]: socket.send() raised exception. [ 461.733154] qubesd[1780]: socket.send() raised exception. [ 461.734262] qubesd[1780]: socket.send() raised exception. [ 463.692734] usb 1-13: USB disconnect, device number 5 [ 463.944033] usb 1-13: new low-speed USB device number 6 using xhci_hcd [ 463.999398] systemd[1]: Received SIGRTMIN+20 from PID 4842 (plymouthd). [ 464.079995] usb 1-13: New USB device found, idVendor=1c4f, idProduct=0034, bcdDevice= 1.10 [ 464.080100] usb 1-13: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 464.080185] usb 1-13: Product: Usb Mouse [ 464.080235] usb 1-13: Manufacturer: SIGMACHIP [ 464.084673] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-13/1-13:1.0/0003:1C4F:0034.0007/input/input21 [ 464.085454] hid-generic 0003:1C4F:0034.0007: input,hidraw3: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:00:14.0-13/input0 [ 466.236021] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=49975872, total_mem_pref=2375704883.2, total_available_memory=29277819727.8) [ 466.238096] qmemman.daemon.algo[1776]: left_memory=3744831950 acceptors_count=1 [ 466.751856] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=4247570599, total_mem_pref=1966254387.2, total_available_memory=29690560950.8) [ 466.752319] qmemman.daemon.algo[1776]: left_memory=4755671292 acceptors_count=1 [ 466.752604] qmemman.systemstate[1776]: stat: dom '0' act=19020636739 pref=1149025382.4 last_target=19020636739 [ 466.752880] qmemman.systemstate[1776]: stat: dom '5' act=4194304000 pref=409903104.0 last_target=4194304000 [ 466.753247] qmemman.systemstate[1776]: stat: dom '3' act=4194304000 pref=407325900.8 last_target=4194304000 [ 466.753517] qmemman.systemstate[1776]: stat: xenfree=4299999399 memset_reqs=[('3', 4194304000), ('0', 23231794849), ('5', 4194304000)] [ 466.753789] qmemman.systemstate[1776]: mem-set domain 3 to 4194304000 [ 466.754138] qmemman.systemstate[1776]: mem-set domain 0 to 23231794849 [ 466.755097] qmemman.systemstate[1776]: mem-set domain 5 to 4194304000 [ 467.068819] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 467.080782] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=36445151, total_mem_pref=1966254387.2, total_available_memory=29690593612.8) [ 467.081149] qmemman.daemon.algo[1776]: left_memory=4755684854 acceptors_count=1 [ 467.272301] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 467.399440] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 467.560448] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=4231422496, total_mem_pref=1556351283.2, total_available_memory=30101170061.8) [ 467.560838] qmemman.daemon.algo[1776]: left_memory=4082769183 acceptors_count=1 [ 467.561192] qmemman.systemstate[1776]: stat: dom '0' act=23231794849 pref=1149025382.4 last_target=23231794849 [ 467.561471] qmemman.systemstate[1776]: stat: dom '3' act=4194304000 pref=407325900.8 last_target=4194304000 [ 467.561736] qmemman.systemstate[1776]: stat: xenfree=4283851296 memset_reqs=[('0', 27427477052), ('3', 4194304000)] [ 467.562092] qmemman.systemstate[1776]: mem-set domain 0 to 27427477052 [ 467.562358] qmemman.systemstate[1776]: mem-set domain 3 to 4194304000 [ 467.628184] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 468.226576] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 468.310238] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 468.450597] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 468.548262] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 469.796663] usb 1-13: USB disconnect, device number 6 [ 470.067048] usb 1-13: new low-speed USB device number 7 using xhci_hcd [ 470.199067] usb 1-13: New USB device found, idVendor=1c4f, idProduct=0034, bcdDevice= 1.10 [ 470.199174] usb 1-13: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 470.199259] usb 1-13: Product: Usb Mouse [ 470.199309] usb 1-13: Manufacturer: SIGMACHIP [ 470.203841] input: SIGMACHIP Usb Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-13/1-13:1.0/0003:1C4F:0034.0008/input/input22 [ 470.204390] hid-generic 0003:1C4F:0034.0008: input,hidraw3: USB HID v1.10 Mouse [SIGMACHIP Usb Mouse] on usb-0000:00:14.0-13/input0 [ 476.968118] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=38377924, total_mem_pref=1556351283.2, total_available_memory=30103807692.8) [ 476.970757] qmemman.daemon.algo[1776]: left_memory=4083458810 acceptors_count=1 [ 477.444847] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=4227571829, total_mem_pref=1149025382.4, total_available_memory=30506023498.6) [ 477.445311] qmemman.systemstate[1776]: stat: dom '0' act=27427477052 pref=1149025382.4 last_target=27427477052 [ 477.445613] qmemman.systemstate[1776]: stat: xenfree=4280000629 memset_reqs=[('0', 31623393832)] [ 477.445894] qmemman.systemstate[1776]: mem-set domain 0 to 31623393832 [ 477.550070] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 477.630718] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 477.783517] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 477.948302] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 481.229753] pciback 0000:00:1f.6: disabling bus mastering [ 481.234276] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=40056183, total_mem_pref=1149025382.4, total_available_memory=30514424632.6) [ 481.343171] pciback 0000:00:1f.6: restoring config space at offset 0x10 (was 0x0, writing 0xdf200000) [ 481.343338] pciback 0000:00:1f.6: restoring config space at offset 0x4 (was 0x100000, writing 0x100002) [ 481.455149] pciback 0000:00:1f.6: restoring config space at offset 0x10 (was 0x0, writing 0xdf200000) [ 481.455315] pciback 0000:00:1f.6: restoring config space at offset 0x4 (was 0x100000, writing 0x100002) [ 481.674934] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=190080144, total_mem_pref=1149025382.4, total_available_memory=30664448593.6) [ 481.675355] qmemman.systemstate[1776]: stat: dom '0' act=31623393832 pref=1149025382.4 last_target=31623393832 [ 481.675668] qmemman.systemstate[1776]: stat: xenfree=242508944 memset_reqs=[('0', 31781660502)] [ 481.676048] qmemman.systemstate[1776]: mem-set domain 0 to 31781660502 [ 481.853204] qmemman.daemon.algo[1776]: balance_when_enough_memory(xen_free_memory=1695980896, total_mem_pref=1149025382.4, total_available_memory=32328616015.6) [ 481.853636] qmemman.systemstate[1776]: stat: dom '0' act=31781660502 pref=1149025382.4 last_target=31781660502 [ 481.853924] qmemman.systemstate[1776]: stat: xenfree=1748409696 memset_reqs=[('0', 33444163756)] [ 481.854283] qmemman.systemstate[1776]: mem-set domain 0 to 33444163756 [ 482.068139] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 482.209782] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 482.342588] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 482.410096] lvm[714]: Monitoring thin pool qubes_dom0-pool00-tpool. [ 482.978951] preshutdown[4849]: real 0m23.952s [ 482.979334] preshutdown[4849]: user 0m0.069s [ 482.979651] preshutdown[4849]: sys 0m0.024s [ 482.980119] preshutdown[4849]: exitcode: '0' [ 482.984697] preshutdown[4849]: real 0m0.006s [ 482.985993] preshutdown[4849]: user 0m0.001s [ 482.986276] preshutdown[4849]: sys 0m0.007s [ 482.989971] preshutdown[4849]: [41mEnding /home/ctor/bin/preshutdown on Thu Sep 13 18:52:38 CEST 2018 482.98 2709.89 [ 482.991696] preshutdown[4849]: (B[m [ 483.001506] qubesdb-daemon[1781]: terminating [ 483.002235] systemd[1]: Stopped Qubes Dom0 startup setup. [ 483.002788] systemd[1]: Stopped Qubes DB agent. [ 483.003726] systemd[1]: Stopping Xenconsoled - handles logging from guest consoles and hypervisor... [ 483.003838] systemd[1]: Stopping Virtualization daemon... [ 483.003967] systemd[1]: Stopping Qubes memory management daemon... [ 483.004053] systemd[1]: Stopping Qubes OS daemon... [ 483.007522] qubesd[1780]: caught SIGTERM, exiting [ 483.007791] systemd[1]: Stopped Qubes memory management daemon. [ 483.008102] systemd[1]: Stopped Xenconsoled - handles logging from guest consoles and hypervisor. [ 483.011154] libvirtd[1797]: S3 disabled [ 483.011495] libvirtd[1797]: S4 disabled [ 483.011823] libvirtd[1797]: S3 disabled [ 483.012153] libvirtd[1797]: S4 disabled [ 483.012390] libvirtd[1797]: S3 disabled [ 483.012625] libvirtd[1797]: S4 disabled [ 483.014648] systemd[1]: Stopped Virtualization daemon. [ 483.014870] systemd[1]: Stopping D-Bus System Message Bus... [ 483.015010] systemd[1]: Stopping The Xen xenstore... [ 483.015056] systemd[1]: Stopped target Remote File Systems. [ 483.015621] systemd[1]: Stopped The Xen xenstore. [ 483.016895] systemd[1]: Unmounting mount xenstore file system... [ 483.017445] systemd[1]: Stopped D-Bus System Message Bus. [ 483.031453] systemd[1]: Unmounted mount xenstore file system. [ 483.048302] systemd[1]: Stopped Qubes OS daemon. [ 483.049731] systemd[1]: Stopping LVM2 PV scan on device 253:0... [ 483.049805] systemd[1]: Stopped target Basic System. [ 483.049896] systemd[1]: Stopped target Slices. [ 483.050084] systemd[1]: Removed slice User and Session Slice. [ 483.050144] systemd[1]: Stopped target Sockets. [ 483.050238] systemd[1]: Closed Virtual machine log manager socket. [ 483.050309] systemd[1]: Closed D-Bus System Message Bus Socket. [ 483.051874] systemd[1]: Closed Virtual machine lock manager socket. [ 483.054836] systemd[1]: Stopped target Paths. [ 483.056301] systemd[1]: Stopped Forward Password Requests to Plymouth Directory Watch. [ 483.060515] systemd[1]: Stopped target System Initialization. [ 483.065939] systemd[1]: Stopping Update UTMP about System Boot/Shutdown... [ 483.069274] systemd[1]: Stopped target Encrypted Volumes. [ 483.074883] systemd[1]: Stopping Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b... [ 483.082947] systemd[1]: Stopped Forward Password Requests to Wall Directory Watch. [ 483.085306] systemd[1]: Stopped Setup Virtual Console. [ 483.090385] systemd[1]: Stopping Load/Save Random Seed... [ 483.093955] systemd[1]: Stopped Load legacy module configuration. [ 483.098849] systemd[1]: Stopped LVM2 PV scan on device 253:0. [ 483.102554] systemd[1]: Stopped Load/Save Random Seed. [ 483.107643] systemd[1]: Removed slice system-lvm2\x2dpvscan.slice. [ 483.111174] systemd[1]: Stopped Update UTMP about System Boot/Shutdown. [ 483.115655] systemd[1]: Stopped Create Volatile Files and Directories. [ 483.119026] systemd[1]: Stopped target Local File Systems. [ 483.124202] systemd[1]: Unmounting /run/user/1000... [ 483.128348] systemd[1]: Unmounting Configuration File System... [ 483.132617] systemd[1]: Unmounting /boot/efi... [ 483.136931] systemd[1]: Unmounting Temporary Directory... [ 483.139251] systemd[1]: Stopped Configure read-only root support. [ 483.143437] systemd[1]: Unmounted /run/user/1000. [ 483.146606] systemd[1]: Unmounted Configuration File System. [ 483.152346] systemd[1]: Unmounted Temporary Directory. [ 483.154901] systemd[1]: Unmounted /boot/efi. [ 483.159059] systemd[1]: Stopped File System Check on /dev/disk/by-uuid/181A-D5EF. [ 483.162857] systemd[1]: Removed slice system-systemd\x2dfsck.slice. [ 483.166731] systemd[1]: Stopped target Local File Systems (Pre). [ 483.169108] systemd[1]: Stopping Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 483.172431] systemd[1]: Stopped Remount Root and Kernel File Systems. [ 483.176419] systemd[1]: Stopped Create Static Device Nodes in /dev. [ 483.180204] systemd[1]: Stopped target Swap. [ 483.191591] dmeventd[714]: No longer monitoring thin pool qubes_dom0-pool00-tpool. [ 483.203592] lvm[6922]: 45 logical volume(s) in volume group "qubes_dom0" unmonitored [ 483.205074] systemd[1]: Stopped Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling. [ 483.206614] systemd[1]: Stopping LVM2 metadata daemon... [ 483.206804] lvmetad[713]: Failed to accept connection errno 11. [ 483.210855] systemd[1]: Stopped LVM2 metadata daemon. [ 487.888467] systemd-cryptsetup[6906]: Failed to deactivate: Device or resource busy [ 487.898259] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Control process exited, code=exited status=1 [ 487.907380] systemd[1]: Stopped Cryptography Setup for luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b. [ 487.914977] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Unit entered failed state. [ 487.922136] systemd[1]: systemd-cryptsetup@luks\x2d9ed952b5\x2d2aa8\x2d4564\x2db700\x2dfb23f5c9e94b.service: Failed with result 'exit-code'. [ 487.922297] systemd[1]: Reached target Unmount All Filesystems. [ 487.927869] systemd[1]: Removed slice system-systemd\x2dcryptsetup.slice. [ 487.932161] systemd[1]: Reached target Shutdown. [ 487.936452] systemd[1]: Reached target Final Step. [ 487.939142] systemd[1]: Starting Reboot... [ 487.943920] systemd[1]: Shutting down. [ 487.970146] systemd[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 487.973724] systemd[1]: Set hardware watchdog to 10min. [ 487.977276] watchdog: watchdog0: watchdog did not stop! [ 488.019093] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 488.024959] dmeventd[714]: dmeventd detected break while being idle for 5 second(s), exiting. [ 488.030553] dmeventd[714]: dmeventd shutting down. [ 488.033542] systemd-journald[706]: Received SIGTERM from PID 1 (systemd-shutdow). [ 488.058151] systemd-shutdown[1]: Sending SIGKILL to remaining processes... [ 488.062139] systemd-shutdown[1]: Process 4842 (plymouthd) has been marked to be excluded from killing. It is running from the root file system, and thus likely to block re-mounting of the root file system to read-only. Please consider moving it into an initrd file system instead. [ 488.063548] systemd-shutdown[1]: Hardware watchdog 'iTCO_wdt', version 0 [ 488.065072] systemd-shutdown[1]: Unmounting file systems. [ 488.066506] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32'. [ 488.077055] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32 [ 488.081286] systemd-shutdown[1]: Remounting '/' read-only with options 'discard,stripe=32'. [ 488.082725] EXT4-fs (dm-4): re-mounted. Opts: discard,stripe=32 [ 488.084110] systemd-shutdown[1]: All filesystems unmounted. [ 488.085486] systemd-shutdown[1]: Deactivating swaps. [ 488.086875] systemd-shutdown[1]: All swaps deactivated. [ 488.088245] systemd-shutdown[1]: Detaching loop devices. [ 488.091238] systemd-shutdown[1]: All loop devices detached. [ 488.092601] systemd-shutdown[1]: Detaching DM devices. [ 488.098244] systemd-shutdown[1]: Detaching DM 253:9. [ 488.118964] systemd-shutdown[1]: Detaching DM 253:8. [ 488.136072] systemd-shutdown[1]: Detaching DM 253:7. [ 488.160097] systemd-shutdown[1]: Detaching DM 253:6. [ 488.184091] systemd-shutdown[1]: Detaching DM 253:56. [ 488.209099] systemd-shutdown[1]: Detaching DM 253:53. [ 488.234111] systemd-shutdown[1]: Detaching DM 253:50. [ 488.258098] systemd-shutdown[1]: Detaching DM 253:5. [ 488.282118] systemd-shutdown[1]: Detaching DM 253:47. [ 488.307068] systemd-shutdown[1]: Detaching DM 253:46. [ 488.331076] systemd-shutdown[1]: Detaching DM 253:45. [ 488.359082] systemd-shutdown[1]: Detaching DM 253:44. [ 488.383098] systemd-shutdown[1]: Detaching DM 253:41. [ 488.413092] systemd-shutdown[1]: Detaching DM 253:40. [ 488.437058] systemd-shutdown[1]: Detaching DM 253:39. [ 488.461092] systemd-shutdown[1]: Detaching DM 253:37. [ 488.485087] systemd-shutdown[1]: Detaching DM 253:36. [ 488.513089] systemd-shutdown[1]: Detaching DM 253:34. [ 488.536097] systemd-shutdown[1]: Detaching DM 253:33. [ 488.559084] systemd-shutdown[1]: Detaching DM 253:32. [ 488.582105] systemd-shutdown[1]: Detaching DM 253:31. [ 488.608119] systemd-shutdown[1]: Detaching DM 253:30. [ 488.631093] systemd-shutdown[1]: Detaching DM 253:3. [ 488.637686] dev_remove: 15 callbacks suppressed [ 488.637725] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 488.650845] systemd-shutdown[1]: Detaching DM 253:29. [ 488.674089] systemd-shutdown[1]: Detaching DM 253:28. [ 488.697094] systemd-shutdown[1]: Detaching DM 253:27. [ 488.720056] systemd-shutdown[1]: Detaching DM 253:26. [ 488.744032] systemd-shutdown[1]: Detaching DM 253:25. [ 488.768137] systemd-shutdown[1]: Detaching DM 253:24. [ 488.791141] systemd-shutdown[1]: Detaching DM 253:23. [ 488.814095] systemd-shutdown[1]: Detaching DM 253:22. [ 488.838077] systemd-shutdown[1]: Detaching DM 253:21. [ 488.862093] systemd-shutdown[1]: Detaching DM 253:20. [ 488.885074] systemd-shutdown[1]: Detaching DM 253:2. [ 488.891217] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 488.897291] systemd-shutdown[1]: Detaching DM 253:19. [ 488.919052] systemd-shutdown[1]: Detaching DM 253:18. [ 488.939103] systemd-shutdown[1]: Detaching DM 253:17. [ 488.962097] systemd-shutdown[1]: Detaching DM 253:16. [ 488.988074] systemd-shutdown[1]: Detaching DM 253:15. [ 489.012097] systemd-shutdown[1]: Detaching DM 253:14. [ 489.035090] systemd-shutdown[1]: Detaching DM 253:13. [ 489.063095] systemd-shutdown[1]: Detaching DM 253:12. [ 489.086087] systemd-shutdown[1]: Detaching DM 253:11. [ 489.109063] systemd-shutdown[1]: Detaching DM 253:10. [ 489.131094] systemd-shutdown[1]: Detaching DM 253:1. [ 489.136832] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 489.142507] systemd-shutdown[1]: Detaching DM 253:0. [ 489.148173] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 489.153853] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 489.160037] systemd-shutdown[1]: Detaching DM devices. [ 489.163248] systemd-shutdown[1]: Detaching DM 253:3. [ 489.164301] systemd-shutdown[1]: Could not detach DM /dev/dm-3: Device or resource busy [ 489.165348] systemd-shutdown[1]: Detaching DM 253:2. [ 489.166401] systemd-shutdown[1]: Could not detach DM /dev/dm-2: Device or resource busy [ 489.167467] systemd-shutdown[1]: Detaching DM 253:1. [ 489.168523] systemd-shutdown[1]: Could not detach DM /dev/dm-1: Device or resource busy [ 489.169580] systemd-shutdown[1]: Detaching DM 253:0. [ 489.170632] systemd-shutdown[1]: Could not detach DM /dev/dm-0: Device or resource busy [ 489.171686] systemd-shutdown[1]: Not all DM devices detached, 5 left. [ 489.172737] systemd-shutdown[1]: Cannot finalize remaining DM devices, continuing. [ 489.196439] + echo 'Hello, this is '\''/usr/lib/systemd/system-shutdown/debug.sh'\'' or '\''/usr/lib/systemd/system-shutdown/debug.sh'\''' [ 489.197552] Hello, this is '/usr/lib/systemd/system-shutdown/debug.sh' or '/usr/lib/systemd/system-shutdown/debug.sh' [ 489.198690] + PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 489.199797] + echo 'Script args: reboot' [ 489.200893] Script args: reboot [ 489.201986] + set [ 489.203075] BASH=/bin/bash [ 489.204161] BASHOPTS=cmdhist:complete_fullquote:extquote:force_fignore:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath [ 489.205266] BASH_ALIASES=() [ 489.206362] BASH_ARGC=([0]="1") [ 489.207457] BASH_ARGV=([0]="reboot") [ 489.208526] BASH_CMDS=() [ 489.209616] BASH_LINENO=([0]="0") [ 489.210693] BASH_SOURCE=([0]="/usr/lib/systemd/system-shutdown/debug.sh") [ 489.211788] BASH_VERSINFO=([0]="4" [1]="3" [2]="43" [3]="1" [4]="release" [5]="x86_64-redhat-linux-gnu") [ 489.212887] BASH_VERSION='4.3.43(1)-release' [ 489.213972] DIRSTACK=() [ 489.215066] EUID=0 [ 489.216111] GROUPS=() [ 489.217142] HOME=/ [ 489.218167] HOSTNAME=dom0 [ 489.219181] HOSTTYPE=x86_64 [ 489.220189] IFS=$' \t\n' [ 489.221155] MACHTYPE=x86_64-redhat-linux-gnu [ 489.222125] OPTERR=1 [ 489.223094] OPTIND=1 [ 489.224118] OSTYPE=linux-gnu [ 489.225102] PATH=/usr/local/bin:/usr/bin:/usr/sbin [ 489.226054] PIPESTATUS=([0]="0") [ 489.227034] PPID=6934 [ 489.228035] PS4='+ ' [ 489.228986] PWD=/ [ 489.229897] SHELL=/bin/bash [ 489.230845] SHELLOPTS=braceexpand:hashall:interactive-comments:xtrace [ 489.231764] SHLVL=1 [ 489.232674] TERM=linux [ 489.233575] UID=0 [ 489.234465] WATCHDOG_USEC=600000000 [ 489.235376] _='Script args: reboot' [ 489.236276] date_log_started='Thu Sep 13 18:52:44 CEST 2018' [ 489.237180] pax_sanitize_slab=full [ 489.238077] root_trim=yes [ 489.239016] + trap onint sigint SIGHUP SIGALRM SIGTERM [ 489.239918] + sysctl kernel.sysrq=1 [ 489.246442] kernel.sysrq = 1 [ 489.247686] + mount -o remount,rw / [ 489.254430] EXT4-fs (dm-4): re-mounted. Opts: discard [ 489.255651] + df [ 489.259245] Filesystem 1K-blocks Used Available Use% Mounted on devtmpfs 1987472 0 1987472 0% /dev tmpfs 2000636 0 2000636 0% /dev/shm tmpfs 2000636 55608 1945028 3% /run tmpfs 2000636 0 2000636 0% /sys/fs/cgroup /dev/mapper/qubes_dom0-root 212377076 12614372 188904824 7% / [ 489.264660] + lsblk [ 489.269925] NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 223.6G 0 disk |-sda2 8:2 0 222.8G 0 part | `-luks-9ed952b5-2aa8-4564-b700-fb23f5c9e94b 253:0 0 222.8G 0 crypt | |-qubes_dom0-pool00_tmeta 253:1 0 104M 0 lvm | | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / | `-qubes_dom0-pool00_tdata 253:2 0 206.8G 0 lvm | `-qubes_dom0-pool00-tpool 253:3 0 206.8G 0 lvm | `-qubes_dom0-root 253:4 0 206.8G 0 lvm / `-sda1 8:1 0 800M 0 part [ 489.279120] + /usr/bin/qvm-shutdown --verbose --wait --all --timeout 600 [ 489.367637] real 0m0.089s user 0m0.054s [ 489.369941] sys 0m0.018s [ 489.370714] + echo 'exit code: 1' [ 489.371498] exit code: 1 [ 489.372298] + /usr/bin/ps axuw [ 489.380837] /usr/bin/ps: [ 489.380839] write error [ 489.381626] : Invalid argument [ 489.384885] + sysctl -a [ 489.385111] + grep -i sysrq [ 489.395975] sysctl: [ 489.395977] reading key "vm.nr_hugepages" [ 489.398443] sysctl: [ 489.398445] reading key "vm.nr_hugepages_mempolicy" [ 489.400902] sysctl: [ 489.400904] reading key "vm.nr_overcommit_hugepages" [ 489.403657] kernel.sysrq = 1 [ 489.404773] + sysctl -w kernel.sysrq=1 [ 489.407835] kernel.sysrq = 1 [ 489.409605] + sysctl -a [ 489.409823] + grep -i sysrq [ 489.419883] sysctl: [ 489.419885] reading key "vm.nr_hugepages" [ 489.422350] sysctl: [ 489.422352] reading key "vm.nr_hugepages_mempolicy" [ 489.424884] sysctl: [ 489.424886] reading key "vm.nr_overcommit_hugepages" [ 489.427711] kernel.sysrq = 1 [ 489.428826] + echo d [ 489.429703] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 489.430687] + echo h [ 489.431645] sysrq: SysRq : HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(V) show-blocked-tasks(w) dump-ftrace-buffer(z) [ 489.432699] + echo m [ 489.433724] sysrq: SysRq : Show Memory [ 489.434734] Mem-Info: [ 489.435740] active_anon:13760 inactive_anon:8498 isolated_anon:0 active_file:35020 inactive_file:127442 isolated_file:0 unevictable:2219 dirty:1 writeback:0 unstable:0 slab_reclaimable:7486 slab_unreclaimable:6999 mapped:2287 shmem:22099 pagetables:115 bounce:0 free:780231 free_pcp:1750 free_cma:0 [ 489.441877] Node 0 active_anon:55040kB inactive_anon:33992kB active_file:140080kB inactive_file:509768kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9148kB dirty:4kB writeback:0kB shmem:88396kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 489.442998] Node 0 DMA free:15900kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15900kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 489.444153] lowmem_reserve[]: 0 2553 3891 3891 3891 [ 489.445295] Node 0 DMA32 free:2409516kB min:5188kB low:7776kB high:10364kB active_anon:4kB inactive_anon:0kB active_file:232kB inactive_file:198668kB unevictable:0kB writepending:0kB present:2740876kB managed:2614964kB mlocked:0kB kernel_stack:48kB pagetables:0kB bounce:0kB free_pcp:3984kB local_pcp:720kB free_cma:0kB [ 489.446515] lowmem_reserve[]: 0 0 1338 1338 1338 [ 489.447724] Node 0 Normal free:695632kB min:2748kB low:4116kB high:5484kB active_anon:55108kB inactive_anon:33992kB active_file:139848kB inactive_file:311100kB unevictable:8876kB writepending:4kB present:1437436kB managed:1370408kB mlocked:8876kB kernel_stack:2208kB pagetables:460kB bounce:0kB free_pcp:2960kB local_pcp:156kB free_cma:0kB [ 489.449007] lowmem_reserve[]: 0 0 0 0 0 [ 489.450285] Node 0 DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15900kB [ 489.451603] Node 0 DMA32: 951*4kB (UME) 654*8kB (UME) 504*16kB (UME) 311*32kB (UME) 194*64kB (UME) 110*128kB (UME) 73*256kB (UME) 41*512kB (UM) 26*1024kB (UM) 14*2048kB (UME) 552*4096kB (M) = 2409516kB [ 489.452943] Node 0 Normal: 5810*4kB (UME) 3287*8kB (UME) 2321*16kB (UME) 1886*32kB (UME) 1426*64kB (UME) 765*128kB (UME) 346*256kB (UME) 107*512kB (UME) 53*1024kB (UME) 33*2048kB (UME) 23*4096kB (UME) = 695632kB [ 489.454304] 186519 total pagecache pages [ 489.455649] 1048575 pages RAM [ 489.456988] 0 pages HighMem/MovableOnly [ 489.458322] 48257 pages reserved [ 489.459651] 0 pages cma reserved [ 489.460980] 0 pages hwpoisoned [ 489.462320] + echo w [ 489.463659] sysrq: SysRq : Show Blocked State [ 489.464966] task PC stack pid father [ 489.466302] + echo 9 [ 489.467614] sysrq: SysRq : Changing Loglevel [ 489.468907] sysrq: Loglevel set to 9 [ 489.470219] + echo -n Before: [ 489.471514] Before: [ 489.471519] + cat /sys/block/sda/device/queue_depth [ 489.475270] 32 [ 489.476735] + echo -n After: [ 489.478017] After: [ 489.478022] + cat /sys/block/sda/device/queue_depth [ 489.481683] 32 [ 489.483198] + hdparm -W /dev/sda [ 489.489891] /dev/sda: write-caching = 1 (on) [ 489.493937] + hdparm -C /dev/sda [ 489.496411] /dev/sda: drive state is: active/idle [ 489.500413] + hdparm -W /dev/sdb [ 489.502816] /dev/sdb: No such file or directory [ 489.504278] + hdparm -C /dev/sdb [ 489.506616] /dev/sdb: No such file or directory [ 489.508080] + echo 'sync first' [ 489.509416] sync first [ 489.510715] + sync [ 489.513799] real 0m0.003s user 0m0.001s [ 489.517639] sys 0m0.002s [ 489.518963] + echo Before: [ 489.520232] Before: [ 489.521491] + echo m [ 489.522786] sysrq: SysRq : Show Memory [ 489.524037] Mem-Info: [ 489.525312] active_anon:13739 inactive_anon:8498 isolated_anon:0 active_file:35051 inactive_file:127441 isolated_file:0 unevictable:2219 dirty:0 writeback:0 unstable:0 slab_reclaimable:7486 slab_unreclaimable:6969 mapped:2281 shmem:22099 pagetables:82 bounce:0 free:780260 free_pcp:1724 free_cma:0 [ 489.532849] Node 0 active_anon:54956kB inactive_anon:33992kB active_file:140204kB inactive_file:509764kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9124kB dirty:0kB writeback:0kB shmem:88396kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 489.534178] Node 0 DMA free:15900kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15900kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 489.535537] lowmem_reserve[]: 0 2553 3891 3891 3891 [ 489.536891] Node 0 DMA32 free:2409516kB min:5188kB low:7776kB high:10364kB active_anon:4kB inactive_anon:0kB active_file:232kB inactive_file:198668kB unevictable:0kB writepending:0kB present:2740876kB managed:2614964kB mlocked:0kB kernel_stack:48kB pagetables:0kB bounce:0kB free_pcp:3988kB local_pcp:720kB free_cma:0kB [ 489.538320] lowmem_reserve[]: 0 0 1338 1338 1338 [ 489.539742] Node 0 Normal free:695624kB min:2748kB low:4116kB high:5484kB active_anon:54904kB inactive_anon:33992kB active_file:139972kB inactive_file:311096kB unevictable:8876kB writepending:0kB present:1437436kB managed:1370408kB mlocked:8876kB kernel_stack:2176kB pagetables:328kB bounce:0kB free_pcp:2908kB local_pcp:72kB free_cma:0kB [ 489.541246] lowmem_reserve[]: 0 0 0 0 0 [ 489.542736] Node 0 DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15900kB [ 489.544272] Node 0 DMA32: 951*4kB (UME) 654*8kB (UME) 504*16kB (UME) 311*32kB (UME) 194*64kB (UME) 110*128kB (UME) 73*256kB (UME) 41*512kB (UM) 26*1024kB (UM) 14*2048kB (UME) 552*4096kB (M) = 2409516kB [ 489.545826] Node 0 Normal: 5752*4kB (UME) 3286*8kB (UME) 2328*16kB (UME) 1886*32kB (UME) 1426*64kB (UME) 764*128kB (UME) 347*256kB (UME) 107*512kB (UME) 53*1024kB (UME) 33*2048kB (UME) 23*4096kB (UME) = 695632kB [ 489.547408] 186553 total pagecache pages [ 489.548977] 1048575 pages RAM [ 489.550542] 0 pages HighMem/MovableOnly [ 489.552107] 48257 pages reserved [ 489.553663] 0 pages cma reserved [ 489.555213] 0 pages hwpoisoned [ 489.556784] + echo 'manually Freeing pagecache pages' [ 489.558355] manually Freeing pagecache pages [ 489.559938] + echo --------------------------------------------------- [ 489.561506] --------------------------------------------------- [ 489.563083] + echo 3 [ 489.600690] debug.sh (6936): drop_caches: 3 [ 489.602298] real 0m0.039s user 0m0.000s [ 489.606939] sys 0m0.039s [ 489.608516] + echo --------------------------------------------------- [ 489.610078] --------------------------------------------------- [ 489.613079] + echo 'After :' [ 489.614646] After : [ 489.616220] + echo m [ 489.617809] sysrq: SysRq : Show Memory [ 489.619365] Mem-Info: [ 489.620916] active_anon:184 inactive_anon:22077 isolated_anon:0 active_file:309 inactive_file:168 isolated_file:0 unevictable:2219 dirty:0 writeback:0 unstable:0 slab_reclaimable:4548 slab_unreclaimable:6895 mapped:2281 shmem:22099 pagetables:72 bounce:0 free:946116 free_pcp:1867 free_cma:0 [ 489.630304] Node 0 active_anon:736kB inactive_anon:88308kB active_file:1236kB inactive_file:672kB unevictable:8876kB isolated(anon):0kB isolated(file):0kB mapped:9124kB dirty:0kB writeback:0kB shmem:88396kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 489.631947] Node 0 DMA free:15900kB min:28kB low:40kB high:52kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15900kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 489.633626] lowmem_reserve[]: 0 2553 3891 3891 3891 [ 489.635309] Node 0 DMA32 free:2609360kB min:5188kB low:7776kB high:10364kB active_anon:4kB inactive_anon:0kB active_file:84kB inactive_file:52kB unevictable:0kB writepending:0kB present:2740876kB managed:2614964kB mlocked:0kB kernel_stack:48kB pagetables:0kB bounce:0kB free_pcp:4000kB local_pcp:732kB free_cma:0kB [ 489.637057] lowmem_reserve[]: 0 0 1338 1338 1338 [ 489.638806] Node 0 Normal free:1159204kB min:2748kB low:4116kB high:5484kB active_anon:664kB inactive_anon:88304kB active_file:1220kB inactive_file:628kB unevictable:8876kB writepending:0kB present:1437436kB managed:1370408kB mlocked:8876kB kernel_stack:2160kB pagetables:288kB bounce:0kB free_pcp:3468kB local_pcp:632kB free_cma:0kB [ 489.640628] lowmem_reserve[]: 0 0 0 0 0 [ 489.642452] Node 0 DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 2*32kB (U) 3*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15900kB [ 489.644303] Node 0 DMA32: 542*4kB (UME) 445*8kB (UME) 369*16kB (UME) 264*32kB (UME) 180*64kB (UME) 109*128kB (UME) 79*256kB (UME) 44*512kB (UM) 30*1024kB (UM) 20*2048kB (UME) 598*4096kB (M) = 2609392kB [ 489.646189] Node 0 Normal: 6159*4kB (UME) 4815*8kB (UME) 3849*16kB (UME) 3008*32kB (UME) 2203*64kB (UME) 1237*128kB (UME) 582*256kB (UME) 209*512kB (UME) 94*1024kB (UME) 38*2048kB (UME) 51*4096kB (UME) = 1159300kB [ 489.648092] 24497 total pagecache pages [ 489.649998] 1048575 pages RAM [ 489.651908] 0 pages HighMem/MovableOnly [ 489.653807] 48257 pages reserved [ 489.655714] 0 pages cma reserved [ 489.657619] 0 pages hwpoisoned [ 489.659609] + echo 'end of log' [ 489.661521] end of log [ 489.663428] + logfile=/dmesg_shutdown.log [ 489.666795] ++ TMPDIR= [ 489.667042] ++ /usr/bin/cut -f2 -d/ [ 489.668726] ++ /usr/bin/mktemp --dry-run '--tmpdir='\''' -t --quiet XXXXXXXXXXXXXX [ 489.684951] + rnd_log_tag=MbGh6XWd3eS8nN [ 489.687239] + echo '//--- /usr/lib/systemd/system-shutdown/debug.sh started execution on: '\''Thu Sep 13 18:52:44 CEST 2018'\'' tag:MbGh6XWd3eS8nN' [ 489.689959] + echo '//--- here'\''s /var/log/boot.log eg. what you see systemd spew on console: ' [ 489.691897] + ls -la /var/log/boot.log [ 489.716936] + cat /var/log/boot.log [ 489.721244] + echo '//--- end of /var/log/boot.log' [ 489.726047] + dmesg //--- /usr/lib/systemd/system-shutdown/debug.sh generated '/dmesg_shutdown.log' on: 'Thu Sep 13 18:52:45 CEST 2018' tag:MbGh6XWd3eS8nN ``` `redsparrow.service` was disabled! `qubes-core.service` was this: ``` [Unit] Description=Qubes Dom0 startup setup After=qubes-db-dom0.service libvirtd.service xenconsoled.service qubesd.service qubes-qmemman.service Before=redsparrow.service [Service] Type=oneshot StandardOutput=syslog RemainAfterExit=yes # Needed to avoid rebooting before all VMs have shut down. TimeoutStopSec=180 ExecStart=/usr/lib/qubes/startup-misc.sh ExecStop=/home/ctor/bin/preshutdown # QubesDB daemons stop after 60s timeout in worst case; speed it up, since no # VMs are running now ExecStop=-/usr/bin/pkill qubesdb-daemon [Install] WantedBy=multi-user.target Also=qubes-meminfo-writer-dom0.service qubes-qmemman.service Alias=qubes_core.service ``` So [this `pkill` PR](https://github.com/QubesOS/qubes-core-admin/pull/227/files) isn't necessary anymore. `/home/ctor/bin/preshutdown` was this: ``` #!/bin/bash tput -Txterm-256color setab 2;echo "Starting $0 `date` `cat /proc/uptime`";echo;tput -Txterm-256color sgr0; xl list time qvm-shutdown --verbose --all --wait; ec="$?" echo "exitcode: '$ec'" time while xl list|grep -q -F '(null)'; do xl list;sleep 1; done #this only happens if there are any qubes-guid pids active (eg. pkill -9 qubes-guid is required to never see any of these '(null)'s tput -Txterm-256color setab 1;echo "Ending $0 on `date` `cat /proc/uptime`";echo;tput -Txterm-256color sgr0; exit $ec ``` Thank you marmarek! Much appreciated

Hey marmarek if this is you https://unix.stackexchange.com/users/209970/marmarek and you care about it, place an answer on this question (it's about this very issue) because I'd love to give you the 150 rep bounty (possible only if you place an answer in 3 days before it expires). Only if you care, I imagine you're busy, but hey that's the least I could do:)

It seems you have posted a bad link for the question…

Thanks so much @v6ak ! fixed above. (it's so easy for me to miss one of ctrl+c, ctrl+shift+c, ctrl+shift+v)

Automated announcement from builder-github

The package qubes-gui-dom0-4.0.9-1.fc25 has been pushed to the r4.0 testing repository for dom0. To test this update, please install it with the following command:

sudo qubes-dom0-update --enablerepo=qubes-dom0-current-testing

Changes included in this update

Automated announcement from builder-github

The package qubes-gui-dom0-4.0.9-1.fc25 has been pushed to the r4.0 stable repository for dom0. To install this update, please use the standard update command:

sudo qubes-dom0-update

Or update dom0 via Qubes Manager.

Changes included in this update

@DemiMarie, please confirm that you had the latest packages (see above) when experiencing the problem you reported in #4368.

Wow. Nice work in tracking this down @constantoverride! Well done, and impressive find. Thank you :)

QubesOS / qubes-issues

System shutdown hang #1581