search

QubesOS / qubes-issues

The Qubes OS Project issue tracker
https://www.qubes-os.org/doc/issue-tracking/
532 stars 46 forks source link

qubes-core-agent gets stuck/hung on dpkg configure #5376

Closed lunarthegrey closed 4 years ago

lunarthegrey commented 4 years ago

Qubes OS version R4.0.1 (all stable packages up to date)

Affected component(s) or functionality qubes-core-agent

Brief summary When doing a dist-upgrade of packages this morning, qubes-core-agent gets stuck on the configuration stage of dpkg.

To Reproduce In the Debian 10 Standalone VM:

  1. sudo apt update; sudo apt dist-upgrade
  2. qubes-core-agent starts to get setup/configured

Expected behavior dpkg is able to configure it successfully and it doesn't hang.

Actual behavior The configuration hangs on qubes-core-agent for an unknown reason.

Additional context Retried the installation, it just hangs here forever...

user@main:~$ sudo apt dist-upgrade
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Calculating upgrade... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
4 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Do you want to continue? [Y/n] y
Setting up qubes-core-agent (4.0.48-1+deb10u1) ...
Removed /etc/systemd/system/multi-user.target.wants/haveged.service.
Created symlink /etc/systemd/system/multi-user.target.wants/haveged.service → /etc/systemd/system/haveged.service.
Leaving 'diversion of /etc/init/plymouth-shutdown.conf to /etc/init/plymouth-shutdown.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/prefdm.conf to /etc/init/prefdm.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/splash-manager.conf to /etc/init/splash-manager.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/start-ttys.conf to /etc/init/start-ttys.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/tty.conf to /etc/init/tty.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/serial.conf to /etc/init/serial.conf.qubes-orig by qubes-core-agent'
qubes-sync-time.service is a disabled or a static unit, not starting it.
qubes-update-check.service is a disabled or a static unit, not starting it.

I have to kill the dpkg process, it just sits there and does nothing.

user@main:~$ ps aux | grep dpkg | grep -v grep
root      7948  0.0  0.1  14896  7136 pts/5    Ss+  15:16   0:00 /usr/bin/dpkg --status-fd 23 --configure --pending
root      7949  0.0  0.0   6776  3464 pts/5    S+   15:16   0:00 /bin/bash /var/lib/dpkg/info/qubes-core-agent.postinst configure 4.0.47-1+deb10u1

If I strace -p 7949 for example, I see the process doing nothing, it seems entirely stuck.

Solutions you've tried Tried to reinstall it, still hangs. I also backed up the VM from its previous state and retried it, still does the same thing.

lunarthegrey commented 4 years ago

I've had this happen to me before which is strange, just didn't feel like reporting it several months back. The only way I could get it working was to create a whole new standalone VM from my template, in which qubes-core-agent installs and upgrades just fine. Now the issue is back in this new VM somehow. It's a really bizarre issue. I can't even CTRL + C when running the installation/upgrade. It's completely stuck.

lunarthegrey commented 4 years ago

I've oddly ran into the issue again :frowning:

This was with my new standalone VM. The template VM that it was based off of updated just fine though. When I updated my standalone VM to apply the new qubes-core-agent it hung again and an strace showed dpkg was waiting. Some service is getting hung I believe and it's waiting for some service to start or restart possibly. Tagging @marmarek as I'm at a loss on what this issue could be. Only happens with Qubes packages. This might provide more details on the issue, I hit CTRL + C after waiting several minutes as it was hung.

user@main:~$ sudo dpkg --configure -a
Setting up qubes-core-agent (4.0.51-1+deb10u1) ...
Removed /etc/systemd/system/multi-user.target.wants/haveged.service.
Created symlink /etc/systemd/system/multi-user.target.wants/haveged.service → /etc/systemd/system/haveged.service.
Leaving 'diversion of /etc/init/plymouth-shutdown.conf to /etc/init/plymouth-shutdown.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/prefdm.conf to /etc/init/prefdm.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/splash-manager.conf to /etc/init/splash-manager.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/start-ttys.conf to /etc/init/start-ttys.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/tty.conf to /etc/init/tty.conf.qubes-disabled by qubes-core-agent'
Leaving 'diversion of /etc/init/serial.conf to /etc/init/serial.conf.qubes-orig by qubes-core-agent'
qubes-sync-time.service is a disabled or a static unit, not starting it.
qubes-update-check.service is a disabled or a static unit, not starting it.
^Cdpkg: error processing package qubes-core-agent (--configure):
 installed qubes-core-agent package post-installation script subprocess was interrupted
dpkg: dependency problems prevent configuration of qubes-core-agent-networking:
 qubes-core-agent-networking depends on qubes-core-agent (= 4.0.51-1+deb10u1); however:
  Package qubes-core-agent is not configured yet.

dpkg: error processing package qubes-core-agent-networking (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of qubes-core-agent-network-manager:
 qubes-core-agent-network-manager depends on qubes-core-agent-networking (= 4.0.51-1+deb10u1); however:
  Package qubes-core-agent-networking is not configured yet.

dpkg: error processing package qubes-core-agent-network-manager (--configure):
 dependency problems - leaving unconfigured
Processing triggers for mime-support (3.62) ...
Processing triggers for libglib2.0-0:amd64 (2.58.3-2+deb10u2) ...
Processing triggers for libc-bin (2.28-10) ...
Processing triggers for man-db (2.8.5-2) ...
Processing triggers for desktop-file-utils (0.23-4) ...
Errors were encountered while processing:
 qubes-core-agent
 qubes-core-agent-networking
 qubes-core-agent-network-manager
lunarthegrey commented 4 years ago

It gets stuck right after or on this;

qubes-update-check.service is a disabled or a static unit, not starting it.

chaywoo commented 4 years ago

Yes I have this problem too.. I didnt try anything other than let it sit for about 5 hours. I didnt know what else to try.. Im a nube, just escaped from the windows prison. Anyway, I also have the download arrow stuck on in the qubes manager, but every time I try to update, I get the error that "dpkg was interrupted, you must manually run 'dpkg --configure -a' to correct the problem, but that creates another problem by getting stuck with an 'ok' option bottom center of window, but clicking the 'ok' doesnt do anything, who knows maybe its not suppose to, nevertheless thats where everything comes to a stand still.. Thanks!

lunarthegrey commented 4 years ago

@chaywoo thanks for reporting the issue as well. Thought I was alone in this! It pretty much breaks dpkg until qubes-core-agent installs correctly. You might have to hit enter when 'ok' displays.

marmarek commented 4 years ago

I've tried to reproduce it, but it works fine for me. Can anybody send a process list (ps auxfww) inside of that template while the update is hanging?

lunarthegrey commented 4 years ago

@marmarek, thanks for joining in. This one is really hard to reproduce because it seems every time I build a fresh standalone VM from the template (which doesn't have any issue) it eventually happens to the standalone VM. Here is a ps auxfww while running the upgrade and being stuck.

user@main:~$ ps auxfww
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         2  0.0  0.0      0     0 ?        S    Jan01   0:00 [kthreadd]
root         3  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [rcu_gp]
root         4  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [rcu_par_gp]
root         6  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kworker/0:0H-kblockd]
root         8  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [mm_percpu_wq]
root         9  0.0  0.0      0     0 ?        S    Jan01   0:11  \_ [ksoftirqd/0]
root        10  0.0  0.0      0     0 ?        R    Jan01   1:36  \_ [rcu_sched]
root        11  0.0  0.0      0     0 ?        I    Jan01   0:00  \_ [rcu_bh]
root        12  0.0  0.0      0     0 ?        S    Jan01   0:01  \_ [migration/0]
root        14  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [cpuhp/0]
root        15  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [cpuhp/1]
root        16  0.0  0.0      0     0 ?        S    Jan01   0:01  \_ [migration/1]
root        17  0.0  0.0      0     0 ?        S    Jan01   0:06  \_ [ksoftirqd/1]
root        19  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kworker/1:0H-kblockd]
root        20  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [kdevtmpfs]
root        21  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [netns]
root        22  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [rcu_tasks_kthre]
root        23  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [kauditd]
root        24  0.0  0.0      0     0 ?        S    Jan01   0:01  \_ [xenbus]
root        25  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [xenwatch]
root        26  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [oom_reaper]
root        27  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [writeback]
root        28  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [kcompactd0]
root        29  0.0  0.0      0     0 ?        SN   Jan01   0:00  \_ [ksmd]
root        30  0.0  0.0      0     0 ?        SN   Jan01   0:00  \_ [khugepaged]
root        31  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [crypto]
root        32  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kintegrityd]
root        33  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kblockd]
root        36  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [ata_sff]
root        37  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [md]
root        38  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [edac-poller]
root        39  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [devfreq_wq]
root        40  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [watchdogd]
root        42  0.0  0.0      0     0 ?        S    Jan01   0:18  \_ [kswapd0]
root        43  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kworker/u5:0]
root        97  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kthrotld]
root        98  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [acpi_thermal_pm]
root        99  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [khvcd]
root       100  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [dm_bufio_cache]
root       101  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [ipv6_addrconf]
root       106  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [kstrp]
root       167  0.0  0.0      0     0 ?        I<   Jan01   0:04  \_ [kworker/0:1H-kblockd]
root       173  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [jbd2/xvda3-8]
root       174  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [ext4-rsv-conver]
root       178  0.0  0.0      0     0 ?        S    Jan01   0:00  \_ [jbd2/xvdd-8]
root       179  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [ext4-rsv-conver]
root       224  0.0  0.0      0     0 ?        I<   Jan01   0:04  \_ [kworker/1:1H-kblockd]
root       308  0.0  0.0      0     0 ?        S    Jan01   0:19  \_ [jbd2/xvdb-8]
root       309  0.0  0.0      0     0 ?        I<   Jan01   0:00  \_ [ext4-rsv-conver]
root       474  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop0]
root       492  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop1]
root       519  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop2]
root       538  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop3]
root       545  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop4]
root       556  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop5]
root       558  0.0  0.0      0     0 ?        S<   Jan01   0:01  \_ [loop6]
root       589  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop7]
root       595  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop8]
root       602  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop9]
root       603  0.0  0.0      0     0 ?        S<   Jan01   0:01  \_ [loop10]
root       604  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop11]
root       621  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop12]
root       628  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop13]
root       631  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop14]
root       655  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop15]
root       659  0.0  0.0      0     0 ?        S<   Jan01   0:01  \_ [loop16]
root       661  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop17]
root       664  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop18]
root       669  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop19]
root       681  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop20]
root       687  0.0  0.0      0     0 ?        S<   Jan01   0:00  \_ [loop21]
root     28311  0.0  0.0      0     0 ?        I    03:59   0:00  \_ [kworker/0:1-cgroup_destroy]
root     28314  0.0  0.0      0     0 ?        I    03:59   0:00  \_ [kworker/u4:2-events_unbound]
root     28638  0.0  0.0      0     0 ?        I    04:14   0:00  \_ [kworker/1:0-events]
root     29052  0.0  0.0      0     0 ?        I    04:21   0:00  \_ [kworker/u4:3-events_unbound]
root     29053  0.0  0.0      0     0 ?        I    04:21   0:00  \_ [kworker/1:2-events_power_efficient]
root     29054  0.0  0.0      0     0 ?        I    04:21   0:00  \_ [kworker/1:3-cgroup_destroy]
root     29239  0.0  0.0      0     0 ?        I    04:21   0:00  \_ [kworker/0:2-mm_percpu_wq]
root     30016  0.0  0.0      0     0 ?        I    04:28   0:00  \_ [kworker/0:0-cgroup_destroy]
root     30020  0.0  0.0      0     0 ?        I    04:28   0:00  \_ [kworker/u4:0]
root         1  0.0  0.1 171292  7300 ?        Ss   Jan01   1:28 /sbin/init
root       219  0.0  0.1  54496  6248 ?        Ss   Jan01   0:03 /lib/systemd/systemd-journald
root       249  0.0  0.0  70784  1344 ?        SLs  Jan01   0:02 /usr/sbin/qubesdb-daemon 0
root       262  0.0  0.0  23048  1604 ?        Ss   Jan01   0:00 /lib/systemd/systemd-udevd
root      1203  0.0  0.0   8084  1196 ?        Ss   Jan01   1:58 /usr/sbin/haveged --Foreground --verbose=1 -w 1024
root      1210  0.1  0.0   4728    80 ?        S    Jan01   5:54 /usr/sbin/meminfo-writer 30000 100000 /var/run/meminfo-writer.pid
root      1222  0.0  0.0  19616  3460 ?        Ss   Jan01   0:01 /lib/systemd/systemd-logind
root      1223  0.0  0.0 225824  2244 ?        Ssl  Jan01   0:00 /usr/sbin/rsyslogd -n -iNONE
message+  1226  0.0  0.0   9876  3096 ?        Ss   Jan01   0:03 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
root      1227  0.0  0.0  19768   940 ?        Ss   Jan01   0:01 /sbin/wpa_supplicant -u -s -O /run/wpa_supplicant
root      1230  0.0  0.2 848264 12472 ?        Ssl  Jan01   0:29 /usr/lib/snapd/snapd
root      1246  0.0  0.0  74076   980 ?        Ssl  Jan01   0:00 /usr/sbin/xl devd
root      1278  0.0  0.0 184964  4044 ?        Ssl  Jan01   0:00 /usr/sbin/cups-browsed
root      1280  0.0  0.0   5460  1572 ?        SLs  Jan01   0:23 /usr/lib/qubes/qrexec-agent
root      1291  0.2  0.0  16312  2660 tty7     SLs+ Jan01  12:29 /usr/bin/qubes-gui
root      1466  0.0  0.0   6736   872 tty7     S+   Jan01   0:00  \_ /usr/bin/qubes-gui-runuser user /bin/sh -l -c exec /usr/bin/xinit /etc/X11/Xsession qubes-session -- /usr/lib/xorg/Xorg :0 -nolisten tcp vt07 -wr -config xorg-qubes.conf > ~/.xsession-errors 2>&1
user      1488  0.0  0.0   8180     0 ?        Ss   Jan01   0:00      \_ /usr/bin/xinit /etc/X11/Xsession qubes-session -- /usr/lib/xorg/Xorg :0 -nolisten tcp vt07 -wr -config xorg-qubes.conf
user      1491  0.8  2.1 499556 124368 ?       SLl  Jan01  48:53          \_ /usr/lib/xorg/Xorg :0 -nolisten tcp vt07 -wr -config xorg-qubes.conf
user      1512  0.0  0.0   6644  1040 ?        S    Jan01   0:00          \_ /bin/bash /usr/bin/qubes-session
user      1533  0.0  0.0  11560  1664 ?        S    Jan01   0:00              \_ /usr/bin/xsettingsd
user      1557  0.0  0.0   5852    40 ?        Ss   Jan01   0:01              \_ /usr/bin/ssh-agent qubes-session
user      1643  0.0  0.0   5260     0 ?        S    Jan01   0:00              \_ sleep inf
root      1315  0.0  0.0   2388   972 ?        Ss   Jan01   0:00 /bin/sh /usr/lib/qubes/init/misc-post.sh
root      1381  0.0  0.0   2388   144 ?        S    Jan01   0:00  \_ /bin/sh /rw/config/rc.local
root      1316  0.0  0.0   5384  1044 hvc0     Ss+  Jan01   0:00 /sbin/agetty -o -p -- \u --keep-baud 115200,38400,9600 hvc0 vt220
root      1318  0.0  0.0   5612   808 tty1     Ss+  Jan01   0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
user      1477  0.0  0.0  21616  4172 ?        Ss   Jan01   0:00 /lib/systemd/systemd --user
user      1478  0.0  0.0  23708   748 ?        S    Jan01   0:00  \_ (sd-pam)
user      1529  0.0  0.0  10376  3712 ?        Ss   Jan01   0:05  \_ /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
user      1607  0.0  0.0 159340  2360 ?        Sl   Jan01   0:00  \_ /usr/lib/dconf/dconf-service
user      1665  0.0  0.0 313940  2312 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfsd
user      3803  0.0  0.0 388076  2048 ?        Sl   Jan01   0:09  |   \_ /usr/lib/gvfs/gvfsd-trash --spawner :1.12 /org/gtk/gvfs/exec_spaw/0
user     14037  0.0  0.0 281972  2972 ?        Sl   Jan01   0:00  |   \_ /usr/lib/gvfs/gvfsd-http --spawner :1.12 /org/gtk/gvfs/exec_spaw/1
user     31418  0.0  0.0 314344  2816 ?        Sl   Jan03   0:00  |   \_ /usr/lib/gvfs/gvfsd-network --spawner :1.12 /org/gtk/gvfs/exec_spaw/3
user     31451  0.0  0.0 315268  2848 ?        Sl   Jan03   0:00  |   \_ /usr/lib/gvfs/gvfsd-dnssd --spawner :1.12 /org/gtk/gvfs/exec_spaw/8
user      3383  0.0  0.0 540412  1128 ?        Sl   Jan01   0:00  \_ /usr/bin/snap userd
user      3714  0.0  0.0 280480  2996 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfs-udisks2-volume-monitor
user      3736  0.0  0.0 240660  2072 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfs-gphoto2-volume-monitor
user      3740  0.0  0.0 319052  1960 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfs-afc-volume-monitor
user      3745  0.0  0.0 236380  2456 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfs-goa-volume-monitor
user      3749  0.0  0.0 238180  1932 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfs-mtp-volume-monitor
user      3809  0.0  0.0 361456  3468 ?        Ssl  Jan01   0:00  \_ /usr/lib/tracker/tracker-store
user      3824  0.0  0.0 164832  2132 ?        Ssl  Jan01   0:00  \_ /usr/lib/gvfs/gvfsd-metadata
user      4427  0.0  0.0  80964   820 ?        SLs  Jan01   0:00  \_ /usr/bin/gpg-agent --supervised
user      4696  0.1  0.4 488036 27152 ?        Ssl  Jan01   9:43  \_ /usr/lib/gnome-terminal/gnome-terminal-server
user      4703  0.0  0.0   8180  1040 pts/0    Ss   Jan01   0:00  |   \_ bash
user     30772  2.7  1.4 1042720 81016 pts/0   SLl+ Jan02  88:20  |   |   \_ psi-plus
user      5963  0.0  0.0   8184  2484 pts/5    Ss   Jan01   0:00  |   \_ bash
root     28765  0.0  0.0  10268  3896 pts/5    S+   04:21   0:00  |   |   \_ sudo apt dist-upgrade
root     28766  0.2  0.9  65996 54980 pts/5    S+   04:21   0:01  |   |       \_ apt dist-upgrade
root     28775  0.0  0.1  14760  6856 pts/1    Ss+  04:21   0:00  |   |           \_ /usr/bin/dpkg --status-fd 26 --configure --pending
root     28776  0.0  0.0   6776  3524 pts/1    S+   04:21   0:00  |   |               \_ /bin/bash /var/lib/dpkg/info/qubes-core-agent.postinst configure 4.0.50-1+deb10u1
root     29851  0.0  0.0  10868  3648 pts/1    S+   04:22   0:00  |   |                   \_ /bin/systemctl start qubes-early-vm-config.service qubes-misc-post.service qubes-mount-dirs.service qubes-rootfs-resize.service qubes-sync-time.timer qubes-sysinit.service qubes-update-check.timer qubes-updates-proxy-forwarder.socket
root     29882  0.0  0.0  19104  3380 pts/1    S+   04:22   0:00  |   |                       \_ /bin/systemd-tty-ask-password-agent --watch
user     29459  0.0  0.0   8180  4992 pts/2    Ss   04:21   0:00  |   \_ bash
user     30031  0.0  0.0  10784  3004 pts/2    R+   04:29   0:00  |       \_ ps auxfww
user     20518  0.0  0.0 159164  2012 ?        Ssl  Jan02   0:00  \_ /usr/lib/evince/evinced
user     29992  3.1  0.7 480272 45424 ?        Sl   04:25   0:06  \_ /usr/bin/gedit --gapplication-service
user      1574  0.0  0.0   5560  1584 ?        SL   Jan01   0:02 /usr/bin/qrexec-client-vm dom0 qubes.WindowIconUpdater /usr/lib/qubes/icon-sender
user      1613  0.0  0.3  48480 22272 ?        S    Jan01   4:59  \_ /usr/bin/python3 /usr/lib/qubes/icon-sender
user      1576  0.0  0.1 598396  6168 ?        Sl   Jan01   0:01 nm-applet
user      1580  0.0  0.0  70964  5260 ?        S    Jan01   0:03 /usr/bin/python3 /usr/share/system-config-printer/applet.py
user      1587  0.0  0.0 388036  2364 ?        SLl  Jan01   0:00 /usr/bin/gnome-keyring-daemon --start --components=pkcs11
user      1609  0.0  0.0 312480  3328 ?        Sl   Jan01   0:00 /usr/lib/at-spi2-core/at-spi-bus-launcher --launch-immediately
user      1624  0.0  0.0   8972  2196 ?        S    Jan01   0:04  \_ /usr/bin/dbus-daemon --config-file=/usr/share/defaults/at-spi2/accessibility.conf --nofork --print-address 3
user      1641  0.0  0.0   5424   476 ?        S    Jan01   0:00 /usr/bin/qrexec-fork-server
user      1649  1.0  0.0 246264  4292 ?        Sl   Jan01  62:38 pulseaudio --start -n --file=/etc/pulse/qubes-default.pa --exit-idle-time=-1
rtkit     1650  0.0  0.0 152648  1872 ?        SNsl Jan01   0:04 /usr/lib/rtkit/rtkit-daemon
root      1653  0.0  0.0 237964  4504 ?        Ssl  Jan01   0:00 /usr/lib/policykit-1/polkitd --no-debug
user      1662  0.0  0.0 174128  3372 ?        Sl   Jan01   0:22 /usr/lib/at-spi2-core/at-spi2-registryd --use-gnome-session
root      3598  0.0  0.0 323880  3452 ?        Ssl  Jan01   0:00 /usr/lib/upower/upowerd
root      3717  0.0  0.0 399536  5192 ?        Ssl  Jan01   0:00 /usr/lib/udisks2/udisksd
user     11338  0.0  0.0 329428  3628 ?        Sl   Jan01   0:00 /usr/bin/python2 /usr/bin/qubes-desktop-run /var/lib/snapd/desktop/applications/firefox_firefox.desktop
user     11343  0.0  0.0   2388     4 ?        S    Jan01   0:00  \_ /bin/sh -l /usr/lib/qubes/qubes-rpc-multiplexer qubes.StartApp+firefox_firefox dom0
user     11349  0.0  0.0   5400     0 ?        S    Jan01   0:00  |   \_ cat
user     11344  0.0  0.0   2388     4 ?        S    Jan01   0:00  \_ /bin/sh -l /usr/lib/qubes/qubes-rpc-multiplexer qubes.StartApp+firefox_firefox dom0
user     11345  0.0  0.0   5264     0 ?        S    Jan01   0:00  |   \_ tee /tmp/qrexec-rpc-stderr-return.11338
user     11346  0.0  0.0   7672    36 ?        S    Jan01   0:00  |   \_ logger -t qubes.StartApp+firefox_firefox-dom0
user     11362  9.1 12.6 5966564 726356 ?      Sl   Jan01 463:38  \_ /snap/firefox/287/firefox
user     11587  0.4  4.5 34442636 260156 ?     Sl   Jan01  24:22      \_ /snap/firefox/287/firefox-bin -contentproc -childID 2 -isForBrowser -prefsLen 6538 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     14324  1.7  7.9 3496712 456032 ?      Sl   Jan01  88:55      \_ /snap/firefox/287/firefox-bin -contentproc -childID 15 -isForBrowser -prefsLen 8344 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     14849  0.5  3.8 3106312 219056 ?      Sl   Jan01  25:48      \_ /snap/firefox/287/firefox-bin -contentproc -childID 18 -isForBrowser -prefsLen 8344 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     15772  0.0  0.1 413232  8520 ?        Sl   Jan01   1:24      \_ /snap/firefox/287/firefox-bin -contentproc -parentBuildID 20191202093317 -prefsLen 8344 -prefMapSize 217192 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true rdd
user     28406  0.3  3.2 3040744 184072 ?      Sl   Jan02  15:24      \_ /snap/firefox/287/firefox-bin -contentproc -childID 53 -isForBrowser -prefsLen 10849 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     32750  0.8  5.2 3092632 300092 ?      Sl   Jan03  25:14      \_ /snap/firefox/287/firefox-bin -contentproc -childID 71 -isForBrowser -prefsLen 10966 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user       931  0.7  4.7 3286316 274368 ?      Sl   Jan03  22:53      \_ /snap/firefox/287/firefox-bin -contentproc -childID 74 -isForBrowser -prefsLen 10966 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     18710  0.5  3.9 3053640 224112 ?      Sl   Jan04   7:00      \_ /snap/firefox/287/firefox-bin -contentproc -childID 106 -isForBrowser -prefsLen 11069 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     18841  0.7  4.2 3142576 246320 ?      Sl   Jan04   8:25      \_ /snap/firefox/287/firefox-bin -contentproc -childID 107 -isForBrowser -prefsLen 11069 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
user     19685  0.8  4.0 3180408 232940 ?      Sl   Jan04   8:45      \_ /snap/firefox/287/firefox-bin -contentproc -childID 108 -isForBrowser -prefsLen 11070 -prefMapSize 217192 -parentBuildID 20191202093317 -greomni /snap/firefox/287/omni.ja -appomni /snap/firefox/287/browser/omni.ja -appdir /snap/firefox/287/browser 11362 true tab
root     16701  0.0  0.0  29072  5128 ?        Ss   Jan04   0:00 /usr/sbin/cupsd -l
user     27567  0.0  0.1 122376  8492 ?        Sl   02:36   0:00 /home/user/.thunderbird/ubijiko0.default/pepmda/bin/pep-json-server
marmarek commented 4 years ago

I see /rw/config/rc.local process on the list. Do you have some long-running command there?

chaywoo commented 4 years ago

@lunarthegrey Thanks! I tried pressing enter and it just looks at me, or maybe its doing something I have no way to know, but after letting it sit for about 20 mins, I figured it was hung up.. I have a very easy time reproducing it any time I try to update debian 9.. Here is what I got, I had to run this command after the hang up..

user@debian-9:~$ ps auxfww
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         2  0.0  0.0      0     0 ?        S    11:47   0:00 [kthreadd]
root         3  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [rcu_gp]
root         4  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [rcu_par_gp]
root         5  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/0:0-eve]
root         6  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kworker/0:0H-kb]
root         7  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/u4:0-ev]
root         8  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [mm_percpu_wq]
root         9  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [ksoftirqd/0]
root        10  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [rcu_sched]
root        11  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [rcu_bh]
root        12  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [migration/0]
root        13  0.9  0.0      0     0 ?        I    11:47   0:02  \_ [kworker/0:1-cgr]
root        14  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [cpuhp/0]
root        15  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [cpuhp/1]
root        16  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [migration/1]
root        17  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [ksoftirqd/1]
root        18  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/1:0-cgr]
root        19  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kworker/1:0H-kb]
root        20  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [kdevtmpfs]
root        21  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [netns]
root        22  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [rcu_tasks_kthre]
root        23  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [kauditd]
root        24  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [xenbus]
root        25  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [xenwatch]
root        26  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [oom_reaper]
root        27  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [writeback]
root        28  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [kcompactd0]
root        29  0.0  0.0      0     0 ?        SN   11:47   0:00  \_ [ksmd]
root        30  0.0  0.0      0     0 ?        SN   11:47   0:00  \_ [khugepaged]
root        31  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [crypto]
root        32  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kintegrityd]
root        33  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kblockd]
root        34  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/1:1-cgr]
root        35  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [ata_sff]
root        36  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [md]
root        37  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [edac-poller]
root        38  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [devfreq_wq]
root        39  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [watchdogd]
root        41  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [kswapd0]
root        42  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kworker/u5:0]
root        64  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/u4:1-ev]
root        96  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kthrotld]
root        97  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [acpi_thermal_pm]
root        98  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [khvcd]
root        99  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [dm_bufio_cache]
root       100  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [ipv6_addrconf]
root       105  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kstrp]
root       166  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kworker/1:1H-kb]
root       172  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [jbd2/xvda3-8]
root       173  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [ext4-rsv-conver]
root       174  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [kworker/0:1H-kb]
root       178  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [jbd2/xvdd-8]
root       179  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [ext4-rsv-conver]
root       217  0.1  0.0      0     0 ?        R    11:47   0:00  \_ [kworker/1:2-cgr]
root       221  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/u4:2]
root       228  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/1:3-cgr]
root       254  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/1:4-cgr]
root       264  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/u4:3-ev]
root       343  0.0  0.0      0     0 ?        S    11:47   0:00  \_ [jbd2/xvdb-8]
root       344  0.0  0.0      0     0 ?        I<   11:47   0:00  \_ [ext4-rsv-conver]
root       397  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/0:2-cgr]
root       399  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/0:3-eve]
root       403  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/0:4-cgr]
root       406  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/0:5-cgr]
root       408  0.0  0.0      0     0 ?        I    11:47   0:00  \_ [kworker/0:6]
root         1  0.2  0.3  65464  7044 ?        Ss   11:47   0:00 /sbin/init
root       204  0.0  0.2  55648  4956 ?        Ss   11:47   0:00 /lib/systemd/systemd-journald
root       238  0.0  0.0  99004  1644 ?        Ss   11:47   0:00 /sbin/lvmetad -f
root       240  0.0  0.2  46172  3928 ?        Ss   11:47   0:00 /lib/systemd/systemd-udevd
root       253  0.0  0.1 111840  2800 ?        SLs  11:47   0:00 /usr/sbin/qubesdb-daemon 0
root       435  0.0  0.2  12020  4636 ?        Ss   11:47   0:00 /usr/sbin/haveged --Foreground --verbose=1 -w 1024
root       452  0.0  0.3  95196  7412 ?        Ss   11:47   0:00 /usr/sbin/cupsd -l
root       455  0.0  0.2  46500  4756 ?        Ss   11:47   0:00 /lib/systemd/systemd-logind
message+   464  0.0  0.2  45396  3868 ?        Ss   11:47   0:00 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root       500  0.0  0.1 250116  2916 ?        Ssl  11:47   0:00 /usr/sbin/rsyslogd -n
root       501  0.0  0.0  27448   240 ?        S    11:47   0:00 /usr/sbin/meminfo-writer 30000 100000 /var/run/meminfo-writer.pid
root       511  0.0  0.1 121244  2652 ?        Ssl  11:47   0:00 /usr/sbin/xl devd
root       517  0.0  0.4 258452  8676 ?        Ssl  11:47   0:00 /usr/sbin/cups-browsed
root       556  0.0  0.1  52616  2916 ?        SLs  11:47   0:00 /usr/lib/qubes/qrexec-agent
root       561  0.2  0.1  72684  3392 tty7     SLs+ 11:47   0:00 /usr/bin/qubes-gui
root       607  0.0  0.1  53328  2988 tty7     S+   11:47   0:00  \_ /usr/bin/qubes-gui-runuser user /bin/sh -l -c exec /usr/bin/xinit /etc/X11/Xsession qubes-session -- /usr/lib/xorg/Xorg :0 -nolisten tcp vt07 -wr -config xorg-qubes.conf > ~/.xsession-errors 2>&1
user       634  0.0  0.0  22312  1188 ?        Ss   11:47   0:00      \_ /usr/bin/xinit /etc/X11/Xsession qubes-session -- /usr/lib/xorg/Xorg :0 -nolisten tcp vt07 -wr -config xorg-qubes.conf
user       640  0.6  3.1 338392 60632 ?        SLl  11:47   0:01          \_ /usr/lib/xorg/Xorg :0 -nolisten tcp vt07 -wr -config xorg-qubes.conf
user       656  0.0  0.1  11156  3024 ?        S    11:47   0:00          \_ /bin/bash /usr/bin/qubes-session
user       679  0.0  0.1  31232  2128 ?        S    11:47   0:00              \_ /usr/bin/xsettingsd
user       711  0.0  0.0  11096   328 ?        Ss   11:47   0:00              \_ /usr/bin/ssh-agent qubes-session
user       782  0.0  0.0   5796   704 ?        S    11:47   0:00              \_ sleep inf
root       586  0.0  0.0  12884  1628 tty1     Ss+  11:47   0:00 /sbin/agetty --noclear tty1 linux
root       587  0.0  0.1  14268  2172 hvc0     Ss+  11:47   0:00 /sbin/agetty --keep-baud 115200,38400,9600 hvc0 vt220
user       628  0.0  0.3  65116  6824 ?        Ss   11:47   0:00 /lib/systemd/systemd --user
user       629  0.0  0.0  86892  1816 ?        S    11:47   0:00  \_ (sd-pam)
user       669  0.0  0.2  45100  3816 ?        Ss   11:47   0:00  \_ /usr/bin/dbus-daemon --session --address=systemd: --nofork --nopidfile --systemd-activation
user       751  0.0  0.2 187292  4884 ?        Sl   11:47   0:00  \_ /usr/lib/dconf/dconf-service
user       792  0.0  0.3 284164  6608 ?        Ssl  11:47   0:00  \_ /usr/lib/gvfs/gvfsd
user      1210  0.3  1.7 584684 32996 ?        Ssl  11:49   0:00  \_ /usr/lib/gnome-terminal/gnome-terminal-server
user      1216  0.0  0.2  21396  5328 pts/0    Ss   11:49   0:00      \_ bash
root      1445  0.0  0.1  55444  3744 pts/0    S+   11:51   0:00      |   \_ sudo dpkg --configure -a
root      1446  0.3  0.3  20236  5768 pts/0    S+   11:51   0:00      |       \_ dpkg --configure -a
root      1447  4.6  0.9  62524 18532 pts/0    S+   11:51   0:00      |           \_ /usr/bin/perl -w /usr/share/debconf/frontend /var/lib/dpkg/info/grub-pc.postinst configure 2.02~beta3-5+deb9u1
root      1537  0.3  0.1  11540  3560 pts/0    S+   11:51   0:00      |               \_ /bin/bash /var/lib/dpkg/info/grub-pc.postinst configure 2.02~beta3-5+deb9u1
root      1818  0.0  0.1  22492  3676 pts/0    S+   11:51   0:00      |               \_ whiptail --backtitle Package configuration --title Configuring grub-pc --output-fd 11 --nocancel --msgbox The grub-pc package is being upgraded. This menu allows you to select  which devices you'd like grub-install to be automatically run for, if  any.  Running grub-install automatically is recommended in most situations, to prevent the installed GRUB core image from getting out of sync with GRUB modules or grub.cfg.  If you're unsure which drive is designated as boot drive by your BIOS,  it is often a good idea to install GRUB to all of them.  Note: it is possible to install GRUB to partition boot records as well,  and some appropriate partitions are offered here. However, this forces  GRUB to use the blocklist mechanism, which makes it less reliable, and  therefore is not recommended. --scrolltext 20 77
user      1273  0.0  0.2  21396  5208 pts/2    Ss   11:50   0:00      \_ bash
user      1838  0.0  0.1  38404  3324 pts/2    R+   11:51   0:00          \_ ps auxfww
user       727  0.0  1.6 247384 31576 ?        Sl   11:47   0:00 /usr/bin/python3 /usr/share/system-config-printer/applet.py
user       729  0.0  2.6 630772 49968 ?        Sl   11:47   0:00 nm-applet
user       733  0.0  0.3 348688  5800 ?        Sl   11:47   0:00 /usr/lib/at-spi2-core/at-spi-bus-launcher --launch-immediately
user       745  0.0  0.1  44992  3428 ?        S    11:47   0:00  \_ /usr/bin/dbus-daemon --config-file=/usr/share/defaults/at-spi2/accessibility.conf --nofork --print-address 3
user       735  0.0  0.0  52720  1832 ?        SL   11:47   0:00 /usr/bin/qrexec-client-vm dom0 qubes.WindowIconUpdater /usr/lib/qubes/icon-sender
user       755  0.0  1.1  71192 21160 ?        S    11:47   0:00  \_ /usr/bin/python3 /usr/lib/qubes/icon-sender
user       760  0.0  0.4 300780  8052 ?        S<l  11:47   0:00 pulseaudio --start -n --file=/etc/pulse/qubes-default.pa --exit-idle-time=-1
rtkit      761  0.0  0.1 185752  2996 ?        SNsl 11:47   0:00 /usr/lib/rtkit/rtkit-daemon
root       766  0.0  0.4 287960  8340 ?        Ssl  11:47   0:00 /usr/lib/policykit-1/polkitd --no-debug
user       780  0.0  0.0  52580   348 ?        S    11:47   0:00 /usr/bin/qrexec-fork-server
user       789  0.0  0.2 220316  5720 ?        Sl   11:47   0:00 /usr/lib/at-spi2-core/at-spi2-registryd --use-gnome-session
root      1148  0.0  0.6 316824 12016 ?        Ssl  11:49   0:00 /usr/lib/packagekit/packagekitd
user@debian-9:~$ ^C
user@debian-9:~$
chaywoo commented 4 years ago

@marmarek thanks for the idea. I just posted a list I dont know where it went, will try again

chaywoo commented 4 years ago

@marmarek Oh there it is! It looks nothing like Lunarthegrey list LoL I dont know what to make of it. For some reason when I paste the text it all changes and adds these lines through and I dont know why its doing that..

lunarthegrey commented 4 years ago

@marmarek oops, I redacted that but since it might help with troubleshooting, this is what's running.

user@main:~$ cat /rw/config/rc.local
#!/bin/sh

# This script will be executed at every VM startup, you can place your own
# custom commands here. This includes overriding some configuration in /etc,
# starting services etc.

# Example for overriding the whole CUPS configuration:
#  rm -rf /etc/cups
#  ln -s /rw/config/cups /etc/cups
#  systemctl --no-block restart cups

socat TCP-LISTEN:21325,fork EXEC:"qrexec-client-vm sys-usb trezord-service"

It's from https://wiki.trezor.io/Qubes_OS

@chaywoo you have to add 3 ``` above and below your text to get it to display differently.

marmarek commented 4 years ago

socat TCP-LISTEN:21325,fork EXEC:"qrexec-client-vm sys-usb trezord-service"

Looks like this is the issue. That command holds rc.local running and prevent further start/stop actions. Try adding & at the end.

lunarthegrey commented 4 years ago

Adding & at the end and rebooting the VM fixed the issue!

For reference I just did a sudo dpkg --configure -a in the VM after applying the change and rebooting.

Thanks so much @marmarek, would have never thought that would cause the issue but it should run in the background anyways. I'm going to see if I can get them to update the wiki so no one else runs into this problem.

chaywoo commented 4 years ago

Thanks marmarek and lunartegrey! Wow what an easy fix! You all are amazing.. I will go to the wiki link and try this out.. Thanks so much