search

coreos / bugs

Issue tracker for CoreOS Container Linux
https://coreos.com/os/eol/
146 stars 30 forks source link

Auto Restart Docker Container #224

Closed joelchen closed 9 years ago

joelchen commented 9 years ago

Hi CoreOS Team,

I am trying to have Docker container auto-restart after CoreOS reboots on Amazon AWS. I have tried the following different ways on CoreOS with version 540 (Docker 1.3.3) and 547 (Docker 1.4.1), but have failed to make them work:

1) Turned on Docker restart policy for container with --restart="always". After reboot, Docker container only start after manually running Docker commands (e.g. docker ps). 2) Started container with docker run --name="nginx" -d -p 80:80 nginx, created the following systemd unit file following example at Docker, and ran sudo systemctl daemon-reload and sudo systemctl start nginx.service.

[Unit]
Description=Nginx
After=docker.service

[Service]
Restart=always
ExecStart=/usr/bin/docker start -a nginx
ExecStop=/usr/bin/docker stop -t 2 nginx

[Install]
WantedBy=local.target

3) Created the following systemd unit file following guide at CoreOS, and ran sudo systemctl daemon-reload and sudo systemctl start nginx.service.

[Unit]
Description=Nginx
After=docker.service
Requires=docker.service

[Service]
ExecStartPre=-/usr/bin/docker kill nginx
ExecStartPre=-/usr/bin/docker rm nginx
ExecStartPre=/usr/bin/docker pull nginx
ExecStart=/usr/bin/docker run --name="nginx" -d -p 80:80 nginx

[Install]
WantedBy=multi-user.target

4) Added DefaultDependencies=no in systemd unit file according to a workaround in this issue.

Warmest Regards, Joel

andreas-venturini commented 9 years ago

You should probably not be starting your services in daemon mode from your systemd config (remove the "-d" flag from your ExecStart line and add ExecStop=/usr/bin/docker stop ${service_name})

joelchen commented 9 years ago

Hi Andreas,

Thank you for your suggestions. I just tried removing -d and included docker stop in the unit file on CoreOS 550, but the nginx container still does not restart after reboot. Running systemctl status nginx gives the following: ● nginx.service - Nginx Loaded: loaded (/etc/systemd/system/nginx.service; disabled; vendor preset: disabled) Active: inactive (dead)

Warmest Regards, Joel

andreas-venturini commented 9 years ago

This was more like a general recommendation, I did not expect it to solve your issue. But since none of the developers have answered I suggest you post outputs of systemctl list-jobs, systemctl statusand sudo journalctl -b _PID=1 to track down the issue

joelchen commented 9 years ago

Hi Andreas & CoreOS Team,

After running the systemd unit file with sudo systemctl start nginx.service and performing a reboot, here are the outputs from my AWS EC2 CoreOS HVM instance:

$ systemctl list-jobs
No jobs running.
$ systemctl status
● ip-172-31-0-149.ap-southeast-1.compute.internal
    State: running
     Jobs: 1 queued
   Failed: 0 units
    Since: Sun 2015-01-04 14:13:09 UTC; 1min 15s ago
   CGroup: /
           ├─1 /usr/lib/systemd/systemd --switched-root --system --deserialize 22
           └─system.slice
             ├─dbus.service
             │ └─483 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
             ├─update-engine.service
             │ └─493 /usr/sbin/update_engine -foreground -logtostderr -no_connection_manager
             ├─system-sshd.slice
             │ └─sshd@0-172.31.0.149:22-121.6.160.128:49988.service
             │   ├─594 sshd: core [priv]
             │   ├─596 sshd: core@pts/0
             │   ├─597 -bash
             │   ├─617 systemctl status
             │   └─618 systemctl status
             ├─system-serial\x2dgetty.slice
             │ ├─serial-getty@hvc0.service
             │ │ └─553 /sbin/agetty --keep-baud 115200 38400 9600 hvc0 vt102
             │ └─serial-getty@ttyS0.service
             │   └─552 /sbin/agetty --keep-baud 115200 38400 9600 ttyS0 vt102
             ├─systemd-journald.service
             │ └─423 /usr/lib/systemd/systemd-journald
             ├─ntpd.service
             │ └─488 /usr/sbin/ntpd -g -n -f /var/lib/ntp/ntp.drift -u ntp:ntp
             ├─systemd-resolved.service
             │ └─498 /usr/lib/systemd/systemd-resolved
             ├─systemd-logind.service
             │ └─490 /usr/lib/systemd/systemd-logind
             ├─systemd-networkd.service
             │ └─486 /usr/lib/systemd/systemd-networkd
             ├─system-getty.slice
             │ └─getty@tty1.service
             │   └─554 /sbin/agetty --noclear tty1 linux
             ├─systemd-udevd.service
             │ └─436 /usr/lib/systemd/systemd-udevd
             ├─polkit.service
             │ └─509 /usr/lib/polkit-1/polkitd --no-debug
             ├─locksmithd.service
             │ └─536 /usr/lib/locksmith/locksmithd
             └─motdgen.service
               ├─619 /bin/bash -e /usr/lib/coreos/motdgen
               ├─623 /bin/bash -e /usr/lib/coreos/motdgen
               └─625 wc -l
$ journalctl -b _PID=1
-- Logs begin at Wed 2014-12-24 10:50:01 UTC, end at Sun 2015-01-04 14:15:49 UTC. --
Jan 04 14:13:09 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: systemd 218 running in system mode. (-PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK -SYSVINIT
Jan 04 14:13:09 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Detected virtualization 'xen'.
Jan 04 14:13:09 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Detected architecture 'x86-64'.
Jan 04 14:13:09 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Set hostname to <ip-172-31-0-149.ap-southeast-1.compute.internal>.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Flush Journal to Persistent Storage...
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Create Static Device Nodes in /dev.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting udev Kernel Device Manager...
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Local File Systems (Pre).
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Local File Systems (Pre).
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Flush Journal to Persistent Storage.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started udev Kernel Device Manager.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started udev Wait for Complete Device Initialization.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Activation of LVM2 logical volumes...
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Activation of LVM2 logical volumes.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Encrypted Volumes.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Encrypted Volumes.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Activation of LVM2 logical volumes...
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Activation of LVM2 logical volumes.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Activation of LVM2 logical volumes...
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Found device /dev/ttyS0.
Jan 04 14:13:10 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Found device /dev/hvc0.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Found device /dev/disk/by-label/OEM.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Mounting /usr/share/oem...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Mounted /usr/share/oem.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Rebuild Dynamic Linker Cache.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Local File Systems.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Local File Systems.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Rebuild Journal Catalog.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Update is Completed.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Create Volatile Files and Directories...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Create missing system files...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Commit a transient machine-id on disk.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Create missing system files.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Create Volatile Files and Directories.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Clean up broken links in /etc/ssl/certs...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Update UTMP about System Boot/Shutdown.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Clean up broken links in /etc/ssl/certs.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Activation of LVM2 logical volumes.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Remote File Systems.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Remote File Systems.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Update CA bundle at /etc/ssl/certs/ca-certificates.crt.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting System Initialization.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target System Initialization.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Generate /run/coreos/motd.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Generate /run/coreos/motd.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Watch for update engine configuration changes.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Watch for update engine configuration changes.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Watch for a cloud-config at /var/lib/coreos-install/user_data.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Watch for a cloud-config at /var/lib/coreos-install/user_data.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting D-Bus System Message Bus Socket.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Listening on D-Bus System Message Bus Socket.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Docker Socket for the API.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting OpenSSH Server Socket.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Listening on OpenSSH Server Socket.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Update Engine Stub Timer.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Daily Cleanup of Temporary Directories.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Daily Cleanup of Temporary Directories.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Timers.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Timers.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Watch for a cloud-config at /media/configdrive.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Failed to start Watch for a cloud-config at /media/configdrive.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Dependency failed for Load user-provided cloud configs.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Job user-config.target/start failed with result 'dependency'.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Paths.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Paths.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Listening on Docker Socket for the API.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Listening on Journal Audit Socket.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Sockets.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Sockets.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Basic System.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Basic System.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Generate /run/issue...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Modifies /etc/environment for CoreOS.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Configure Addon /usr/share/oem.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Run Addon /usr/share/oem.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Install an ssh key from /proc/cmdline...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting D-Bus System Message Bus...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started D-Bus System Message Bus.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Network Service...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Generate sshd host keys...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Network Time Service...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Network Time Service.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Extend Filesystems...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Login Service...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Update Engine...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Load cloud-config from url defined in /proc/cmdline.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Load cloud-config from /usr/share/oem/cloud-config.yml...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Generate /run/issue.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Install an ssh key from /proc/cmdline.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Login Service.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Network Service.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Network.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Network.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Network Name Resolution...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Hostname Service...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Network Name Resolution.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Hostname Service.
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Authorization Manager...
Jan 04 14:13:13 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Extend Filesystems.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Generate sshd host keys.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reloading.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Update Engine.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Cluster reboot manager...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Failed to set memory.limit_in_bytes on : Invalid argument
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Failed to reset devices.list on /system.slice: Invalid argument
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Cluster reboot manager.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Generate /run/coreos/motd...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Authorization Manager.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Cloudinit from EC2-style metadata...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Generate /run/coreos/motd.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Permit User Sessions...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Permit User Sessions.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Serial Getty on ttyS0...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Serial Getty on ttyS0.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Serial Getty on hvc0...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Serial Getty on hvc0.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Getty on tty1...
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Getty on tty1.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Login Prompts.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Login Prompts.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Multi-User System.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Multi-User System.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Cloudinit from EC2-style metadata.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Load cloud-config from /usr/share/oem/cloud-config.yml.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Load system-provided cloud configs.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Reached target Load system-provided cloud configs.
Jan 04 14:13:14 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Startup finished in 30.882s (kernel) + 1.208s (initrd) + 4.590s (userspace) = 36.680s.
Jan 04 14:13:17 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Time has been changed
Jan 04 14:13:28 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting system-sshd.slice.
Jan 04 14:13:28 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Created slice system-sshd.slice.
Jan 04 14:13:28 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting OpenSSH per-connection server daemon (121.6.160.128:49988)...
Jan 04 14:13:28 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started OpenSSH per-connection server daemon (121.6.160.128:49988).
Jan 04 14:14:25 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Generate /run/coreos/motd...
Jan 04 14:14:25 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Generate /run/coreos/motd.
Jan 04 14:15:38 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Starting Generate /run/coreos/motd...
Jan 04 14:15:38 ip-172-31-0-149.ap-southeast-1.compute.internal systemd[1]: Started Generate /run/coreos/motd.

Warmest Regards, Joel

joelchen commented 9 years ago

Here is my AWS EC2 instance's System Log:

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.18.1 (buildbot@ip-10-204-3-57) (gcc version 4.8.3 (Gentoo Hardened 4.8.3 p1.1, pie-0.5.9) ) #2 SMP Fri Jan 2 04:50:48 UTC 2015
[    0.000000] Command line: BOOT_IMAGE=/syslinux/vmlinuz.A console=ttyS0,115200n8 console=tty0 ro noswap cros_legacy root=LABEL=ROOT rootflags=subvol=root usr=PARTLABEL=USR-A
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] Hypervisor detected: Xen HVM
[    0.000000] Xen version 4.2.
[    0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[    0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[    0.000000] You might have to change the root device
[    0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[    0.000000] in your root= kernel command line option
[    0.000000] AGP: No AGP bridge found
[    0.000000] e820: last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000] init_memory_mapping: [mem 0x3fe00000-0x3fffffff]
[    0.000000] init_memory_mapping: [mem 0x3c000000-0x3fdfffff]
[    0.000000] init_memory_mapping: [mem 0x00100000-0x3bffffff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen   )
[    0.000000] ACPI: XSDT 0x00000000FC00F710 00005C (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: FACP 0x00000000FC00F260 0000F4 (v04 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: DSDT 0x00000000FC0035E0 00BBF6 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[    0.000000] ACPI: APIC 0x00000000FC00F360 0000D8 (v02 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: SRAT 0x00000000FC00F4B0 000170 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: HPET 0x00000000FC00F620 000038 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: WAET 0x00000000FC00F660 000028 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: SSDT 0x00000000FC00F690 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: SSDT 0x00000000FC00F6D0 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x3fffffff]
[    0.000000] NUMA: Warning: invalid memblk node 0 [mem 0x100000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0xbfffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x3fff9000-0x3fffffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009dfff]
[    0.000000]   node   0: [mem 0x00100000-0x3fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x3fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x00] disabled)
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 15 CPUs, 14 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] e820: [mem 0x40000000-0xfbffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on Xen HVM
[    0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:15 nr_node_ids:1
[    0.000000] PERCPU: Embedded 29 pages/cpu @ffff88003fc00000 s80960 r8192 d29632 u131072
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257928
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: init=/usr/lib/systemd/systemd BOOT_IMAGE=/syslinux/vmlinuz.A console=ttyS0,115200n8 console=tty0 ro noswap cros_legacy root=LABEL=ROOT rootflags=subvol=root usr=PARTLABEL=USR-A
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] AGP: Checking aperture...
[    0.000000] AGP: No AGP bridge found
[    0.000000] Memory: 995876K/1048180K available (5098K kernel code, 932K rwdata, 2276K rodata, 21656K init, 928K bss, 52304K reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=15.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=15
[    0.000000] NR_IRQS:8448 nr_irqs:952 0
[    0.000000] xen:events: Using 2-level ABI
[    0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 4194304 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] tsc: Detected 2494.048 MHz processor
[    0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4988.09 BogoMIPS (lpj=2494048)
[    0.008003] pid_max: default: 32768 minimum: 301
[    0.011014] ACPI: Core revision 20140926
[    0.019047] ACPI: All ACPI Tables successfully acquired
[    0.022088] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.026221] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.030107] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
[    0.033007] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
[    0.037162] Initializing cgroup subsys memory
[    0.039008] Initializing cgroup subsys devices
[    0.042005] Initializing cgroup subsys freezer
[    0.044004] Initializing cgroup subsys net_cls
[    0.046004] Initializing cgroup subsys blkio
[    0.049004] Initializing cgroup subsys perf_event
[    0.051004] Initializing cgroup subsys net_prio
[    0.054054] CPU: Physical Processor ID: 0
[    0.057459] mce: CPU supports 2 MCE banks
[    0.059022] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    0.059022] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[    0.077107] ftrace: allocating 19770 entries in 78 pages
[    0.101868] Switched APIC routing to physical flat.
[    0.106336] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.120102] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz (fam: 06, model: 3e, stepping: 04)
[    0.125013] installing Xen timer for CPU 0
[    0.128067] cpu 0 spinlock event irq 53
[    0.132541] Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
[    0.136000] x86: Booted up 1 node, 1 CPUs
[    0.136008] smpboot: Total of 1 processors activated (4988.09 BogoMIPS)
[    0.137344] NMI watchdog: disabled (cpu0): hardware events not enabled
[    0.138084] devtmpfs: initialized
[    0.141462] pinctrl core: initialized pinctrl subsystem
[    0.142135] NET: Registered protocol family 16
[    0.143128] cpuidle: using governor ladder
[    0.144008] cpuidle: using governor menu
[    0.145055] ACPI: bus type PCI registered
[    0.146005] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.147055] dca service started, version 1.12.1
[    0.148202] PCI: Using configuration type 1 for base access
[    0.149651] ACPI: Added _OSI(Module Device)
[    0.150005] ACPI: Added _OSI(Processor Device)
[    0.151004] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.152007] ACPI: Added _OSI(Processor Aggregator Device)
[    0.156053] ACPI: Interpreter enabled
[    0.157008] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20140926/hwxface-580)
[    0.160006] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20140926/hwxface-580)
[    0.163013] ACPI: (supports S0 S3 S4 S5)
[    0.164006] ACPI: Using IOAPIC for interrupt routing
[    0.165027] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.202000] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.202011] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[    0.203010] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.204066] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.205649] acpiphp: Slot [0] registered
[    0.206701] acpiphp: Slot [3] registered
[    0.207234] acpiphp: Slot [4] registered
[    0.208225] acpiphp: Slot [5] registered
[    0.209245] acpiphp: Slot [6] registered
[    0.210235] acpiphp: Slot [7] registered
[    0.211230] acpiphp: Slot [8] registered
[    0.212243] acpiphp: Slot [9] registered
[    0.213238] acpiphp: Slot [10] registered
[    0.214222] acpiphp: Slot [11] registered
[    0.215223] acpiphp: Slot [12] registered
[    0.216233] acpiphp: Slot [13] registered
[    0.217255] acpiphp: Slot [14] registered
[    0.218240] acpiphp: Slot [15] registered
[    0.219229] acpiphp: Slot [16] registered
[    0.220230] acpiphp: Slot [17] registered
[    0.221245] acpiphp: Slot [18] registered
[    0.222236] acpiphp: Slot [19] registered
[    0.223229] acpiphp: Slot [20] registered
[    0.224230] acpiphp: Slot [21] registered
[    0.225259] acpiphp: Slot [22] registered
[    0.226228] acpiphp: Slot [23] registered
[    0.227234] acpiphp: Slot [24] registered
[    0.228220] acpiphp: Slot [25] registered
[    0.229244] acpiphp: Slot [26] registered
[    0.230283] acpiphp: Slot [27] registered
[    0.231236] acpiphp: Slot [28] registered
[    0.232225] acpiphp: Slot [29] registered
[    0.233220] acpiphp: Slot [30] registered
[    0.234229] acpiphp: Slot [31] registered
[    0.235218] PCI host bridge to bus 0000:00
[    0.236008] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.237006] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7]
[    0.238005] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    0.239007] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.240005] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff]
[    0.245237] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.246005] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.247004] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.248008] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.249497] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
[    0.249497] * this clock source is slow. Consider trying other clock sources
[    0.250952] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.255825] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[    0.258177] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.261173] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.264163] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[    0.280847] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.281045] xen:balloon: Initialising balloon driver
[    0.286027] xen_balloon: Initialising balloon driver
[    0.287105] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.288000] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.288006] vgaarb: loaded
[    0.289004] vgaarb: bridge control possible 0000:00:02.0
[    0.290030] init_memory_mapping: [mem 0x40000000-0x47ffffff]
[    0.291763] PCI: Using ACPI for IRQ routing
[    0.292457] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.293019] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.295777] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[    0.298027] Switched to clocksource xen
[    0.303649] pnp: PnP ACPI init
[    0.305892] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[    0.309921] system 00:01: [io  0x08a0-0x08a3] has been reserved
[    0.313409] system 00:01: [io  0x0cc0-0x0ccf] has been reserved
[    0.316601] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.320349] system 00:07: [io  0x10c0-0x1141] has been reserved
[    0.323711] system 00:07: [io  0xb044-0xb047] has been reserved
[    0.342252] pnp: PnP ACPI: found 8 devices
[    0.350278] NET: Registered protocol family 2
[    0.352961] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
[    0.356903] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
[    0.360761] TCP: Hash tables configured (established 8192 bind 8192)
[    0.364385] TCP: reno registered
[    0.366556] UDP hash table entries: 512 (order: 2, 16384 bytes)
[    0.369777] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[    0.373485] NET: Registered protocol family 1
[    0.376207] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.379799] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.383242] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.687025] RAPL PMU detected, hw unit 2^-16 Joules, API unit is 2^-32 Joules, 3 fixed counters 163840 ms ovfl timer
[    0.693163] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    0.696540] Initialise system trusted keyring
[    0.699236] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.703789] VFS: Disk quotas dquot_6.5.2
[    0.706216] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.709780] msgmni has been set to 1945
[    0.712375] alg: No test for stdrng (krng)
[    0.714865] Key type asymmetric registered
[    0.717351] Asymmetric key parser 'x509' registered
[    0.720222] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    0.724489] io scheduler noop registered
[    0.726851] io scheduler deadline registered
[    0.729381] io scheduler cfq registered (default)
[    0.732098] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.735098] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.749241] Console: switching to colour frame buffer device 100x37
[    0.753012] GHES: HEST is not enabled!
[    0.754512] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    0.757135] xen:grant_table: Grant tables using version 1 layout
[    0.759465] Grant table initialized
[    0.761062] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.789683] serial 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.793318] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[    0.797741] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.799705] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.802378] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    0.806086] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    0.808512] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[    0.811799] TCP: cubic registered
[    0.813670] NET: Registered protocol family 10
[    0.816246] NET: Registered protocol family 17
[    0.818841] Loading compiled-in X.509 certificates
[    0.822042] Loaded X.509 cert 'Magrathea: Glacier signing key: 6bcbbbc870f53cb42fd079b077cf393635b4ae07'
[    0.826934] registered taskstats version 1
[    1.688092] tsc: Refined TSC clocksource calibration: 2493.989 MHz
[    5.929088] xenbus_probe_frontend: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...
[   30.832130] 
[   30.833734] xenbus_probe_frontend: Timeout connecting to device: device/vfb/0 (local state 3, remote state 1)
[   30.839769] xenbus_probe_frontend: Device with no driver: device/vbd/51712
[   30.843745] xenbus_probe_frontend: Device with no driver: device/vif/0
[   30.847616] rtc_cmos 00:02: setting system clock to 2015-01-04 14:13:08 UTC (1420380788)
[   30.858949] Freeing unused kernel memory: 21656K (ffffffff81aea000 - ffffffff83010000)
[   30.863429] Write protecting the kernel read-only data: 10240k
[   30.868776] Freeing unused kernel memory: 1036K (ffff8800014fd000 - ffff880001600000)
[   30.876576] Freeing unused kernel memory: 1820K (ffff880001839000 - ffff880001a00000)
[   30.884410] systemd[1]: Inserted module 'autofs4'
[   30.890559] random: systemd urandom read with 42 bits of entropy available
[   30.895660] systemd[1]: systemd 218 running in system mode. (-PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP -GCRYPT -GNUTLS -ACL -XZ -LZ4 +SECCOMP +BLKID -ELFUTILS +KMOD -IDN)
[   30.904300] systemd[1]: Detected virtualization 'xen'.
[   30.906856] systemd[1]: Detected architecture 'x86-64'.
[   30.909648] systemd[1]: Running in initial RAM disk.
[   30.914098] systemd[1]: No hostname configured.
[   30.916438] systemd[1]: Set hostname to <localhost>.
[   30.918894] systemd[1]: Initializing machine ID from random generator.
[   30.952987] systemd[1]: Cannot add dependency job for unit systemd-journald-audit.socket, ignoring: Unit systemd-journald-audit.socket failed to load: No such file or directory.
[   30.961811] systemd[1]: Starting Dispatch Password Requests to Console Directory Watch.
[   30.965966] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   30.970309] systemd[1]: Starting Local File Systems.
[   30.974035] systemd[1]: Reached target Local File Systems.
[   30.977110] systemd[1]: Starting Timers.
[   30.979881] systemd[1]: Reached target Timers.
[   30.982315] systemd[1]: Starting Paths.
[   30.985038] systemd[1]: Reached target Paths.
[   30.987399] systemd[1]: Starting Encrypted Volumes.
[   30.990489] systemd[1]: Reached target Encrypted Volumes.
[   30.993121] systemd[1]: Expecting device dev-disk-by\x2dpartlabel-USR\x2dA.device...
[   30.997583] systemd[1]: Starting Swap.
[   31.000349] systemd[1]: Reached target Swap.
[   31.002987] systemd[1]: Starting -.slice.
[   31.005934] systemd[1]: Created slice -.slice.
[   31.008603] systemd[1]: Starting Journal Socket.
[   31.011820] systemd[1]: Listening on Journal Socket.
[   31.014634] systemd[1]: Starting udev Control Socket.
[   31.018061] systemd[1]: Listening on udev Control Socket.
[   31.020810] systemd[1]: Starting System Slice.
[   31.023567] systemd[1]: Created slice System Slice.
[   31.025998] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[   31.031780] systemd[1]: Starting Slices.
[   31.034573] systemd[1]: Reached target Slices.
[   31.036977] systemd[1]: Starting system-systemd\x2dfsck.slice.
[   31.040411] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[   31.043561] systemd[1]: Started dracut ask for additional cmdline parameters.
[   31.048042] systemd[1]: Starting dracut cmdline hook...
[   31.051499] systemd[1]: Starting udev Kernel Socket.
[   31.054714] systemd[1]: Listening on udev Kernel Socket.
[   31.066079] systemd[1]: Starting Journal Socket (/dev/log).
[   31.077410] systemd[1]: Listening on Journal Socket (/dev/log).
[   31.090961] systemd[1]: Starting Journal Service...
[   31.100720] systemd[1]: Starting Sockets.
[   31.108915] systemd[1]: Reached target Sockets.
[   31.117649] systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device...
[   31.122181] systemd-journald[125]: File /var/log/journal/09360e5cf6064de2a1077c2caed141d9/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   31.137458] systemd[1]: Started Load Kernel Modules.
[   31.140074] systemd[1]: Starting Apply Kernel Variables...
[   31.149089] systemd[1]: Started Create list of required static device nodes for the current kernel.
[   31.160946] systemd[1]: Started dracut cmdline hook.
[   31.169410] systemd[1]: Started Apply Kernel Variables.
[   31.173200] systemd[1]: Started Journal Service.
[   31.285358] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
[   31.326707] ACPI: Power Button [PWRF]
[   31.344375] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input3
[   31.353431] SCSI subsystem initialized
[   31.359251] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[   31.384995] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[   31.393867] xen_netfront: Initialising Xen virtual ethernet driver
[   31.408390] microcode: CPU0 sig=0x306e4, pf=0x1, revision=0x415
[   31.416675] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[   31.433611] mousedev: PS/2 mouse device common for all mice
[   31.440088] ACPI: Sleep Button [SLPF]
[   31.451692] scsi host0: ata_piix
[   31.456697] AVX version of gcm_enc/dec engaged.
[   31.459834] AES CTR mode by8 optimization enabled
[   31.463159] scsi host1: ata_piix
[   31.465840] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[   31.470143] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[   31.477410] blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
[   31.485377] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   31.494776]  xvda: xvda1 xvda2 xvda3 xvda4 xvda6 xvda7 xvda9
[   31.590063] raid6: sse2x1    7679 MB/s
[   31.609059] raid6: sse2x2    9316 MB/s
[   31.628057] raid6: sse2x4   10871 MB/s
[   31.630794] raid6: using algorithm sse2x4 (10871 MB/s)
[   31.634114] raid6: using ssse3x2 recovery algorithm
[   31.642377] xor: automatically using best checksumming function:
[   31.656056]    avx       : 22044.000 MB/sec
[   31.673088] Btrfs loaded
[   31.676290] BTRFS: device label ROOT devid 1 transid 213428 /dev/xvda9
[   31.744225] BTRFS info (device xvda9): disk space caching is enabled
[   31.765220] BTRFS: detected SSD devices, enabling SSD mode
[   31.773892] BTRFS info (device xvda9): disk space caching is enabled
[   31.817639] EXT4-fs (xvda3): mounted filesystem without journal. Opts: (null)
[   31.957522] random: nonblocking pool is initialized
[   31.968878] BTRFS info (device xvda9): disk space caching is enabled
[   32.041909] systemd-journald[125]: Received SIGTERM from PID 1 (systemd).
[   32.774017] systemd-journald[423]: Received request to flush runtime journal from PID 1
[   36.125949] EXT4-fs (xvda6): mounted filesystem with ordered data mode. Opts: commit=600

Here are outputs from a couple of journalctl commands:

$ journalctl --disk-usage
Archived and active journals take up 1.3G on disk.
$ journalctl --verify
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-00000000000ac438-00050af40db4f2a2.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-00000000000c5272-00050afd884b9b8b.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-00000000000e0de0-00050b0a44e9eadc.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-00000000000faf04-00050b1cdf8cb835.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-000000000011634b-00050b2e92ffb114.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-00000000001333fe-00050b468fd56dac.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-000000000014abdc-00050b5617be46e4.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@faefc50d176e43f7aa21792cad7bafc6-0000000000163faa-00050b6555ed9ffa.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@00050b7ae12afb6c-03203656754bdd68.journal~
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@33386400774c4f079a1569c06b63bebf-0000000000000001-00050b7ae0807351.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@33386400774c4f079a1569c06b63bebf-000000000001c812-00050b899d9e51d7.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@33386400774c4f079a1569c06b63bebf-000000000003f7bd-00050bab5c765db4.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system@33386400774c4f079a1569c06b63bebf-0000000000060fbd-00050bc1196c7113.journal
PASS: /var/log/journal/1da420abea044fabb4c4b3761f327847/system.journal

Could the "systemd-journald[125]: File /var/log/journal/09360e5cf6064de2a1077c2caed141d9/system.journal corrupted or uncleanly shut down, renaming and replacing." be causing systemd to not behave normally? Is "Archived and active journals take up 1.3G on disk." normal for a CoreOS system that has been running for less than a month's time? How do I cleanup and maintain unused journals which take up so much disk space on my CoreOS system? Are the Btrfs issues encountered by people using CoreOS somehow related? Thank you.

Warmest Regards, Joel

joelchen commented 9 years ago

Hi all,

Found the cause of the issue. I was using sudo systemctl daemon-reload instead of sudo systemctl enable /etc/systemd/system/nginx.service. I had the impression that they work the same from a blog which wrote that daemon-reload allows systemd to pickup new unit files, but that does not seem to be the case with CoreOS 550. Also in the blog, after renaming the unit file and executing the command sudo systemctl reset-failed, the service does not seem to be unregistered. Any advice on the correct way to deregister systemd services? Thank you.

$ sudo systemctl enable /etc/systemd/system/nginx.service
Created symlink from /etc/systemd/system/multi-user.target.wants/nginx.service to /etc/systemd/system/nginx.service.

With a fresh new AWS EC2 instance, I noticed from the System Log that "systemd-journald[80]: File /var/log/journal/54cb235d665e42319b527ab3aac746ec/system.journal corrupted or uncleanly shut down, renaming and replacing." is still occurring on the latest CoreOS 550 HVM:

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.18.1 (buildbot@ip-10-204-3-57) (gcc version 4.8.3 (Gentoo Hardened 4.8.3 p1.1, pie-0.5.9) ) #2 SMP Fri Jan 2 04:50:48 UTC 2015
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz console=ttyS0,115200n8 console=tty0 root=LABEL=ROOT mount.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] Hypervisor detected: Xen HVM
[    0.000000] Xen version 4.2.
[    0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[    0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[    0.000000] You might have to change the root device
[    0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[    0.000000] in your root= kernel command line option
[    0.000000] AGP: No AGP bridge found
[    0.000000] e820: last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000] init_memory_mapping: [mem 0x3fe00000-0x3fffffff]
[    0.000000] init_memory_mapping: [mem 0x3c000000-0x3fdfffff]
[    0.000000] init_memory_mapping: [mem 0x00100000-0x3bffffff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen   )
[    0.000000] ACPI: XSDT 0x00000000FC00F710 00005C (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: FACP 0x00000000FC00F260 0000F4 (v04 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: DSDT 0x00000000FC0035E0 00BBF6 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[    0.000000] ACPI: APIC 0x00000000FC00F360 0000D8 (v02 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: SRAT 0x00000000FC00F4B0 000170 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: HPET 0x00000000FC00F620 000038 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: WAET 0x00000000FC00F660 000028 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: SSDT 0x00000000FC00F690 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: SSDT 0x00000000FC00F6D0 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x3fffffff]
[    0.000000] NUMA: Warning: invalid memblk node 0 [mem 0x100000000-0xbfffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0xbfffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x3fff9000-0x3fffffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x0009dfff]
[    0.000000]   node   0: [mem 0x00100000-0x3fffffff]
[    0.000000] Initmem setup node 0 [mem 0x00001000-0x3fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x00] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x00] disabled)
[    0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 15 CPUs, 14 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] e820: [mem 0x40000000-0xfbffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on Xen HVM
[    0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:15 nr_node_ids:1
[    0.000000] PERCPU: Embedded 29 pages/cpu @ffff88003fc00000 s80960 r8192 d29632 u131072
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257928
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: init=/usr/lib/systemd/systemd BOOT_IMAGE=/boot/vmlinuz console=ttyS0,115200n8 console=tty0 root=LABEL=ROOT mount.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[    0.000000] AGP: Checking aperture...
[    0.000000] AGP: No AGP bridge found
[    0.000000] Memory: 995876K/1048180K available (5098K kernel code, 932K rwdata, 2276K rodata, 21656K init, 928K bss, 52304K reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=15.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=15
[    0.000000] NR_IRQS:8448 nr_irqs:952 0
[    0.000000] xen:events: Using 2-level ABI
[    0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] allocated 4194304 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] tsc: Detected 2494.082 MHz processor
[    0.005000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4988.16 BogoMIPS (lpj=2494082)
[    0.012003] pid_max: default: 32768 minimum: 301
[    0.016012] ACPI: Core revision 20140926
[    0.025272] ACPI: All ACPI Tables successfully acquired
[    0.030089] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.035231] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.040105] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
[    0.046008] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
[    0.051168] Initializing cgroup subsys memory
[    0.055011] Initializing cgroup subsys devices
[    0.058007] Initializing cgroup subsys freezer
[    0.062005] Initializing cgroup subsys net_cls
[    0.065007] Initializing cgroup subsys blkio
[    0.069007] Initializing cgroup subsys perf_event
[    0.073008] Initializing cgroup subsys net_prio
[    0.077067] CPU: Physical Processor ID: 0
[    0.081458] mce: CPU supports 2 MCE banks
[    0.084023] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    0.084023] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[    0.105274] ftrace: allocating 19770 entries in 78 pages
[    0.131003] Switched APIC routing to physical flat.
[    0.137366] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.151756] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz (fam: 06, model: 3e, stepping: 04)
[    0.160014] installing Xen timer for CPU 0
[    0.163071] cpu 0 spinlock event irq 53
[    0.167527] Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
[    0.171000] x86: Booted up 1 node, 1 CPUs
[    0.171006] smpboot: Total of 1 processors activated (4988.16 BogoMIPS)
[    0.172382] NMI watchdog: disabled (cpu0): hardware events not enabled
[    0.173075] devtmpfs: initialized
[    0.176524] pinctrl core: initialized pinctrl subsystem
[    0.177128] NET: Registered protocol family 16
[    0.178133] cpuidle: using governor ladder
[    0.179010] cpuidle: using governor menu
[    0.180057] ACPI: bus type PCI registered
[    0.181005] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.182069] dca service started, version 1.12.1
[    0.183234] PCI: Using configuration type 1 for base access
[    0.184635] ACPI: Added _OSI(Module Device)
[    0.185005] ACPI: Added _OSI(Processor Device)
[    0.186007] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.187007] ACPI: Added _OSI(Processor Aggregator Device)
[    0.191029] ACPI: Interpreter enabled
[    0.192010] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20140926/hwxface-580)
[    0.195008] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20140926/hwxface-580)
[    0.198013] ACPI: (supports S0 S3 S4 S5)
[    0.199004] ACPI: Using IOAPIC for interrupt routing
[    0.200030] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.249132] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.250011] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[    0.251015] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.252079] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.253664] acpiphp: Slot [0] registered
[    0.254678] acpiphp: Slot [3] registered
[    0.255241] acpiphp: Slot [4] registered
[    0.256252] acpiphp: Slot [5] registered
[    0.257237] acpiphp: Slot [6] registered
[    0.258243] acpiphp: Slot [7] registered
[    0.259236] acpiphp: Slot [8] registered
[    0.260235] acpiphp: Slot [9] registered
[    0.261243] acpiphp: Slot [10] registered
[    0.262241] acpiphp: Slot [11] registered
[    0.263236] acpiphp: Slot [12] registered
[    0.264243] acpiphp: Slot [13] registered
[    0.265259] acpiphp: Slot [14] registered
[    0.266264] acpiphp: Slot [15] registered
[    0.267232] acpiphp: Slot [16] registered
[    0.268240] acpiphp: Slot [17] registered
[    0.269276] acpiphp: Slot [18] registered
[    0.270242] acpiphp: Slot [19] registered
[    0.271234] acpiphp: Slot [20] registered
[    0.272237] acpiphp: Slot [21] registered
[    0.273256] acpiphp: Slot [22] registered
[    0.274334] acpiphp: Slot [23] registered
[    0.275239] acpiphp: Slot [24] registered
[    0.276242] acpiphp: Slot [25] registered
[    0.277238] acpiphp: Slot [26] registered
[    0.278243] acpiphp: Slot [27] registered
[    0.279239] acpiphp: Slot [28] registered
[    0.280234] acpiphp: Slot [29] registered
[    0.281235] acpiphp: Slot [30] registered
[    0.282235] acpiphp: Slot [31] registered
[    0.283229] PCI host bridge to bus 0000:00
[    0.284007] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.285005] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7]
[    0.286005] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    0.287005] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.288005] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff]
[    0.294560] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.295005] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.296008] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.297005] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.298675] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
[    0.298675] * this clock source is slow. Consider trying other clock sources
[    0.300286] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.307124] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[    0.311108] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.314184] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.318126] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[    0.337582] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.338050] xen:balloon: Initialising balloon driver
[    0.345028] xen_balloon: Initialising balloon driver
[    0.346212] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.347000] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.347012] vgaarb: loaded
[    0.348005] vgaarb: bridge control possible 0000:00:02.0
[    0.349071] PCI: Using ACPI for IRQ routing
[    0.350457] init_memory_mapping: [mem 0x40000000-0x47ffffff]
[    0.351869] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.352018] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.355005] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[    0.358000] Switched to clocksource xen
[    0.363718] pnp: PnP ACPI init
[    0.366445] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[    0.371744] system 00:01: [io  0x08a0-0x08a3] has been reserved
[    0.376620] system 00:01: [io  0x0cc0-0x0ccf] has been reserved
[    0.381697] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.387036] system 00:07: [io  0x10c0-0x1141] has been reserved
[    0.393051] system 00:07: [io  0xb044-0xb047] has been reserved
[    0.414751] pnp: PnP ACPI: found 8 devices
[    0.423285] NET: Registered protocol family 2
[    0.427450] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
[    0.433171] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
[    0.438399] TCP: Hash tables configured (established 8192 bind 8192)
[    0.443905] TCP: reno registered
[    0.447216] UDP hash table entries: 512 (order: 2, 16384 bytes)
[    0.452602] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[    0.457814] NET: Registered protocol family 1
[    0.462750] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.467691] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.471842] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.769031] RAPL PMU detected, hw unit 2^-16 Joules, API unit is 2^-32 Joules, 3 fixed counters 163840 ms ovfl timer
[    0.776682] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    0.781257] Initialise system trusted keyring
[    0.784694] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.790129] VFS: Disk quotas dquot_6.5.2
[    0.793400] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.798369] msgmni has been set to 1945
[    0.801625] alg: No test for stdrng (krng)
[    0.804780] Key type asymmetric registered
[    0.807734] Asymmetric key parser 'x509' registered
[    0.811424] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    0.816950] io scheduler noop registered
[    0.820127] io scheduler deadline registered
[    0.823271] io scheduler cfq registered (default)
[    0.826849] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.831154] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.851992] Console: switching to colour frame buffer device 100x37
[    0.856595] GHES: HEST is not enabled!
[    0.858514] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    0.861840] xen:grant_table: Grant tables using version 1 layout
[    0.865276] Grant table initialized
[    0.867496] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.899962] serial 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.905826] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[    0.913116] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.916541] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.920872] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    0.927026] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    0.931040] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[    0.936611] TCP: cubic registered
[    0.940061] NET: Registered protocol family 10
[    0.944062] NET: Registered protocol family 17
[    0.948308] Loading compiled-in X.509 certificates
[    0.953148] Loaded X.509 cert 'Magrathea: Glacier signing key: 6bcbbbc870f53cb42fd079b077cf393635b4ae07'
[    0.961071] registered taskstats version 1
[    1.770088] tsc: Refined TSC clocksource calibration: 2493.989 MHz
[    6.064078] xenbus_probe_frontend: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...
[   30.969262] 
[   30.970980] xenbus_probe_frontend: Timeout connecting to device: device/vfb/0 (local state 3, remote state 1)
[   30.978116] xenbus_probe_frontend: Device with no driver: device/vbd/51712
[   30.982652] xenbus_probe_frontend: Device with no driver: device/vif/0
[   30.986945] rtc_cmos 00:02: setting system clock to 2015-01-05 11:50:42 UTC (1420458642)
[   30.997585] Freeing unused kernel memory: 21656K (ffffffff81aea000 - ffffffff83010000)
[   31.002302] Write protecting the kernel read-only data: 10240k
[   31.007425] Freeing unused kernel memory: 1036K (ffff8800014fd000 - ffff880001600000)
[   31.014892] Freeing unused kernel memory: 1820K (ffff880001839000 - ffff880001a00000)
[   31.021503] systemd[1]: Inserted module 'autofs4'
[   31.024464] random: systemd urandom read with 42 bits of entropy available
[   31.028546] systemd[1]: systemd 218 running in system mode. (-PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP -GCRYPT -GNUTLS -ACL -XZ -LZ4 +SECCOMP +BLKID -ELFUTILS +KMOD -IDN)
[   31.039770] systemd[1]: Detected virtualization 'xen'.
[   31.043177] systemd[1]: Detected architecture 'x86-64'.
[   31.046193] systemd[1]: Running in initial RAM disk.
[   31.050603] systemd[1]: No hostname configured.
[   31.053084] systemd[1]: Set hostname to <localhost>.
[   31.056505] systemd[1]: Initializing machine ID from random generator.
[   31.089107] systemd[1]: Cannot add dependency job for unit systemd-journald-audit.socket, ignoring: Unit systemd-journald-audit.socket failed to load: No such file or directory.
[   31.099461] systemd[1]: Starting Timers.
[   31.103047] systemd[1]: Reached target Timers.
[   31.106200] systemd[1]: Starting Dispatch Password Requests to Console Directory Watch.
[   31.111413] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   31.116656] systemd[1]: Starting Paths.
[   31.120016] systemd[1]: Reached target Paths.
[   31.123088] systemd[1]: Starting -.slice.
[   31.126689] systemd[1]: Created slice -.slice.
[   31.129987] systemd[1]: Starting Journal Socket.
[   31.133820] systemd[1]: Listening on Journal Socket.
[   31.137420] systemd[1]: Starting udev Control Socket.
[   31.141558] systemd[1]: Listening on udev Control Socket.
[   31.145195] systemd[1]: Starting Journal Socket (/dev/log).
[   31.149566] systemd[1]: Listening on Journal Socket (/dev/log).
[   31.153473] systemd[1]: Starting System Slice.
[   31.157231] systemd[1]: Created slice System Slice.
[   31.160678] systemd[1]: Started dracut ask for additional cmdline parameters.
[   31.165308] systemd[1]: Starting Journal Service...
[   31.169427] systemd[1]: Starting Slices.
[   31.173004] systemd[1]: Reached target Slices.
[   31.176196] systemd[1]: Started Load Kernel Modules.
[   31.180619] systemd[1]: Starting Apply Kernel Variables...
[   31.185257] systemd[1]: Starting dracut cmdline hook...
[   31.189523] systemd[1]: Expecting device dev-disk-by\x2dlabel-ROOT.device...
[   31.195452] systemd-journald[80]: File /var/log/journal/54cb235d665e42319b527ab3aac746ec/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   31.218477] systemd[1]: Starting Swap.
[   31.230078] systemd[1]: Reached target Swap.
[   31.240497] systemd[1]: Starting system-systemd\x2dfsck.slice.
[   31.256643] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[   31.269007] systemd[1]: Starting Encrypted Volumes.
[   31.278406] systemd[1]: Reached target Encrypted Volumes.
[   31.283068] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[   31.290461] systemd[1]: Expecting device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device...
[   31.296740] systemd[1]: Starting udev Kernel Socket.
[   31.299969] systemd[1]: Listening on udev Kernel Socket.
[   31.302900] systemd[1]: Starting Sockets.
[   31.305870] systemd[1]: Reached target Sockets.
[   31.308423] systemd[1]: Starting Local File Systems.
[   31.311694] systemd[1]: Reached target Local File Systems.
[   31.315360] systemd[1]: Started Journal Service.
[   31.427838] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
[   31.464417] ACPI: Power Button [PWRF]
[   31.476664] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input3
[   31.496424] SCSI subsystem initialized
[   31.501682] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[   31.521266] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[   31.527586] microcode: CPU0 sig=0x306e4, pf=0x1, revision=0x415
[   31.530601] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[   31.538716] xen_netfront: Initialising Xen virtual ethernet driver
[   31.549441] ACPI: Sleep Button [SLPF]
[   31.573210] mousedev: PS/2 mouse device common for all mice
[   31.576906] scsi host0: ata_piix
[   31.586401] scsi host1: ata_piix
[   31.592479] AVX version of gcm_enc/dec engaged.
[   31.596079] AES CTR mode by8 optimization enabled
[   31.599420] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[   31.603636] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[   31.611114] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[   31.636426] blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
[   31.696380] GPT:Primary header thinks Alt. header is not at the end of the disk.
[   31.700718] GPT:9289727 != 62914559
[   31.702839] GPT:Alternate GPT header not at the end of the disk.
[   31.706189] GPT:9289727 != 62914559
[   31.708132] GPT: Use GNU Parted to correct GPT errors.
[   31.710807]  xvda: xvda1 xvda2 xvda3 xvda4 xvda6 xvda7 xvda9
[   31.828069] raid6: sse2x1    7710 MB/s
[   31.847057] raid6: sse2x2    9429 MB/s
[   31.866067] raid6: sse2x4   11164 MB/s
[   31.868980] raid6: using algorithm sse2x4 (11164 MB/s)
[   31.872563] raid6: using ssse3x2 recovery algorithm
[   31.877115] xor: automatically using best checksumming function:
[   31.891056]    avx       : 21324.000 MB/sec
[   31.906820] Btrfs loaded
[   31.910952] BTRFS: device label ROOT devid 1 transid 23 /dev/xvda9
[   32.002995] BTRFS info (device xvda9): disk space caching is enabled
[   32.048370] BTRFS: detected SSD devices, enabling SSD mode
[   32.090074] EXT4-fs (xvda3): mounted filesystem without journal. Opts: (null)
[   32.106604] random: nonblocking pool is initialized
[   32.166277] BTRFS info (device xvda9): disk space caching is enabled
[   32.610523] systemd-journald[80]: Received SIGTERM from PID 1 (systemd).
[   36.857594] systemd-journald[408]: Received request to flush runtime journal from PID 1
[   40.307477] EXT4-fs (xvda6): mounted filesystem with ordered data mode. Opts: commit=600
[   42.524167] BTRFS info (device xvda9): resizing devid 1
[   42.526856] BTRFS: new size for /dev/xvda9 is 29725011968

Warmest Regards, Joel

czerasz commented 8 years ago

I also had issues with auto start after reboot. Adding Restart and RestartSec fixed the issue:

# Restart after crash
Restart=always
# Give the service 10 seconds to recover after the previous restart
RestartSec=10s

Posted more details here.