recreated ec2 instance takes a very long time to join cluster

Here is the log showing that this instance discovers its cluster entry and begins cycling through each each instance attempting to join. It appears that each join attempt fails due to an i/o error to one of the instances - it is always the same instance - regardless of which instance the join is initiated with. After some time this clears and the instance succeeds in joining the cluster.

After etcd is restarted for eighth it joins the cluster.

The instance that is listed as the source of the i/o error is up and appears to be working. For some reason it gives this fleetctl version skew warning. It's not clear why, since this instance is just hours old and other cluster instances are weeks old. They are all created with the ec2 stable ami-8097d4e8. Just noting this in case it might be the cause of the join issue.

####################################################################
WARNING: fleetctl (0.9.0) is older than the latest registered
version of fleet found in the cluster (0.9.2). You are strongly
recommended to upgrade fleetctl to prevent incompatibility issues.
####################################################################

Here's the journal of the instance attempting to join the cluster:

-- Reboot --
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-journal[399]: Runtime journal is using 8.0M (max allowed 187.6M, trying to leave 281.4M free of 1.8G available → current limit 187.6M).
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-journal[399]: Permanent journal is using 8.0M (max allowed 2.9G, trying to leave 4.0G free of 29.4G available → current limit 2.9G).
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-journal[399]: Time spent on flushing to /var is 7.261ms for 2 entries.
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-journald[79]: Received SIGTERM from PID 1 (n/a).
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-journal[399]: Journal started
May 28 01:36:01 ip-10-0-6-12.resilient-net.net systemd[1]: systemd 218 running in system mode. (-PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP -GCRYPT -GNUTLS -ACL -XZ -LZ4 +SECCOMP +BLKID -ELFUTILS +KMOD -IDN)
May 28 01:36:01 ip-10-0-6-12.resilient-net.net systemd[1]: Detected virtualization 'xen'.
May 28 01:36:01 ip-10-0-6-12.resilient-net.net systemd[1]: Detected architecture 'x86-64'.
May 28 01:36:01 ip-10-0-6-12.resilient-net.net systemd[1]: Set hostname to <ip-10-0-6-12.resilient-net.net>.
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Flush Journal to Persistent Storage...
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Started Flush Journal to Persistent Storage.
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Started Create Static Device Nodes in /dev.
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Local File Systems (Pre).
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Local File Systems (Pre).
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Starting udev Kernel Device Manager...
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-udevd[423]: starting version 218
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd-udevd[423]: RUN{builtin}: 'uaccess' unknown /usr/lib64/udev/rules.d/73-seat-late.rules:15
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Started udev Kernel Device Manager.
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Started udev Wait for Complete Device Initialization.
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Activation of LVM2 logical volumes...
May 28 01:36:02 ip-10-0-6-12.resilient-net.net systemd[1]: Found device /dev/hvc0.
May 28 01:36:03 ip-10-0-6-12.resilient-net.net systemd[1]: Started Activation of LVM2 logical volumes.
May 28 01:36:03 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Encrypted Volumes.
May 28 01:36:03 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Encrypted Volumes.
May 28 01:36:03 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Activation of LVM2 logical volumes...
May 28 01:36:03 ip-10-0-6-12.resilient-net.net lvm[426]: No volume groups found
May 28 01:36:03 ip-10-0-6-12.resilient-net.net lvm[444]: No volume groups found
May 28 01:36:03 ip-10-0-6-12.resilient-net.net systemd[1]: Started Activation of LVM2 logical volumes.
May 28 01:36:03 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Activation of LVM2 logical volumes...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Found device /dev/disk/by-label/OEM.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Mounting /usr/share/oem...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net kernel: EXT4-fs (xvda6): mounted filesystem with ordered data mode. Opts: commit=600
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Mounted /usr/share/oem.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Rebuild Dynamic Linker Cache.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Local File Systems.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Local File Systems.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Commit a transient machine-id on disk.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Create Volatile Files and Directories...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Create missing system files...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Rebuild Journal Catalog.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Update is Completed.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Create missing system files.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Create Volatile Files and Directories.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Clean up broken links in /etc/ssl/certs...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Update UTMP about System Boot/Shutdown...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net lvm[450]: No volume groups found
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Activation of LVM2 logical volumes.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Remote File Systems.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Remote File Systems.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Update UTMP about System Boot/Shutdown.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Clean up broken links in /etc/ssl/certs.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Update CA bundle at /etc/ssl/certs/ca-certificates.crt.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting System Initialization.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target System Initialization.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Docker Socket for the API.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Update Engine Stub Timer.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting D-Bus System Message Bus Socket.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Listening on D-Bus System Message Bus Socket.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Watch for a cloud-config at /media/configdrive.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Failed to start Watch for a cloud-config at /media/configdrive.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Dependency failed for Load user-provided cloud configs.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Job user-config.target/start failed with result 'dependency'.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Watch for update engine configuration changes.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Watch for update engine configuration changes.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Daily Cleanup of Temporary Directories.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Daily Cleanup of Temporary Directories.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Timers.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Timers.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting OpenSSH Server Socket.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Listening on OpenSSH Server Socket.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Watch for a cloud-config at /var/lib/coreos-install/user_data.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Watch for a cloud-config at /var/lib/coreos-install/user_data.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Paths.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Paths.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Listening on Docker Socket for the API.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Listening on Journal Audit Socket.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Sockets.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Sockets.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Basic System.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Basic System.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Extend Filesystems...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting D-Bus System Message Bus...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started D-Bus System Message Bus.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Network Service...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Network Time Service...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Network Time Service.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Modifies /etc/environment for CoreOS.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Login Service...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Configure Addon /usr/share/oem.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Load cloud-config from url defined in /proc/cmdline.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Update Engine...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate sshd host keys...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Install an ssh key from /proc/cmdline...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/issue...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Run Addon /usr/share/oem.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Load cloud-config from /usr/share/oem/cloud-config.yml...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Extend Filesystems.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/issue.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Install an ssh key from /proc/cmdline.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Login Service.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd-logind[475]: New seat seat0.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Started Network Service.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Network Name Resolution...
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Network.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Network.
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd-networkd[473]: lo              : link configured
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd-networkd[473]: eth0            : gained carrier
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd-networkd[473]: eth0            : DHCPv4 address 10.0.6.12/24 via 10.0.6.1
May 28 01:36:06 ip-10-0-6-12.resilient-net.net dbus[465]: [system] Activating via systemd: service name='org.freedesktop.hostname1' unit='dbus-org.freedesktop.hostname1.service'
May 28 01:36:06 ip-10-0-6-12.resilient-net.net systemd-networkd[473]: eth0            : link configured
May 28 01:36:07 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Hostname Service...
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: ntpd 4.2.8@1.3265-o Tue Feb  3 20:25:55 UTC 2015 (1): Starting
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Command line: /usr/sbin/ntpd -g -n -f /var/lib/ntp/ntp.drift -u ntp:ntp
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: ntpd 4.2.8@1.3265-o Tue Feb  3 20:25:55 UTC 2015 (1): Starting
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Command line: /usr/sbin/ntpd -g -n -f /var/lib/ntp/ntp.drift -u ntp:ntp
May 28 01:36:07 ip-10-0-6-12.resilient-net.net systemd-resolved[487]: Using system hostname 'ip-10-0-6-12.resilient-net.net'.
May 28 01:36:07 ip-10-0-6-12.resilient-net.net systemd[1]: Started Network Name Resolution.
May 28 01:36:07 ip-10-0-6-12.resilient-net.net dbus[465]: [system] Successfully activated service 'org.freedesktop.hostname1'
May 28 01:36:07 ip-10-0-6-12.resilient-net.net systemd[1]: Started Hostname Service.
May 28 01:36:07 ip-10-0-6-12.resilient-net.net dbus[465]: [system] Activating via systemd: service name='org.freedesktop.PolicyKit1' unit='polkit.service'
May 28 01:36:07 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Authorization Manager...
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: proto: precision = 0.434 usec (-21)
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: proto: precision = 0.434 usec (-21)
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Listen and drop on 0 v6wildcard [::]:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Listen and drop on 1 v4wildcard 0.0.0.0:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Listen normally on 2 lo 127.0.0.1:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Listen normally on 3 eth0 10.0.6.12:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Listen normally on 4 lo [::1]:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: bind(21) AF_INET6 fe80::8d4:59ff:feca:8c59%2%2#123 flags 0x11 failed: Cannot assign requested address
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: unable to create socket on eth0 (5) for fe80::8d4:59ff:feca:8c59%2#123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: failed to init interface for address fe80::8d4:59ff:feca:8c59%2
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: Listening on routing socket on fd #21 for interface updates
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Listen and drop on 0 v6wildcard [::]:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Listen and drop on 1 v4wildcard 0.0.0.0:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Listen normally on 2 lo 127.0.0.1:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Listen normally on 3 eth0 10.0.6.12:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Listen normally on 4 lo [::1]:123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: bind(21) AF_INET6 fe80::8d4:59ff:feca:8c59%2%2#123 flags 0x11 failed: Cannot assign requested address
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: unable to create socket on eth0 (5) for fe80::8d4:59ff:feca:8c59%2#123
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: failed to init interface for address fe80::8d4:59ff:feca:8c59%2
May 28 01:36:07 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:07 ntpd[474]: Listening on routing socket on fd #21 for interface updates
May 28 01:36:07 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate sshd host keys.
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: Checking availability of "local-file"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: Fetching user-data from datasource of type "local-file"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: Fetching meta-data from datasource of type "local-file"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Parsing user-data as cloud-config
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: Processing cloud-config from user-data
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Writing file to "/run/systemd/system/etcd.service.d/10-oem.conf"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Wrote file to "/run/systemd/system/etcd.service.d/10-oem.conf"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Wrote file /run/systemd/system/etcd.service.d/10-oem.conf to filesystem
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Writing file to "/etc/oem-release"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Wrote file to "/etc/oem-release"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Wrote file /etc/oem-release to filesystem
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Masking unit file "user-configdrive.service"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Masking unit file "user-configvirtfs.service"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Writing unit "oem-cloudinit.service" to filesystem
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Writing file to "/run/systemd/system/oem-cloudinit.service"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Wrote file to "/run/systemd/system/oem-cloudinit.service"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Wrote unit "oem-cloudinit.service"
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Ensuring runtime unit file "oem-cloudinit.service" is unmasked
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 /run/systemd/system/oem-cloudinit.service is not null or empty, refusing to unmask
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Ensuring runtime unit file "etcd.service" is unmasked
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Ensuring runtime unit file "fleet.service" is unmasked
May 28 01:36:07 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:07 Ensuring runtime unit file "locksmithd.service" is unmasked
May 28 01:36:07 ip-10-0-6-12.resilient-net.net polkitd[497]: Started polkitd version 0.112
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Reloading.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013608:INFO:main.cc(159)] CoreOS Update Engine starting
May 28 01:36:08 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013608:INFO:update_check_scheduler.cc(82)] Next update check in 2m17s
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:08 Calling unit command "restart" on "oem-cloudinit.service"'
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Update Engine.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Cloudinit from EC2-style metadata...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Failed to set memory.limit_in_bytes on : Invalid argument
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Failed to reset devices.list on /system.slice: Invalid argument
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Cluster reboot manager...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: Checking availability of "cloud-drive"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: Checking availability of "ec2-metadata-service"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Cluster reboot manager.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: Fetching user-data from datasource of type "ec2-metadata-service"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/user-data. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: Fetching meta-data from datasource of type "ec2-metadata-service"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/meta-data/public-keys. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/meta-data/public-keys/0/openssh-key. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: Found SSH key for "qaaskey"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/meta-data/hostname. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/meta-data/local-ipv4. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/meta-data/public-ipv4. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Fetching data from http://169.254.169.254/2009-04-04/meta-data/network_config/content_path. Attempt #1
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Parsing user-data as cloud-config
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: Merging cloud-config from meta-data and user-data
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Set hostname to ip-10-0-6-12.resilient-net.net
May 28 01:36:08 ip-10-0-6-12.resilient-net.net polkitd[497]: Loading rules from directory /etc/polkit-1/rules.d
May 28 01:36:08 ip-10-0-6-12.resilient-net.net polkitd[497]: Loading rules from directory /usr/share/polkit-1/rules.d
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Permit User Sessions...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net polkitd[497]: Finished loading, compiling and executing 2 rules
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Permit User Sessions.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Serial Getty on hvc0...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Serial Getty on hvc0.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Getty on tty1...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Getty on tty1.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Login Prompts.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Login Prompts.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Multi-User System.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Multi-User System.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Authorization Manager.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net dbus[465]: [system] Successfully activated service 'org.freedesktop.PolicyKit1'
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd-hostnamed[492]: Changed host name to 'ip-10-0-6-12'
May 28 01:36:08 ip-10-0-6-12.resilient-net.net polkitd[497]: Acquired the name org.freedesktop.PolicyKit1 on the system bus
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Authorized SSH keys for core user
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Writing file to "/etc/environment"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Wrote file to "/etc/environment"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Updated /etc/environment
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Writing drop-in unit "20-cloudinit.conf" to filesystem
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Writing file to "/run/systemd/system/etcd.service.d/20-cloudinit.conf"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Wrote file to "/run/systemd/system/etcd.service.d/20-cloudinit.conf"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Wrote drop-in unit "20-cloudinit.conf"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Ensuring runtime unit file "etcd.service" is unmasked
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Writing drop-in unit "20-cloudinit.conf" to filesystem
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Writing file to "/run/systemd/system/fleet.service.d/20-cloudinit.conf"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Wrote file to "/run/systemd/system/fleet.service.d/20-cloudinit.conf"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Wrote drop-in unit "20-cloudinit.conf"
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Ensuring runtime unit file "fleet.service" is unmasked
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Ensuring runtime unit file "locksmithd.service" is unmasked
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Reloading.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Calling unit command "start" on "etcd.service"'
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Failed to set memory.limit_in_bytes on : Invalid argument
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Failed to reset devices.list on /system.slice: Invalid argument
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Result of "start" on "etcd.service": done
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Calling unit command "start" on "fleet.service"'
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting fleet.socket.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Listening on fleet.socket.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting fleet daemon...
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started fleet daemon.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[520]: 2015/05/28 01:36:08 Result of "start" on "fleet.service": done
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Cloudinit from EC2-style metadata.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Started Load cloud-config from /usr/share/oem/cloud-config.yml.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Load system-provided cloud configs.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Reached target Load system-provided cloud configs.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net systemd[1]: Startup finished in 2.847s (kernel) + 2.600s (initrd) + 7.269s (userspace) = 12.716s.
May 28 01:36:08 ip-10-0-6-12.resilient-net.net coreos-cloudinit[480]: 2015/05/28 01:36:08 Result of "restart" on "oem-cloudinit.service": done
May 28 01:36:08 ip-10-0-6-12.resilient-net.net locksmithd[524]: locksmithd starting currentOperation="UPDATE_STATUS_IDLE" strategy="best-effort"
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO fleet.go:58: Starting fleetd version 0.9.0
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO fleet.go:162: No provided or default config file found - proceeding without
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO server.go:153: Establishing etcd connectivity
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:09 ip-10-0-6-12.resilient-net.net systemd-udevd[423]: RUN{builtin}: 'uaccess' unknown /usr/lib64/udev/rules.d/73-seat-late.rules:15
May 28 01:36:09 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:09.501 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:36:09 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:09.504 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:36:09 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:09.504 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:09 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:10 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:10.092 INFO      | Discovery found peers [http://10.0.6.11:7001 http://10.0.7.10:7001 http://10.0.7.11:7001 http://10.0.7.12:7001 http://10.0.6.10:7001]
May 28 01:36:10 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:10.092 INFO      | Discovery fetched back peer list: [10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001]
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:10 ip-10-0-6-12.resilient-net.net ntpd[474]: Listen normally on 6 eth0 [fe80::8d4:59ff:feca:8c59%2]:123
May 28 01:36:10 ip-10-0-6-12.resilient-net.net ntpd[474]: 28 May 01:36:10 ntpd[474]: Listen normally on 6 eth0 [fe80::8d4:59ff:feca:8c59%2]:123
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:10 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:11 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:11 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:12 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:12.443 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:12 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:12.446 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:36:12 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:12 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:12 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:12 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:12 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:12 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:13 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:13 ip-10-0-6-12.resilient-net.net locksmithd[524]: Unlocking old locks failed: error setting up lock. Retrying in 10s.
May 28 01:36:14 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:14 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:14 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:14.798 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:14 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:14.801 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:36:16 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:16 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:16 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:16 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:16 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:16 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:17 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:17.152 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:17 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:17.158 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:17 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:18 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:18 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:19 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:19.509 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:19 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:19.512 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:36:21 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:21.863 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:21 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:21.863 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001] at 0th time. Retrying in 4.7 seconds
May 28 01:36:22 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:22 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:22 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:22 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:22 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:22 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:23 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:23 ip-10-0-6-12.resilient-net.net locksmithd[524]: Unlocking old locks failed: error setting up lock. Retrying in 20s.
May 28 01:36:24 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:24 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:28 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:28.213 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:28 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:28.216 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:36:30 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:30.568 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:30 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:30.571 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:36:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:32 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:32.922 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:32 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:32.926 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:34 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:34 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:35 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:35.277 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:35 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:35.280 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:36:37 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:37.631 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:37 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:37.631 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001] at 1th time. Retrying in 4.7 seconds
May 28 01:36:43 ip-10-0-6-12.resilient-net.net locksmithd[524]: Unlocking old locks failed: error setting up lock. Retrying in 40s.
May 28 01:36:43 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:43.981 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:43 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:43.985 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:36:46 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:46.336 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:46 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:46.339 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:36:48 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:48.690 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:48 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:48.694 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:36:50 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:50 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:50 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:50 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:50 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:50 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:51 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:51.046 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:51 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:51.048 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:51 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:36:52 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:36:52 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:36:53 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013653:INFO:update_attempter.cc(674)] Updating boot flags...
May 28 01:36:53 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:53.400 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:36:53 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:53.400 WARNING   | lb-3 cannot connect to existing peers [10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:36:53 ip-10-0-6-12.resilient-net.net etcd[577]: [etcd] May 28 01:36:53.400 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:36:53 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:36:53 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:36:53 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:37:03 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:37:03 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:37:03 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:37:03 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:37:03 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:03.586 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:37:03 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:03.587 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:37:03 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:03.587 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:37:04 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:04.207 INFO      | Discovery found peers [http://10.0.6.10:7001 http://10.0.6.11:7001 http://10.0.7.10:7001 http://10.0.7.11:7001 http://10.0.7.12:7001]
May 28 01:37:04 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:04.208 INFO      | Discovery fetched back peer list: [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001]
May 28 01:37:04 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:04.211 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:37:04 ip-10-0-6-12.resilient-net.net systemd[1]: Starting system-sshd.slice.
May 28 01:37:04 ip-10-0-6-12.resilient-net.net systemd[1]: Created slice system-sshd.slice.
May 28 01:37:04 ip-10-0-6-12.resilient-net.net systemd[1]: Starting OpenSSH per-connection server daemon (10.0.6.58:54573)...
May 28 01:37:04 ip-10-0-6-12.resilient-net.net systemd[1]: Started OpenSSH per-connection server daemon (10.0.6.58:54573).
May 28 01:37:06 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:06.562 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:08 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:08.912 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:08 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:08.915 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:37:11 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:11.267 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:11 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:11.274 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:37:13 ip-10-0-6-12.resilient-net.net sshd[626]: Accepted publickey for core from 10.0.6.58 port 54573 ssh2: RSA ff:65:c0:68:2b:c9:73:7b:03:ad:69:a7:e8:c4:5a:f6
May 28 01:37:13 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:13.626 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:13 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:13.629 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:37:15 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:15.981 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:15 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:15.981 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001] at 0th time. Retrying in 2.6 seconds
May 28 01:37:17 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:17.983 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:37:20 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:37:20 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:20.335 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:20 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:37:22 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:22.685 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:22 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:22.689 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:37:23 ip-10-0-6-12.resilient-net.net locksmithd[524]: Unlocking old locks failed: error setting up lock. Retrying in 1m20s.
May 28 01:37:24 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:24 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:37:24 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:24 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:37:24 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:24 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:37:25 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:25.040 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:25 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:25.044 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:25 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:37:26 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:37:26 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:37:27 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:27.395 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:27 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:27.398 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:37:29 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:29.750 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:29 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:29.750 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001] at 1th time. Retrying in 2.6 seconds
May 28 01:37:31 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:31.752 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:37:34 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:34.103 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:36 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:36.454 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:36 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:36.457 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:37:38 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:38.808 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:38 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:38.812 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:37:41 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:41.163 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:41 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:41.166 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:37:43 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:43.518 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:43 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:43.518 WARNING   | lb-3 cannot connect to existing peers [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:37:43 ip-10-0-6-12.resilient-net.net etcd[619]: [etcd] May 28 01:37:43.518 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:37:43 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:37:43 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:37:43 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:37:53 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:37:53 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:37:53 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:37:53 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:37:53 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:53.586 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:37:53 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:53.587 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:37:53 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:53.587 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:37:54 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:54.159 INFO      | Discovery found peers [http://10.0.6.10:7001 http://10.0.6.11:7001 http://10.0.7.10:7001 http://10.0.7.11:7001 http://10.0.7.12:7001]
May 28 01:37:54 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:54.160 INFO      | Discovery fetched back peer list: [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001]
May 28 01:37:54 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:54.163 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:37:56 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:56.514 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:58 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:58.865 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:37:58 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:37:58.869 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:38:01 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:01.220 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:01 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:01.224 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:38:03 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:03.576 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:03 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:03.581 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:38:05 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:05.932 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:05 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:05.932 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001] at 0th time. Retrying in 3.9 seconds
May 28 01:38:08 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:08.935 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:38:11 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:11.287 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:13 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:13.638 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:13 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:13.641 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:38:15 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:15.993 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:15 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:15.997 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:38:18 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:18.348 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:18 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:18.360 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:38:20 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:20.712 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:20 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:20.712 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001] at 1th time. Retrying in 3.9 seconds
May 28 01:38:23 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:23.714 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:prefs.cc(54)] certificate-report-to-send-update not present in /var/lib/update_engine/prefs
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:prefs.cc(54)] certificate-report-to-send-download not present in /var/lib/update_engine/prefs
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:WARNING:libpolicy.cc(29)] Could not load the device policy file.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(195)] No device policies/settings present.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(239)] Scattering disabled since scatter factor is set to 0
May 28 01:38:25 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:omaha_request_params.cc(61)] Current group set to stable
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(206)] update_disabled = false, target_version_prefix = , scatter_factor_in_seconds = 0s
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(213)] Wall Clock Based Wait Enabled = 0, Update Check Count Wait Enabled = 0, Waiting Period = 0s
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(664)] Already updated boot flags. Skipping.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(847)] Scheduling an action processor start.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:action_processor.cc(36)] ActionProcessor::StartProcessing: OmahaRequestAction
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:omaha_request_action.cc(265)] Posting an Omaha request to https://public.update.core-os.net/v1/update/
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:omaha_request_action.cc(266)] Request: <?xml version="1.0" encoding="UTF-8"?>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <request protocol="3.0" version="CoreOSUpdateEngine-0.1.0.0" updaterversion="CoreOSUpdateEngine-0.1.0.0" installsource="scheduler" ismachine="1">
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <os version="Chateau" platform="CoreOS" sp="557.2.0_x86_64"></os>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <app appid="{e96281a6-d1af-4bde-9a0a-97b76e56dc57}" version="557.2.0" track="stable" bootid="{e8b42a74-63d5-4847-b3db-e6c102b180d9}" oem="ami" oemversion="0.0.3" alephversion="557.2.0" machineid="be27db2bf3a74d4ab500441ae143ffaf" lang="en-US" board="amd64-usr" hardware_class="" delta_okay="false" >
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <ping active="1"></ping>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <updatecheck targetversionprefix=""></updatecheck>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <event eventtype="3" eventresult="2" previousversion=""></event>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: </app>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: </request>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:libcurl_http_fetcher.cc(62)] Starting/Resuming transfer
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:libcurl_http_fetcher.cc(51)] We are connected via Ethernet, Updates allowed: Yes
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:libcurl_http_fetcher.cc(185)] Setting up curl options for HTTPS
May 28 01:38:25 ip-10-0-6-12.resilient-net.net locksmithd[524]: LastCheckedTime=0 Progress=0 CurrentOperation="UPDATE_STATUS_CHECKING_FOR_UPDATE" NewVersion=0.0.0.0 NewSize=0
May 28 01:38:25 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:libcurl_http_fetcher.cc(448)] Setting up timeout source: 1 seconds.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:libcurl_http_fetcher.cc(261)] HTTP response code: 200
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:libcurl_http_fetcher.cc(318)] Transfer completed (200), 267 bytes downloaded
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:omaha_request_action.cc(588)] Omaha request response: <?xml version="1.0" encoding="UTF-8"?>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <response protocol="3.0" server="update.core-os.net">
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <daystart elapsed_seconds="0"></daystart>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <app appid="e96281a6-d1af-4bde-9a0a-97b76e56dc57" status="ok">
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: <updatecheck status="noupdate"></updatecheck>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: </app>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: </response>
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:omaha_request_action.cc(406)] No update.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:action_processor.cc(82)] ActionProcessor::ActionComplete: finished OmahaRequestAction, starting OmahaResponseHandlerAction
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:omaha_response_handler_action.cc(36)] There are no updates. Aborting.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:action_processor.cc(68)] ActionProcessor::ActionComplete: OmahaResponseHandlerAction action failed. Aborting processing.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:action_processor.cc(73)] ActionProcessor::ActionComplete: finished last action of type OmahaResponseHandlerAction
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(460)] Processing Done.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_attempter.cc(508)] No update.
May 28 01:38:25 ip-10-0-6-12.resilient-net.net update_engine[476]: [0528/013825:INFO:update_check_scheduler.cc(82)] Next update check in 43m16s
May 28 01:38:25 ip-10-0-6-12.resilient-net.net locksmithd[524]: LastCheckedTime=0 Progress=0 CurrentOperation="UPDATE_STATUS_IDLE" NewVersion=0.0.0.0 NewSize=0
May 28 01:38:26 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:26.066 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:26 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:26 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:38:26 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:26 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:38:26 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:26 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:27 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:38:28 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:38:28 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:38:28 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:28.416 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:28 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:28.419 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:38:30 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:30.771 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:30 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:30.776 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:38:33 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:33.128 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:33 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:33.131 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:38:35 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:38:35 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:38:35 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:38:35 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:35.483 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:35 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:35.483 WARNING   | lb-3 cannot connect to existing peers [10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:38:35 ip-10-0-6-12.resilient-net.net etcd[641]: [etcd] May 28 01:38:35.483 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:38:43 ip-10-0-6-12.resilient-net.net locksmithd[524]: Unlocking old locks failed: error setting up lock. Retrying in 2m40s.
May 28 01:38:45 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:38:45 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:38:45 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:38:45 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:38:45 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:45.594 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:38:45 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:45.595 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:38:45 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:45.595 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:38:46 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:46.176 INFO      | Discovery found peers [http://10.0.7.10:7001 http://10.0.7.11:7001 http://10.0.7.12:7001 http://10.0.6.10:7001 http://10.0.6.11:7001]
May 28 01:38:46 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:46.177 INFO      | Discovery fetched back peer list: [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001]
May 28 01:38:46 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:46.180 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:38:48 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:48.532 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:48 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:48.536 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:38:50 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:50.887 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:50 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:50.891 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:38:53 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:53.243 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:53 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:53.245 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:38:55 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:55.597 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:57 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:57.948 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:38:57 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:38:57.949 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001] at 0th time. Retrying in 3.8 seconds
May 28 01:39:00 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:00.953 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:39:03 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:03.313 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:03 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:03.322 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:39:05 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:05.674 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:05 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:05.678 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:39:08 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:08.030 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:08 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:08.033 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:39:10 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:10.384 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:12 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:12.735 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:12 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:12.736 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001] at 1th time. Retrying in 3.8 seconds
May 28 01:39:15 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:15.739 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:39:18 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:18.091 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:18 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:18.095 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:39:20 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:20.447 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:20 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:20.450 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:39:22 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:22.802 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:22 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:22.805 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:39:25 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:25.156 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:25 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:39:25 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:39:27 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:27.507 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:27 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:27.507 WARNING   | lb-3 cannot connect to existing peers [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:39:27 ip-10-0-6-12.resilient-net.net etcd[657]: [etcd] May 28 01:39:27.507 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:39:27 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:39:27 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:39:27 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:39:28 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:28 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:39:28 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:28 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:39:28 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:28 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:29 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:39:30 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:39:30 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:39:37 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:39:37 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:39:37 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:39:37 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:39:37 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:37.594 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:39:37 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:37.595 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:39:37 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:37.595 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:39:38 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:38.234 INFO      | Discovery found peers [http://10.0.7.10:7001 http://10.0.7.11:7001 http://10.0.7.12:7001 http://10.0.6.10:7001 http://10.0.6.11:7001]
May 28 01:39:38 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:38.235 INFO      | Discovery fetched back peer list: [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001]
May 28 01:39:38 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:38.238 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:39:40 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:40.590 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:40 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:40.593 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:39:42 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:42.945 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:42 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:42.949 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:39:45 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:45.300 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:45 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:45.303 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:39:47 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:47.655 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:50 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:50.006 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:50 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:50.007 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001] at 0th time. Retrying in 3.0 seconds
May 28 01:39:53 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:53.010 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:39:55 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:55.362 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:55 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:55.383 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:39:57 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:57.735 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:39:57 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:39:57.738 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:40:00 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:00.090 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:00 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:00.092 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:40:02 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:02.444 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:04 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:04.795 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:04 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:04.795 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001] at 1th time. Retrying in 3.0 seconds
May 28 01:40:07 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:07.800 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:40:10 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:10.152 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:10 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:10.156 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:40:12 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:12.507 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:12 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:12.510 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:40:14 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:14.862 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:14 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:14.864 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:40:17 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:17.216 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:19 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:19.567 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:19 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:19.567 WARNING   | lb-3 cannot connect to existing peers [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:40:19 ip-10-0-6-12.resilient-net.net etcd[677]: [etcd] May 28 01:40:19.568 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:40:19 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:40:19 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:40:19 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:40:29 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:40:29 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:40:29 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:40:29 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:40:29 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:40:29 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:29.605 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:40:29 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:29.605 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:40:29 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:29.605 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:40:29 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:40:30 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:30.208 INFO      | Discovery found peers [http://10.0.7.11:7001 http://10.0.7.12:7001 http://10.0.6.10:7001 http://10.0.6.11:7001 http://10.0.7.10:7001]
May 28 01:40:30 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:30.209 INFO      | Discovery fetched back peer list: [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001]
May 28 01:40:30 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:30.213 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:40:30 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:30 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:40:30 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:30 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:40:30 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:30 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:31 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:40:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:40:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:40:32 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:32.564 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:32 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:32.568 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:40:34 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:34.919 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:34 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:34.921 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:40:37 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:37.272 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:39 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:39.623 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:39 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:39.626 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:40:41 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:41.977 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:41 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:41.977 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001] at 0th time. Retrying in 4.7 seconds
May 28 01:40:45 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:45.981 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:40:48 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:48.332 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:48 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:48.336 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:40:50 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:50.688 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:50 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:50.691 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:40:53 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:53.042 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:55 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:55.393 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:55 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:55.397 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:40:57 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:57.748 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:40:57 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:40:57.749 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001] at 1th time. Retrying in 4.7 seconds
May 28 01:41:01 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:01.752 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:41:04 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:04.104 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:04 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:04.108 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:41:06 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:06.459 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:06 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:06.462 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:41:08 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:08.813 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:11 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:11.164 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:11 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:11.168 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:41:13 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:13.519 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:13 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:13.520 WARNING   | lb-3 cannot connect to existing peers [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:41:13 ip-10-0-6-12.resilient-net.net etcd[688]: [etcd] May 28 01:41:13.520 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:41:13 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:41:13 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:41:13 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:41:23 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:41:23 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:41:23 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:41:23 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:41:23 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:23.599 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:41:23 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:23.599 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:41:23 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:23.599 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:41:23 ip-10-0-6-12.resilient-net.net locksmithd[524]: Unlocking old locks failed: error setting up lock. Retrying in 5m0s.
May 28 01:41:24 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:24.326 INFO      | Discovery found peers [http://10.0.7.11:7001 http://10.0.7.12:7001 http://10.0.6.10:7001 http://10.0.6.11:7001 http://10.0.7.10:7001]
May 28 01:41:24 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:24.327 INFO      | Discovery fetched back peer list: [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001]
May 28 01:41:24 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:24.330 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:41:26 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:26.682 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:26 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:26.686 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:41:29 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:29.038 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:29 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:29.040 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:41:31 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:31.392 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:41:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:41:32 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:32 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Update /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 100ms
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 200ms
May 28 01:41:33 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:33.743 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:33 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:33.745 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:33 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 400ms
May 28 01:41:34 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO client.go:291: Failed getting response from http://localhost:4001/: dial tcp 127.0.0.1:4001: connection refused
May 28 01:41:34 ip-10-0-6-12.resilient-net.net fleetd[578]: ERROR client.go:213: Unable to get result for {Create /_coreos.com/fleet/machines/be27db2bf3a74d4ab500441ae143ffaf/object}, retrying in 800ms
May 28 01:41:35 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:41:35 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.
May 28 01:41:36 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:36.097 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:36 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:36.097 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001] at 0th time. Retrying in 4.8 seconds
May 28 01:41:40 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:40.100 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:41:42 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:42.452 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:42 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:42.456 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:41:44 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:44.807 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:44 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:44.810 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:41:47 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:47.162 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:49 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:49.512 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:49 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:49.516 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:41:51 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:51.868 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:51 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:51.868 INFO      | lb-3 is unable to join the cluster using any of the peers [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001] at 1th time. Retrying in 4.8 seconds
May 28 01:41:55 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:55.872 INFO      | Send Join Request to http://10.0.7.11:7001/join
May 28 01:41:58 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:58.224 INFO      | lb-3 attempted to join via 10.0.7.11:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:41:58 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:41:58.227 INFO      | Send Join Request to http://10.0.7.12:7001/join
May 28 01:42:00 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:00.579 INFO      | lb-3 attempted to join via 10.0.7.12:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:42:00 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:00.583 INFO      | Send Join Request to http://10.0.6.10:7001/join
May 28 01:42:02 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:02.934 INFO      | lb-3 attempted to join via 10.0.6.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:42:05 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:05.285 INFO      | lb-3 attempted to join via 10.0.6.11:7001 failed: fail checking join version: Client Internal Error (Get http://10.0.6.11:7001/version: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:42:05 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:05.288 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:42:07 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:07.640 INFO      | lb-3 attempted to join via 10.0.7.10:7001 failed: fail on join request: Client Internal Error (Put http://10.0.6.11:7001/join: dial tcp 10.0.6.11:7001: i/o timeout)
May 28 01:42:07 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:07.641 WARNING   | lb-3 cannot connect to existing peers [10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001 10.0.7.10:7001]: fail joining the cluster via given peers after 3 retries
May 28 01:42:07 ip-10-0-6-12.resilient-net.net etcd[707]: [etcd] May 28 01:42:07.641 CRITICAL  | fail joining the cluster via given peers after 3 retries
May 28 01:42:07 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE
May 28 01:42:07 ip-10-0-6-12.resilient-net.net systemd[1]: Unit etcd.service entered failed state.
May 28 01:42:07 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service failed.
May 28 01:42:17 ip-10-0-6-12.resilient-net.net systemd[1]: etcd.service holdoff time over, scheduling restart.
May 28 01:42:17 ip-10-0-6-12.resilient-net.net systemd[1]: Stopping etcd...
May 28 01:42:17 ip-10-0-6-12.resilient-net.net systemd[1]: Starting etcd...
May 28 01:42:17 ip-10-0-6-12.resilient-net.net systemd[1]: Started etcd.
May 28 01:42:17 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:17.836 INFO      | The path /var/lib/etcd/log is in btrfs
May 28 01:42:17 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:17.837 INFO      | Set NOCOW to path /var/lib/etcd/log succeeded
May 28 01:42:17 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:17.837 INFO      | Discovery via https://discovery.etcd.io using prefix /df8be5a8e3db17a5a99b62b921e51068.
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.443 INFO      | Discovery found peers [http://10.0.7.10:7001 http://10.0.7.11:7001 http://10.0.7.12:7001 http://10.0.6.10:7001 http://10.0.6.11:7001]
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.444 INFO      | Discovery fetched back peer list: [10.0.7.10:7001 10.0.7.11:7001 10.0.7.12:7001 10.0.6.10:7001 10.0.6.11:7001]
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.446 INFO      | Send Join Request to http://10.0.7.10:7001/join
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.494 INFO      | lb-3 joined the cluster via peer 10.0.7.10:7001
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.496 INFO      | etcd server [name lb-3, listen on :4001, advertised url http://10.0.6.12:4001]
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.496 INFO      | peer server [name lb-3, listen on :7001, advertised url http://10.0.6.12:7001]
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.497 INFO      | lb-3 starting in peer mode
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.497 INFO      | lb-3: state changed from 'initialized' to 'follower'.
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.540 INFO      | lb-3: state changed from 'follower' to 'snapshotting'.
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.604 INFO      | lb-3: peer added: 'tn-2'
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.609 INFO      | lb-3: peer added: 'tn-3'
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.620 INFO      | lb-3: peer added: 'lb-1'
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.625 INFO      | lb-3: peer added: 'tn-1'
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.628 INFO      | lb-3: peer added: 'lb-2'
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.691 INFO      | lb-3: state changed from 'snapshotting' to 'follower'.
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.691 INFO      | lb-3: term #38 started.
May 28 01:42:18 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:18.692 INFO      | lb-3: leader changed from '' to 'lb-2'.
May 28 01:42:21 ip-10-0-6-12.resilient-net.net etcd[726]: [etcd] May 28 01:42:21.752 INFO      | lb-3: snapshot of 17772457 events at index 17772457 completed
May 28 01:42:34 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO server.go:164: Starting server components
May 28 01:42:34 ip-10-0-6-12.resilient-net.net fleetd[578]: INFO engine.go:80: Engine leader is f1287f22734c4c088f75bc5b18ff6a2f
May 28 01:42:36 ip-10-0-6-12.resilient-net.net systemd[1]: Starting Generate /run/coreos/motd...
May 28 01:42:36 ip-10-0-6-12.resilient-net.net systemd[1]: Started Generate /run/coreos/motd.

coreos / bugs

recreated ec2 instance takes a very long time to join cluster #368