rancher / rancher

Complete container management platform
http://rancher.com
Apache License 2.0
23.23k stars 2.95k forks source link

Issue with adding Host using AWS UI in Rancher with self signed certificate - In HA Environment #4404

Closed Rucknar closed 8 years ago

Rucknar commented 8 years ago

Rancher Version: 1.0.1-rc-5 Docker Version: 1.10.1 OS: RancherOS 0.4.3 Steps to Reproduce:

Results: Hosts stuck in the first state of adding a host, no hosts appear in AWS, can't spot anything in the logs. After a while, i chose to 'delete' these hosts as they wouldn't add, this means i now have process's for each of these in the running process's tab.

screen shot 2016-04-14 at 15 08 21

I've deployed a single server alongside this (admittedly with RC7) and it can add hosts just fine. Hesitated to raising this as i'm worried it's something i've done wrong in the HA configuration. Rancher seems happy though and i've confirmed the host registration URL looks right.

Expected: AWS hosts to be added to the environment.

Rucknar commented 8 years ago

I'm going to re-deploy with 1.0.1 and re-test today, will update the ticket with my progress.

Rucknar commented 8 years ago

Rebuilt with 1.0.1 and replicated the error.

Create machine process's just timeout: screen shot 2016-04-15 at 16 07 37

The interface and API show me the below error:

io.cattle.platform.async.utils.TimeoutException
    at io.cattle.platform.async.retry.impl.RetryTimeoutServiceImpl$1.run(RetryTimeoutServiceImpl.java:51)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)

Wondering if it could be related the callback URL?

Rucknar commented 8 years ago

Just confirmed that manually adding the hosts works just fine using the 'custom' method.

Rucknar commented 8 years ago

Okay doke, managed to track this one back to https://github.com/rancher/rancher/issues/4426 Closing this ticket in favour of that one.

Rucknar commented 8 years ago

Looks like it's not related to #4426 I've done a deployment/upgrade to HA without errors now. Still having an issue with adding AWS hosts, it gets further now. Current state of play is that the host is created in AWS, but the agent never makes contact to the host. It might be the agent doesn't get deployed at all.

OS: RancherOS 0.4.4 
Zone: EU-West1b
screen shot 2016-04-19 at 21 55 21

^ What i see in Rancher

screen shot 2016-04-19 at 21 55 36

^ noticed there isn't any userdata listed, is that correct?

System Log:

pports 2 MCE banks
[    0.055021] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[    0.058002] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[    0.062192] Freeing SMP alternatives memory: 16K (ffffffff81c20000 - ffffffff81c24000)
[    0.066660] ftrace: allocating 28061 entries in 110 pages
[    0.091397] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.094003] Switched APIC routing to physical flat.
[    0.097000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.111401] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.115020] installing Xen timer for CPU 0
[    0.117063] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz (fam: 06, model: 3f, stepping: 02)
[    0.120037] cpu 0 spinlock event irq 53
[    0.121033] Performance Events: unsupported p6 CPU model 63 no PMU driver, software events only.
[    0.124639] NMI watchdog: disabled (cpu0): hardware events not enabled
[    0.125006] NMI watchdog: Shutting down hard lockup detector on all cpus
[    0.126063] installing Xen timer for CPU 1
[    0.127054] x86: Booting SMP configuration:
[    0.128006] .... node  #0, CPUs:        #1cpu 1 spinlock event irq 59
[    0.133017] x86: Booted up 1 node, 2 CPUs
[    0.134004] smpboot: Total of 2 processors activated (9600.23 BogoMIPS)
[    0.135358] devtmpfs: initialized
[    0.139744] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.140055] pinctrl core: initialized pinctrl subsystem
[    0.141199] NET: Registered protocol family 16
[    0.146005] cpuidle: using governor ladder
[    0.151004] cpuidle: using governor menu
[    0.153090] ACPI: bus type PCI registered
[    0.155006] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.157061] dca service started, version 1.12.1
[    0.159248] PCI: Using configuration type 1 for base access
[    0.166067] ACPI: Added _OSI(Module Device)
[    0.167013] ACPI: Added _OSI(Processor Device)
[    0.168007] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.169003] ACPI: Added _OSI(Processor Aggregator Device)
[    0.174617] ACPI: Interpreter enabled
[    0.175009] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150619/hwxface-580)
[    0.177979] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150619/hwxface-580)
[    0.179978] ACPI: (supports S0 S3 S4 S5)
[    0.180008] ACPI: Using IOAPIC for interrupt routing
[    0.181045] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.223603] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.224015] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[    0.225010] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.226055] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.227830] acpiphp: Slot [0] registered
[    0.228790] acpiphp: Slot [3] registered
[    0.229276] acpiphp: Slot [4] registered
[    0.230303] acpiphp: Slot [5] registered
[    0.231278] acpiphp: Slot [6] registered
[    0.232249] acpiphp: Slot [7] registered
[    0.233320] acpiphp: Slot [8] registered
[    0.234255] acpiphp: Slot [9] registered
[    0.235294] acpiphp: Slot [10] registered
[    0.236298] acpiphp: Slot [11] registered
[    0.237255] acpiphp: Slot [12] registered
[    0.238282] acpiphp: Slot [13] registered
[    0.239274] acpiphp: Slot [14] registered
[    0.240271] acpiphp: Slot [15] registered
[    0.241264] acpiphp: Slot [16] registered
[    0.242265] acpiphp: Slot [17] registered
[    0.243242] acpiphp: Slot [18] registered
[    0.244273] acpiphp: Slot [19] registered
[    0.245269] acpiphp: Slot [20] registered
[    0.246278] acpiphp: Slot [21] registered
[    0.247271] acpiphp: Slot [22] registered
[    0.248260] acpiphp: Slot [23] registered
[    0.249274] acpiphp: Slot [24] registered
[    0.250265] acpiphp: Slot [25] registered
[    0.251273] acpiphp: Slot [26] registered
[    0.252263] acpiphp: Slot [27] registered
[    0.253276] acpiphp: Slot [28] registered
[    0.254265] acpiphp: Slot [29] registered
[    0.255281] acpiphp: Slot [30] registered
[    0.256281] acpiphp: Slot [31] registered
[    0.257302] PCI host bridge to bus 0000:00
[    0.258006] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.259005] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.260008] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.261008] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.262005] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window]
[    0.268150] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.269004] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.270003] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.271008] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.272616] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
[    0.272616] * this clock source is slow. Consider trying other clock sources
[    0.274064] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.280767] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[    0.281934] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.282976] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.284000] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[    0.299000] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.299063] xen:balloon: Initialising balloon driver
[    0.303028] xen_balloon: Initialising balloon driver
[    0.306030] init_memory_mapping: [mem 0x210000000-0x217ffffff]
[    0.305097] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.305098] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.305099] vgaarb: loaded
[    0.305100] vgaarb: bridge control possible 0000:00:02.0
[    0.311000] SCSI subsystem initialized
[    0.313037] ACPI: bus type USB registered
[    0.314028] usbcore: registered new interface driver usbfs
[    0.315012] usbcore: registered new interface driver hub
[    0.316025] usbcore: registered new device driver usb
[    0.317082] PCI: Using ACPI for IRQ routing
[    0.318580] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.319018] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.320615] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[    0.322029] clocksource: Switched to clocksource xen
[    0.329946] pnp: PnP ACPI init
[    0.331485] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[    0.334922] system 00:01: [io  0x08a0-0x08a3] has been reserved
[    0.337628] system 00:01: [io  0x0cc0-0x0ccf] has been reserved
[    0.340201] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.343170] system 00:07: [io  0x10c0-0x1141] has been reserved
[    0.345939] system 00:07: [io  0xb044-0xb047] has been reserved
[    0.364074] pnp: PnP ACPI: found 8 devices
[    0.373461] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.377748] NET: Registered protocol family 2
[    0.379838] TCP established hash table entries: 65536 (order: 7, 524288 bytes)
[    0.383168] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.386161] TCP: Hash tables configured (established 65536 bind 65536)
[    0.389129] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.391931] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.394893] NET: Registered protocol family 1
[    0.396840] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.399350] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.402125] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.405019] Unpacking initramfs...
[    4.586087] random: nonblocking pool is initialized
[    5.295797] Freeing initrd memory: 27236K (ffff880034abe000 - ffff880036557000)
[    5.299464] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.302415] software IO TLB [mem 0xec000000-0xf0000000] (64MB) mapped at [ffff8800ec000000-ffff8800efffffff]
[    5.307088] RAPL PMU detected, API unit is 2^-32 Joules, 3 fixed counters 655360 ms ovfl timer
[    5.310967] hw unit of domain pp0-core 2^-14 Joules
[    5.313261] hw unit of domain package 2^-14 Joules
[    5.315470] hw unit of domain dram 2^-16 Joules
[    5.318179] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    5.321051] Initialise system trusted keyring
[    5.323316] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    5.327463] zpool: loaded
[    5.328844] VFS: Disk quotas dquot_6.6.0
[    5.330742] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    5.334756] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    5.338027] io scheduler noop registered
[    5.339852] io scheduler deadline registered
[    5.341851] io scheduler cfq registered (default)
[    5.344124] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    5.346659] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    5.363153] Console: switching to colour frame buffer device 100x37
[    5.367261] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    5.370587] ACPI: Power Button [PWRF]
[    5.372310] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
[    5.375707] ACPI: Sleep Button [SLPF]
[    5.377663] GHES: HEST is not enabled!
[    5.379324] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    5.382455] xen:grant_table: Grant tables using version 1 layout
[    5.385121] Grant table initialized
[    5.386806] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    5.389324] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    5.418826] 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    5.422863] Linux agpgart interface v0.103
[    5.424798] [drm] Initialized drm 1.1.0 20060810
[    5.427154] tun: Universal TUN/TAP device driver, 1.6
[    5.429473] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    5.432495] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.435717] ehci-pci: EHCI PCI platform driver
[    5.437670] ehci-platform: EHCI generic platform driver
[    5.439936] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[    5.445384] serio: i8042 KBD port at 0x60,0x64 irq 1
[    5.447523] serio: i8042 AUX port at 0x60,0x64 irq 12
[    5.450271] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    5.450656] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2
[    5.457050] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[    5.460158] sdhci: Secure Digital Host Controller Interface driver
[    5.462914] sdhci: Copyright(c) Pierre Ossman
[    5.465165] NET: Registered protocol family 10
[    5.467441] NET: Registered protocol family 17
[    5.469501] 9pnet: Installing 9P2000 support
[    5.471722] Loading compiled-in X.509 certificates
[    5.473972] registered taskstats version 1
[    5.475870] zswap: loading zswap
[    5.477525] zpool: no driver for type zbud
[    5.479461] zswap: zbud zpool not available
[    5.481354] zswap: zpool creation failed
[    6.306108] tsc: Refined TSC clocksource calibration: 2399.998 MHz
[    6.308893] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns
[   10.583104] xenbus_probe_frontend: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...
[   35.488611] 
[   35.489646] xenbus_probe_frontend: Timeout connecting to device: device/vfb/0 (local state 3, remote state 1)
[   35.494926] xenbus_probe_frontend: Device with no driver: device/vbd/768
[   35.498447] xenbus_probe_frontend: Device with no driver: device/vif/0
[   35.502122] rtc_cmos 00:02: setting system clock to 2016-04-19 20:38:50 UTC (1461098330)
[   35.507574] Freeing unused kernel memory: 1264K (ffffffff81ae4000 - ffffffff81c20000)
[   35.511516] Write protecting the kernel read-only data: 10240k
[   35.514813] Freeing unused kernel memory: 324K (ffff8800015af000 - ffff880001600000)
[   35.519103] Freeing unused kernel memory: 956K (ffff880001911000 - ffff880001a00000)
INFO[0000] Launching Bootstrap Docker                   
[   35.605802] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.
INFO[0000] Set 127.0.0.1/8 on lo                        
INFO[0000] Waiting for Docker at unix:///var/run/system-docker.sock 
[   35.651227] Bridge firewalling registered
[   35.654731] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[   35.659767] ip_tables: (C) 2000-2006 Netfilter Core Team
INFO[0000] Connected to Docker at unix:///var/run/system-docker.sock 
INFO[0000] Loading images from /usr/share/ros/images.tar 
INFO[0001] Done loading images from /usr/share/ros/images.tar 
INFO[0001] Running Bootstrap services                   
INFO[0001] Project [bootstrap]: Starting project        
INFO[0001] [0/2] [udev-bootstrap]: Starting             
[   37.288513] cgroup: docker (101) created nested cgroup for controller "memory" which has incomplete hierarchy support. Nested cgroups may change behavior in the future.
[   37.296502] cgroup: "memory" requires setting use_hierarchy to 1 on the root
[   37.327759] udevd[8]: starting version 3.1.5
[   37.354935] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[   37.359509] microcode: CPU0 sig=0x306f2, pf=0x1, revision=0x25
[   37.363011] microcode: CPU1 sig=0x306f2, pf=0x1, revision=0x25
[   37.366378] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[   37.372906] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[   37.377745] xen_netfront: Initialising Xen virtual ethernet driver
[   37.380986] scsi host0: ata_piix
[   37.382895] scsi host1: ata_piix
[   37.384675] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[   37.388158] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[   37.394394] AVX2 version of gcm_enc/dec engaged.
[   37.397033] AES CTR mode by8 optimization enabled
[   37.423700] mousedev: PS/2 mouse device common for all mice
[   37.428818] blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
[   37.435557]  xvda: xvda1
[   38.068838] udevd[26]: starting version 3.1.5
INFO[0002] [1/2] [udev-bootstrap]: Started              
INFO[0002] [1/2] [state-script]: Starting               
INFO[0002] [2/2] [state-script]: Started                
INFO[0002] Project [bootstrap]: Project started         
INFO[0002] Mounting state device /dev/xvda1 to /state   
[   38.552875] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null)
INFO[0003] Launching System Docker                      
INFO[0003] Set 172.18.42.1/16 on docker-sys             
INFO[0000] Loading images from /usr/share/ros/images.tar 
INFO[0003] Done loading images from /usr/share/ros/images.tar 
INFO[0003] Project [os]: Starting project               
INFO[0003] [0/20] [system-volumes]: Starting            
INFO[0003] [0/20] [command-volumes]: Starting           
INFO[0003] [0/20] [container-data-volumes]: Starting    
INFO[0003] [0/20] [user-volumes]: Starting              
INFO[0003] [1/20] [system-volumes]: Started             
INFO[0003] [1/20] [syslog]: Starting                    
INFO[0003] [1/20] [udev-cold]: Starting                 
INFO[0003] [2/20] [command-volumes]: Started            
INFO[0003] [2/20] [preload-system-images]: Starting     
INFO[0003] [2/20] [acpid]: Starting                     
INFO[0003] [3/20] [container-data-volumes]: Started     
INFO[0003] [4/20] [user-volumes]: Started               
INFO[0003] [4/20] [all-volumes]: Starting               
[   43.977364] device veth3188290 entered promiscuous mode
[   43.980705] IPv6: ADDRCONF(NETDEV_UP): veth3188290: link is not ready
[   43.984217] docker-sys: port 1(veth3188290) entered forwarding state
[   43.987584] docker-sys: port 1(veth3188290) entered forwarding state
[   43.991267] docker-sys: port 1(veth3188290) entered disabled state
[   44.137304] eth0: renamed from veth0d25002
[   44.144239] IPv6: ADDRCONF(NETDEV_CHANGE): veth3188290: link becomes ready
[   44.147726] docker-sys: port 1(veth3188290) entered forwarding state
[   44.150948] docker-sys: port 1(veth3188290) entered forwarding state
[   44.209874] docker-sys: port 1(veth3188290) entered disabled state
[   44.213366] veth0d25002: renamed from eth0
[   44.291387] docker-sys: port 1(veth3188290) entered disabled state
[   44.297252] device veth3188290 left promiscuous mode
[   44.299952] docker-sys: port 1(veth3188290) entered disabled state
INFO[0005] [5/20] [preload-system-images]: Started      
INFO[0005] [5/20] [cloud-init-pre]: Starting            
INFO[0005] [6/20] [syslog]: Started                     
INFO[0005] [7/20] [all-volumes]: Started                
INFO[0005] [8/20] [acpid]: Started                      
INFO[0005] [9/20] [udev-cold]: Started                  
INFO[0005] [9/20] [udev]: Starting                      
[   44.579315] udevd[10]: starting version 3.1.5
[   45.105631] 9p: Installing v9fs 9p2000 file system support
[   45.108766] 9pnet_virtio: no channels available
INFO[0005] [10/20] [udev]: Started                      
[   45.185254] udevd[1]: starting version 3.1.5
INFO[0005] [11/20] [cloud-init-pre]: Started            
INFO[0006] [11/20] [network-pre]: Starting              
INFO[0006] [12/20] [network-pre]: Started               
INFO[0006] [12/20] [wait-for-network-pre]: Starting     
[   45.439686] device vethd5f12fd entered promiscuous mode
[   45.443560] IPv6: ADDRCONF(NETDEV_UP): vethd5f12fd: link is not ready
[   45.448930] docker-sys: port 1(vethd5f12fd) entered forwarding state
[   45.452868] docker-sys: port 1(vethd5f12fd) entered forwarding state
[   45.456660] docker-sys: port 1(vethd5f12fd) entered disabled state
[   45.651245] eth0: renamed from veth9ffc3a4
[   45.656451] IPv6: ADDRCONF(NETDEV_CHANGE): vethd5f12fd: link becomes ready
[   45.659528] docker-sys: port 1(vethd5f12fd) entered forwarding state
[   45.662345] docker-sys: port 1(vethd5f12fd) entered forwarding state
[   46.248163] IPv6: eth0: IPv6 duplicate address fe80::42:acff:fe12:1 detected!
[   46.522759] docker-sys: port 1(vethd5f12fd) entered disabled state
[   46.527949] veth9ffc3a4: renamed from eth0
[   46.558921] docker-sys: port 1(vethd5f12fd) entered disabled state
[   46.566039] device vethd5f12fd left promiscuous mode
[   46.569737] docker-sys: port 1(vethd5f12fd) entered disabled state
INFO[0007] [13/20] [wait-for-network-pre]: Started      
INFO[0007] [13/20] [ntp]: Starting                      
INFO[0007] [14/20] [ntp]: Started                       
INFO[0007] [14/20] [cloud-init]: Starting               
[   46.959233] 9pnet_virtio: no channels available
INFO[0007] [15/20] [cloud-init]: Started                
INFO[0008] [15/21] [network]: Starting                  
INFO[0008] [16/21] [network]: Started                   
INFO[0008] [16/21] [wait-for-network]: Starting         
INFO[0008] [16/21] [resizefs]: Starting                 
[   47.512418] device veth60926a4 entered promiscuous mode
[   47.514946] IPv6: ADDRCONF(NETDEV_UP): veth60926a4: link is not ready
[   47.517864] docker-sys: port 1(veth60926a4) entered forwarding state
[   47.520671] docker-sys: port 1(veth60926a4) entered forwarding state
[   47.523723] docker-sys: port 1(veth60926a4) entered disabled state
[   47.635320] eth0: renamed from veth7867a19
[   47.642386] IPv6: ADDRCONF(NETDEV_CHANGE): veth60926a4: link becomes ready
[   47.645465] docker-sys: port 1(veth60926a4) entered forwarding state
[   47.648298] docker-sys: port 1(veth60926a4) entered forwarding state
[   47.979730] veth7867a19: renamed from eth0
[   47.985143] docker-sys: port 1(veth60926a4) entered disabled state
[   48.002992] docker-sys: port 1(veth60926a4) entered disabled state
[   48.008193] device veth60926a4 left promiscuous mode
[   48.010347] docker-sys: port 1(veth60926a4) entered disabled state
INFO[0009] [17/21] [wait-for-network]: Started          
Pulling from rancher/os-resizefs
Pulling fs layer
Pulling fs layer
Pulling fs layer
Pulling fs layer
Pulling fs layer
Pulling fs layer
Waiting
Waiting
Waiting
Downloading [==================================================>]    681 B/681 B
Downloading
Download complete
Downloading [===========>                                       ] 16.38 kB/71.48 kB
Downloading
Downloading [======================>                            ] 32.77 kB/71.48 kB
Downloading
Downloading [==================================>                ] 49.15 kB/71.48 kB
Downloading
Downloading [=============================================>     ] 65.54 kB/71.48 kB
Downloading
Downloading [==================================================>] 71.48 kB/71.48 kB
Downloading
Verifying Checksum
Download complete
Downloading [>                                                  ] 529.7 kB/65.69 MB
Downloading
Downloading [>                                                  ] 1.066 MB/65.69 MB
Downloading
Downloading [=>                                                 ] 1.607 MB/65.69 MB
Downloading
Downloading [=>                                                 ] 2.148 MB/65.69 MB
Downloading
Downloading [==>                                                ] 2.688 MB/65.69 MB
Downloading
Downloading [==>                                                ] 3.229 MB/65.69 MB
Downloading
Downloading [==>                                                ]  3.77 MB/65.69 MB
Downloading
Downloading [===>                                               ]  4.31 MB/65.69 MB
Downloading
Downloading [===>                                               ] 4.851 MB/65.69 MB
Downloading
Downloading [==================================================>]     32 B/32 B
Downloading
Verifying Checksum
Download complete
Downloading [====>                                              ] 5.392 MB/65.69 MB
Downloading
Downloading [====>                                              ] 5.932 MB/65.69 MB
Downloading
Downloading [====>                                              ] 6.473 MB/65.69 MB
Downloading
Downloading [=====>                                             ] 7.014 MB/65.69 MB
Downloading
Downloading [=====>                                             ] 7.554 MB/65.69 MB
Downloading
Downloading [======>                                            ] 8.095 MB/65.69 MB
Downloading
Downloading [======>                                            ] 8.636 MB/65.69 MB
Downloading
Downloading [======>                                            ] 9.176 MB/65.69 MB
Downloading
Downloading [=======>                                           ] 9.717 MB/65.69 MB
Downloading
Downloading [=======>                                           ] 10.26 MB/65.69 MB
Downloading
Downloading [========>                                          ]  10.8 MB/65.69 MB
Downloading
Downloading [========>                                          ] 11.34 MB/65.69 MB
Downloading
Downloading [=========>                                         ] 11.88 MB/65.69 MB
Downloading
Downloading [=========>                                         ] 12.42 MB/65.69 MB
Downloading
Downloading [=========>                                         ] 12.96 MB/65.69 MB
Downloading
Downloading [==========>                                        ]  13.5 MB/65.69 MB
Downloading
Downloading [==========>                                        ] 14.04 MB/65.69 MB
Downloading
Downloading [===========>                                       ] 14.58 MB/65.69 MB
Downloading
Downloading [===========>                                       ] 15.12 MB/65.69 MB
Downloading
Downloading [===========>                                       ] 15.66 MB/65.69 MB
Downloading
Downloading [>                                                  ]  83.9 kB/7.637 MB
Downloading
Downloading [=>                                                 ] 165.8 kB/7.637 MB
Downloading
Downloading [============>                                      ] 16.21 MB/65.69 MB
Downloading
Downloading [=>                                                 ] 247.7 kB/7.637 MB
Downloading
Downloading [==>                                                ] 329.7 kB/7.637 MB
Downloading
Downloading [==>                                                ] 411.6 kB/7.637 MB
Downloading
Downloading [============>                                      ] 16.75 MB/65.69 MB
Downloading
Downloading [===>                                               ] 493.5 kB/7.637 MB
Downloading
Downloading [===>                                               ] 575.4 kB/7.637 MB
Downloading
Downloading [====>                                              ] 657.3 kB/7.637 MB
Downloading
Downloading [====>                                              ] 739.3 kB/7.637 MB
Downloading
Downloading [=====>                                             ] 821.2 kB/7.637 MB
Downloading
Downloading [=============>                                     ] 17.29 MB/65.69 MB
Downloading
Downloading [=====>                                             ] 903.1 kB/7.637 MB
Downloading
Downloading [=============>                                     ] 17.83 MB/65.69 MB
Downloading
Downloading [======>                                            ]   985 kB/7.637 MB
Downloading
Downloading [======>                                            ] 1.067 MB/7.637 MB
Downloading
Downloading [=======>                                           ] 1.149 MB/7.637 MB
Downloading
Downloading [========>                                          ] 1.231 MB/7.637 MB
Downloading
Downloading [========>                                          ] 1.313 MB/7.637 MB
Downloading
Downloading [=============>                                     ] 18.37 MB/65.69 MB
Downloading
Downloading [=========>                                         ] 1.395 MB/7.637 MB
Downloading
Downloading [=========>                                         ] 1.477 MB/7.637 MB
Downloading
Downloading [==========>                                        ] 1.558 MB/7.637 MB
Downloading
Downloading [==========>                                        ]  1.64 MB/7.637 MB
Downloading
Downloading [===========>                                       ] 1.722 MB/7.637 MB
Downloading
Downloading [===========>                                       ] 1.804 MB/7.637 MB
Downloading
Downloading [==============>                                    ] 18.91 MB/65.69 MB
Downloading
Downloading [============>                                      ] 1.886 MB/7.637 MB
Downloading
Downloading [============>                                      ] 1.968 MB/7.637 MB
Downloading
Downloading [=============>                                     ]  2.05 MB/7.637 MB
Downloading
Downloading [=============>                                     ] 2.132 MB/7.637 MB
Downloading
Downloading [==============>                                    ] 2.214 MB/7.637 MB
Downloading
Downloading [===============>                                   ] 2.296 MB/7.637 MB
Downloading
Downloading [==================================================>]    440 B/440 B
Downloading
Verifying Checksum
Download complete
Downloading [===============>                                   ] 2.378 MB/7.637 MB
Downloading
Downloading [================>                                  ]  2.46 MB/7.637 MB
Downloading
Downloading [==============>                                    ] 19.45 MB/65.69 MB
Downloading
Downloading [================>                                  ] 2.542 MB/7.637 MB
Downloading
Downloading [=================>                                 ] 2.623 MB/7.637 MB
Downloading
Downloading [=================>                                 ] 2.705 MB/7.637 MB
Downloading
Downloading [==================>                                ] 2.787 MB/7.637 MB
Downloading
Downloading [==================>                                ] 2.869 MB/7.637 MB
Downloading
Downloading [===================>                               ] 2.951 MB/7.637 MB
Downloading
Downloading [===================>                               ] 3.033 MB/7.637 MB
Downloading
Downloading [====================>                              ] 3.115 MB/7.637 MB
Downloading
Downloading [====================>                              ] 3.197 MB/7.637 MB
Downloading
Downloading [=====================>                             ] 3.279 MB/7.637 MB
Downloading
Downloading [===============>                                   ] 19.99 MB/65.69 MB
Downloading
Downloading [======================>                            ] 3.361 MB/7.637 MB
Downloading
Downloading [======================>                            ] 3.443 MB/7.637 MB
Downloading
Downloading [=======================>                           ] 3.525 MB/7.637 MB
Downloading
Downloading [=======================>                           ] 3.606 MB/7.637 MB
Downloading
Downloading [========================>                          ] 3.688 MB/7.637 MB
Downloading
Downloading [========================>                          ]  3.77 MB/7.637 MB
Downloading
Downloading [=========================>                         ] 3.852 MB/7.637 MB
Downloading
Downloading [=========================>                         ] 3.934 MB/7.637 MB
Downloading
Downloading [==========================>                        ] 4.016 MB/7.637 MB
Downloading
Downloading [===============>                                   ] 20.53 MB/65.69 MB
Downloading
Downloading [==========================>                        ] 4.098 MB/7.637 MB
Downloading
Downloading [===========================>                       ]  4.18 MB/7.637 MB
Downloading
Downloading [===========================>                       ] 4.262 MB/7.637 MB
Downloading
Downloading [============================>                      ] 4.344 MB/7.637 MB
Downloading
Downloading [============================>                      ] 4.426 MB/7.637 MB
Downloading
Downloading [=============================>                     ] 4.508 MB/7.637 MB
Downloading
Downloading [==============================>                    ]  4.59 MB/7.637 MB
Downloading
Downloading [==============================>                    ] 4.671 MB/7.637 MB
Downloading
Downloading [===============================>                   ] 4.753 MB/7.637 MB
Downloading
Downloading [===============================>                   ] 4.835 MB/7.637 MB
Downloading
Downloading [================================>                  ] 4.917 MB/7.637 MB
Downloading
Downloading [================================>                  ] 4.999 MB/7.637 MB
Downloading
Downloading [=================================>                 ] 5.081 MB/7.637 MB
Downloading
Downloading [================>                                  ] 21.07 MB/65.69 MB
Downloading
Downloading [=================================>                 ] 5.163 MB/7.637 MB
Downloading
Downloading [==================================>                ] 5.245 MB/7.637 MB
Downloading
Downloading [==================================>                ] 5.327 MB/7.637 MB
Downloading
Downloading [===================================>               ] 5.409 MB/7.637 MB
Downloading
Downloading [===================================>               ] 5.491 MB/7.637 MB
Downloading
Downloading [====================================>              ] 5.573 MB/7.637 MB
Downloading
Downloading [=====================================>             ] 5.654 MB/7.637 MB
Downloading
Downloading [=====================================>             ] 5.736 MB/7.637 MB
Downloading
Downloading [======================================>            ] 5.818 MB/7.637 MB
Downloading
Downloading [======================================>            ]   5.9 MB/7.637 MB
Downloading
Downloading [=======================================>           ] 5.982 MB/7.637 MB
Downloading
Downloading [=======================================>           ] 6.064 MB/7.637 MB
Downloading
Downloading [========================================>          ] 6.146 MB/7.637 MB
Downloading
Downloading [================>                                  ] 21.61 MB/65.69 MB
Downloading
Downloading [========================================>          ] 6.228 MB/7.637 MB
Downloading
Downloading [=========================================>         ]  6.31 MB/7.637 MB
Downloading
Downloading [=========================================>         ] 6.392 MB/7.637 MB
Downloading
Downloading [==========================================>        ] 6.556 MB/7.637 MB
Downloading
Downloading [===========================================>       ] 6.638 MB/7.637 MB
Downloading
Downloading [===========================================>       ] 6.719 MB/7.637 MB
Downloading
Downloading [============================================>      ] 6.801 MB/7.637 MB
Downloading
Downloading [=============================================>     ] 6.883 MB/7.637 MB
Downloading
Downloading [=============================================>     ] 6.965 MB/7.637 MB
Downloading
Downloading [==============================================>    ] 7.047 MB/7.637 MB
Downloading
Downloading [==============================================>    ] 7.129 MB/7.637 MB
Downloading
Downloading [===============================================>   ] 7.211 MB/7.637 MB
Downloading
Downloading [===============================================>   ] 7.293 MB/7.637 MB
Downloading
Downloading [================>                                  ] 22.15 MB/65.69 MB
Downloading
Downloading [================================================>  ] 7.375 MB/7.637 MB
Downloading
Downloading [================================================>  ] 7.457 MB/7.637 MB
Downloading
Downloading [=================================================> ] 7.539 MB/7.637 MB
Downloading
Downloading [=================================================> ] 7.621 MB/7.637 MB
Downloading
Verifying Checksum
Download complete
Downloading [=================>                                 ] 22.69 MB/65.69 MB
Downloading
Downloading [=================>                                 ] 23.23 MB/65.69 MB
Downloading
Downloading [==================>                                ] 23.77 MB/65.69 MB
Downloading
Downloading [==================>                                ] 24.32 MB/65.69 MB
Downloading
Downloading [==================>                                ] 24.86 MB/65.69 MB
Downloading
Downloading [===================>                               ]  25.4 MB/65.69 MB
Downloading
Downloading [===================>                               ] 25.94 MB/65.69 MB
Downloading
Downloading [====================>                              ] 26.48 MB/65.69 MB
Downloading
Downloading [====================>                              ] 27.02 MB/65.69 MB
Downloading
Downloading [====================>                              ] 27.56 MB/65.69 MB
Downloading
Downloading [=====================>                             ]  28.1 MB/65.69 MB
Downloading
Downloading [=====================>                             ] 28.64 MB/65.69 MB
Downloading
Downloading [======================>                            ] 29.18 MB/65.69 MB
Downloading
Downloading [======================>                            ] 29.72 MB/65.69 MB
Downloading
Downloading [=======================>                           ] 30.26 MB/65.69 MB
Downloading
Downloading [=======================>                           ]  30.8 MB/65.69 MB
Downloading
Downloading [=======================>                           ] 31.34 MB/65.69 MB
Downloading
Downloading [========================>                          ] 31.88 MB/65.69 MB
Downloading
Downloading [========================>                          ] 32.43 MB/65.69 MB
Downloading
Downloading [=========================>                         ] 32.97 MB/65.69 MB
Downloading
Downloading [=========================>                         ] 33.51 MB/65.69 MB
Downloading
Downloading [=========================>                         ] 34.05 MB/65.69 MB
Downloading
Downloading [==========================>                        ] 34.59 MB/65.69 MB
Downloading
Downloading [==========================>                        ] 35.13 MB/65.69 MB
Downloading
Downloading [===========================>                       ] 35.67 MB/65.69 MB
Downloading
Downloading [===========================>                       ] 36.21 MB/65.69 MB
Downloading
Downloading [===========================>                       ] 36.75 MB/65.69 MB
Downloading
Downloading [============================>                      ] 37.29 MB/65.69 MB
Downloading
Downloading [============================>                      ] 37.83 MB/65.69 MB
Downloading
Downloading [=============================>                     ] 38.37 MB/65.69 MB
Downloading
Downloading [=============================>                     ] 38.91 MB/65.69 MB
Downloading
Downloading [==============================>                    ] 39.45 MB/65.69 MB
Downloading
Downloading [==============================>                    ] 39.99 MB/65.69 MB
Downloading
Downloading [==============================>                    ] 40.54 MB/65.69 MB
Downloading
Downloading [===============================>                   ] 41.08 MB/65.69 MB
Downloading
Downloading [===============================>                   ] 41.62 MB/65.69 MB
Downloading
Downloading [================================>                  ] 42.16 MB/65.69 MB
Downloading
Downloading [================================>                  ]  42.7 MB/65.69 MB
Downloading
Downloading [================================>                  ] 43.24 MB/65.69 MB
Downloading
Downloading [=================================>                 ] 43.78 MB/65.69 MB
Downloading
Downloading [=================================>                 ] 44.32 MB/65.69 MB
Downloading
Downloading [==================================>                ] 44.86 MB/65.69 MB
Downloading
Downloading [==================================>                ]  45.4 MB/65.69 MB
Downloading
Downloading [==================================>                ] 45.94 MB/65.69 MB
Downloading
Downloading [===================================>               ] 46.48 MB/65.69 MB
Downloading
Downloading [===================================>               ] 47.02 MB/65.69 MB
Downloading
Downloading [====================================>              ] 47.56 MB/65.69 MB
Downloading
Downloading [====================================>              ]  48.1 MB/65.69 MB
Downloading
Downloading [=====================================>             ] 48.65 MB/65.69 MB
Downloading
Downloading [=====================================>             ] 49.19 MB/65.69 MB
Downloading
Downloading [=====================================>             ] 49.73 MB/65.69 MB
Downloading
Downloading [======================================>            ] 50.27 MB/65.69 MB
Downloading
Downloading [======================================>            ] 50.81 MB/65.69 MB
Downloading
Downloading [=======================================>           ] 51.35 MB/65.69 MB
Downloading
Downloading [=======================================>           ] 51.89 MB/65.69 MB
Downloading
Downloading [=======================================>           ] 52.43 MB/65.69 MB
Downloading
Downloading [========================================>          ] 52.97 MB/65.69 MB
Downloading
Downloading [========================================>          ] 53.51 MB/65.69 MB
Downloading
Downloading [=========================================>         ] 54.05 MB/65.69 MB
Downloading
Downloading [=========================================>         ] 54.59 MB/65.69 MB
Downloading
Downloading [=========================================>         ] 55.13 MB/65.69 MB
Downloading
Downloading [==========================================>        ] 55.67 MB/65.69 MB
Downloading
Downloading [==========================================>        ] 56.21 MB/65.69 MB
Downloading
Downloading [===========================================>       ] 56.76 MB/65.69 MB
Downloading
Downloading [===========================================>       ]  57.3 MB/65.69 MB
Downloading
Downloading [============================================>      ] 57.84 MB/65.69 MB
Downloading
Downloading [============================================>      ] 58.38 MB/65.69 MB
Downloading
Downloading [============================================>      ] 58.92 MB/65.69 MB
Downloading
Downloading [=============================================>     ] 59.46 MB/65.69 MB
Downloading
Downloading [=============================================>     ]    60 MB/65.69 MB
Downloading
Downloading [==============================================>    ] 60.54 MB/65.69 MB
Downloading
Downloading [==============================================>    ] 61.08 MB/65.69 MB
Downloading
Downloading [==============================================>    ] 61.62 MB/65.69 MB
Downloading
Downloading [===============================================>   ] 62.16 MB/65.69 MB
Downloading
Downloading [===============================================>   ]  62.7 MB/65.69 MB
Downloading
Downloading [================================================>  ] 63.24 MB/65.69 MB
Downloading
Downloading [================================================>  ] 63.78 MB/65.69 MB
Downloading
Downloading [================================================>  ] 64.32 MB/65.69 MB
Downloading
Downloading [=================================================> ] 64.87 MB/65.69 MB
Downloading
Downloading [=================================================> ] 65.41 MB/65.69 MB
Downloading
Verifying Checksum
Download complete
Extracting [>                                                  ] 557.1 kB/65.69 MB
Extracting
Extracting [>                                                  ] 1.114 MB/65.69 MB
Extracting
Extracting [=>                                                 ] 1.671 MB/65.69 MB
Extracting
Extracting [=>                                                 ] 2.228 MB/65.69 MB
Extracting
Extracting [==>                                                ] 2.785 MB/65.69 MB
Extracting
Extracting [==>                                                ] 3.342 MB/65.69 MB
Extracting
Extracting [==>                                                ] 3.899 MB/65.69 MB
Extracting
Extracting [===>                                               ] 4.456 MB/65.69 MB
Extracting
Extracting [===>                                               ] 5.014 MB/65.69 MB
Extracting
Extracting [====>                                              ] 5.571 MB/65.69 MB
Extracting
Extracting [====>                                              ] 6.128 MB/65.69 MB
Extracting
Extracting [=====>                                             ] 6.685 MB/65.69 MB
Extracting
Extracting [=====>                                             ] 7.242 MB/65.69 MB
Extracting
Extracting [=====>                                             ] 7.799 MB/65.69 MB
Extracting
Extracting [======>                                            ] 8.356 MB/65.69 MB
Extracting
Extracting [======>                                            ] 8.913 MB/65.69 MB
Extracting
Extracting [=======>                                           ]  9.47 MB/65.69 MB
Extracting
Extracting [=======>                                           ] 10.03 MB/65.69 MB
Extracting
Extracting [========>                                          ] 10.58 MB/65.69 MB
Extracting
Extracting [========>                                          ] 11.14 MB/65.69 MB
Extracting
Extracting [========>                                          ]  11.7 MB/65.69 MB
Extracting
Extracting [=========>                                         ] 12.26 MB/65.69 MB
Extracting
Extracting [=========>                                         ] 12.81 MB/65.69 MB
Extracting
Extracting [==========>                                        ] 13.37 MB/65.69 MB
Extracting
Extracting [==========>                                        ] 13.93 MB/65.69 MB
Extracting
Extracting [===========>                                       ] 14.48 MB/65.69 MB
Extracting
Extracting [===========>                                       ] 15.04 MB/65.69 MB
Extracting
Extracting [===========>                                       ]  15.6 MB/65.69 MB
Extracting
Extracting [============>                                      ] 16.15 MB/65.69 MB
Extracting
Extracting [============>                                      ] 16.71 MB/65.69 MB
Extracting
Extracting [=============>                                     ] 17.27 MB/65.69 MB
Extracting
Extracting [=============>                                     ] 17.83 MB/65.69 MB
Extracting
Extracting [=============>                                     ] 18.38 MB/65.69 MB
Extracting
Extracting [==============>                                    ] 18.94 MB/65.69 MB
Extracting
Extracting [==============>                                    ]  19.5 MB/65.69 MB
Extracting
Extracting [===============>                                   ] 20.05 MB/65.69 MB
Extracting
Extracting [===============>                                   ] 20.61 MB/65.69 MB
Extracting
Extracting [================>                                  ] 21.17 MB/65.69 MB
Extracting
Extracting [================>                                  ] 21.73 MB/65.69 MB
Extracting
Extracting [================>                                  ] 22.28 MB/65.69 MB
Extracting
Extracting [=================>                                 ] 22.84 MB/65.69 MB
Extracting
Extracting [=================>                                 ]  23.4 MB/65.69 MB
Extracting
Extracting [==================>                                ] 23.95 MB/65.69 MB
Extracting
Extracting [==================>                                ] 24.51 MB/65.69 MB
Extracting
Extracting [===================>                               ] 25.07 MB/65.69 MB
Extracting
Extracting [===================>                               ] 25.62 MB/65.69 MB
Extracting
Extracting [===================>                               ] 26.18 MB/65.69 MB
Extracting
Extracting [====================>                              ] 26.74 MB/65.69 MB
Extracting
Extracting [====================>                              ]  27.3 MB/65.69 MB
Extracting
Extracting [=====================>                             ] 27.85 MB/65.69 MB
Extracting
Extracting [=====================>                             ] 28.41 MB/65.69 MB
Extracting
Extracting [======================>                            ] 28.97 MB/65.69 MB
Extracting
Extracting [======================>                            ] 29.52 MB/65.69 MB
Extracting
Extracting [======================>                            ] 30.08 MB/65.69 MB
Extracting
Extracting [=======================>                           ] 30.64 MB/65.69 MB
Extracting
Extracting [=======================>                           ]  31.2 MB/65.69 MB
Extracting
Extracting [========================>                          ] 31.75 MB/65.69 MB
Extracting
Extracting [========================>                          ] 32.31 MB/65.69 MB
Extracting
Extracting [=========================>                         ] 32.87 MB/65.69 MB
Extracting
Extracting [=========================>                         ] 33.42 MB/65.69 MB
Extracting
Extracting [=========================>                         ] 33.98 MB/65.69 MB
Extracting
Extracting [==========================>                        ] 34.54 MB/65.69 MB
Extracting
Extracting [==========================>                        ] 35.09 MB/65.69 MB
Extracting
Extracting [===========================>                       ] 35.65 MB/65.69 MB
Extracting
Extracting [===========================>                       ] 36.21 MB/65.69 MB
Extracting
Extracting [===========================>                       ] 36.77 MB/65.69 MB
Extracting
Extracting [============================>                      ] 37.32 MB/65.69 MB
Extracting
Extracting [============================>                      ] 37.88 MB/65.69 MB
Extracting
Extracting [=============================>                     ] 38.44 MB/65.69 MB
Extracting
Extracting [=============================>                     ] 38.99 MB/65.69 MB
Extracting
Extracting [==============================>                    ] 39.55 MB/65.69 MB
Extracting
Extracting [==============================>                    ] 40.11 MB/65.69 MB
Extracting
Extracting [==============================>                    ] 40.67 MB/65.69 MB
Extracting
Extracting [===============================>                   ] 41.22 MB/65.69 MB
Extracting
Extracting [===============================>                   ] 41.78 MB/65.69 MB
Extracting
Extracting [================================>                  ] 42.34 MB/65.69 MB
Extracting
Extracting [================================>                  ] 42.89 MB/65.69 MB
Extracting
Extracting [=================================>                 ] 43.45 MB/65.69 MB
Extracting
Extracting [=================================>                 ] 44.01 MB/65.69 MB
Extracting
Extracting [=================================>                 ] 44.56 MB/65.69 MB
Extracting
Extracting [==================================>                ] 45.12 MB/65.69 MB
Extracting
Extracting [==================================>                ] 45.68 MB/65.69 MB
Extracting
Extracting [===================================>               ] 46.24 MB/65.69 MB
Extracting
Extracting [===================================>               ] 46.79 MB/65.69 MB
Extracting
Extracting [====================================>              ] 47.35 MB/65.69 MB
Extracting
Extracting [====================================>              ] 47.91 MB/65.69 MB
Extracting
Extracting [====================================>              ] 48.46 MB/65.69 MB
Extracting
Extracting [=====================================>             ] 49.02 MB/65.69 MB
Extracting
Extracting [=====================================>             ] 49.58 MB/65.69 MB
Extracting
Extracting [======================================>            ] 50.14 MB/65.69 MB
Extracting
Extracting [======================================>            ] 50.69 MB/65.69 MB
Extracting
Extracting [=======================================>           ] 51.25 MB/65.69 MB
Extracting
Extracting [=======================================>           ] 51.81 MB/65.69 MB
Extracting
Extracting [=======================================>           ] 52.36 MB/65.69 MB
Extracting
Extracting [========================================>          ] 52.92 MB/65.69 MB
Extracting
Extracting [========================================>          ] 53.48 MB/65.69 MB
Extracting
Extracting [=========================================>         ] 54.03 MB/65.69 MB
Extracting
Extracting [=========================================>         ] 54.59 MB/65.69 MB
Extracting
Extracting [=========================================>         ] 55.15 MB/65.69 MB
Extracting
Extracting [==========================================>        ] 55.71 MB/65.69 MB
Extracting
Extracting [==========================================>        ] 56.26 MB/65.69 MB
Extracting
Extracting [===========================================>       ] 56.82 MB/65.69 MB
Extracting
Extracting [===========================================>       ] 57.38 MB/65.69 MB
Extracting
Extracting [============================================>      ] 57.93 MB/65.69 MB
Extracting
Extracting [============================================>      ] 58.49 MB/65.69 MB
Extracting
Extracting [============================================>      ] 59.05 MB/65.69 MB
Extracting
Extracting [=============================================>     ]  59.6 MB/65.69 MB
Extracting
Extracting [=============================================>     ] 60.16 MB/65.69 MB
Extracting
Extracting [==============================================>    ] 60.72 MB/65.69 MB
Extracting
Extracting [==============================================>    ] 61.28 MB/65.69 MB
Extracting
Extracting [===============================================>   ] 61.83 MB/65.69 MB
Extracting
Extracting [===============================================>   ] 62.39 MB/65.69 MB
Extracting
Extracting [===============================================>   ] 62.95 MB/65.69 MB
Extracting
Extracting [================================================>  ]  63.5 MB/65.69 MB
Extracting
Extracting [================================================>  ] 64.06 MB/65.69 MB
Extracting
Extracting [=================================================> ] 64.62 MB/65.69 MB
Extracting
Extracting [=================================================> ] 65.18 MB/65.69 MB
Extracting
Extracting [==================================================>] 65.69 MB/65.69 MB
Extracting
Pull complete
Pull complete
Extracting [======================>                            ] 32.77 kB/71.48 kB
Extracting
Extracting [=============================================>     ] 65.54 kB/71.48 kB
Extracting
Extracting [==================================================>] 71.48 kB/71.48 kB
Extracting
Extracting [==================================================>] 71.48 kB/71.48 kB
Extracting
Pull complete
Pull complete
Extracting [==================================================>]    681 B/681 B
Extracting
Extracting [==================================================>]    681 B/681 B
Extracting
Pull complete
Pull complete
Extracting [==================================================>]     32 B/32 B
Extracting
Extracting [==================================================>]     32 B/32 B
Extracting
Pull complete
Pull complete
Extracting [>                                                  ]  98.3 kB/7.637 MB
Extracting
Extracting [=>                                                 ] 196.6 kB/7.637 MB
Extracting
Extracting [=>                                                 ] 294.9 kB/7.637 MB
Extracting
Extracting [==>                                                ] 393.2 kB/7.637 MB
Extracting
Extracting [===>                                               ] 491.5 kB/7.637 MB
Extracting
Extracting [===>                                               ] 589.8 kB/7.637 MB
Extracting
Extracting [====>                                              ] 688.1 kB/7.637 MB
Extracting
Extracting [=====>                                             ] 786.4 kB/7.637 MB
Extracting
Extracting [=====>                                             ] 884.7 kB/7.637 MB
Extracting
Extracting [======>                                            ]   983 kB/7.637 MB
Extracting
Extracting [=======>                                           ] 1.081 MB/7.637 MB
Extracting
Extracting [=======>                                           ]  1.18 MB/7.637 MB
Extracting
Extracting [========>                                          ] 1.278 MB/7.637 MB
Extracting
Extracting [=========>                                         ] 1.376 MB/7.637 MB
Extracting
Extracting [=========>                                         ] 1.475 MB/7.637 MB
Extracting
Extracting [==========>                                        ] 1.573 MB/7.637 MB
Extracting
Extracting [==========>                                        ] 1.671 MB/7.637 MB
Extracting
Extracting [===========>                                       ] 1.769 MB/7.637 MB
Extracting
Extracting [============>                                      ] 1.868 MB/7.637 MB
Extracting
Extracting [============>                                      ] 1.966 MB/7.637 MB
Extracting
Extracting [=============>                                     ] 2.064 MB/7.637 MB
Extracting
Extracting [==============>                                    ] 2.163 MB/7.637 MB
Extracting
Extracting [==============>                                    ] 2.261 MB/7.637 MB
Extracting
Extracting [===============>                                   ] 2.359 MB/7.637 MB
Extracting
Extracting [================>                                  ] 2.458 MB/7.637 MB
Extracting
Extracting [================>                                  ] 2.556 MB/7.637 MB
Extracting
Extracting [=================>                                 ] 2.654 MB/7.637 MB
Extracting
Extracting [==================>                                ] 2.753 MB/7.637 MB
Extracting
Extracting [==================>                                ] 2.851 MB/7.637 MB
Extracting
Extracting [===================>                               ] 2.949 MB/7.637 MB
Extracting
Extracting [===================>                               ] 3.047 MB/7.637 MB
Extracting
Extracting [====================>                              ] 3.146 MB/7.637 MB
Extracting
Extracting [=====================>                             ] 3.244 MB/7.637 MB
Extracting
Extracting [=====================>                             ] 3.342 MB/7.637 MB
Extracting
Extracting [======================>                            ] 3.441 MB/7.637 MB
Extracting
Extracting [=======================>                           ] 3.539 MB/7.637 MB
Extracting
Extracting [=======================>                           ] 3.637 MB/7.637 MB
Extracting
Extracting [========================>                          ] 3.736 MB/7.637 MB
Extracting
Extracting [=========================>                         ] 3.834 MB/7.637 MB
Extracting
Extracting [=========================>                         ] 3.932 MB/7.637 MB
Extracting
Extracting [==========================>                        ]  4.03 MB/7.637 MB
Extracting
Extracting [===========================>                       ] 4.129 MB/7.637 MB
Extracting
Extracting [===========================>                       ] 4.227 MB/7.637 MB
Extracting
Extracting [============================>                      ] 4.325 MB/7.637 MB
Extracting
Extracting [============================>                      ] 4.424 MB/7.637 MB
Extracting
Extracting [=============================>                     ] 4.522 MB/7.637 MB
Extracting
Extracting [==============================>                    ]  4.62 MB/7.637 MB
Extracting
Extracting [==============================>                    ] 4.719 MB/7.637 MB
Extracting
Extracting [===============================>                   ] 4.817 MB/7.637 MB
Extracting
Extracting [================================>                  ] 4.915 MB/7.637 MB
Extracting
Extracting [================================>                  ] 5.014 MB/7.637 MB
Extracting
Extracting [=================================>                 ] 5.112 MB/7.637 MB
Extracting
Extracting [==================================>                ]  5.21 MB/7.637 MB
Extracting
Extracting [==================================>                ] 5.308 MB/7.637 MB
Extracting
Extracting [===================================>               ] 5.407 MB/7.637 MB
Extracting
Extracting [====================================>              ] 5.505 MB/7.637 MB
Extracting
Extracting [====================================>              ] 5.603 MB/7.637 MB
Extracting
Extracting [=====================================>             ] 5.702 MB/7.637 MB
Extracting
Extracting [=====================================>             ]   5.8 MB/7.637 MB
Extracting
Extracting [======================================>            ] 5.898 MB/7.637 MB
Extracting
Extracting [=======================================>           ] 5.997 MB/7.637 MB
Extracting
Extracting [=======================================>           ] 6.095 MB/7.637 MB
Extracting
Extracting [========================================>          ] 6.193 MB/7.637 MB
Extracting
Extracting [=========================================>         ] 6.291 MB/7.637 MB
Extracting
Extracting [=========================================>         ]  6.39 MB/7.637 MB
Extracting
Extracting [==========================================>        ] 6.488 MB/7.637 MB
Extracting
Extracting [===========================================>       ] 6.586 MB/7.637 MB
Extracting
Extracting [===========================================>       ] 6.685 MB/7.637 MB
Extracting
Extracting [============================================>      ] 6.783 MB/7.637 MB
Extracting
Extracting [=============================================>     ] 6.881 MB/7.637 MB
Extracting
Extracting [=============================================>     ]  6.98 MB/7.637 MB
Extracting
Extracting [==============================================>    ] 7.078 MB/7.637 MB
Extracting
Extracting [==============================================>    ] 7.176 MB/7.637 MB
Extracting
Extracting [===============================================>   ] 7.274 MB/7.637 MB
Extracting
Extracting [================================================>  ] 7.373 MB/7.637 MB
Extracting
Extracting [================================================>  ] 7.471 MB/7.637 MB
Extracting
Extracting [=================================================> ] 7.569 MB/7.637 MB
Extracting
Extracting [==================================================>] 7.637 MB/7.637 MB
Extracting
Pull complete
Pull complete
Extracting [==================================================>]    440 B/440 B
Extracting
Extracting [==================================================>]    440 B/440 B
Extracting
Pull complete
Pull complete
Digest: sha256:94cbb830d8aa0a5d21d145b70588e792fb21210081a6cc0f69d916709570c95b
Status: Downloaded newer image for rancher/os-resizefs:v0.4.4
[   64.842878] device vethb186e69 entered promiscuous mode
[   64.845764] IPv6: ADDRCONF(NETDEV_UP): vethb186e69: link is not ready
[   64.871460] eth0: renamed from veth2ec41dd
[   64.879155] IPv6: ADDRCONF(NETDEV_CHANGE): vethb186e69: link becomes ready
[   64.882243] docker-sys: port 1(vethb186e69) entered forwarding state
[   64.885023] docker-sys: port 1(vethb186e69) entered forwarding state
[   65.277141] IPv6: eth0: IPv6 duplicate address fe80::42:acff:fe12:1 detected!
[   79.904099] docker-sys: port 1(vethb186e69) entered forwarding state
[  118.395705] EXT4-fs (xvda1): resizing filesystem from 2094474 to 15725626 blocks
[  118.694541] EXT4-fs (xvda1): resized filesystem to 15725626
[  119.039748] veth2ec41dd: renamed from eth0
[  119.045228] docker-sys: port 1(vethb186e69) entered disabled state
[  119.063882] docker-sys: port 1(vethb186e69) entered disabled state
[  119.069169] device vethb186e69 left promiscuous mode
[  119.071769] docker-sys: port 1(vethb186e69) entered disabled state
INFO[0080] [18/21] [resizefs]: Started                  
INFO[0080] [18/21] [console]: Starting                  
INFO[0080] Rebuilding console                           
INFO[0081] [19/21] [console]: Started                   
INFO[0081] [19/21] [docker]: Starting                   
INFO[0081] [19/21] [preload-user-images]: Starting      
INFO[0081] [20/21] [docker]: Started                    
[  119.801260] device veth673f58a entered promiscuous mode
[  119.803954] IPv6: ADDRCONF(NETDEV_UP): veth673f58a: link is not ready
[  119.806949] docker-sys: port 1(veth673f58a) entered forwarding state
[  119.809812] docker-sys: port 1(veth673f58a) entered forwarding state
[  119.850283] eth0: renamed from veth855663f
[  119.857345] IPv6: ADDRCONF(NETDEV_CHANGE): veth673f58a: link becomes ready
[  119.967650] veth855663f: renamed from eth0
[  119.980348] docker-sys: port 1(veth673f58a) entered disabled state
[  120.070487] docker-sys: port 1(veth673f58a) entered disabled state
[  120.076053] device veth673f58a left promiscuous mode
[  120.078548] docker-sys: port 1(veth673f58a) entered disabled state
INFO[0081] [21/21] [preload-user-images]: Started       
INFO[0081] Project [os]: Project started                
INFO[0081] RancherOS v0.4.4 started                     

RancherOS rancher /dev/ttyS0

docker-sys: 172.18.42.1 eth0: 172.31.21.11 lo: 127.0.0.1

rancher login: [  122.495337] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
[  126.884315] IPv6: ADDRCONF(NETDEV_UP): docker0: link is not ready
Rucknar commented 8 years ago

Before i spend more time going around in circles...

Is it possible for someone else to test 'add-host' for AWS in 1.0.1 when using a HA setup with a self generated SSL cert?

Rucknar commented 8 years ago

Re-confirmed, this doesn't happen on a single instance deployed to AWS, all works as planned.

aemneina commented 8 years ago

This issue is caused by an 'add host' functionality inconsistency where; when adding custom host, a ca fingerprint environmental variable is passed including key. Whereas this is missed, in the docker run command, when spinning up using a cloud provider.

aemneina commented 8 years ago

Verified this working with rancher/server:v1.1.0-dev5-rc5. Added, removed then added some more ubuntu ec2 hosts via the Rancher docker-machine functionality.