search

rancher / os

Tiny Linux distro that runs the entire OS as Docker containers
https://rancher.com/docs/os/v1.x/en/
Apache License 2.0
6.45k stars 657 forks source link

RancherOS Snapshot on AWS can't start correctly if the snapshot is spinned up in a different VPC #914

Closed Shuliyey closed 8 years ago

Shuliyey commented 8 years ago

I was success to spin up the lates HVM RancherOS image https://console.aws.amazon.com/ec2/home?region=us-west-2#launchInstanceWizard:ami=ami-4f50a72f in a VPC on AWS.

I customised the my instance, then I created a snapshot, this snapshot works fine, if it's spinned up in the same subnet. But If I try use this snapshot on a difference VPC. It seems to have network connection issues, Hence I couldn't ssh to the instance.

This is the system log I get back from AWS

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.2.8-ckt4-rancher (root@0cf8b2419650) (gcc version 4.8.4 (Ubuntu 4.8.4-2ubuntu1~14.04.1) ) #1 SMP Tue Apr 5 16:12:00 UTC 2016 ()
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-v0.4.4-rancheros console=ttyS0
[    0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[    0.000000] x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x04: 'AVX registers'
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 0x340 bytes, using 'standard' format.
[    0.000000] x86/fpu: Using 'eager' FPU context switches.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000efffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000003e08fffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] Hypervisor detected: Xen
[    0.000000] Xen version 4.2.
[    0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[    0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[    0.000000] You might have to change the root device
[    0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[    0.000000] in your root= kernel command line option
[    0.000000] e820: last_pfn = 0x3e0900 max_arch_pfn = 0x400000000
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT  
[    0.000000] e820: last_pfn = 0xf0000 max_arch_pfn = 0x400000000
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000] init_memory_mapping: [mem 0x3e0600000-0x3e07fffff]
[    0.000000] init_memory_mapping: [mem 0x3e0000000-0x3e05fffff]
[    0.000000] init_memory_mapping: [mem 0x3c0000000-0x3dfffffff]
[    0.000000] init_memory_mapping: [mem 0x00100000-0xefffffff]
[    0.000000] init_memory_mapping: [mem 0x100000000-0x3bfffffff]
[    0.000000] init_memory_mapping: [mem 0x3e0800000-0x3e08fffff]
[    0.000000] RAMDISK: [mem 0x34abe000-0x36556fff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen   )
[    0.000000] ACPI: XSDT 0x00000000FC00F5A0 000054 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: FACP 0x00000000FC00F260 0000F4 (v04 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: DSDT 0x00000000FC0035E0 00BBF6 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[    0.000000] ACPI: FACS 0x00000000FC0035A0 000040
[    0.000000] ACPI: APIC 0x00000000FC00F360 0000D8 (v02 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: HPET 0x00000000FC00F4B0 000038 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: WAET 0x00000000FC00F4F0 000028 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: SSDT 0x00000000FC00F520 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: SSDT 0x00000000FC00F560 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x00000003e08fffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x3e08f9000-0x3e08fffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x00000003e08fffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000efffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x00000003e08fffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x00000003e08fffff]
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 15 CPUs, 13 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xffffffff]
[    0.000000] e820: [mem 0xf0000000-0xfbffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on Xen HVM
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:15 nr_node_ids:1
[    0.000000] PERCPU: Embedded 33 pages/cpu @ffff8803e0200000 s94552 r8192 d32424 u262144
[    0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 3937380
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-v0.4.4-rancheros console=ttyS0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 15638668K/15999604K available (5806K kernel code, 907K rwdata, 3140K rodata, 1264K init, 880K bss, 360936K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  Build-time adjustment of leaf fanout to 64.
[    0.000000]  RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=15.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=15
[    0.000000] NR_IRQS:8448 nr_irqs:952 16
[    0.000000] xen:events: Using 2-level ABI
[    0.000000] xen:events: Xen HVM callback vector for event delivery is enabled
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    0.000000] console [ttyS0] enabled
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[    0.000000] tsc: Detected 2494.058 MHz processor
[    0.005000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4988.11 BogoMIPS (lpj=2494058)
[    0.010003] pid_max: default: 32768 minimum: 301
[    0.013008] ACPI: Core revision 20150619
[    0.021635] ACPI: All ACPI Tables successfully acquired
[    0.026208] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.034556] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.040781] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.045019] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.050280] Initializing cgroup subsys blkio
[    0.053006] Initializing cgroup subsys memory
[    0.056011] Initializing cgroup subsys devices
[    0.059004] Initializing cgroup subsys freezer
[    0.061004] Initializing cgroup subsys net_cls
[    0.064004] Initializing cgroup subsys perf_event
[    0.068007] Initializing cgroup subsys net_prio
[    0.071060] CPU: Physical Processor ID: 0
[    0.074489] mce: CPU supports 2 MCE banks
[    0.077024] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    0.080002] Last level dTLB entries: 4KB 512, 2MB 0, 4MB 0, 1GB 4
[    0.086231] Freeing SMP alternatives memory: 16K (ffffffff81c20000 - ffffffff81c24000)
[    0.092623] ftrace: allocating 28061 entries in 110 pages
[    0.122521] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.127003] Switched APIC routing to physical flat.
[    0.131000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.146602] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.153012] installing Xen timer for CPU 0
[    0.155047] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz (fam: 06, model: 3e, stepping: 04)
[    0.159011] cpu 0 spinlock event irq 53
[    0.160026] Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
[    0.163604] NMI watchdog: disabled (cpu0): hardware events not enabled
[    0.164006] NMI watchdog: Shutting down hard lockup detector on all cpus
[    0.165065] installing Xen timer for CPU 1
[    0.166055] x86: Booting SMP configuration:
[    0.167006] .... node  #0, CPUs:        #1cpu 1 spinlock event irq 59
[    0.172020] x86: Booted up 1 node, 2 CPUs
[    0.173005] smpboot: Total of 2 processors activated (9976.23 BogoMIPS)
[    0.175133] devtmpfs: initialized
[    0.181199] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.182066] pinctrl core: initialized pinctrl subsystem
[    0.183192] NET: Registered protocol family 16
[    0.188007] cpuidle: using governor ladder
[    0.194006] cpuidle: using governor menu
[    0.196092] ACPI: bus type PCI registered
[    0.199005] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.203064] dca service started, version 1.12.1
[    0.206289] PCI: Using configuration type 1 for base access
[    0.214080] ACPI: Added _OSI(Module Device)
[    0.215006] ACPI: Added _OSI(Processor Device)
[    0.216004] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.217004] ACPI: Added _OSI(Processor Aggregator Device)
[    0.222588] ACPI: Interpreter enabled
[    0.223008] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150619/hwxface-580)
[    0.226005] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150619/hwxface-580)
[    0.229013] ACPI: (supports S0 S3 S4 S5)
[    0.230004] ACPI: Using IOAPIC for interrupt routing
[    0.231024] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.276022] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.277012] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[    0.278010] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.279045] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.280851] acpiphp: Slot [0] registered
[    0.281894] acpiphp: Slot [3] registered
[    0.282328] acpiphp: Slot [4] registered
[    0.283302] acpiphp: Slot [5] registered
[    0.284314] acpiphp: Slot [6] registered
[    0.285310] acpiphp: Slot [7] registered
[    0.286314] acpiphp: Slot [8] registered
[    0.287307] acpiphp: Slot [9] registered
[    0.288310] acpiphp: Slot [10] registered
[    0.289317] acpiphp: Slot [11] registered
[    0.290303] acpiphp: Slot [12] registered
[    0.291300] acpiphp: Slot [13] registered
[    0.292303] acpiphp: Slot [14] registered
[    0.293318] acpiphp: Slot [15] registered
[    0.294316] acpiphp: Slot [16] registered
[    0.295316] acpiphp: Slot [17] registered
[    0.296312] acpiphp: Slot [18] registered
[    0.297310] acpiphp: Slot [19] registered
[    0.298305] acpiphp: Slot [20] registered
[    0.299303] acpiphp: Slot [21] registered
[    0.300325] acpiphp: Slot [22] registered
[    0.301312] acpiphp: Slot [23] registered
[    0.302308] acpiphp: Slot [24] registered
[    0.303313] acpiphp: Slot [25] registered
[    0.304307] acpiphp: Slot [26] registered
[    0.305317] acpiphp: Slot [27] registered
[    0.306307] acpiphp: Slot [28] registered
[    0.307305] acpiphp: Slot [29] registered
[    0.308306] acpiphp: Slot [30] registered
[    0.309309] acpiphp: Slot [31] registered
[    0.310314] PCI host bridge to bus 0000:00
[    0.311006] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.312005] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.313005] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.314005] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.315005] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window]
[    0.321383] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.322005] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.323005] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.324004] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.325580] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
[    0.325580] * this clock source is slow. Consider trying other clock sources
[    0.327006] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.336305] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[    0.337966] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.338971] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.339946] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[    0.356444] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.357054] xen:balloon: Initialising balloon driver
[    0.360027] xen_balloon: Initialising balloon driver
[    0.363053] init_memory_mapping: [mem 0x3e8000000-0x3efffffff]
[    0.363070] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.363071] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.363072] vgaarb: loaded
[    0.363073] vgaarb: bridge control possible 0000:00:02.0
[    0.368000] SCSI subsystem initialized
[    0.370026] ACPI: bus type USB registered
[    0.371023] usbcore: registered new interface driver usbfs
[    0.372015] usbcore: registered new interface driver hub
[    0.373029] usbcore: registered new device driver usb
[    0.374083] PCI: Using ACPI for IRQ routing
[    0.375574] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.376018] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.377676] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[    0.379028] clocksource: Switched to clocksource xen
[    0.387258] pnp: PnP ACPI init
[    0.388831] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[    0.392109] system 00:01: [io  0x08a0-0x08a3] has been reserved
[    0.394890] system 00:01: [io  0x0cc0-0x0ccf] has been reserved
[    0.397677] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.400647] system 00:07: [io  0x10c0-0x1141] has been reserved
[    0.403406] system 00:07: [io  0xb044-0xb047] has been reserved
[    0.422581] pnp: PnP ACPI: found 8 devices
[    0.432731] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.436961] NET: Registered protocol family 2
[    0.439215] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.442808] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.446075] TCP: Hash tables configured (established 131072 bind 65536)
[    0.449280] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    0.452167] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    0.455269] NET: Registered protocol family 1
[    0.457450] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.460267] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.463040] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.466087] Unpacking initramfs...
[    4.575084] random: nonblocking pool is initialized
[    5.486052] Freeing initrd memory: 27236K (ffff880034abe000 - ffff880036557000)
[    5.489563] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    5.492590] software IO TLB [mem 0xec000000-0xf0000000] (64MB) mapped at [ffff8800ec000000-ffff8800efffffff]
[    5.497196] RAPL PMU detected, API unit is 2^-32 Joules, 3 fixed counters 163840 ms ovfl timer
[    5.501122] hw unit of domain pp0-core 2^-16 Joules
[    5.503384] hw unit of domain package 2^-16 Joules
[    5.505627] hw unit of domain dram 2^-16 Joules
[    5.508399] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    5.511305] Initialise system trusted keyring
[    5.513574] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    5.517950] zpool: loaded
[    5.519400] VFS: Disk quotas dquot_6.6.0
[    5.521293] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    5.525412] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    5.528916] io scheduler noop registered
[    5.530735] io scheduler deadline registered
[    5.532756] io scheduler cfq registered (default)
[    5.534974] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    5.537570] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    5.556230] Console: switching to colour frame buffer device 100x37
[    5.560439] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    5.564102] ACPI: Power Button [PWRF]
[    5.565849] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1
[    5.569291] ACPI: Sleep Button [SLPF]
[    5.571240] GHES: HEST is not enabled!
[    5.573015] ioatdma: Intel(R) QuickData Technology Driver 4.00
[    5.576226] xen:grant_table: Grant tables using version 1 layout
[    5.579034] Grant table initialized
[    5.580757] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    5.583432] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    5.614370] 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    5.618519] Linux agpgart interface v0.103
[    5.620530] [drm] Initialized drm 1.1.0 20060810
[    5.622924] tun: Universal TUN/TAP device driver, 1.6
[    5.625289] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    5.628240] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.631295] ehci-pci: EHCI PCI platform driver
[    5.633366] ehci-platform: EHCI generic platform driver
[    5.635833] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[    5.641237] serio: i8042 KBD port at 0x60,0x64 irq 1
[    5.643555] serio: i8042 AUX port at 0x60,0x64 irq 12
[    5.646260] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    5.647069] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2
[    5.653655] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[    5.657013] sdhci: Secure Digital Host Controller Interface driver
[    5.659862] sdhci: Copyright(c) Pierre Ossman
[    5.662089] NET: Registered protocol family 10
[    5.664380] NET: Registered protocol family 17
[    5.666485] 9pnet: Installing 9P2000 support
[    5.668884] Loading compiled-in X.509 certificates
[    5.671110] registered taskstats version 1
[    5.673016] zswap: loading zswap
[    5.674816] zpool: no driver for type zbud
[    5.676741] zswap: zbud zpool not available
[    5.678722] zswap: zpool creation failed
[    6.497094] tsc: Refined TSC clocksource calibration: 2493.989 MHz
[    6.499735] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x23f30b7e2bf, max_idle_ns: 440795296312 ns
[   10.780068] xenbus_probe_frontend: Waiting for devices to initialise: 25s...20s...15s...10s...5s...0s...
[   35.683511] 
[   35.684423] xenbus_probe_frontend: Timeout connecting to device: device/vfb/0 (local state 3, remote state 1)
[   35.689018] xenbus_probe_frontend: Device with no driver: device/vbd/768
[   35.692085] xenbus_probe_frontend: Device with no driver: device/pci/0
[   35.695217] rtc_cmos 00:02: setting system clock to 2016-05-06 02:55:55 UTC (1462503355)
[   35.700128] Freeing unused kernel memory: 1264K (ffffffff81ae4000 - ffffffff81c20000)
[   35.703717] Write protecting the kernel read-only data: 10240k
[   35.706732] Freeing unused kernel memory: 324K (ffff8800015af000 - ffff880001600000)
[   35.710653] Freeing unused kernel memory: 956K (ffff880001911000 - ffff880001a00000)
INFO[0000] Launching Bootstrap Docker                   
[   35.816564] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.
INFO[0000] Set 127.0.0.1/8 on lo                        
INFO[0000] Waiting for Docker at unix:///var/run/system-docker.sock 
[   35.868258] Bridge firewalling registered
[   35.871634] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[   35.876526] ip_tables: (C) 2000-2006 Netfilter Core Team
INFO[0000] Connected to Docker at unix:///var/run/system-docker.sock 
INFO[0000] Loading images from /usr/share/ros/images.tar 
INFO[0001] Done loading images from /usr/share/ros/images.tar 
INFO[0001] Running Bootstrap services                   
INFO[0001] Project [bootstrap]: Starting project        
INFO[0002] [0/2] [udev-bootstrap]: Starting             
[   37.800088] cgroup: docker (103) created nested cgroup for controller "memory" which has incomplete hierarchy support. Nested cgroups may change behavior in the future.
[   37.807836] cgroup: "memory" requires setting use_hierarchy to 1 on the root
[   37.848188] udevd[8]: starting version 3.1.5
[   37.908203] scsi host0: ata_piix
[   37.911632] ixgbevf: Intel(R) 10 Gigabit PCI Express Virtual Function Network Driver - version 2.12.1-k
[   37.916610] ixgbevf: Copyright (c) 2009 - 2012 Intel Corporation.
[   37.919578] scsi host1: ata_piix
[   37.922162] microcode: CPU0 sig=0x306e4, pf=0x1, revision=0x415
[   37.924984] microcode: CPU1 sig=0x306e4, pf=0x1, revision=0x415
[   37.930182] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[   37.935433] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[   37.939371] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[   37.948169] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[   37.966693] AVX version of gcm_enc/dec engaged.
[   37.968933] blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
[   37.974460] AES CTR mode by8 optimization enabled
[   37.977261]  xvda: xvda1
[   37.977401] piix4_smbus 0000:00:01.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[   37.985025] mousedev: PS/2 mouse device common for all mice
[   37.998523] ixgbevf 0000:00:03.0: 02:b5:6d:4e:b2:61
[   38.000862] ixgbevf 0000:00:03.0: MAC: 1
[   38.002765] ixgbevf 0000:00:03.0: Intel(R) 82599 Virtual Function
[   38.204016] udevd[26]: starting version 3.1.5
INFO[0002] [1/2] [udev-bootstrap]: Started              
INFO[0002] [1/2] [state-script]: Starting               
INFO[0002] [2/2] [state-script]: Started                
INFO[0002] Project [bootstrap]: Project started         
INFO[0002] Mounting state device /dev/xvda1 to /state   
[   49.459303] EXT4-fs (xvda1): recovery complete
[   49.461794] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null)
INFO[0014] Launching System Docker                      
INFO[0014] Set 172.18.42.1/16 on docker-sys             
INFO[0001] Waiting for Docker at unix:///var/run/system-docker.sock 
INFO[0001] Waiting for Docker at unix:///var/run/system-docker.sock 
INFO[0001] Waiting for Docker at unix:///var/run/system-docker.sock 
INFO[0002] Waiting for Docker at unix:///var/run/system-docker.sock 
INFO[0002] Waiting for Docker at unix:///var/run/system-docker.sock 
INFO[0004] Waiting for Docker at unix:///var/run/system-docker.sock 
INFO[0011] Connected to Docker at unix:///var/run/system-docker.sock 
INFO[0011] Loading images from /usr/share/ros/images.tar 
INFO[0018] Done loading images from /usr/share/ros/images.tar 
INFO[0018] Project [os]: Starting project               
INFO[0018] [0/20] [system-volumes]: Starting            
INFO[0019] [0/20] [command-volumes]: Starting           
INFO[0019] [0/20] [container-data-volumes]: Starting    
INFO[0019] [0/20] [user-volumes]: Starting              
INFO[0019] [1/20] [system-volumes]: Started             
INFO[0019] [1/20] [udev-cold]: Starting                 
INFO[0019] [2/20] [command-volumes]: Started            
INFO[0019] [2/20] [preload-system-images]: Starting     
INFO[0019] [3/20] [user-volumes]: Started               
INFO[0019] [4/20] [container-data-volumes]: Started     
INFO[0019] [4/20] [all-volumes]: Starting               
INFO[0019] [4/20] [syslog]: Starting                    
INFO[0019] [4/20] [acpid]: Starting                     
[   71.545941] device veth7a867b8 entered promiscuous mode
[   71.548762] IPv6: ADDRCONF(NETDEV_UP): veth7a867b8: link is not ready
[   71.593403] eth0: renamed from veth0814872
[   71.600409] IPv6: ADDRCONF(NETDEV_CHANGE): veth7a867b8: link becomes ready
[   71.603867] docker-sys: port 1(veth7a867b8) entered forwarding state
[   71.606875] docker-sys: port 1(veth7a867b8) entered forwarding state
INFO[0019] [5/20] [udev-cold]: Started                  
INFO[0019] [5/20] [udev]: Starting                      
INFO[0019] [6/20] [all-volumes]: Started                
INFO[0019] [7/20] [acpid]: Started                      
INFO[0019] [8/20] [udev]: Started                       
INFO[0019] [9/20] [syslog]: Started                     
[   72.444122] IPv6: eth0: IPv6 duplicate address fe80::42:acff:fe12:1 detected!
acpid: starting up with netlink and the input layer

acpid: 1 rule loaded

acpid: waiting for events: event logging is off

[   73.129550] veth0814872: renamed from eth0
[   73.135179] docker-sys: port 1(veth7a867b8) entered disabled state
[   73.158534] docker-sys: port 1(veth7a867b8) entered disabled state
[   73.163782] device veth7a867b8 left promiscuous mode
[   73.166194] docker-sys: port 1(veth7a867b8) entered disabled state
INFO[0020] [10/20] [preload-system-images]: Started     
INFO[0020] [10/20] [cloud-init-pre]: Starting           
[   73.434883] 9p: Installing v9fs 9p2000 file system support
[   73.437856] 9pnet_virtio: no channels available
INFO[0021] [11/20] [cloud-init-pre]: Started            
INFO[0021] [11/20] [network-pre]: Starting              
INFO[0021] [12/20] [network-pre]: Started               
INFO[0021] [12/20] [wait-for-network-pre]: Starting     
[   73.773415] device vethd37ef86 entered promiscuous mode
[   73.777254] IPv6: ADDRCONF(NETDEV_UP): vethd37ef86: link is not ready
[   73.781404] docker-sys: port 1(vethd37ef86) entered forwarding state
[   73.785528] docker-sys: port 1(vethd37ef86) entered forwarding state
[   73.789783] docker-sys: port 1(vethd37ef86) entered disabled state
[   73.831406] eth0: renamed from veth3b60d65
[   73.840565] IPv6: ADDRCONF(NETDEV_CHANGE): vethd37ef86: link becomes ready
[   73.844263] docker-sys: port 1(vethd37ef86) entered forwarding state
[   73.847623] docker-sys: port 1(vethd37ef86) entered forwarding state
[   73.983892] udevd[8]: starting version 3.1.5
[   73.983905] udevd[1]: starting version 3.1.5
[   74.207919] ixgbevf 0000:00:03.0: NIC Link is Up 10 Gbps
[   74.269132] IPv6: eth0: IPv6 duplicate address fe80::42:acff:fe12:1 detected!
[   74.278641] udevd[1]: unable to receive credentials of ctrl connection: Resource temporarily unavailable
[   74.889790] veth3b60d65: renamed from eth0
[   74.895214] docker-sys: port 1(vethd37ef86) entered disabled state
[   74.915567] docker-sys: port 1(vethd37ef86) entered disabled state
[   74.920942] device vethd37ef86 left promiscuous mode
[   74.923309] docker-sys: port 1(vethd37ef86) entered disabled state
INFO[0022] [13/20] [wait-for-network-pre]: Started      
INFO[0022] [13/20] [ntp]: Starting                      
INFO[0022] [14/20] [ntp]: Started                       
INFO[0022] [14/20] [cloud-init]: Starting               
[   75.142136] 9pnet_virtio: no channels available
INFO[0022] [15/20] [cloud-init]: Started                
WARN[0053] Error making HTTP request: Get https://raw.githubusercontent.com/rancher/os-services/v0.4.4/r/resize-fs.yml: dial tcp 23.235.47.133:443: i/o timeout. Retrying 
WARN[0083] Error making HTTP request: Get https://raw.githubusercontent.com/rancher/os-services/v0.4.4/r/resize-fs.yml: dial tcp 23.235.47.133:443: i/o timeout. Retrying

Steps to reproduce.

  1. Spin up an instance using the latest RancherOS (https://console.aws.amazon.com/ec2/home?region=us-west-2#launchInstanceWizard:ami=ami-4f50a72f) image in a VPC
  2. Create an snapshot of this instance
  3. Try spin up an instance on a difference VPC using this snapshot.
  4. You should see the network error in the log pasted above

I believe this problem doesn't happen for other images such as Ubuntu

Shuliyey commented 8 years ago

Sorry I'm closing this issue, I forgot to attach an internet gate way to the new VPC i created, so it won't have outbound internet connection. Hence it couldn't download the resize-fs.yml

Shuliyey commented 8 years ago

seems like I have to create a route in the route table to reference the route to the internet gateway as well