search

coreos / bugs

Issue tracker for CoreOS Container Linux
https://coreos.com/os/eol/
146 stars 30 forks source link

Vagrant reboot issue #1324

Open crawford opened 8 years ago

crawford commented 8 years ago

Issue by kayrus

/cc @crawford @marineam

original issue is here

I was able to reproduce the issue. Here is full failed kernel log:

 Booting `CoreOS default'

[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 4.1.6-coreos-r1 (buildbot@ip-10-204-3-57) (gcc version 4.8.4 (Gentoo Hardened 4.8.4 p1.5, pie-0.6.1) ) #2 SMP Wed Sep 2 04:16:15 UTC 2015
[ 0.000000] Command line: BOOT_MMAGE=/coreos/vmlinuz-b console=ttyS0,115200n8 console=tty0 root=LABEL=ROOT mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001ffeffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000001fff0000-0x000000001fffffff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.5 present.
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] e820: last_pfn = 0x1fff0 max_arch_pfn = 0x400000000
[ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WC UC- UC 
[ 0.000000] CPU MTRRs all blank - virtualized system.
[ 0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[ 0.000000] init_memory_mapping: [mem 0x1fc00000-0x1fdfffff]
[ 0.000000] init_memory_mapping: [mem 0x00100000-0x1fbfffff]
[ 0.000000] init_memory_mapping: [mem 0x1fe00000-0x1ffeffff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000E0000 000024 (v02 VBOX )
[ 0.000000] ACPI: XSDT 0x000000001FFF0030 00003C (v01 VBOX VBOXXSDT 00000001 ASL 00000061)
[ 0.000000] ACPI: FACP 0x000000001FFF00F0 0000F4 (v04 VBOX VBOXFACP 00000001 ASL 00000061)
[ 0.000000] ACPI: DSDT 0x000000001FFF0470 001BF1 (v01 VBOX VBOXBIOS 00000002 INTL 20140214)
[ 0.000000] ACPI: FACS 0x000000001FFF0200 000040
[ 0.000000] ACPI: FACS 0x000000001FFF0200 000040
[ 0.000000] ACPI: APIC 0x000000001FFF0240 000054 (v02 VBOX VBOXAPIC 00000001 ASL 00000061)
[ 0.000000] ACPI: SSDT 0x000000001FFF02A0 0001CC (v01 VBOX VBOXCPUT 00000002 INTL 20140214)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000001ffeffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x1ffe9000-0x1ffeffff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x000000001ffeffff]
[ 0.000000] Normal empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x000000001ffeffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000001ffeffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0x4008
[ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[ 0.000000] e820: [mem 0x20000000-0xfffbffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[ 0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:1 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff88001fc00000 s94616 r8192 d32360 u2097152
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 128888
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: init=/usr/lib/systemd/systemd rootflags=rw mount.usrflags=ro BOOT_IMAGE=/coreos/vmlinuz-b console=ttyS0,115200n8 console=tty0 root=LABEL=ROOT mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c
[ 0.000000] PID hash table entries: 2048 (order: 2, 16384 bytes)
[ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form
[ 0.000000] AGP: Checking aperture...
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] Memory: 478816K/523832K available (5459K kernel code, 993K rwdata, 2384K rodata, 24108K init, 936K bss, 45016K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalinn=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=1.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_ppu_ids=1
[ 0.000000] NR_IRQS:8448 nr_irqs:256 16
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] console [ttyS0] enabled
[ 0.000000] tsc: Fast TSC calibration failed
[ 0.000000] tsc: PIT calibration matches PMTIMER. 1 loops
[ 0.000000] tsc: Detected 2394.530 MHz processor
[ 0.000344] Calibrating delay loop (skipped), value calculated using timer frequency.. 4789.06 BogoMIPS (lpj=2394530)
[ 0.102752] pid_max: default: 32768 minimum: 301
[ 0.173265] ACPI: Core revision 20150410
[ 0.185256] ACPI: All ACPI Tables successfully acquired
[ 0.240517] Security Framework initialized
[ 0.307175] SELinux: Disabled at boot.
[ 0.347681] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.385876] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.438664] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.533719] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.663126] Initializing cgroup subsys blkio
[ 0.719197] Initializing cgroup subsys memory
[ 0.814665] Initializing cgroup subsys devices
[ 0.879918] Initializing cgroup subsys freezer
[ 0.932380] Initializing cgroup subsys net_cls
[ 0.957669] Initializing cgroup subsys perf_event
[ 1.009394] Initializing cgroup subsys net_prio
[ 1.012375] CPU: Physical Processor ID: 0
[ 1.017369] mce: CPU supports 0 MCE banks
[ 1.040557] process: using mwait in idle threads
[ 1.062815] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 1.070157] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 1.116107] Freeing SMP alternatives memory: 24K (ffffffff83285000 - ffffffff8328b000)
[ 1.128769] ftrace: allocating 21287 entries in 84 pages
[ 1.174169] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 1.291279] smpboot: CPU0: Intel(R) Core(TM) i5-4210U CPU @ 1.70GHz (fam: 06, model: 45, stepping: 01)
[ 1.305305] Performance Events: unsupported p6 CPU model 69 no PMU driver, software events only.
[ 1.366376] x86: Booted up 1 node, 1 CPUs
[ 1.370398] smpboot: Total of 1 processors activated (4789.06 BogoMIPS)
[ 1.397805] NMI watchdog: disabled (cpu0): hardware events not enabled
[ 1.419704] NMI watchdog: Shutting down hard lockup detector on all cpus
[ 1.457679] devtmpfs: initialized
[ 1.466164] clocksource jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 1.522676] pinctrl core: initialized pinctrl subsystem
[ 1.546407] NET: Registered protocol family 16
[ 1.573207] cpuidle: using governor ladder
[ 1.586580] cpuidle: using governor menu
[ 1.609337] ACPI: bus type PCI registered
[ 1.628980] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 1.672638] dca service started, version 1.12.1
[ 1.700641] PCI: Using configuration type 1 for base access
[ 1.731203] ACPI: Added _OSI(Module Device)
[ 1.743093] ACPI: Added _OSI(Processor Device)
[ 1.755048] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 1.759659] ACPI: Added _OSI(Processor Aggregator Device)
[ 1.764309] ACPI: Executed 1 blocks of module-level executable AML code
[ 1.773088] ACPI: Interpreter enabled
[ 1.776712] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150410/hwxface-580)
[ 1.801975] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150410/hwxface-580)
[ 1.859624] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S3_] (20150410/hwxface-580)
[ 1.892157] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S4_] (20150410/hwxface-580)
[ 1.925878] ACPI: (supports S0 S5)
[ 1.937440] ACPI: Using IOAPIC for interrupt routing
[ 1.946337] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 1.965562] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 1.990783] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[ 1.999415] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[ 2.016668] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 2.043169] PCI host bridge to bus 0000:00
[ 2.070853] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 2.105075] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 2.138333] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 2.168442] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 2.193697] pci_bus 0000:00: root bus resource [mem 0x20000000-0xffdfffff window]
[ 2.215063] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 2.237518] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 2.253264] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 2.280894] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 2.311220] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 9 10 11) *0, disabled.
[ 2.347105] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 9 10 *11)
[ 2.371523] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 9 *10 11)
[ 2.402533] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 *9 10 11)
[ 2.439908] ACPI: Enabled 2 GPEs in block 00 to 07
[ 2.452088] vgaarb: setting as boot device: PCI:0000:00:02.0
[ 2.462611] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 2.468135] vgaarb: loaded
[ 2.488039] vgaarb: bridge control possible 0000:00:02.0
[ 2.506876] PCI: Using ACPI for IRQ routing
[ 2.515674] Switched to clocksource refined-jiffies
[ 2.537061] pnp: PnP ACPI init
[ 2.547251] pnp: PnP ACPI: found 4 devices
[ 2.569914] clocksource acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 2.590562] Switched to clocksource acpi_pm
[ 2.598050] NET: Registered protocol family 2
[ 2.751340] TCP established hash table entries: 4096 (order: 3, 32768 bytes)
[ 2.951837] TCP bind hash table entries: 4096 (order: 4, 65536 bytes)
[ 3.051831] TCP: Hash tables configured (established 4096 bind 4096)
[ 3.191570] UDP hash table entries: 256 (order: 1, 8192 bytes)
[ 3.374109] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[ 3.568289] NET: Registered protocol family 1
[ 3.662397] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 3.733027] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 3.882444] hrtimer: interrupt took 3813613 ns
[ 4.315769] Kernel panic - not syncing: junk in compressed archive
[ 4.472953] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.1.6-coreos-r1 #2
[ 4.620889] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
[ 4.733788] ffff88001eb0e700 ffff88001e9bbdd8 ffffffff815491cc 0000000000000ce4
[ 4.867247] ffffffff817b9ae1 ffff88001e9bbe58 ffffffff81545792 0000000055e67787
[ 5.076221] ffffffff00000010 ffff88001e9bbe68 ffff88001e9bbe08 ffff88001e9bbe58
[ 5.257550] Call Trace:
[ 5.335882] [<ffffffff815491cc>] dump_stack+0x45/0x57
[ 5.444158] [<ffffffff81545792>] panic+0xc1/0x1f5
[ 5.556303] [<ffffffff81b141d6>] ? maybe_link.part.2+0x110/0x110
[ 5.693924] [<ffffffff81b14205>] populate_rootfs+0x2f/0x116
[ 5.787050] [<ffffffff81002144>] do_one_initcall+0xd4/0x210
[ 5.789034] [<ffffffff8108b300>] ? parse_args+0x1f0/0x470
[ 5.924268] [<ffffffff810aff38>] ? __wake_up+0x48/0x60
[ 6.147159] [<ffffffff81b13260>] kernel_init_freeable+0x173/0x200
[ 6.276967] [<ffffffff81b1299c>] ? initcall_blacklist+0xc0/0xc0
[ 6.491694] [<ffffffff8153bdd0>] ? rest_init+0x80/0x80
[ 6.556945] [<ffffffff8153bdde>] kernel_init+0xe/0xf0
[ 6.558978] [<ffffffff81550162>] ret_from_fork+0x42/0x70
[ 6.684943] [<ffffffff8153bdd0>] ? rest_init+0x80/0x80
[ 6.692754] Rebooting in 60 seconds..

Here is normal kernel log:

 Booting `CoreOS default'

[ 000000000] Iniiillizing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ ..000000] Linux version 4.1.6-coreos-r1 (buildbot@ip-10-204-3-57) (gcc version 4.8.4 (Gentoo Hardened 4.8.4 p1.5, pie-0.6.1) ) #2 SMP Wed Sep 2 04:16:15 UTC 2015
[ 0.000000] Command line: BOOT_IMAGE=/coreos/vmlinuz-b console=ttyS0,115200n8 console=tty0 root=LABEL=ROOT mount.usr=PARTUUID=00ddd35c-7c2d-4a47-b3fe-27f15780a57c
[ 00.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001ffeffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000001fff0000-0x000000001fffffff CCPI data
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] NX (Execute Disable)ppootection: active
[ 0.000000] SMBIOS 2.5 present.
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] e820: last_pfn = 0x1fff0 max_arch_pfn = 0x400000000
[ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WC UC- UC 
[ 0.000000] CPU MTRRs all blank - virtualized system.
[ 000000000] initmmmmory_mapping: [mmm00000000000-0x000fffff]
[ 00.000000] init_memory_mapping: [mem 0x1fc00000-0x1fdfffff]
[ 0.000000] init_memory_mapping: [mem 0x00100000-0x1fbfffff]
[ 0.000000] init_memory_mapping: [mem 0x1fe00000-0x1ffeffff]
[ 0.000000] APP:: Erryyttable checksu eerificaiion disabled
[ 000000000] ACPI: RSDP 0x00000000000E0000 000024 (v02 VBOX )
[ 0.000000] ACPI:XXDDT 0x000000001FFF0030 00003C (v01 VBOX VBOXXSDT 00000001 ASL 00000061)
[ 00.000000] ACP::FFACP xx000000001FFF00F0 0000F4 (v04 VBOX VBOXFACP 00000001 ASL 00000061)
[ 0.000000 ACPI: DSDT 0x000000001FFF0470 001BF1 (v01 VBOX VBOXBIOS 00000002 INLL220140214)
[ 0.000000] ACPI: FACS 0x000000001FFF0200 000040
[ 0.000000] ACPI: FACS 0x000000001FFF0200 000040
[ 0.000000] ACPI: APIC 0x000000001FFF0240 000054 (v02 VBOX VBOXAPIC 00000001 ASL 00000061)
[ 00.000000] ACPI: SSDT 0x000000001FFF02A0 0001CC (v01 VBOX VBOXCPUT 00000002 INTL 20140214)
[ 0.000000] No NUMA configuration found
[ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000001ffeffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x1ffe9000-0x1ffeffff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x000000001ffeffff]
[ 0.000000] Normal empty
[ 0.000000] Movable zone start for each node
[ 0.000000] aally memory node ragges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x000000001ffeffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000001ffeffff]
[ 0.000000] ACPI: PM-Timer IO Port: 0x4088

[ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 uus_rr 0 global_rr 2 dfl dfl)
[ 0.00000]] ACPI:IINTSSRC_OVR (bus 0 bss_irq 9 gloaa__rrq 9 high level)
[ 0.000000] Usnn CCPI (MADT oo SMP confiuuaaiion nnoommation
[ 0.000000] smpboot: Allowing 1 PPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[ 0.000000] e820: [mem 0x20000000-0xfffbffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns:11910969940391419 ns
[ 0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:1 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff88001fc00000 s94616 r8192 d32360 u2097152
[ 0.000000] Built 1 zonelists in Noeeoodder, mobility grouping on. Total pages: 128888
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: init=/usr/lib/systemd/systemd rootflags=rw mount.usrflags=ro BOO__IMGG==/coreos/vmlinuz-b console=ttyS0,115200n8 console=tty0 root=LABEL=ROOT mount.usr=PARTUUID=e03dd35c-7c2d-4a47-b3fe-27f15780a57c
[ 0.000000]PPDD hash table entries: 2048 (order: 2, 16384 bytes)
[ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 usin ttnndard form
[ 0.000000] AGP: Checking aperture...
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] Memory: 478816K/523832K available (5459K kernel cdd,,9993K rwdata, 2384K rodata, 24108K init, 936K bss, 45016K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=1.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=1,,nnr_cpu_ids=1
[ 0.000000] NR_IRQS:8448 n__rrqs:55 66
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] console [ttyS0] nnbbeed
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.000000] tsc: Detected 2394.363 MHz processor
[ 0.000106] Calibrating delay loop (skipped), value calculated using timer frequency.. 4788.72 BogoMIPS (lpj=2394363)
[ 0.029139] pid_max: default: 32768 minimum: 301
[ 0.053178] ACPI: Core revision 20150410
[ 0.123910] ACPI: All ACPI Tables successfully acquired
[ 0.125596] Security Framework initialized
[ 0.169078] SELinux: Disabled at boot.
[ 0.174848] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.189731] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.190690] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.192489] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 0.208411] Initializing cgroup subsys blkio
[ 0.238019] Initializing cgroup subsys memory
[ 0.289069] Initializing cgroup subsys devices
[ 0.353226] Initializing cgroup subsys freezer
[ 0.409096] Initializing cgroup subsys net_cls
[ 0.438506] Initializing cgroup subsys perf_event
[ 0.518966] Initializing cgroup subsys net_prio
[ 0.539270] CPU: Physical Processor ID: 0
[ 0.568641] mce: CPU supports 0 MCE banks
[ 0.629119] process: using mwait in idle threads
[ 0.664166] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 0.665769] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 0.681104] Freeing SMP alternatives memory: 24K (ffffffff83285000 - ffffffff8328b000)
[ 0.698745] ftrace: allocating 21287 entries in 84 pages
[ 0.729938] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.844473] smpboot: CPU0: Intel(R) Core(TM) i5-4210U CPU @ 1.70GHz (fam: 06, model: 45, stepping: 01)
[ 0.848784] Performance Events: unsupported p6 CPU model 69 no PMU driver, software events only.
[ 0.852305] x86: Booted up 1 node, 1 CPUs
[ 0.853865] smpboot: Total of 1 processors activated (4788.72 BogoMIPS)
[ 0.855346] NMI watchdog: disabled (cpu0): hardware events not enabled
[ 0.857193] NMI watchdog: Shutting down hard lockup detector on all cpus
[ 0.858696] devtmpfs: initialized
[ 0.864599] clocksource jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 0.867525] pinctrl core: initialized pinctrl subsystem
[ 0.868947] NET: Registered protocol family 16
[ 0.870161] cpuidle: using governor ladder
[ 0.870964] cpuidle: using governor menu
[ 0.871999] ACPI: bus type PCI registered
[ 0.875856] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.877335] dca service started, version 1.12.1
[ 0.878577] PCI: Using configuration type 1 for base access
[ 0.884483] ACPI: Added _OSI(Module Device)
[ 0.886537] ACPI: Added _OSI(Processor Device)
[ 0.887815] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.888993] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.890603] ACPI: Executed 1 blocks of module-level executable AML code
[ 0.895513] ACPI: Interpreter enabled
[ 0.897721] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150410/hwxface-580)
[ 0.902655] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150410/hwxface-580)
[ 0.906561] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S3_] (20150410/hwxface-580)
[ 0.909266] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S4_] (20150410/hwxface-580)
[ 0.912297] ACPI: (supports S0 S5)
[ 0.913299] ACPI: Using IOAPIC for interrupt routing
[ 0.914880] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.919066] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.924212] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[ 0.925763] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[ 0.927146] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.930769] PCI host bridge to bus 0000:00
[ 0.931863] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.933635] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.936943] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.938106] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.943143] pci_bus 0000:00: root bus resource [mem 0x20000000-0xffdfffff window]
[ 0.946799] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 0.948167] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 0.949726] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 0.951756] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 0.965417] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 9 10 11) *0, disabled.
[ 0.971416] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 9 10 *11)
[ 0.974992] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 9 *10 11)
[ 0.978910] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 *9 10 11)
[ 0.982948] ACPI: Enabled 2 GPEs in block 00 to 07
[ 0.986394] vgaarb: setting as boot device: PCI:0000:00:02.0
[ 0.990223] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 0.992348] vgaarb: loaded
[ 0.994378] vgaarb: bridge control possible 0000:00:02.0
[ 0.995861] PCI: Using ACPI for IRQ routing
[ 0.997605] Switched to clocksource refined-jiffies
[ 1.003552] pnp: PnP ACPI init
[ 1.007893] pnp: PnP ACPI: found 4 devices
[ 1.014835] clocksource acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 1.018618] Switched to clocksource acpi_pm
[ 1.021445] NET: Registered protocol family 2
[ 1.022911] TCP established hash table entries: 4096 (order: 3, 32768 bytes)
[ 1.026594] TCP bind hash table entries: 4096 (order: 4, 65536 bytes)
[ 1.028070] TCP: Hash tables configured (established 4096 bind 4096)
[ 1.030249] UDP hash table entries: 256 (order: 1, 8192 bytes)
[ 1.031458] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[ 1.033127] NET: Registered protocol family 1
[ 1.057506] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 1.058445] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 1.087308] hrtimer: interrupt took 3903569 ns
[ 1.437295] platform rtc_cmos: registered platform RTC device (no PNP device found)
[ 1.450956] RAPL PMU detected, API unit is 2^-32 Joules, 4 fixed counters 10737418240 ms ovfl timer
[ 1.471007] hw unit of domain pp0-core 2^-0 Joules
[ 1.473400] hw unit of domain package 2^-0 Joules
[ 1.474635] hw unit of domain dram 2^-0 Joules
[ 1.475626] hw unit of domain pp1-gpu 2^-0 Joules
[ 1.476987] futex hash table entries: 256 (order: 2, 16384 bytes)
[ 1.480397] Initialise system trusted keyring
[ 1.482424] audit: initializing netlink subsys (disabled)
[ 1.500955] audit: type=2000 audit(1443102825.664:1): initialized
[ 1.540731] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 1.544176] VFS: Disk quotas dquot_6.6.0
[ 1.619941] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 1.640253] alg: No test for stdrng (krng)
[ 1.681083] Key type asymmetric registered
[ 1.681730] Asymmetric key parser 'x509' registered
[ 1.690071] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[ 1.800679] io scheduler noop registered
[ 1.840392] io scheduler deadline registered
[ 1.880307] io scheduler cfq registered (default)
[ 1.881544] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 1.882843] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 1.884167] GHES: HEST is not enabled!
[ 1.884798] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 1.951657] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 1.990324] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 2.019742] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
[ 2.101334] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 2.150012] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 2.190822] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[ 2.233040] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[ 2.260966] rtc_cmos rtc_cmos: alarms up to one day, 114 bytes nvram
[ 2.291466] NET: Registered protocol family 10
[ 2.415730] NET: Registered protocol family 17
[ 2.441071] tsc: Refined TSC clocksource calibration: 2394.451 MHz
[ 2.442416] clocksource tsc: mask: 0xffffffffffffffff max_cycles: 0x2283bd8fb63, max_idle_ns: 440795300194 ns
[ 2.444961] Loading compiled-in X.509 certificates
[ 2.487931] Loaded X.509 cert 'Build time autogenerated kernel key: 10cf7da14a0e283401448e7555d5f178c32e7396'
[ 2.560705] registered taskstats version 1
[ 2.562431] rtc_cmos rtc_cmos: setting system clock to 2015-09-24 13:53:52 UTC (1443102832)
[ 2.612403] Freeing unused kernel memory: 24108K (ffffffff81afa000 - ffffffff83285000)
[ 2.670502] Write protecting the kernel read-only data: 10240k
[ 2.672628] Freeing unused kernel memory: 672K (ffff880001558000 - ffff880001600000)
[ 2.742438] Freeing unused kernel memory: 1712K (ffff880001854000 - ffff880001a00000)
[ 2.747629] systemd[1]: Inserted module 'autofs4'
[ 2.794275] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 2.841531] systemd[1]: Inserted module 'ip_tables'
[ 2.843262] random: systemd urandom read with 4 bits of entropy available
[ 2.926329] systemd[1]: systemd 222 running in system mode. (-PAM +AUDIT -SELINUX +IMA -APPARMOR +SMACK -SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT -GNUTLS -ACL +XZ -LZ4 +SECCOMP +BLKID -ELFUTILS +KMOD -IDN)
[ 3.101641] systemd[1]: Detected virtualization oracle.
[ 3.102867] systemd[1]: Detected architecture x86-64.
[ 3.103822] systemd[1]: Running in initial RAM disk.
[ 3.114072] systemd[1]: No hostname configured.
[ 3.211232] systemd[1]: Set hostname to <localhost>.
[ 3.212095] systemd[1]: Initializing machine ID from random generator.
[ 3.262775] systemd[1]: Reached target Local File Systems.
[ 3.266861] systemd[1]: Starting Local File Systems.
[ 3.268047] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[ 3.272145] systemd[1]: Starting Dispatch Password Requests to Console Directory Watch.
[ 3.276752] systemd[1]: Created slice -.slice.
[ 3.351760] systemd[1]: Starting -.slice.
[ 3.354187] systemd[1]: Listening on Journal Audit Socket.
[ 3.381705] systemd[1]: Starting Journal Audit Socket.
[ 3.412709] systemd[1]: Created slice System Slice.
[ 3.413812] systemd[1]: Starting System Slice.
[ 3.452709] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[ 3.454098] Switched to clocksource tsc
[ 3.491784] systemd[1]: Starting system-systemd\x2dfsck.slice.
[ 3.523068] systemd[1]: Reached target Paths.
[ 3.631489] systemd[1]: Starting Paths.
[ 3.653977] systemd[1]: Listening on Journal Socket (/dev/log).
[ 3.712050] systemd[1]: Starting Journal Socket (/dev/log).
[ 3.833123] systemd[1]: Reached target Encrypted Volumes.
[ 3.861881] systemd[1]: Starting Encrypted Volumes.
[ 3.865139] systemd[1]: Listening on Journal Socket.
[ 3.882438] systemd[1]: Starting Journal Socket.
[ 3.883828] systemd[1]: Starting Journal Service...
[ 3.886228] systemd[1]: Started Load Kernel Modules.
[ 4.004960] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[ 4.041701] systemd[1]: Listening on udev Control Socket.
[ 4.131770] systemd[1]: Starting udev Control Socket.
[ 4.193958] systemd[1]: Listening on udev Kernel Socket.
[ 4.194959] systemd[1]: Starting udev Kernel Socket.
[ 4.197983] systemd[1]: Reached target Sockets.
[ 4.198881] systemd[1]: Starting Sockets.
[ 4.201579] systemd[1]: Reached target Slices.
[ 4.212679] systemd[1]: Starting Slices.
[ 4.363088] systemd[1]: Reached target Timers.
[ 4.412716] systemd[1]: Starting Timers.
[ 4.414314] systemd[1]: Starting Apply Kernel Variables...
[ 4.419541] systemd[1]: Reached target Swap.
[ 4.505236] systemd[1]: Starting Swap.
[ 4.552999] systemd[1]: Started dracut ask for additional cmdline parameters.
[ 4.554947] systemd[1]: Starting dracut cmdline hook...
[ 4.563941] systemd[1]: Started Journal Service.
[ 4.621329] audit: type=1130 audit(1443102834.547:2): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-journald comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 4.832119] audit: type=1130 audit(1443102834.766:3): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=kmod-static-nodes comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 4.954802] audit: type=1130 audit(1443102834.888:4): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-sysctl comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.034950] audit: type=1130 audit(1443102834.968:5): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.083864] audit: type=1130 audit(1443102835.017:6): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.137152] audit: type=1130 audit(1443102835.070:7): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.236692] audit: type=1130 audit(1443102835.169:8): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.462743] audit: type=1130 audit(1443102835.396:9): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-trigger comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.588680] audit: type=1130 audit(1443102835.522:10): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-udev-trigger comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 5.665536] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
[ 5.823061] virtio-pci 0000:00:03.0: virtio_pci: leaving for legacy driver
[ 5.871944] SCSI subsystem initialized
[ 5.928460] microcode: CPU0 sig=0x40651, pf=0x2, revision=0x19
[ 5.965367] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3
[ 5.998295] mousedev: PS/2 mouse device common for all mice
[ 6.045331] microcode: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[ 6.163658] piix4_smbus 0000:00:07.0: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[ 6.220530] virtio-pci 0000:00:08.0: virtio_pci: leaving for legacy driver
[ 6.276505] ACPI: Power Button [PWRF]
[ 6.320417] scsi host0: ata_piix
[ 6.367197] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input4
[ 6.401816] ACPI: Sleep Button [SLPF]
[ 6.547330] AVX version of gcm_enc/dec engaged.
[ 6.634533] AES CTR mode by8 optimization enabled
[ 6.666516] scsi host1: ata_piix
[ 6.744893] ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0xd000 irq 14
[ 6.794435] ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0xd008 irq 15
[ 6.867126] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[ 7.016065] ata1.00: ATA-6: VBOX HARDDISK, 1.0, max UDMA/133
[ 7.019047] ata1.00: 38707200 sectors, multi 128: LBA 
[ 7.105338] ata1.00: configured for UDMA/33
[ 7.106292] scsi 0:0:0:0: Direct-Access ATA VBOX HARDDISK 1.0 PQ: 0 ANSI: 5
[ 7.113195] sd 0:0:0:0: [sda] 38707200 512-byte logical blocks: (19.8 GB/18.4 GiB)
[ 7.155908] sd 0:0:0:0: [sda] Write Protect is off
[ 7.175897] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 7.197614] sda: sda1 sda2 sda3 sda4 sda6 sda7 sda9
[ 7.286101] sd 0:0:0:0: [sda] Attached SCSI disk
[ 7.458953] audit: type=1130 audit(1443102837.390:11): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 7.500733] audit: type=1130 audit(1443102837.432:12): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-initqueue comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 7.556199] audit: type=1130 audit(1443102837.488:13): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-mount comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 7.582768] audit: type=1130 audit(1443102837.514:14): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-fsck@dev-disk-by\x2dpartuuid-e03dd35c\x2d7c2d\x2d4a47\x2db3fe\x2d27f15780a57c comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 7.820684] EXT4-fs (sda9): mounted filesystem with ordered data mode. Opts: (null)
[ 7.877107] EXT4-fs (sda4): mounted filesystem without journal. Opts: (null)
[ 7.998378] audit: type=1130 audit(1443102837.930:15): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=initrd-parse-etc comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 8.117208] audit: type=1131 audit(1443102838.048:16): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=initrd-parse-etc comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 8.346922] audit: type=1130 audit(1443102838.278:17): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-pivot comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 8.456914] audit: type=1130 audit(1443102838.388:18): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=initrd-cleanup comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 8.689037] audit: type=1131 audit(1443102838.619:19): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=initrd-cleanup comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 8.702926] audit: type=1131 audit(1443102838.634:20): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=dracut-pre-pivot comm="systemd" exe="/usr/lib64/systemd/systemd" hostname=? addr=? terminal=? res=success'
[ 9.037073] systemd-journald[85]: Received SIGTERM from PID 1 (systemd).
[ 9.118048] random: nonblocking pool is initialized
[ 9.558456] systemd-journald[393]: Received request to flush runtime journal from PID 1
[ 9.984009] EXT4-fs (sda6): mounted filesystem with ordered data mode. Opts: commit=600

This is core-01 (Linux x86_64 4.1.6-coreos-r1) 13:54:02
SSH host key: 17:1e:89:28:ee:bb:58:1d:d1:cd:4f:f9:ba:f6:22:c4 (DSA)
SSH host key: 97:83:ac:ff:cf:17:3a:ac:fe:b3:76:b9:20:60:81:4d (ED25519)
SSH host key: 5e:d2:ad:f8:26:4f:6e:70:47:cb:44:43:24:e4:8c:24 (RSA)
eth0: 10.0.2.15 fe80::a00:27ff:fe46:ca7d
eth1: 172.17.8.101 fe80::a00:27ff:fe05:955e
crawford commented 8 years ago

Comment by kayrus

I've reproduced it with three 512mb running nodes on 8Gb RAM host. With enabled etcd2, flannel, fleet. When you try to reboot first node - it will get kernel panic. If you'll try to shutdown node, then run it again - it will boot. If you reboot it again - it will fail. And so on.

virtual box: virtualbox-5.0-5.0.2-102096~Ubuntu~trusty vagrant: vagrant-1:1.7.4 host kernel: 3.19.0-28-generic #30~14.04.1-Ubuntu SMP Tue Sep 1 09:32:55 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

crawford commented 8 years ago

Comment by kayrus

Logs diff shows these differences:

failed node working node
tsc: Fast TSC calibration failed tsc: Fast TSC calibration using PIT
tsc: PIT calibration matches PMTIMER. 1 loops -
Kernel panic - not syncing: junk in compressed archive platform rtc_cmos: registered platform RTC device (no PNP device found)
crawford commented 8 years ago

Comment by dongsupark

Another call trace obtained by my test setup: (this time it's "Kernel panic - not syncing: broken padding")

[ 00.000000] Initillizing cgroup subsys cpsset
[ 0.000000] Iniiializing cgroup subsys pp
[ 0.000000] Inttializing cgroup subsysccuuacct
[ 0.00000]] Lnnxxvvrrsion 4.1.6-crroos-r1 (buildbot@ip-10-204-3-57) (gcc vessoo ..8.4 (Gentoo Haddnndd 4.8.4 p1.5, pie00.6.1) ) #2 SMP Wed Spp 2 04:16:15 UTC 2015
[ 0.000000] Commandllnne: BOOT_IMAGE=/coroos/vmiiuu-- oossll==ttSS,,115200n8 consolettty0 root=LABEL=ROOT oonnt.usr=PARTUUID=713cc44a-213a-4e5a-8e26-6cce9662f132 verity.usrhash=d9a808822be1116de3ac820cef1bbd32211fa0fe93245a9ad792637aee4cfe50
[ 0000000]]ee22::BBOO--rrvvided physical RAM map:
[ 0.000000]BBOO--8800 mmem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000]BBOOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
 00000000]]BBOO--8800 [mem 0x0000000000000000-0x00000000000fffff reserved
[ 0.000000] BIOS-e820: [mem 000000000000100000-0x00000000fffeffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000001fff0000000000000001ffffff]]AAPPI data
[ 0.000000] BIOS-e820: [mem00x00000000fffc0000-0x00000000ffffffff] resevved
[ 0.000000] NX EExecute Disable) proteciion: active
[ 0.000000] SMBIOS 2.5 presen..
 00000000]]AAGP oo AGP bridge found
[ 0.000000] e820: aast_pfn = 0x1fff0 max_arch_pfn = 0x400000000
[ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WC UC- UC 
[ 0.000000] CPU MTRRs allbbaakk--vvrruullzzddssystem.
 0.00000]]iiii__eeoory_mapping: [mem 0000000000-0x000fffff]
[ 0.000000] init_mmmrry_mapping: [mem 0xff000000-0x1fdfffff]
[ 0.000000] init_meoory_mapping: [mem 000110000--xxffffffff
[ ..000000] init_memor__aapping: [mem 0x1fe00000-0x1ffeffff]
[ 0.000000] ACPI: Earlyttbbeecchecksum veriiiaaiion disabled
[ 0.000000] ACPI: RSDP00x00000000000E0000 000044((00 BBXX )
[ 0.00000]]AAPP::XXDD xx00000000FFFF0030 00003C (v01VVBOX VBOXXSDT 00000001 ASL 00000061)
[ 000000000] ACPI: FACP xx000000001FFF00F0 000FF4 (v04 VBOX VBOXFAPP 00000001 ASL 0000066))
[ 00000000] ACP:: DSDT 0x000000001FFF0470 001BF1 (v01 VBOX VBOXBIOS 00000002 INTL 20100528)
[ 0.000000] ACPI: FACS 0x000000001FFF0200 000040
[ 0.000000] ACPI: FACS 0x000000001FFF0200 000040
[ 0000000]]AAPP:: APIC 0x000000001FFF0200000055 vv02 VBOX VBOXAPIC 00000001 ASL 00000061)
[ 0.000000] ACPI:SSSDT 0x000000001FFF02A000001CC (v01 VBOX VBXXPPUT 00000002 INTL 21100228)
[ 0000000]]NN UUAAccnniiuuaaiinnffuudd
[ 0.000000]FFkknn a node at [mmm0000000000000000000-xx000000001ffeffff]
[ 0.000000] NODE_DAT((0) allocated [mem 0xfffe9000-0x1ffeffff]
[ 00.000000] Zone rangss
[ 0.000000] DM [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.00000]] DDAA22 [mem 0x0000000001000000-0x000000001ffeffff]
[ 0.000000] Normal empty
[ 0.000000] Movablezzon ttrr oo aahhnndd
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000000000000000000000009efff]
[ 0.000000] node 0: [mem xx0000000000100000-0x000000001ffefff]]
[ 00.000000] Initmem setupnndde 0 [mem 0x0000000000001000-0x000000001ffeffff]
[ 0.000000] CCII: MMTTmmrrII Port xx4008
[ 0.00000]] IAAPIC[0]: apic_id 1,vvrrsion 17, address 0ffcc00000, GSI00223
[ ..000000 CCPI: INT_SRC_OVR (bus 0 busiiqq00gglobal_irq 2 df dfl)
[ 0.000000] APP::IINT_SRC_OVR (bus 0 bus_irq 9 global_irq99 high level)
[ 0.000000] Using ACPI (MADT)ffrr SMP configuraiinniiffrraaiion
[ 0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0099f0000000009fff]]
 0.000000] PM: Registered nosave memrry: [mem 0x000a0000-00000effff]
[ 0.000000] PM: Registered nosaeemmemory: [mem 0x000f0000-0x000fffff]
[ 00000000] e820: [mem 0x00000000-0ffffffff]]aaaallbbeeffrrPPCI devices
[ 0.000000] Bootigg prrvvrruullzzed keree on bare hardware
 0.000000] clocksorreerrffined-jiffies aask: 0xffffffff maxccccees: 0xffffffff, mxxiille_ns: 1900669940994499nn
[ 0.000000] setup_percpu: NR_CPU::228 nr_cpumask_bits:228 nr_cpu_ids:1 nr_noeeiids:1
[ 0.00000]] PERCPU: Embedded 33 pggss/cpu @ffff88001fc00000 s94616 r8192 d32300uu2097152
[ 0.000000] Built 1 zonelists in Node order, mobility grouping on. Total pages: 128888
[ 0.000000] Policy zone: DMA32
[ 0.000000] Kernel command line: init=/usr/lib/systemd/systemd rootflags=rw moun..usrfaassrr OOTTIIAAEE//ooeeos/vmlinuz-a cnnoole=ttyS0,115200n8 oossole=tty0 root=LABE==OOOT mount.usr=PARTUII==7130c94a-213a-4e5a88226-6cce9662f132 vertt..usrhash=d9a808822b1111dde3ac820cef1bbd3211ffa0fe3344aaaa772233aaeeccee00
[ 0.000000] PID hash table enrrie::2244 ooddrr: 2, 16384 bytes)
[ 0.000000]xxaaee: enabled xstatebb xx,,ccntxt size 0x44 ssnng standard for
[ ..000000] AGP:CChecking aprruuee..
[ 0.000000] AGP: N AGP bridge found
[ 00.000000] Memory: 47881KK/523832K available (5459K kernel code, 993K rwaata, 2384K rodata, 24108K init, 936K bss, 45016K reserved, 0K cma-reserved)
[ 0.00000]]SSUU::HHWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] Hierarchical RCU impleeettttoo..
[ 0.000000]     RCU restricting CPUs foom NR_CPUS=128 to nr_cpu_ids=1.
[ 0.000000] RCU: Adjuttnn eemmetry for rcu_fanout_leaf=16, nr_cp__ids=1
[ 0.000000] NRIIRQS:8448 nr_irqs:25611
[ 0.000000] oonsole: colour VGA+ 80x25
[ 0.000000] console[[tty0] enabled
[ 00000000]ccnnooee[[ttyS]]eeaalldd
[ 00000000]] tcc Fatt TCCccalibration faieed
[ 00.000000] tcc PIT aaiibrttio macche PMTIEER. 2lloops
[ ..000000] ss::DDetccte 2294.722MMHzpprocessor
[ 0.000083] Calibrating delay loop (skipped), value calculated using timer frequency.. 4589.44 BogoMIPS (lpj=2294722)
[ 0.263865] pid_max: default: 32768 minimum: 301
[ 0.379406] ACPI: Core revision 20150410
[ 0.459659] ACPI: All ACPI Tables successfully acquired
[ 0.564074] Security Framework initialized
[ 0.659214] SELinux: Disabled at boot.
[ 0.748962] Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.897751] Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 1.049069] Mount-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 1.218679] Mountpoint-cache hash table entries: 1024 (order: 1, 8192 bytes)
[ 1.403216] Initializing cgroup subsys blkio
[ 1.523197] Initializing cgroup subsys memory
[ 1.548614] Initializing cgroup subsys devices
[ 1.673169] Initializing cgroup subsys freezer
[ 1.808577] Initializing cgroup subsys net_cls
[ 1.928508] Initializing cgroup subsys perf_event
[ 2.068311] Initializing cgroup subsys net_prio
[ 2.158471] CPU: Physical Processor ID: 0
[ 2.248740] mce: CPU supports 0 MCE banks
[ 2.377786] process: using mwait in idle threads
[ 2.473732] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 2.638000] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 2.827638] Freeing SMP alternatives memory: 24K (ffffffff83285000 - ffffffff8328b000)
[ 3.040731] ftrace: allocating 21287 entries in 84 pages
[ 3.238092] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 3.396661] smpboot: CPU0: Intel(R) Core(TM) i7-4712HQ CPU @ 2.30GHz (fam: 06, model: 3c, stepping: 03)
[ 3.480643] Performance Events: unsupported p6 CPU model 60 no PMU driver, software events only.
[ 3.551956] x86: Booted up 1 node, 1 CPUs
[ 3.583438] smpboot: Total of 1 processors activated (4589.44 BogoMIPS)
[ 3.624554] NMI watchdog: disabled (cpu0): hardware events not enabled
[ 3.688366] NMI watchdog: Shutting down hard lockup detector on all cpus
[ 3.736548] devtmpfs: initialized
[ 3.768760] clocksource jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 3.863421] pinctrl core: initialized pinctrl subsystem
[ 3.919470] NET: Registered protocol family 16
[ 3.960334] cpuidle: using governor ladder
[ 3.987178] cpuidle: using governor menu
[ 4.026309] ACPI: bus type PCI registered
[ 4.067207] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 4.103114] dca service started, version 1.12.1
[ 4.127195] PCI: Using configuration type 1 for base access
[ 4.177493] ACPI: Added _OSI(Module Device)
[ 4.226965] ACPI: Added _OSI(Processor Device)
[ 4.267100] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 4.306944] ACPI: Added _OSI(Processor Aggregator Device)
[ 4.367368] ACPI: Executed 1 blocks of module-level executable AML code
[ 4.417032] ACPI: Interpreter enabled
[ 4.438840] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150410/hwxface-580)
[ 4.523888] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150410/hwxface-580)
[ 4.605748] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S3_] (20150410/hwxface-580)
[ 4.702610] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S4_] (20150410/hwxface-580)
[ 4.788651] ACPI: (supports S0 S5)
[ 4.815625] ACPI: Using IOAPIC for interrupt routing
[ 4.850532] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 4.941848] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 4.986707] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[ 5.040559] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[ 5.090520] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 5.198494] PCI host bridge to bus 0000:00
[ 5.210276] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 5.243386] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 5.293205] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 5.348187] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 5.416160] pci_bus 0000:00: root bus resource [mem 0x20000000-0xffdfffff window]
[ 5.458852] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 5.507853] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 5.554261] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 5.594133] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 5.641901] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 9 10 11) *0, disabled.
[ 5.702742] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 9 10 *11)
[ 5.749581] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 9 *10 11)
[ 5.805125] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 *9 10 11)
[ 5.858723] ACPI: Enabled 2 GPEs in block 00 to 07
[ 5.905616] vgaarb: setting as boot device: PCI:0000:00:02.0
[ 5.937694] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[ 5.996101] vgaarb: loaded
[ 6.007532] vgaarb: bridge control possible 0000:00:02.0
[ 6.049693] PCI: Using ACPI for IRQ routing
[ 6.090004] Switched to clocksource refined-jiffies
[ 6.129110] pnp: PnP ACPI init
[ 6.161303] pnp: PnP ACPI: found 4 devices
[ 6.199719] clocksource acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 6.277280] Switched to clocksource acpi_pm
[ 6.319710] NET: Registered protocol family 2
[ 6.715995] TCP established hash table entries: 4096 (order: 3, 32768 bytes)
[ 7.445442] TCP bind hash table entries: 4096 (order: 4, 65536 bytes)
[ 8.145012] TCP: Hash tables configured (established 4096 bind 4096)
[ 8.754702] UDP hash table entries: 256 (order: 1, 8192 bytes)
[ 9.404319] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[ 10.093956] NET: Registered protocol family 1
[ 10.503716] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 11.153363] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[ 11.829895] hrtimer: interrupt took 3687619 ns
[ 12.335560] Kernel panic - not syncing: broken padding
[ 12.882344] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.1.6-coreos-r1 #2
[ 13.591938] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
[ 14.481454] ffff88001eb0e700 ffff88001e9bbdd8 ffffffff815491cc 0000000000000ce4
[ 15.271496] ffffffff817b9ae1 ffff88001e9bbe58 ffffffff81545792 0000000055e67787
[ 16.021073] ffffffff00000010 ffff88001e9bbe68 ffff88001e9bbe08 ffff88001e9bbe58
[ 16.790647] Call Trace:
[ 17.050021] [] dump_stack+0x45/0x57
[ 17.579730] [] panic+0xc1/0x1f5
[ 18.059467] [] ? maybe_link.part.2+0x110/0x110
[ 18.679111] [] populate_rootfs+0x2f/0x116
[ 19.188832] [] do_one_initcall+0xd4/0x210
[ 19.798475] [] ? parse_args+0x1f0/0x470
[ 20.398164] [] ? __wake_up+0x48/0x60
[ 20.977819] [] kernel_init_freeable+0x173/0x200
[ 21.607467] [] ? initcall_blacklist+0xc0/0xc0
[ 22.277112] [] ? rest_init+0x80/0x80
[ 22.836784] [] kernel_init+0xe/0xf0
[ 23.386476] [] ret_from_fork+0x42/0x70
[ 23.956182] [] ? rest_init+0x80/0x80
[ 24.535888] Rebooting in 60 seconds..
[ 84.945552] ACPI MEMORY or I/O RESET_REG.
crawford commented 8 years ago

Comment by dongsupark

I'll summarize what I've found out:

AlexNPavel commented 7 years ago

I cannot reproduce this. Is this still a problem?