search

awslabs / amazon-ebs-autoscale

Don't run out of disk space on your EC2 instance when generating or working with large files. Automatically add EBS volumes to a filesystem mount point in response to disk utilization.
MIT License
111 stars 60 forks source link

ebs-autoscale service stops cloud boothook init process #13

Open pditommaso opened 4 years ago

pditommaso commented 4 years ago

I've noticed the ebs-autoscale service stops the Ec2 instance bootstrap when using the a GPU enabled instance. Note the last line in the instance log

[    0.000000] Linux version 4.14.181-142.260.amzn2.x86_64 (mockbuild@ip-10-0-1-132) (gcc version 7.3.1 20180712 (Red Hat 7.3.1-8) (GCC)) #1 SMP Wed Jun 24 19:07:39 UTC 2020
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.14.181-142.260.amzn2.x86_64 root=UUID=4abd235b-dc3a-4516-93ec-e7966d52defe ro console=tty0 console=ttyS0,115200n8 net.ifnames=0 biosdevname=0 nvme_core.io_timeout=4294967295 rd.emergency=poweroff rd.shell=0
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Xen HVM domU, BIOS 4.2.amazon 08/24/2006
[    0.000000] Hypervisor detected: Xen HVM
[    0.000000] Xen version 4.2.
[    0.000000] Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[    0.000000] Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[    0.000000] You might have to change the root device
[    0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[    0.000000] in your root= kernel command line option
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] e820: last_pfn = 0x80000 max_arch_pfn = 0x400000000
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] found SMP MP-table at [mem 0x000fbc50-0x000fbc5f]
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] RAMDISK: [mem 0x354f8000-0x36a73fff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen   )
[    0.000000] ACPI: XSDT 0x00000000FC00E2A0 000054 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: FACP 0x00000000FC00DF60 0000F4 (v04 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: DSDT 0x00000000FC0021C0 00BD19 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: FACS 0x00000000FC002180 000040
[    0.000000] ACPI: FACS 0x00000000FC002180 000040
[    0.000000] ACPI: APIC 0x00000000FC00E060 0000D8 (v02 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: HPET 0x00000000FC00E1B0 000038 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: WAET 0x00000000FC00E1F0 000028 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.000000] ACPI: SSDT 0x00000000FC00E220 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] ACPI: SSDT 0x00000000FC00E260 000033 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000007fffffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x7ffde000-0x7fffffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x000000007fffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x000000007fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000007fffffff]
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 15 CPUs, 14 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] e820: [mem 0x80000000-0xfbffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on Xen HVM
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x94/0x4cb with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:15 nr_cpu_ids:15 nr_node_ids:1
[    0.000000] percpu: Embedded 44 pages/cpu s140504 r8192 d31528 u262144
[    0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 515976
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.14.181-142.260.amzn2.x86_64 root=UUID=4abd235b-dc3a-4516-93ec-e7966d52defe ro console=tty0 console=ttyS0,115200n8 net.ifnames=0 biosdevname=0 nvme_core.io_timeout=4294967295 rd.emergency=poweroff rd.shell=0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 2011720K/2096756K available (10252K kernel code, 1957K rwdata, 2776K rodata, 2084K init, 4236K bss, 85036K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[    0.000000] Kernel/User page tables isolation: enabled
[    0.000000] ftrace: allocating 26656 entries in 105 pages
[    0.004000] Hierarchical RCU implementation.
[    0.004000]  RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=15.
[    0.004000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=15
[    0.004000] NR_IRQS: 524544, nr_irqs: 952, preallocated irqs: 16
[    0.004000] xen:events: Using 2-level ABI
[    0.004000] xen:events: Xen HVM callback vector for event delivery is enabled
[    0.004000] Console: colour VGA+ 80x25
[    0.004000] console [tty0] enabled
[    0.004000] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    0.004000] console [ttyS0] enabled
[    0.004000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[    0.008000] tsc: Fast TSC calibration using PIT
[    0.020004] tsc: Detected 2299.952 MHz processor
[    0.024011] Calibrating delay loop (skipped), value calculated using timer frequency.. 4600.11 BogoMIPS (lpj=9200232)
[    0.036006] pid_max: default: 32768 minimum: 301
[    0.048022] ACPI: Core revision 20170728
[    0.055478] ACPI: 3 ACPI AML tables successfully acquired and loaded
[    0.060032] Security Framework initialized
[    0.064005] SELinux:  Initializing.
[    0.067663] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.072201] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.076017] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes)
[    0.084012] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes)
[    0.088287] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[    0.092005] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[    0.096006] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.104003] Spectre V2 : Mitigation: Full generic retpoline
[    0.108002] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.116002] Speculative Store Bypass: Vulnerable
[    0.120029] MDS: Vulnerable: Clear CPU buffers attempted, no microcode
[    0.133402] smpboot: Max logical packages: 15
[    0.136830] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.144003] Switched APIC routing to physical flat.
[    0.150742] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    0.195365] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.200022] installing Xen timer for CPU 0
[    0.204088] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[    0.208033] cpu 0 spinlock event irq 53
[    0.212035] Performance Events: unsupported p6 CPU model 79 no PMU driver, software events only.
[    0.216041] Hierarchical SRCU implementation.
[    0.220123] NMI watchdog: Perf event create on CPU 0 failed with -2
[    0.224006] NMI watchdog: Perf NMI watchdog permanently disabled
[    0.228218] smp: Bringing up secondary CPUs ...
[    0.232007] smp: Brought up 1 node, 1 CPU
[    0.235699] smpboot: Total of 1 processors activated (4600.11 BogoMIPS)
[    0.236520] devtmpfs: initialized
[    0.239582] x86/mm: Memory block size: 128MB
[    0.240286] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.244024] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    0.248266] NET: Registered protocol family 16
[    0.252270] cpuidle: using governor ladder
[    0.256010] cpuidle: using governor menu
[    0.259675] ACPI: bus type PCI registered
[    0.260008] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.264358] PCI: Using configuration type 1 for base access
[    0.271306] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.272219] ACPI: Added _OSI(Module Device)
[    0.276012] ACPI: Added _OSI(Processor Device)
[    0.279753] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.280004] ACPI: Added _OSI(Processor Aggregator Device)
[    0.286350] ACPI: Interpreter enabled
[    0.288014] ACPI: (supports S0 S4 S5)
[    0.291472] ACPI: Using IOAPIC for interrupt routing
[    0.292035] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.296421] ACPI: Enabled 2 GPEs in block 00 to 0F
[    0.353885] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.356020] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[    0.360026] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.364023] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.369131] acpiphp: Slot [0] registered
[    0.373232] acpiphp: Slot [3] registered
[    0.376917] acpiphp: Slot [4] registered
[    0.380519] acpiphp: Slot [5] registered
[    0.384495] acpiphp: Slot [6] registered
[    0.388481] acpiphp: Slot [7] registered
[    0.392596] acpiphp: Slot [8] registered
[    0.396543] acpiphp: Slot [9] registered
[    0.400475] acpiphp: Slot [10] registered
[    0.404460] acpiphp: Slot [11] registered
[    0.408369] acpiphp: Slot [12] registered
[    0.412359] acpiphp: Slot [13] registered
[    0.416400] acpiphp: Slot [14] registered
[    0.420472] acpiphp: Slot [15] registered
[    0.424578] acpiphp: Slot [16] registered
[    0.428443] acpiphp: Slot [17] registered
[    0.432390] acpiphp: Slot [18] registered
[    0.436215] acpiphp: Slot [19] registered
[    0.440291] acpiphp: Slot [20] registered
[    0.444325] acpiphp: Slot [21] registered
[    0.448409] acpiphp: Slot [22] registered
[    0.452591] acpiphp: Slot [23] registered
[    0.456669] acpiphp: Slot [24] registered
[    0.460665] acpiphp: Slot [25] registered
[    0.464533] acpiphp: Slot [26] registered
[    0.468487] acpiphp: Slot [27] registered
[    0.472492] acpiphp: Slot [28] registered
[    0.476484] acpiphp: Slot [29] registered
[    0.480641] acpiphp: Slot [30] registered
[    0.484486] acpiphp: Slot [31] registered
[    0.488437] PCI host bridge to bus 0000:00
[    0.492008] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.496008] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.500008] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.504008] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfbffffff window]
[    0.508008] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.521894] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.524006] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.528007] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.532007] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.536979] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
[    0.536979] * this clock source is slow. Consider trying other clock sources
[    0.542850] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.556000] ACPI: PCI Interrupt Link [LNKA] (IRQs *5 10 11)
[    0.556268] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.560260] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.564269] ACPI: PCI Interrupt Link [LNKD] (IRQs *5 10 11)
[    0.590724] xen:balloon: Initialising balloon driver
[    0.604588] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[    0.608000] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.608029] pci 0000:00:02.0: vgaarb: bridge control possible
[    0.612004] vgaarb: loaded
[    0.615046] EDAC MC: Ver: 3.0.0
[    0.616633] PCI: Using ACPI for IRQ routing
[    0.620753] NetLabel: Initializing
[    0.624005] NetLabel:  domain hash size = 128
[    0.628006] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.632026] NetLabel:  unlabeled traffic allowed by default
[    0.636311] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.640028] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.644007] hpet0: 3 comparators, 64-bit 62.500000 MHz counter
[    0.650114] clocksource: Switched to clocksource xen
[    0.665004] VFS: Disk quotas dquot_6.6.0
[    0.670761] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.681357] pnp: PnP ACPI init
[    0.686556] system 00:00: [mem 0x00000000-0x0009ffff] could not be reserved
[    0.695818] system 00:01: [io  0x08a0-0x08a3] has been reserved
[    0.703772] system 00:01: [io  0x0cc0-0x0ccf] has been reserved
[    0.713511] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.722011] system 00:07: [io  0x10c0-0x1141] has been reserved
[    0.728096] system 00:07: [io  0xb044-0xb047] has been reserved
[    0.759256] pnp: PnP ACPI: found 8 devices
[    0.770883] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.789604] NET: Registered protocol family 2
[    0.796172] TCP established hash table entries: 16384 (order: 5, 131072 bytes)
[    0.805774] TCP bind hash table entries: 16384 (order: 6, 262144 bytes)
[    0.815526] TCP: Hash tables configured (established 16384 bind 16384)
[    0.826196] UDP hash table entries: 1024 (order: 3, 32768 bytes)
[    0.845199] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes)
[    0.851890] NET: Registered protocol family 1
[    0.856713] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.862691] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.868694] random: fast init done
[    0.873831] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.879716] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.889716] Unpacking initramfs...
[    0.949003] Freeing initrd memory: 22000K
[    0.954387] Scanning for low memory corruption every 60 seconds
[    0.961712] audit: initializing netlink subsys (disabled)
[    0.971340] Initialise system trusted keyrings
[    0.980476] Key type blacklist registered
[    0.995477] audit: type=2000 audit(1594393169.218:1): state=initialized audit_enabled=0 res=1
[    1.014686] workingset: timestamp_bits=36 max_order=19 bucket_order=0
[    1.021608] zbud: loaded
[    1.183355] Key type asymmetric registered
[    1.187714] Asymmetric key parser 'x509' registered
[    1.192781] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251)
[    1.200911] io scheduler noop registered (default)
[    1.206376] io scheduler cfq registered
[    1.211508] crc32: CRC_LE_BITS = 64, CRC_BE BITS = 64
[    1.217238] crc32: self tests passed, processed 225944 bytes in 151583 nsec
[    1.226110] crc32c: CRC_LE_BITS = 64
[    1.233542] crc32c: self tests passed, processed 225944 bytes in 75881 nsec
[    1.250795] crc32_combine: 8373 self tests passed
[    1.269175] crc32c_combine: 8373 self tests passed
[    1.276809] xen:grant_table: Grant tables using version 1 layout
[    1.285331] Grant table initialized
[    1.289448] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    1.295304] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    1.340730] 00:06: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.349030] xen_netfront: Initialising Xen virtual ethernet driver
[    1.356093] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
[    1.365796] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.370894] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.378200] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    1.386244] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0
[    1.391387] rtc_cmos 00:02: alarms up to one day, 114 bytes nvram, hpet irqs
[    1.396913] hidraw: raw HID events driver (C) Jiri Kosina
[    1.403631] NET: Registered protocol family 17
[    1.408254] mce: Using 2 MCE banks
[    1.412810] sched_clock: Marking stable (1412781104, 0)->(2382986251, -970205147)
[    1.419690] registered taskstats version 1
[    1.423834] Loading compiled-in X.509 certificates
[    1.430647] Loaded X.509 cert 'Build time autogenerated kernel key: ec1f0501375e6326d44c78d99d988dda1ca5bd80'
[    1.439328] zswap: loaded using pool lzo/zbud
[    1.443477] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[    1.449103] ima: Allocated hash algorithm: sha1
[    1.556122] xenbus_probe_frontend: Device with no driver: device/vbd/51712
[    1.562594] rtc_cmos 00:02: setting system clock to 2020-07-10 14:59:29 UTC (1594393169)
[    1.573099] Freeing unused kernel memory: 2084K
[    1.584128] Write protecting the kernel read-only data: 16384k
[    1.589778] Freeing unused kernel memory: 2016K
[    1.596378] Freeing unused kernel memory: 1320K
[    1.637914] systemd[1]: Inserted module 'autofs4'
[    1.655998] NET: Registered protocol family 10
[    1.661830] Segment Routing with IPv6
[    1.665102] systemd[1]: Inserted module 'ipv6'
[    1.669568] random: systemd: uninitialized urandom read (16 bytes read)
[    1.674827] random: systemd: uninitialized urandom read (16 bytes read)
[    1.680127] random: systemd: uninitialized urandom read (16 bytes read)
[    1.686523] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[    1.701101] systemd[1]: Detected virtualization xen.
[    1.705923] systemd[1]: Detected architecture x86-64.
[    1.710688] systemd[1]: Running in initial RAM disk.

Welcome to Amazon Linux 2 dracut-033-535.amzn2.1.3 (Initramfs)!

[    1.720100] systemd[1]: No hostname configured.
[    1.724356] systemd[1]: Set hostname to <localhost>.
[    1.728984] systemd[1]: Initializing machine ID from random generator.
[  OK  ] Reached target Swap.
[    1.764905] systemd[1]: Reached target Swap.
[    1.768804] systemd[1]: Starting Swap.
[  OK  ] Created slice Root Slice.
[    1.776540] systemd[1]: Created slice Root Slice.
[  OK  ] Listening on udev Control Socket.
[  OK  ] Created slice System Slice.
[  OK  ] Listening on Journal Socket.
         Starting Apply Kernel Variables...
         Starting Journal Service...
[  OK  ] Reached target Timers.
[  OK  ] Reached target Local File Systems.
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Reached target Slices.
         Starting Create list of required st... nodes for the current kernel...
[  OK  ] Reached target Paths.
[  OK  ] Reached target Sockets.
[  OK  ] Started Journal Service.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Started Create list of required sta...ce nodes for the current kernel.
         Starting Create Static Device Nodes in /dev...
[  OK  ] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[  OK  ] Started udev Kernel Device Manager.
         Starting dracut pre-trigger hook...
[  OK  ] Started dracut pre-trigger hook.
         Starting udev Coldplug all Devices...
[  OK  ] Started udev Coldplug all Devices.
[  OK  ] Reached target System Initialization.
[  OK  ] Reached target Basic System.
         Starting dracut initqueue hook...
[    1.984088] tsc: Refined TSC clocksource calibration: 2300.001 MHz
[    1.988940] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x212735f0517, max_idle_ns: 440795237604 ns
[    2.017145] SCSI subsystem initialized
[    2.036875] Invalid max_queues (4), will use default max: 1.
[    2.062100] scsi host0: ata_piix
[    2.065832] scsi host1: ata_piix
[    2.068899] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc100 irq 14
[    2.075426] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc108 irq 15
[    2.104398] blkfront: xvda: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
[    2.125760]  xvda: xvda1
[  OK  ] Found device /dev/disk/by-uuid/4abd235b-dc3a-4516-93ec-e7966d52defe.
         Starting File System Check on /dev/...b-dc3a-4516-93ec-e7966d52defe...
[  OK  ] Started File System Check on /dev/d...35b-dc3a-4516-93ec-e7966d52defe.
[  OK  ] Started dracut initqueue hook.
         Mounting /sysroot...
[  OK  ] Reached target Remote File Systems (Pre).
[  OK  ] Reached target Remote File Systems.
[    2.314625] EXT4-fs (xvda1): mounted filesystem with ordered data mode. Opts: (null)
[  OK  ] Mounted /sysroot.
[  OK  ] Reached target Initrd Root File System.
         Starting Reload Configuration from the Real Root...
[  OK  ] Started Reload Configuration from the Real Root.
[  OK  ] Reached target Initrd File Systems.
[  OK  ] Reached target Initrd Default Target.
         Starting dracut pre-pivot and cleanup hook...
[  OK  ] Started dracut pre-pivot and cleanup hook.
         Starting Cleaning Up and Shutting Down Daemons...
[  OK  ] Stopped Cleaning Up and Shutting Down Daemons.
[  OK  ] Stopped dracut pre-pivot and cleanup hook.
         Stopping dracut pre-pivot and cleanup hook...
[  OK  ] Stopped target Remote File Systems.
[  OK  ] Stopped target Remote File Systems (Pre).
[  OK  ] Stopped dracut initqueue hook.
         Stopping dracut initqueue hook...
[  OK  ] Stopped target Initrd Default Target.
[  OK  ] Stopped target Basic System.
[  OK  ] Stopped target Sockets.
[  OK  ] Stopped target Paths.
[  OK  ] Stopped target System Initialization.
[  OK  ] Stopped target Local File Systems.
[  OK  ] Stopped target Swap.
[  OK  ] Stopped Apply Kernel Variables.
         Stopping Apply Kernel Variables...
[  OK  ] Stopped udev Coldplug all Devices.
         Stopping udev Coldplug all Devices...
[  OK  ] Stopped dracut pre-trigger hook.
         Stopping dracut pre-trigger hook...
         Stopping udev Kernel Device Manager...
[  OK  ] Stopped target Slices.
[  OK  ] Stopped target Timers.
[  OK  ] Stopped udev Kernel Device Manager.
[  OK  ] Stopped Create Static Device Nodes in /dev.
         Stopping Create Static Device Nodes in /dev...
[  OK  ] Stopped Create list of required sta...ce nodes for the current kernel.
         Stopping Create list of required st... nodes for the current kernel...
[  OK  ] Closed udev Kernel Socket.
[  OK  ] Closed udev Control Socket.
         Starting Cleanup udevd DB...
[  OK  ] Started Cleanup udevd DB.
[  OK  ] Reached target Switch Root.
         Starting Switch Root...
[    2.649234] systemd-journald[932]: Received SIGTERM from PID 1 (systemd).
[    3.226413] systemd: 25 output lines suppressed due to ratelimiting
[    3.662003] SELinux:  Disabled at runtime.
[    3.668088] audit: type=1404 audit(1594393171.604:2): selinux=0 auid=4294967295 ses=4294967295
[    3.874246] ip_tables: (C) 2000-2006 Netfilter Core Team
[    3.880114] systemd[1]: Inserted module 'ip_tables'

Welcome to Amazon Linux 2!

[  OK  ] Stopped Switch Root.
[[    4.411489] random: crng init done
[    4.414627] random: 7 urandom warning(s) missed due to ratelimiting
  OK  ] Stopped Journal Service.
         Starting Journal Service...
[  OK  ] Listening on Delayed Shutdown Socket.
[  OK  ] Created slice system-serial\x2dgetty.slice.
         Mounting Huge Pages File System...
[  OK  ] Reached target Local Encrypted Volumes.
         Starting Read and set NIS domainname from /etc/sysconfig/network...
         Mounting Debug File System...
[  OK  ] Created slice system-getty.slice.
[  OK  ] Created slice User and Session Slice.
[  OK  ] Reached target Slices.
[  OK  ] Created slice system-selinux\x2dpol...grate\x2dlocal\x2dchanges.slice.
[  OK  ] Listening on udev Control Socket.
[  OK  ] Reached target Swap.
         Starting Remount Root and Kernel File Systems...
         Starting Setup Virtual Console...
[  OK  ] Set up automount Arbitrary Executab...ats File System Automount Point.
[  OK  ] Listening on /dev/initctl Compatibility Named Pipe.
[    4.548231] EXT4-fs (xvda1): re-mounted. Opts: (null)
         Starting Create list of required st... nodes for the current kernel...
         Mounting POSIX Message Queue File System...
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Stopped target Switch Root.
[  OK  ] Stopped target Initrd File Systems.
[  OK  ] Stopped target Initrd Root File System.
[  OK  ] Mounted Huge Pages File System.
[  OK  ] Mounted POSIX Message Queue File System.
[  OK  ] Mounted Debug File System.
[  OK  ] Started Journal Service.
[  OK  ] Started Read and set NIS domainname from /etc/sysconfig/network.
[  OK  ] Started Remount Root and Kernel File Systems.
[  OK  ] Started Setup Virtual Console.
[  OK  ] Started Create list of required sta...ce nodes for the current kernel.
         Starting Create Static Device Nodes in /dev...
         Starting Load Kernel Modules...
         Starting Rebuild Hardware Database...
         Starting Configure read-only root support...
         Starting Flush Journal to Persistent Storage...
[  OK  ] Started Load Kernel Modules.
         Starting Apply Kernel Variables...
[  OK  ] Started Configure read-only root support.
         Starting Load/Save Random Seed...
[    4.794687] systemd-journald[1664]: Received request to flush runtime journal from PID 1
[  OK  ] Started Load/Save Random Seed.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Started Flush Journal to Persistent Storage.
[  OK  ] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[  OK  ] Reached target Local File Systems (Pre).
[  OK  ] Reached target Local File Systems.
         Starting Rebuild Journal Catalog...
         Starting Mark the need to relabel after reboot...
         Starting Preprocess NFS configuration...
         Starting Create Volatile Files and Directories...
[  OK  ] Started Rebuild Journal Catalog.
[  OK  ] Started Mark the need to relabel after reboot.
[  OK  ] Started Preprocess NFS configuration.
[  OK  ] Started Create Volatile Files and Directories.
         Starting Security Auditing Service...
         Mounting RPC Pipe File System...
[  OK  ] Started udev Kernel Device Manager.
[    5.095446] RPC: Registered named UNIX socket transport module.
[    5.102526] RPC: Registered udp transport module.
[    5.107821] RPC: Registered tcp transport module.
[    5.113123] RPC: Registered tcp NFSv4.1 backchannel transport module.
[  OK  ] Mounted RPC Pipe File System.
[  OK  ] Reached target rpc_pipefs.target.
[  OK  ] Started Security Auditing Service.
         Starting Update UTMP about System Boot/Shutdown...
[  OK  ] Started Update UTMP about System Boot/Shutdown.
[  OK  ] Started Rebuild Hardware Database.
         Starting udev Coldplug all Devices...
         Starting Update is Completed...
[  OK  ] Started Update is Completed.
[  OK  ] Started udev Coldplug all Devices.
[  OK  ] Reached target System Initialization.
[  OK  ] Reached target Timers.
[  OK  ] Listening on RPCbind Server Activation Socket.
         Starting RPC bind service...
[  OK  ] Listening on Amazon Elastic Container Service Volume Plugin.
[  OK  ] Listening on D-Bus System Message Bus Socket.
[  OK  ] Reached target Paths.
[  OK  ] Listening on Docker Socket for the API.
[  OK  ] Reached target Sockets.
[  OK  ] Reached target Basic System.
         Starting NTP client/server...
[  OK  ] Started Hardware RNG Entropy Gatherer Daemon.
         Starting Hardware RNG Entropy Gatherer Daemon...
         Starting Dump dmesg to /var/log/dmesg...
         Starting ACPI Event Daemon...
[  OK  ] Started D-Bus System Message Bus.
[    6.416123] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[    6.439513] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input4
[    6.453200] ACPI: Power Button [PWRF]
[    6.456985] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input5
[    6.463906] ACPI: Sleep Button [SLPF]
[    6.598357] mousedev: PS/2 mouse device common for all mice
[    6.677864] AVX2 version of gcm_enc/dec engaged.
[    6.684277] AES CTR mode by8 optimization enabled
         Starting D-Bus System Message Bus...
         Starting Initial cloud-init job (pre-networking)...
         Starting GSSAPI Proxy Daemon...
         Starting Login Service...
[  OK  ] Started irqbalance daemon.
         Starting irqbalance daemon...
[  OK  ] Started RPC bind service.
[  OK  ] Started Dump dmesg to /var/log/dmesg.
[  OK  ] Started ACPI Event Daemon.
[  OK  ] Started NTP client/server.
[  OK  ] Found device /dev/ttyS0.
[    6.794995] alg: No test for pcbc(aes) (pcbc-aes-aesni)
[  OK  ] Created slice system-ec2net\x2difup.slice.
[    6.930025] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[    6.935415] EDAC sbridge:  Ver: 1.1.2 
[  OK  ] Started Login Service.
[  OK  ] Started GSSAPI Proxy Daemon.
[  OK  ] Reached target NFS client services.
[  OK  ] Reached target Remote File Systems (Pre).
[  OK  ] Reached target Remote File Systems.
[  OK  ] Started Initial cloud-init job (pre-networking).
[  OK  ] Reached target Network (Pre).
         Starting LSB: Bring up/down networking...
[   13.481964] cloud-init[3021]: Cloud-init v. 19.3-3.amzn2 running 'init-local' at Fri, 10 Jul 2020 14:59:41 +0000. Up 13.37 seconds.
[  OK  ] Started LSB: Bring up/down networking.
[  OK  ] Reached target Network.
         Starting containerd container runtime...
[  OK  ] Started Amazon Elastic Container Service Volume Plugin.
         Starting Amazon Elastic Container Service Volume Plugin...
         Starting Postfix Mail Transport Agent...
         Starting Initial cloud-init job (metadata service crawler)...
[  OK  ] Started containerd container runtime.
[   17.069180] cloud-init[3632]: Cloud-init v. 19.3-3.amzn2 running 'init' at Fri, 10 Jul 2020 14:59:44 +0000. Up 17.04 seconds.
[   17.086409] cloud-init[3632]: ci-info: ++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
[   17.096311] cloud-init[3632]: ci-info: +--------+------+-----------------------------+---------------+--------+-------------------+
[   17.104273] cloud-init[3632]: ci-info: | Device |  Up  |           Address           |      Mask     | Scope  |     Hw-Address    |
[   17.116295] cloud-init[3632]: ci-info: +--------+------+-----------------------------+---------------+--------+-------------------+
[   17.125790] cloud-init[3632]: ci-info: |  eth0  | True |         172.31.19.95        | 255.255.240.0 | global | 06:d4:1c:6a:d7:72 |
[   17.136537] cloud-init[3632]: ci-info: |  eth0  | True | fe80::4d4:1cff:fe6a:d772/64 |       .       |  link  | 06:d4:1c:6a:d7:72 |
[   17.147369] cloud-init[3632]: ci-info: |   lo   | True |          127.0.0.1          |   255.0.0.0   |  host  |         .         |
[   17.160291] cloud-init[3632]: ci-info: |   lo   | True |           ::1/128           |       .       |  host  |         .         |
[   17.173510] cloud-init[3632]: ci-info: +--------+------+-----------------------------+---------------+--------+-------------------+
[   17.180466] cloud-init[3632]: ci-info: ++++++++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++++++
[   17.186017] cloud-init[3632]: ci-info: +-------+-----------------+-------------+-----------------+-----------+-------+
[   17.191432] cloud-init[3632]: ci-info: | Route |   Destination   |   Gateway   |     Genmask     | Interface | Flags |
[   17.196198] cloud-init[3632]: ci-info: +-------+-----------------+-------------+-----------------+-----------+-------+
[   17.200758] cloud-init[3632]: ci-info: |   0   |     0.0.0.0     | 172.31.16.1 |     0.0.0.0     |    eth0   |   UG  |
[   17.205669] cloud-init[3632]: ci-info: |   1   | 169.254.169.254 |   0.0.0.0   | 255.255.255.255 |    eth0   |   UH  |
[   17.210670] cloud-init[3632]: ci-info: |   2   |   172.31.16.0   |   0.0.0.0   |  255.255.240.0  |    eth0   |   U   |
[   17.218692] cloud-init[3632]: ci-info: +-------+-----------------+-------------+-----------------+-----------+-------+
[   17.232598] cloud-init[3632]: ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
[   17.238951] cloud-init[3632]: ci-info: +-------+-------------+---------+-----------+-------+
[   17.246216] cloud-init[3632]: ci-info: | Route | Destination | Gateway | Interface | Flags |
[   17.253093] cloud-init[3632]: ci-info: +-------+-------------+---------+-----------+-------+
[   17.257154] cloud-init[3632]: ci-info: |   9   |  fe80::/64  |    ::   |    eth0   |   U   |
[   17.263411] cloud-init[3632]: ci-info: |   11  |    local    |    ::   |    eth0   |   U   |
[   17.269683] cloud-init[3632]: ci-info: |   12  |   ff00::/8  |    ::   |    eth0   |   U   |
[   17.276207] cloud-init[3632]: ci-info: +-------+-------------+---------+-----------+-------+
         Starting Hostname Service...
[  OK  ] Started Hostname Service.
[  OK  ] Started Postfix Mail Transport Agent.
<13>Jul 10 15:00:11 userdata0: + yum install -y jq sed wget unzip git btrfs-progs lvm2
<13>Jul 10 15:00:11 userdata0: Loaded plugins: dkms-build-requires, priorities, update-motd, upgrade-helper
<13>Jul 10 15:00:15 userdata0: Package sed-4.2.2-5.amzn2.0.2.x86_64 already installed and latest version
<13>Jul 10 15:00:17 userdata0: Resolving Dependencies
<13>Jul 10 15:00:17 userdata0: --> Running transaction check
<13>Jul 10 15:00:17 userdata0: ---> Package btrfs-progs.x86_64 0:4.15.1-1.amzn2.0.1 will be installed
<13>Jul 10 15:00:17 userdata0: --> Processing Dependency: libzstd.so.1()(64bit) for package: btrfs-progs-4.15.1-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: liblzo2.so.2()(64bit) for package: btrfs-progs-4.15.1-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: ---> Package git.x86_64 0:2.23.3-1.amzn2.0.1 will be installed
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: perl-Git = 2.23.3-1.amzn2.0.1 for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: git-core-doc = 2.23.3-1.amzn2.0.1 for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: git-core = 2.23.3-1.amzn2.0.1 for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: emacs-filesystem >= 25.3 for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: perl(Term::ReadKey) for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: perl(Git::I18N) for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: perl(Git) for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libsecret-1.so.0()(64bit) for package: git-2.23.3-1.amzn2.0.1.x86_64
<13>Jul 10 15:00:18 userdata0: ---> Package jq.x86_64 0:1.5-1.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: ---> Package lvm2.x86_64 7:2.02.177-4.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: lvm2-libs = 7:2.02.177-4.amzn2.0.2 for package: 7:lvm2-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: device-mapper-persistent-data >= 0.7.0-0.1.rc6 for package: 7:lvm2-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: liblvm2app.so.2.2(Base)(64bit) for package: 7:lvm2-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libdevmapper-event.so.1.02(Base)(64bit) for package: 7:lvm2-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: liblvm2app.so.2.2()(64bit) for package: 7:lvm2-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libdevmapper-event.so.1.02()(64bit) for package: 7:lvm2-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: ---> Package unzip.x86_64 0:6.0-20.amzn2 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package wget.x86_64 0:1.14-18.amzn2.1 will be installed
<13>Jul 10 15:00:18 userdata0: --> Running transaction check
<13>Jul 10 15:00:18 userdata0: ---> Package device-mapper-event-libs.x86_64 7:1.02.146-4.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package device-mapper-persistent-data.x86_64 0:0.7.3-3.amzn2 will be installed
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libaio.so.1(LIBAIO_0.4)(64bit) for package: device-mapper-persistent-data-0.7.3-3.amzn2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libaio.so.1(LIBAIO_0.1)(64bit) for package: device-mapper-persistent-data-0.7.3-3.amzn2.x86_64
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: libaio.so.1()(64bit) for package: device-mapper-persistent-data-0.7.3-3.amzn2.x86_64
<13>Jul 10 15:00:18 userdata0: ---> Package emacs-filesystem.noarch 1:25.3-3.amzn2.0.1 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package git-core.x86_64 0:2.23.3-1.amzn2.0.1 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package git-core-doc.noarch 0:2.23.3-1.amzn2.0.1 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package libsecret.x86_64 0:0.18.5-2.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package libzstd.x86_64 0:1.3.3-1.amzn2.0.1 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package lvm2-libs.x86_64 7:2.02.177-4.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: device-mapper-event = 7:1.02.146-4.amzn2.0.2 for package: 7:lvm2-libs-2.02.177-4.amzn2.0.2.x86_64
<13>Jul 10 15:00:18 userdata0: ---> Package lzo.x86_64 0:2.06-8.amzn2.0.3 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package oniguruma.x86_64 0:5.9.6-1.amzn2.0.3 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package perl-Git.noarch 0:2.23.3-1.amzn2.0.1 will be installed
<13>Jul 10 15:00:18 userdata0: --> Processing Dependency: perl(Error) for package: perl-Git-2.23.3-1.amzn2.0.1.noarch
<13>Jul 10 15:00:18 userdata0: ---> Package perl-TermReadKey.x86_64 0:2.30-20.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: --> Running transaction check
<13>Jul 10 15:00:18 userdata0: ---> Package device-mapper-event.x86_64 7:1.02.146-4.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package libaio.x86_64 0:0.3.109-13.amzn2.0.2 will be installed
<13>Jul 10 15:00:18 userdata0: ---> Package perl-Error.noarch 1:0.17020-2.amzn2 will be installed
<13>Jul 10 15:00:19 userdata0: --> Finished Dependency Resolution
<13>Jul 10 15:00:19 userdata0: 
<13>Jul 10 15:00:19 userdata0: Dependencies Resolved
<13>Jul 10 15:00:19 userdata0: 
<13>Jul 10 15:00:19 userdata0: ================================================================================
<13>Jul 10 15:00:19 userdata0:  Package                       Arch   Version                  Repository  Size
<13>Jul 10 15:00:19 userdata0: ================================================================================
<13>Jul 10 15:00:19 userdata0: Installing:
<13>Jul 10 15:00:19 userdata0:  btrfs-progs                   x86_64 4.15.1-1.amzn2.0.1       amzn2-core 771 k
<13>Jul 10 15:00:19 userdata0:  git                           x86_64 2.23.3-1.amzn2.0.1       amzn2-core 135 k
<13>Jul 10 15:00:19 userdata0:  jq                            x86_64 1.5-1.amzn2.0.2          amzn2-core 154 k
<13>Jul 10 15:00:19 userdata0:  lvm2                          x86_64 7:2.02.177-4.amzn2.0.2   amzn2-core 1.3 M
<13>Jul 10 15:00:19 userdata0:  unzip                         x86_64 6.0-20.amzn2             amzn2-core 172 k
<13>Jul 10 15:00:19 userdata0:  wget                          x86_64 1.14-18.amzn2.1          amzn2-core 547 k
<13>Jul 10 15:00:19 userdata0: Installing for dependencies:
<13>Jul 10 15:00:19 userdata0:  device-mapper-event           x86_64 7:1.02.146-4.amzn2.0.2   amzn2-core 185 k
<13>Jul 10 15:00:19 userdata0:  device-mapper-event-libs      x86_64 7:1.02.146-4.amzn2.0.2   amzn2-core 185 k
<13>Jul 10 15:00:19 userdata0:  device-mapper-persistent-data x86_64 0.7.3-3.amzn2            amzn2-core 411 k
<13>Jul 10 15:00:19 userdata0:  emacs-filesystem              noarch 1:25.3-3.amzn2.0.1       amzn2-core  64 k
<13>Jul 10 15:00:19 userdata0:  git-core                      x86_64 2.23.3-1.amzn2.0.1       amzn2-core 5.0 M
<13>Jul 10 15:00:19 userdata0:  git-core-doc                  noarch 2.23.3-1.amzn2.0.1       amzn2-core 2.4 M
<13>Jul 10 15:00:19 userdata0:  libaio                        x86_64 0.3.109-13.amzn2.0.2     amzn2-core  24 k
<13>Jul 10 15:00:19 userdata0:  libsecret                     x86_64 0.18.5-2.amzn2.0.2       amzn2-core 153 k
<13>Jul 10 15:00:19 userdata0:  libzstd                       x86_64 1.3.3-1.amzn2.0.1        amzn2-core 203 k
<13>Jul 10 15:00:19 userdata0:  lvm2-libs                     x86_64 7:2.02.177-4.amzn2.0.2   amzn2-core 1.1 M
<13>Jul 10 15:00:19 userdata0:  lzo                           x86_64 2.06-8.amzn2.0.3         amzn2-core  62 k
<13>Jul 10 15:00:19 userdata0:  oniguruma                     x86_64 5.9.6-1.amzn2.0.3        amzn2-core 127 k
<13>Jul 10 15:00:19 userdata0:  perl-Error                    noarch 1:0.17020-2.amzn2        amzn2-core  32 k
<13>Jul 10 15:00:19 userdata0:  perl-Git                      noarch 2.23.3-1.amzn2.0.1       amzn2-core  47 k
<13>Jul 10 15:00:19 userdata0:  perl-TermReadKey              x86_64 2.30-20.amzn2.0.2        amzn2-core  31 k
<13>Jul 10 15:00:19 userdata0: 
<13>Jul 10 15:00:19 userdata0: Transaction Summary
<13>Jul 10 15:00:19 userdata0: ================================================================================
<13>Jul 10 15:00:19 userdata0: Install  6 Packages (+15 Dependent packages)
<13>Jul 10 15:00:19 userdata0: 
<13>Jul 10 15:00:19 userdata0: Total download size: 13 M
<13>Jul 10 15:00:19 userdata0: Installed size: 57 M
<13>Jul 10 15:00:19 userdata0: Downloading packages:
<13>Jul 10 15:00:19 userdata0: --------------------------------------------------------------------------------
<13>Jul 10 15:00:19 userdata0: Total                                               32 MB/s |  13 MB  00:00     
<13>Jul 10 15:00:19 userdata0: Running transaction check
<13>Jul 10 15:00:20 userdata0: Running transaction test
<13>Jul 10 15:00:20 userdata0: Transaction test succeeded
<13>Jul 10 15:00:20 userdata0: Running transaction
<13>Jul 10 15:00:25 userdata0:   Installing : 7:device-mapper-event-libs-1.02.146-4.amzn2.0.2.x86_64      1/21 
<13>Jul 10 15:00:26 userdata0:   Installing : git-core-2.23.3-1.amzn2.0.1.x86_64                          2/21 
<13>Jul 10 15:00:26 userdata0:   Installing : git-core-doc-2.23.3-1.amzn2.0.1.noarch                      3/21 
[  OK  ] Listening on Device-mapper event daemon FIFOs.
<13>Jul 10 15:00:26 userdata0:   Installing : 7:device-mapper-event-1.02.146-4.amzn2.0.2.x86_64           4/21 
<13>Jul 10 15:00:26 userdata0:   Installing : 7:lvm2-libs-2.02.177-4.amzn2.0.2.x86_64                     5/21 
<13>Jul 10 15:00:26 userdata0:   Installing : lzo-2.06-8.amzn2.0.3.x86_64                                 6/21 
<13>Jul 10 15:00:26 userdata0:   Installing : perl-TermReadKey-2.30-20.amzn2.0.2.x86_64                   7/21 
<13>Jul 10 15:00:26 userdata0:   Installing : oniguruma-5.9.6-1.amzn2.0.3.x86_64                          8/21 
<13>Jul 10 15:00:26 userdata0:   Installing : 1:perl-Error-0.17020-2.amzn2.noarch                         9/21 
<13>Jul 10 15:00:26 userdata0:   Installing : libaio-0.3.109-13.amzn2.0.2.x86_64                         10/21 
<13>Jul 10 15:00:26 userdata0:   Installing : device-mapper-persistent-data-0.7.3-3.amzn2.x86_64         11/21 
<13>Jul 10 15:00:26 userdata0:   Installing : libzstd-1.3.3-1.amzn2.0.1.x86_64                           12/21 
<13>Jul 10 15:00:26 userdata0:   Installing : libsecret-0.18.5-2.amzn2.0.2.x86_64                        13/21 
<13>Jul 10 15:00:26 userdata0:   Installing : 1:emacs-filesystem-25.3-3.amzn2.0.1.noarch                 14/21 
<13>Jul 10 15:00:27 userdata0:   Installing : perl-Git-2.23.3-1.amzn2.0.1.noarch                         15/21 
<13>Jul 10 15:00:27 userdata0:   Installing : git-2.23.3-1.amzn2.0.1.x86_64                              16/21 
<13>Jul 10 15:00:27 userdata0:   Installing : btrfs-progs-4.15.1-1.amzn2.0.1.x86_64                      17/21 
[  OK  ] Listening on LVM2 metadata daemon socket.
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...
[  OK  ] Started LVM2 metadata daemon.
         Starting LVM2 metadata daemon...
[  OK  ] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[  OK  ] Listening on LVM2 poll daemon socket.
<13>Jul 10 15:00:27 userdata0:   Installing : 7:lvm2-2.02.177-4.amzn2.0.2.x86_64                         18/21 
<13>Jul 10 15:00:27 userdata0: Created symlink from /etc/systemd/system/sysinit.target.wants/lvm2-lvmpolld.socket to /usr/lib/systemd/system/lvm2-lvmpolld.socket.
<13>Jul 10 15:00:27 userdata0:   Installing : jq-1.5-1.amzn2.0.2.x86_64                                  19/21 
<13>Jul 10 15:00:28 userdata0:   Installing : unzip-6.0-20.amzn2.x86_64                                  20/21 
<13>Jul 10 15:00:28 userdata0:   Installing : wget-1.14-18.amzn2.1.x86_64                                21/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : 1:emacs-filesystem-25.3-3.amzn2.0.1.noarch                  1/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : git-2.23.3-1.amzn2.0.1.x86_64                               2/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : btrfs-progs-4.15.1-1.amzn2.0.1.x86_64                       3/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : libsecret-0.18.5-2.amzn2.0.2.x86_64                         4/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : libzstd-1.3.3-1.amzn2.0.1.x86_64                            5/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : libaio-0.3.109-13.amzn2.0.2.x86_64                          6/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : wget-1.14-18.amzn2.1.x86_64                                 7/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : 7:lvm2-2.02.177-4.amzn2.0.2.x86_64                          8/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : 7:lvm2-libs-2.02.177-4.amzn2.0.2.x86_64                     9/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : unzip-6.0-20.amzn2.x86_64                                  10/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : git-core-2.23.3-1.amzn2.0.1.x86_64                         11/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : jq-1.5-1.amzn2.0.2.x86_64                                  12/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : device-mapper-persistent-data-0.7.3-3.amzn2.x86_64         13/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : 1:perl-Error-0.17020-2.amzn2.noarch                        14/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : 7:device-mapper-event-libs-1.02.146-4.amzn2.0.2.x86_64     15/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : oniguruma-5.9.6-1.amzn2.0.3.x86_64                         16/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : perl-TermReadKey-2.30-20.amzn2.0.2.x86_64                  17/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : 7:device-mapper-event-1.02.146-4.amzn2.0.2.x86_64          18/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : perl-Git-2.23.3-1.amzn2.0.1.noarch                         19/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : git-core-doc-2.23.3-1.amzn2.0.1.noarch                     20/21 
<13>Jul 10 15:00:28 userdata0:   Verifying  : lzo-2.06-8.amzn2.0.3.x86_64                                21/21 
<13>Jul 10 15:00:28 userdata0: 
<13>Jul 10 15:00:28 userdata0: Installed:
<13>Jul 10 15:00:28 userdata0:   btrfs-progs.x86_64 0:4.15.1-1.amzn2.0.1   git.x86_64 0:2.23.3-1.amzn2.0.1     
<13>Jul 10 15:00:28 userdata0:   jq.x86_64 0:1.5-1.amzn2.0.2               lvm2.x86_64 7:2.02.177-4.amzn2.0.2  
<13>Jul 10 15:00:28 userdata0:   unzip.x86_64 0:6.0-20.amzn2               wget.x86_64 0:1.14-18.amzn2.1       
<13>Jul 10 15:00:28 userdata0: 
<13>Jul 10 15:00:28 userdata0: Dependency Installed:
<13>Jul 10 15:00:28 userdata0:   device-mapper-event.x86_64 7:1.02.146-4.amzn2.0.2                             
<13>Jul 10 15:00:28 userdata0:   device-mapper-event-libs.x86_64 7:1.02.146-4.amzn2.0.2                        
<13>Jul 10 15:00:28 userdata0:   device-mapper-persistent-data.x86_64 0:0.7.3-3.amzn2                          
<13>Jul 10 15:00:28 userdata0:   emacs-filesystem.noarch 1:25.3-3.amzn2.0.1                                    
<13>Jul 10 15:00:28 userdata0:   git-core.x86_64 0:2.23.3-1.amzn2.0.1                                          
<13>Jul 10 15:00:28 userdata0:   git-core-doc.noarch 0:2.23.3-1.amzn2.0.1                                      
<13>Jul 10 15:00:28 userdata0:   libaio.x86_64 0:0.3.109-13.amzn2.0.2                                          
<13>Jul 10 15:00:28 userdata0:   libsecret.x86_64 0:0.18.5-2.amzn2.0.2                                         
<13>Jul 10 15:00:28 userdata0:   libzstd.x86_64 0:1.3.3-1.amzn2.0.1                                            
<13>Jul 10 15:00:28 userdata0:   lvm2-libs.x86_64 7:2.02.177-4.amzn2.0.2                                       
<13>Jul 10 15:00:28 userdata0:   lzo.x86_64 0:2.06-8.amzn2.0.3                                                 
<13>Jul 10 15:00:28 userdata0:   oniguruma.x86_64 0:5.9.6-1.amzn2.0.3                                          
<13>Jul 10 15:00:28 userdata0:   perl-Error.noarch 1:0.17020-2.amzn2                                           
<13>Jul 10 15:00:28 userdata0:   perl-Git.noarch 0:2.23.3-1.amzn2.0.1                                          
<13>Jul 10 15:00:28 userdata0:   perl-TermReadKey.x86_64 0:2.30-20.amzn2.0.2                                   
<13>Jul 10 15:00:28 userdata0: 
<13>Jul 10 15:00:28 userdata0: Complete!
<13>Jul 10 15:00:28 userdata0: + curl -s https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip -o /tmp/awscliv2.zip
<13>Jul 10 15:00:28 userdata0: + unzip -q /tmp/awscliv2.zip -d /tmp
<13>Jul 10 15:00:29 userdata0: + /tmp/aws/install
<13>Jul 10 15:00:30 userdata0: You can now run: /usr/local/bin/aws --version
<13>Jul 10 15:00:30 userdata0: ++ jq -r .tag_name
<13>Jul 10 15:00:30 userdata0: ++ curl --silent https://api.github.com/repos/awslabs/amazon-ebs-autoscale/releases/latest
<13>Jul 10 15:00:30 userdata0: + EBS_AUTOSCALE_VERSION=v2.4.0
<13>Jul 10 15:00:30 userdata0: + cd /opt
<13>Jul 10 15:00:30 userdata0: + git clone https://github.com/awslabs/amazon-ebs-autoscale.git
<13>Jul 10 15:00:30 userdata0: Cloning into 'amazon-ebs-autoscale'...
<13>Jul 10 15:00:32 userdata0: + cd /opt/amazon-ebs-autoscale
<13>Jul 10 15:00:32 userdata0: + git checkout v2.4.0
<13>Jul 10 15:00:32 userdata0: Note: switching to 'v2.4.0'.
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0: You are in 'detached HEAD' state. You can look around, make experimental
<13>Jul 10 15:00:32 userdata0: changes and commit them, and you can discard any commits you make in this
<13>Jul 10 15:00:32 userdata0: state without impacting any branches by switching back to a branch.
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0: If you want to create a new branch to retain commits you create, you may
<13>Jul 10 15:00:32 userdata0: do so (now or later) by using -c with the switch command. Example:
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:   git switch -c <new-branch-name>
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0: Or undo this operation with:
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:   git switch -
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0: Turn off this advice by setting config variable advice.detachedHead to false
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0: HEAD is now at d0d76db update README
<13>Jul 10 15:00:32 userdata0: + sh /opt/amazon-ebs-autoscale/install.sh
<13>Jul 10 15:00:32 userdata0: ++ cat
<13>Jul 10 15:00:32 userdata0: + USAGE='Install Amazon EBS Autoscale
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:     /opt/amazon-ebs-autoscale/install.sh [options] [[-m] <mount-point>]
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0: Options
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:     -d, --initial-device DEVICE
<13>Jul 10 15:00:32 userdata0:                         Initial device to use for mountpoint - e.g. /dev/xvdba.
<13>Jul 10 15:00:32 userdata0:                         (Default: none - automatically create and attaches a volume)
<13>Jul 10 15:00:32 userdata0:                         If provided --initial-size is ignored.
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:     -f, --file-system   btrfs | lvm.ext4
<13>Jul 10 15:00:32 userdata0:                         Filesystem to use (default: btrfs).
<13>Jul 10 15:00:32 userdata0:                         Options are btrfs or lvm.ext4
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:     -h, --help
<13>Jul 10 15:00:32 userdata0:                         Print help and exit.
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:     -m, --mountpoint    MOUNTPOINT
<13>Jul 10 15:00:32 userdata0:                         Mount point for autoscale volume (default: /scratch)
<13>Jul 10 15:00:32 userdata0: 
<13>Jul 10 15:00:32 userdata0:     -s, --initial-size  SIZE
<13>Jul 10 15:00:32 userdata0:                         Initial size of the volume in GB. (Default: 100)
<13>Jul 10 15:00:32 userdata0:                         Only used if --initial-device is NOT specified.
<13>Jul 10 15:00:32 userdata0:     '
<13>Jul 10 15:00:32 userdata0: + MOUNTPOINT=/scratch
<13>Jul 10 15:00:32 userdata0: + SIZE=100
<13>Jul 10 15:00:32 userdata0: + DEVICE=
<13>Jul 10 15:00:32 userdata0: + FILE_SYSTEM=btrfs
<13>Jul 10 15:00:32 userdata0: ++ dirname /opt/amazon-ebs-autoscale/install.sh
<13>Jul 10 15:00:32 userdata0: + BASEDIR=/opt/amazon-ebs-autoscale
<13>Jul 10 15:00:32 userdata0: + . /opt/amazon-ebs-autoscale/shared/utils.sh
<13>Jul 10 15:00:32 userdata0: + initialize
<13>Jul 10 15:00:32 userdata0: ++ curl -s http://169.254.169.254/latest/meta-data/placement/availability-zone/
<13>Jul 10 15:00:32 userdata0: + export AWS_AZ=eu-west-1b
<13>Jul 10 15:00:32 userdata0: + AWS_AZ=eu-west-1b
<13>Jul 10 15:00:32 userdata0: ++ sed -e 's/[a-z]$//'
<13>Jul 10 15:00:32 userdata0: ++ echo eu-west-1b
<13>Jul 10 15:00:32 userdata0: + export AWS_REGION=eu-west-1
<13>Jul 10 15:00:32 userdata0: + AWS_REGION=eu-west-1
<13>Jul 10 15:00:32 userdata0: ++ curl -s http://169.254.169.254/latest/meta-data/instance-id
<13>Jul 10 15:00:32 userdata0: + export INSTANCE_ID=i-09bcba24c8d2d305f
<13>Jul 10 15:00:32 userdata0: + INSTANCE_ID=i-09bcba24c8d2d305f
<13>Jul 10 15:00:32 userdata0: + export EBS_AUTOSCALE_CONFIG_FILE=/etc/ebs-autoscale.json
<13>Jul 10 15:00:32 userdata0: + EBS_AUTOSCALE_CONFIG_FILE=/etc/ebs-autoscale.json
<13>Jul 10 15:00:32 userdata0: + PARAMS=
<13>Jul 10 15:00:32 userdata0: + ((  0  ))
<13>Jul 10 15:00:32 userdata0: + eval set -- ''
<13>Jul 10 15:00:32 userdata0: ++ set --
<13>Jul 10 15:00:32 userdata0: + '[' '!' -z '' ']'
<13>Jul 10 15:00:32 userdata0: + mkdir -p /usr/local/amazon-ebs-autoscale/bin /usr/local/amazon-ebs-autoscale/shared
<13>Jul 10 15:00:32 userdata0: + cp /opt/amazon-ebs-autoscale/bin/create-ebs-volume /opt/amazon-ebs-autoscale/bin/ebs-autoscale /usr/local/amazon-ebs-autoscale/bin
<13>Jul 10 15:00:32 userdata0: + chmod +x /usr/local/amazon-ebs-autoscale/bin/create-ebs-volume /usr/local/amazon-ebs-autoscale/bin/ebs-autoscale
<13>Jul 10 15:00:32 userdata0: + ln -sf /usr/local/amazon-ebs-autoscale/bin/create-ebs-volume /usr/local/amazon-ebs-autoscale/bin/ebs-autoscale /usr/local/bin/
<13>Jul 10 15:00:32 userdata0: + ln -sf /usr/local/amazon-ebs-autoscale/bin/create-ebs-volume /usr/local/amazon-ebs-autoscale/bin/ebs-autoscale /usr/bin/
<13>Jul 10 15:00:32 userdata0: + cp /opt/amazon-ebs-autoscale/shared/utils.sh /usr/local/amazon-ebs-autoscale/shared
<13>Jul 10 15:00:32 userdata0: + cp /opt/amazon-ebs-autoscale/config/ebs-autoscale.logrotate /etc/logrotate.d/ebs-autoscale
<13>Jul 10 15:00:32 userdata0: + sed -e s#%%FILESYSTEM%%#btrfs#
<13>Jul 10 15:00:32 userdata0: + sed -e s#%%MOUNTPOINT%%#/scratch#
<13>Jul 10 15:00:32 userdata0: + cat /opt/amazon-ebs-autoscale/config/ebs-autoscale.json
<13>Jul 10 15:00:32 userdata0: + '[' -e /scratch ']'
<13>Jul 10 15:00:32 userdata0: + '[' -e /scratch ']'
<13>Jul 10 15:00:32 userdata0: + mkdir -p /scratch
<13>Jul 10 15:00:32 userdata0: + '[' -z '' ']'
<13>Jul 10 15:00:32 userdata0: ++ create-ebs-volume --size 100
[   85.996517] blkfront: xvdba: barrier or flush: disabled; persistent grants: disabled; indirect descriptors: enabled;
<13>Jul 10 15:00:55 userdata0: + DEVICE=/dev/xvdba
<13>Jul 10 15:00:55 userdata0: + '[' btrfs = btrfs ']'
<13>Jul 10 15:00:55 userdata0: + mkfs.btrfs -f -d single /dev/xvdba
[   87.332006] raid6: sse2x1   gen()  9532 MB/s
[   87.400010] raid6: sse2x1   xor()  6582 MB/s
[   87.468004] raid6: sse2x2   gen() 11224 MB/s
[   87.536003] raid6: sse2x2   xor()  7190 MB/s
[   87.604010] raid6: sse2x4   gen() 13419 MB/s
[   87.672006] raid6: sse2x4   xor()  8293 MB/s
[   87.740006] raid6: avx2x1   gen() 18689 MB/s
[   87.808005] raid6: avx2x1   xor() 12375 MB/s
[   87.876009] raid6: avx2x2   gen() 21194 MB/s
[   87.944006] raid6: avx2x2   xor() 12867 MB/s
[   88.012008] raid6: avx2x4   gen() 24682 MB/s
[   88.080005] raid6: avx2x4   xor() 15408 MB/s
[   88.085698] raid6: using algorithm avx2x4 gen() 24682 MB/s
[   88.091210] raid6: .... xor() 15408 MB/s, rmw enabled
[   88.097587] raid6: using avx2x2 recovery algorithm
[   88.111227] xor: automatically using best checksumming function   avx       
[   88.544604] Btrfs loaded, crc32c=crc32c-intel
[   88.548751] BTRFS: device fsid 65c270e3-1175-4c53-8dd4-a1fb83e545a6 devid 1 transid 5 /dev/xvdba
<13>Jul 10 15:00:56 userdata0: + mount /dev/xvdba /scratch
[   88.570221] BTRFS info (device xvdba): disk space caching is enabled
[   88.579081] BTRFS info (device xvdba): has skinny extents
[   88.584918] BTRFS info (device xvdba): flagging fs with big metadata feature
[   88.615238] BTRFS info (device xvdba): enabling ssd optimizations
[   88.620890] BTRFS info (device xvdba): creating UUID tree
<13>Jul 10 15:00:57 userdata0: + tee -a /etc/fstab
<13>Jul 10 15:00:57 userdata0: + echo -e '/dev/xvdba\t/scratch\tbtrfs\tdefaults\t0\t0'
<13>Jul 10 15:00:57 userdata0: + chmod 1777 /scratch
<13>Jul 10 15:00:57 userdata0: ++ detect_init_system
<13>Jul 10 15:00:57 userdata0: + INIT_SYSTEM=systemd
<13>Jul 10 15:00:57 userdata0: + case $INIT_SYSTEM in
<13>Jul 10 15:00:57 userdata0: + echo 'systemd detected'
<13>Jul 10 15:00:57 userdata0: + cd /opt/amazon-ebs-autoscale/service/systemd
<13>Jul 10 15:00:57 userdata0: + . ./install.sh
<13>Jul 10 15:00:57 userdata0: ++ cp ebs-autoscale.service /usr/lib/systemd/system/ebs-autoscale.service
<13>Jul 10 15:00:57 userdata0: ++ systemctl daemon-reload
<13>Jul 10 15:00:57 userdata0: ++ systemctl enable ebs-autoscale.service
<13>Jul 10 15:00:57 userdata0: Created symlink from /etc/systemd/system/multi-user.target.wants/ebs-autoscale.service to /usr/lib/systemd/system/ebs-autoscale.service.
<13>Jul 10 15:00:57 userdata0: ++ systemctl start ebs-autoscale.service

To replicate the problem I've used to following userdata: 

MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="//"

--//
Content-Type: text/cloud-boothook; charset="us-ascii"

su - root << 'EOF'
(
exec > >(tee /var/log/user-data.log|logger -t userdata0 -s 2>/dev/console) 2>&1
set -x
#
# as shown https://github.com/awslabs/amazon-ebs-autoscale/blob/master/templates/cloud-init-userdata.yaml#L14
#
yum install -y jq sed wget unzip git btrfs-progs lvm2
curl -s "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "/tmp/awscliv2.zip"
unzip -q /tmp/awscliv2.zip -d /tmp && /tmp/aws/install
EBS_AUTOSCALE_VERSION=$(curl --silent "https://api.github.com/repos/awslabs/amazon-ebs-autoscale/releases/latest" | jq -r .tag_name)
cd /opt && git clone https://github.com/awslabs/amazon-ebs-autoscale.git
cd /opt/amazon-ebs-autoscale && git checkout $EBS_AUTOSCALE_VERSION
sh /opt/amazon-ebs-autoscale/install.sh 2>&1 > /var/log/ebs-autoscale-install.log
)
EOF

--//--

(I'm using a boot hook because I need to create the mount before the docker daemon is started)

Then I've launched as 

aws --region eu-west-1 \
  ec2 run-instances \
  --image-id ami-092cd8a8ec660cde6 \
  --key-name seqera \
  --user-data file://./userdata.txt \
  --count 1 \
  --security-group-ids <my-sec-group> \
  --instance-type t2.small \
  --iam-instance-profile Name=TowerForge-1PeKIJ1kMXO6t0rVZTKYig-InstanceRole

It works fine with ami-0501b08c7280e37c5

pditommaso commented 4 years ago

An update on this. It turns out that's with the cloud-boothook. When putting into a shellscript it works.

The problem is that I need to create the mount before docker start to is as the container storage.

I've tried another approach, inspired by your script, stopping the daemon, creating the mount, starting again docker and launching the ecs agent with systemctl enable --now ecs and ... surprise! it hangs again!

root      4806  0.0  0.1 144868 31812 ?        Ss   21:41   0:00 /usr/bin/python /usr/bin/cloud-init modules --mode=final
root      4850  0.0  0.0   4236   748 ?        S    21:41   0:00  \_ tee -a /var/log/cloud-init-output.log
root      4859  0.0  0.0  11544  2416 ?        S    21:41   0:00  \_ /bin/sh /var/lib/cloud/instance/scripts/runcmd
root      4860  0.0  0.0  11544  2552 ?        S    21:41   0:00      \_ bash /root/tower-forge.sh
root      4861  0.0  0.0  11544  1580 ?        S    21:41   0:00          \_ bash /root/tower-forge.sh
root      4862  0.0  0.0   4236   752 ?        S    21:41   0:00          |   \_ tee /var/log/user-data.log
root      4864  0.0  0.0  46944  2088 ?        S    21:41   0:00          |   \_ logger -t nf-tower -s
root      5811  0.0  0.0  31492  3360 ?        S    21:42   0:00          \_ systemctl enable --now ecs

give up (for now)

wleepang commented 4 years ago

This looks like the following error: https://github.com/aws/amazon-ecs-agent/issues/1707

You need to add the --no-block flag when starting ecs again.

systemctl enable --now --no-block ecs
pditommaso commented 4 years ago

Nice. This solves the problem, thanks! I'm leaving the issue open because IMO it would be nice to have it working also in the boothook phase to avoid having to mess with docker and ecs agent stop/start. Feel free to proceed with how you think it's better.

microbioticajon commented 3 years ago

I have also run in to this issue. Im not sure what the consequence of starting the ecs agent before the end of my user data will be for my Batch node.