siderolabs / talos

Talos Linux is a modern Linux distribution built for Kubernetes.
https://www.talos.dev
Mozilla Public License 2.0
6.81k stars 544 forks source link

virtual box setup dont work #9263

Closed LaneaLucy closed 2 months ago

LaneaLucy commented 2 months ago

Bug Report

Description

trying to use talos for the first time and following https://www.talos.dev/v1.7/talos-guides/install/local-platforms/virtualbox/ when doing talosctl apply-config --insecure --nodes $CONTROL_PLANE_IP --file _out/controlplane.yaml i only get errors in vm (see logs)

Logs

image image

Environment

smira commented 2 months ago

I can't say from the screenshots, VirtualBox should have a way to capture serial console logs which you can download and attach in full.

The first screenshot VM seems to have a broken DNS resolver (?).

The second screenshot VM is probably fine, but it hasn't finished bootup. Have you bootstrapped etcd? If DNS still doesn't work, nothing else would work (can't pull images).

LaneaLucy commented 2 months ago

`[ 0.000000] Linux version 6.6.43-talos (@buildkitsandbox) (gcc (GCC) 13.2.0, GNU ld (GNU Binutils) 2.42) #1 SMP Mon Aug 5 13:28:56 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz talos.platform=metal console=ttyS0 console=tty0 init_on_alloc=1 slab_nomerge pti=on consoleblank=0 nvme_core.io_timeout=4294967295 printk.devkmsg=on ima_template=ima-ng ima_appraise=fix ima_hash=sha512 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffeffff] usable [ 0.000000] BIOS-e820: [mem 0x000000007fff0000-0x000000007fffffff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 2.5 present. [ 0.000000] DMI: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000003] kvm-clock: using sched offset of 7813465135 cycles [ 0.000007] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000026] tsc: Detected 2594.826 MHz processor [ 0.002440] last_pfn = 0x7fff0 max_arch_pfn = 0x400000000 [ 0.002453] MTRRs disabled by BIOS [ 0.002458] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.002562] found SMP MP-table at [mem 0x0009fff0-0x0009ffff] [ 0.002830] RAMDISK: [mem 0x2fc21000-0x33e07fff] [ 0.002837] ACPI: Early table checksum verification disabled [ 0.002841] ACPI: RSDP 0x00000000000E0000 000024 (v02 VBOX ) [ 0.002849] ACPI: XSDT 0x000000007FFF0030 00003C (v01 VBOX VBOXXSDT 00000001 ASL 00000061) [ 0.002859] ACPI: FACP 0x000000007FFF00F0 0000F4 (v04 VBOX VBOXFACP 00000001 ASL 00000061) [ 0.002868] ACPI: DSDT 0x000000007FFF0610 002353 (v02 VBOX VBOXBIOS 00000002 INTL 20200925) [ 0.002875] ACPI: FACS 0x000000007FFF0200 000040 [ 0.002880] ACPI: FACS 0x000000007FFF0200 000040 [ 0.002884] ACPI: APIC 0x000000007FFF0240 00005C (v02 VBOX VBOXAPIC 00000001 ASL 00000061) [ 0.002888] ACPI: SSDT 0x000000007FFF02A0 00036C (v01 VBOX VBOXCPUT 00000002 INTL 20200925) [ 0.002893] ACPI: Reserving FACP table memory at [mem 0x7fff00f0-0x7fff01e3] [ 0.002895] ACPI: Reserving DSDT table memory at [mem 0x7fff0610-0x7fff2962] [ 0.002896] ACPI: Reserving FACS table memory at [mem 0x7fff0200-0x7fff023f] [ 0.002898] ACPI: Reserving FACS table memory at [mem 0x7fff0200-0x7fff023f] [ 0.002899] ACPI: Reserving APIC table memory at [mem 0x7fff0240-0x7fff029b] [ 0.002900] ACPI: Reserving SSDT table memory at [mem 0x7fff02a0-0x7fff060b] [ 0.003367] No NUMA configuration found [ 0.003370] Faking a node at [mem 0x0000000000000000-0x000000007ffeffff] [ 0.003377] NODE_DATA(0) allocated [mem 0x7ffec000-0x7ffeffff] [ 0.003407] Zone ranges: [ 0.003409] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.003412] DMA32 [mem 0x0000000001000000-0x000000007ffeffff] [ 0.003414] Normal empty [ 0.003416] Movable zone start for each node [ 0.003417] Early memory node ranges [ 0.003418] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.003420] node 0: [mem 0x0000000000100000-0x000000007ffeffff] [ 0.003423] Initmem setup node 0 [mem 0x0000000000001000-0x000000007ffeffff] [ 0.003431] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.003468] On node 0, zone DMA: 97 pages in unavailable ranges [ 0.010125] On node 0, zone DMA32: 16 pages in unavailable ranges [ 0.010736] ACPI: PM-Timer IO Port: 0x4008 [ 0.010844] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23 [ 0.010851] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.010854] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) [ 0.010861] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.010864] smpboot: Allowing 2 CPUs, 0 hotplug CPUs [ 0.010896] [mem 0x80000000-0xfebfffff] available for PCI devices [ 0.010900] Booting paravirtualized kernel on KVM [ 0.010903] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.020254] setup_percpu: NR_CPUS:512 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 [ 0.020765] percpu: Embedded 58 pages/cpu s197584 r8192 d31792 u1048576 [ 0.020802] Kernel command line: BOOT_IMAGE=/boot/vmlinuz talos.platform=metal console=ttyS0 console=tty0 init_on_alloc=1 slab_nomerge pti=on consoleblank=0 nvme_core.io_timeout=4294967295 printk.devkmsg=on ima_template=ima-ng ima_appraise=fix ima_hash=sha512 [ 0.021077] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz pti=on", will be passed to user space. [ 0.021087] random: crng init done [ 0.021463] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 0.021632] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) [ 0.021690] Fallback order for Node 0: 0 [ 0.021694] Built 1 zonelists, mobility grouping on. Total pages: 515824 [ 0.021695] Policy zone: DMA32 [ 0.022175] mem auto-init: stack:all(zero), heap alloc:on, heap free:off [ 0.030083] Memory: 1926064K/2096696K available (26624K kernel code, 5005K rwdata, 14784K rodata, 4984K init, 2792K bss, 170372K reserved, 0K cma-reserved) [ 0.030333] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 [ 0.030341] Kernel/User page tables isolation: enabled [ 0.030387] ftrace: allocating 70741 entries in 277 pages [ 0.044157] ftrace: allocated 277 pages with 4 groups [ 0.044308] rcu: Hierarchical RCU implementation. [ 0.044309] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2. [ 0.044311] Rude variant of Tasks RCU enabled. [ 0.044312] Tracing variant of Tasks RCU enabled. [ 0.044313] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.044314] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 [ 0.051295] NR_IRQS: 33024, nr_irqs: 440, preallocated irqs: 16 [ 0.051524] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.051842] kfence: initialized - using 2097152 bytes for 255 objects at 0x(ptrval)-0x(ptrval) [ 0.057628] Console: colour VGA+ 80x25 [ 0.057635] printk: console [tty0] enabled [ 0.087673] printk: console [ttyS0] enabled [ 0.181928] ACPI: Core revision 20230628 [ 0.183052] APIC: Switch to symmetric I/O mode setup [ 0.184760] x2apic enabled [ 0.185822] APIC: Switched APIC routing to: physical x2apic [ 0.188440] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.189889] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2567247e60f, max_idle_ns: 440795287698 ns [ 0.192356] Calibrating delay loop (skipped) preset value.. 5189.65 BogoMIPS (lpj=10379304) [ 0.194442] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8 [ 0.196358] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0 [ 0.197849] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.200105] Spectre V2 : Mitigation: Retpolines [ 0.201513] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.204358] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.205656] Speculative Store Bypass: Vulnerable [ 0.206637] MDS: Mitigation: Clear CPU buffers [ 0.209132] MMIO Stale Data: Unknown: No mitigations [ 0.210119] SRBDS: Unknown: Dependent on hypervisor status [ 0.211222] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.213480] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.214845] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'

[ 0.217570] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.253821] Freeing SMP alternatives memory: 64K [ 0.254782] pid_max: default: 32768 minimum: 301 [ 0.256038] LSM: initializing lsm=lockdown,capability,yama,bpf,apparmor,integrity [ 0.257811] Yama: becoming mindful. [ 0.258845] LSM support for eBPF active [ 0.259924] AppArmor: AppArmor initialized [ 0.260987] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) [ 0.262172] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) [ 0.372090] smpboot: CPU0: Intel(R) Core(TM) i5-3320M CPU @ 2.60GHz (family: 0x6, model: 0x3a, stepping: 0x9) [ 0.372350] RCU Tasks Rude: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1. [ 0.372350] RCU Tasks Trace: Setting shift to 1 and lim to 1 rcu_task_cb_adjust=1. [ 0.372399] Performance Events: unsupported p6 CPU model 58 no PMU driver, software events only. [ 0.374403] signal: max sigframe size: 1776 [ 0.375354] rcu: Hierarchical SRCU implementation. [ 0.376353] rcu: Max phase no-delay instances is 1000. [ 0.377675] smp: Bringing up secondary CPUs ... [ 0.378583] smpboot: x86: Booting SMP configuration: [ 0.379465] .... node #0, CPUs: #1 [ 0.382362] smp: Brought up 1 node, 2 CPUs [ 0.384855] smpboot: Max logical packages: 1 [ 0.385817] smpboot: Total of 2 processors activated (10379.30 BogoMIPS) [ 0.387366] devtmpfs: initialized [ 0.388737] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 0.390410] futex hash table entries: 512 (order: 3, 32768 bytes, linear) [ 0.392524] PM: RTC time: 12:07:46, date: 2024-09-03 [ 0.394012] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 0.395243] audit: initializing netlink subsys (disabled) [ 0.396438] thermal_sys: Registered thermal governor 'step_wise' [ 0.396440] thermal_sys: Registered thermal governor 'user_space' [ 0.397468] audit: type=2000 audit(1725365275.633:1): state=initialized audit_enabled=0 res=1 [ 0.399857] cpuidle: using governor menu [ 0.401053] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.402534] dca service started, version 1.12.1 [ 0.403726] PCI: Using configuration type 1 for base access [ 0.405675] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 0.448650] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 0.452365] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 0.453859] cryptd: max_cpu_qlen set to 1000 [ 0.456556] ACPI: Added _OSI(Module Device) [ 0.457505] ACPI: Added _OSI(Processor Device) [ 0.458413] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.459329] ACPI: Added _OSI(Processor Aggregator Device) [ 0.461458] ACPI: 2 ACPI AML tables successfully acquired and loaded [ 0.463529] ACPI: _OSC evaluation for CPUs failed, trying _PDC [ 0.464435] ACPI: Interpreter enabled [ 0.465170] ACPI: PM: (supports S0 S5) [ 0.465879] ACPI: Using IOAPIC for interrupt routing [ 0.466935] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.468358] PCI: Using E820 reservations for host bridge windows [ 0.469818] ACPI: Enabled 2 GPEs in block 00 to 07 [ 0.475568] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.477529] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.479240] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.480621] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge [ 0.482849] PCI host bridge to bus 0000:00 [ 0.484355] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.485865] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.487360] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.488355] pci_bus 0000:00: root bus resource [mem 0x80000000-0xfdffffff window] [ 0.490031] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.492464] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.494537] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.496268] pci 0000:00:01.1: [8086:7111] type 00 class 0x01018a [ 0.497532] pci 0000:00:01.1: reg 0x20: [io 0xd000-0xd00f] [ 0.498666] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.500353] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.501773] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.503333] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.504554] pci 0000:00:02.0: [15ad:0405] type 00 class 0x030000 [ 0.507436] pci 0000:00:02.0: reg 0x10: [io 0xd010-0xd01f] [ 0.509908] pci 0000:00:02.0: reg 0x14: [mem 0xe0000000-0xe0ffffff pref] [ 0.512618] pci 0000:00:02.0: reg 0x18: [mem 0xf0000000-0xf01fffff] [ 0.520699] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 0.522882] pci 0000:00:03.0: [8086:100e] type 00 class 0x020000 [ 0.525861] pci 0000:00:03.0: reg 0x10: [mem 0xf0200000-0xf021ffff] [ 0.531194] pci 0000:00:03.0: reg 0x18: [io 0xd020-0xd027] [ 0.539957] pci 0000:00:04.0: [80ee:cafe] type 00 class 0x088000 [ 0.543401] pci 0000:00:04.0: reg 0x10: [io 0xd040-0xd05f] [ 0.545701] pci 0000:00:04.0: reg 0x14: [mem 0xf0400000-0xf07fffff] [ 0.549808] pci 0000:00:04.0: reg 0x18: [mem 0xf0800000-0xf0803fff pref] [ 0.558157] pci 0000:00:05.0: [8086:2415] type 00 class 0x040100 [ 0.559464] pci 0000:00:05.0: reg 0x10: [io 0xd100-0xd1ff] [ 0.560413] pci 0000:00:05.0: reg 0x14: [io 0xd200-0xd23f] [ 0.561847] pci 0000:00:06.0: [106b:003f] type 00 class 0x0c0310 [ 0.564470] pci 0000:00:06.0: reg 0x10: [mem 0xf0804000-0xf0804fff] [ 0.574185] pci 0000:00:07.0: [8086:7113] type 00 class 0x068000 [ 0.576573] pci 0000:00:07.0: quirk: [io 0x4000-0x403f] claimed by PIIX4 ACPI [ 0.578157] pci 0000:00:07.0: quirk: [io 0x4100-0x410f] claimed by PIIX4 SMB [ 0.580492] pci 0000:00:0b.0: [8086:265c] type 00 class 0x0c0320 [ 0.583066] pci 0000:00:0b.0: reg 0x10: [mem 0xf0805000-0xf0805fff] [ 0.596307] pci 0000:00:0d.0: [8086:2829] type 00 class 0x010601 [ 0.598836] pci 0000:00:0d.0: reg 0x10: [io 0xd240-0xd247] [ 0.601786] pci 0000:00:0d.0: reg 0x14: [io 0xd248-0xd24b] [ 0.605730] pci 0000:00:0d.0: reg 0x18: [io 0xd250-0xd257] [ 0.608591] pci 0000:00:0d.0: reg 0x1c: [io 0xd258-0xd25b] [ 0.613758] pci 0000:00:0d.0: reg 0x20: [io 0xd260-0xd26f] [ 0.616493] pci 0000:00:0d.0: reg 0x24: [mem 0xf0806000-0xf0807fff] [ 0.621929] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 0.623554] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.624440] ACPI: PCI: Interrupt link LNKC configured for IRQ 9 [ 0.625832] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.627403] iommu: Default domain type: Translated [ 0.628356] iommu: DMA domain TLB invalidation policy: strict mode [ 0.629824] SCSI subsystem initialized [ 0.630657] ACPI: bus type USB registered [ 0.631437] usbcore: registered new interface driver usbfs [ 0.632364] usbcore: registered new interface driver hub [ 0.633572] usbcore: registered new device driver usb [ 0.636411] pps_core: LinuxPPS API ver. 1 registered [ 0.639109] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti giometti@linux.it [ 0.644161] PTP clock support registered [ 0.645426] EDAC MC: Ver: 3.0.0 [ 0.647171] NET: Registered PF_ATMPVC protocol family [ 0.648359] NET: Registered PF_ATMSVC protocol family [ 0.650547] NetLabel: Initializing [ 0.651520] NetLabel: domain hash size = 128 [ 0.653307] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.654916] NetLabel: unlabeled traffic allowed by default [ 0.656375] PCI: Using ACPI for IRQ routing [ 0.664500] pci 0000:00:02.0: vgaarb: setting as boot VGA device [ 0.668350] pci 0000:00:02.0: vgaarb: bridge control possible [ 0.668350] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 0.668357] vgaarb: loaded [ 0.673345] clocksource: Switched to clocksource kvm-clock [ 0.673517] VFS: Disk quotas dquot_6.6.0 [ 0.674281] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.675830] AppArmor: AppArmor Filesystem Enabled [ 0.676908] pnp: PnP ACPI init [ 0.678461] pnp: PnP ACPI: found 3 devices [ 0.693320] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.696005] NET: Registered PF_INET protocol family [ 0.697554] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) [ 0.700499] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) [ 0.703852] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 0.706176] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) [ 0.708708] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 0.711866] TCP: Hash tables configured (established 16384 bind 16384) [ 0.713949] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear) [ 0.716119] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear) [ 0.718828] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 0.724937] RPC: Registered named UNIX socket transport module. [ 0.726129] RPC: Registered udp transport module. [ 0.727059] RPC: Registered tcp transport module. [ 0.728146] RPC: Registered tcp-with-tls transport module. [ 0.729428] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.730819] NET: Registered PF_XDP protocol family [ 0.731889] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.733246] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.739136] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.741164] pci_bus 0000:00: resource 7 [mem 0x80000000-0xfdffffff window] [ 0.746280] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.750621] PCI: CLS 0 bytes, default 64 [ 0.752569] Unpacking initramfs... [ 0.756927] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 0.759435] kvm_intel: VMX not supported by CPU 0 [ 0.760813] kvm_amd: CPU 0 isn't AMD or Hygon [ 0.763285] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2567247e60f, max_idle_ns: 440795287698 ns [ 0.772823] clocksource: Switched to clocksource tsc [ 0.773865] platform rtc_cmos: registered platform RTC device (no PNP device found) [ 0.779269] Initialise system trusted keyrings [ 0.780135] Key type blacklist registered [ 0.785288] workingset: timestamp_bits=40 max_order=19 bucket_order=0 [ 0.788296] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 0.797269] NFS: Registering the id_resolver key type [ 0.798768] Key type id_resolver registered [ 0.799854] Key type id_legacy registered [ 0.801027] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 0.802995] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering... [ 0.824839] Key type cifs.spnego registered [ 0.826893] Key type cifs.idmap registered [ 0.889020] fuse: init (API version 7.39) [ 0.890852] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 0.893417] ceph: loaded (mds proto 32) [ 0.894830] integrity: Platform Keyring initialized [ 0.910137] NET: Registered PF_ALG protocol family [ 0.911600] Key type asymmetric registered [ 0.912757] Asymmetric key parser 'x509' registered [ 0.914156] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249) [ 0.928732] io scheduler mq-deadline registered [ 0.930446] io scheduler kyber registered [ 0.931207] io scheduler bfq registered [ 0.932519] hv_vmbus: registering driver hyperv_fb [ 0.933589] IPMI message handler: version 39.2 [ 0.934556] ipmi device interface [ 0.940767] ipmi_si: IPMI System Interface driver [ 0.941694] ipmi_si: Unable to find any System Interface(s) [ 0.942620] IPMI poweroff: Copyright (C) 2004 MontaVista Software - IPMI Powerdown via sys_reboot [ 0.944300] ACPI: AC: AC Adapter [AC] (on-line) [ 0.945375] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 0.956933] ACPI: button: Power Button [PWRF] [ 0.957803] input: Sleep Button as /devices/LNXSYSTM:00/LNXSLPBN:00/input/input1 [ 0.959115] ACPI: button: Sleep Button [SLPF] [ 0.963897] ACPI: video: Video Device [GFX0] (multi-head: yes rom: no post: no) [ 0.966395] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A03:00/LNXVIDEO:00/input/input2 [ 0.976773] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 0.978574] ACPI: battery: Slot [BAT0] (battery present) [ 0.984951] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 0.986259] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 0.987985] Non-volatile memory driver v1.3 [ 0.989510] Linux agpgart interface v0.103 [ 0.990614] AMD-Vi: AMD IOMMUv2 functionality not available on this system - This is not a bug. [ 0.991988] ACPI: bus type drm_connector registered [ 0.998602] loop: module loaded [ 0.999403] rbd: loaded (major 252) [ 1.000032] Guest personality initialized and is inactive [ 1.005005] VMCI host device registered (name=vmci, major=10, minor=126) [ 1.006140] Initialized host personality [ 1.006881] Loading iSCSI transport class v2.0-870. [ 1.007958] iscsi: registered transport (tcp) [ 1.008784] hv_vmbus: registering driver hv_storvsc [ 1.021892] scsi host0: ata_piix [ 1.028736] scsi host1: ata_piix [ 1.030413] ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0xd000 irq 14 [ 1.031661] ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0xd008 irq 15 [ 1.037354] wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information. [ 1.039454] wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld Jason@zx2c4.com. All Rights Reserved. [ 1.041932] tun: Universal TUN/TAP device driver, 1.6 [ 1.044087] hv_vmbus: registering driver hv_netvsc [ 1.045260] usbcore: registered new interface driver cdc_acm [ 1.046511] cdc_acm: USB Abstract Control Model driver for USB modems and ISDN adapters [ 1.048519] ehci-pci 0000:00:0b.0: EHCI Host Controller [ 1.050492] ehci-pci 0000:00:0b.0: new USB bus registered, assigned bus number 1 [ 1.052102] ehci-pci 0000:00:0b.0: irq 19, io mem 0xf0805000 [ 1.053348] usbcore: registered new interface driver uas [ 1.054567] usbcore: registered new interface driver usb-storage [ 1.055905] usbcore: registered new interface driver usbserial_generic [ 1.057397] usbserial: USB Serial support registered for generic [ 1.058971] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12 [ 1.061691] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 1.062871] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 1.064036] hv_vmbus: registering driver hyperv_keyboard [ 1.065590] mousedev: PS/2 mouse device common for all mice [ 1.068176] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input3 [ 1.069094] rtc_cmos rtc_cmos: registered as rtc0 [ 1.072070] ehci-pci 0000:00:0b.0: USB 2.0 started, EHCI 1.00 [ 1.072351] rtc_cmos rtc_cmos: alarms up to one day, 114 bytes nvram [ 1.076114] fail to initialize ptp_kvm [ 1.076206] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 1.076942] hub 1-0:1.0: USB hub found [ 1.082414] hub 1-0:1.0: 12 ports detected [ 1.088845] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com [ 1.091999] intel_pstate: CPU model not supported [ 1.093429] sdhci: Secure Digital Host Controller Interface driver [ 1.094772] sdhci: Copyright(c) Pierre Ossman [ 1.100998] hid: raw HID events driver (C) Jiri Kosina [ 1.103663] usbcore: registered new interface driver usbhid [ 1.105840] usbhid: USB HID core driver [ 1.110009] hv_utils: Registering HyperV Utility Driver [ 1.111365] hv_vmbus: registering driver hv_utils [ 1.113153] hv_vmbus: registering driver hv_balloon [ 1.114358] NET: Registered PF_LLC protocol family [ 1.115480] GACT probability NOT on [ 1.116316] Mirror/redirect action on [ 1.117251] Simple TC action Loaded [ 1.118233] netem: version 1.3 [ 1.119025] u32 classifier [ 1.119684] input device check on [ 1.120525] Actions configured [ 1.145643] xt_time: kernel timezone is -0000 [ 1.146785] IPVS: Registered protocols (TCP, UDP) [ 1.147874] IPVS: Connection hash table configured (size=4096, memory=32Kbytes) [ 1.150957] IPVS: ipvs loaded. [ 1.153568] IPVS: [rr] scheduler registered. [ 1.155577] IPVS: [wrr] scheduler registered. [ 1.156830] IPVS: [lc] scheduler registered. [ 1.159017] IPVS: [sh] scheduler registered. [ 1.160334] ipip: IPv4 and MPLS over IPv4 tunneling driver [ 1.162048] gre: GRE over IPv4 demultiplexor driver [ 1.163448] Initializing XFRM netlink socket [ 1.167637] NET: Registered PF_INET6 protocol family [ 1.170693] Segment Routing with IPv6 [ 1.171846] In-situ OAM (IOAM) with IPv6 [ 1.173147] mip6: Mobile IPv6 [ 1.174090] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver [ 1.176070] NET: Registered PF_PACKET protocol family [ 1.177877] Bridge firewalling registered [ 1.179276] NET: Registered PF_X25 protocol family [ 1.180572] X25: Linux Version 0.2 [ 1.181668] RPC: Registered rdma transport module. [ 1.183086] RPC: Registered rdma backchannel transport module. [ 1.184801] l2tp_core: L2TP core driver, V2.0 [ 1.186226] NET: Registered PF_PHONET protocol family [ 1.187633] 8021q: 802.1Q VLAN Support v1.8 [ 1.193594] DCCP: Activated CCID 2 (TCP-like) [ 1.194995] DCCP: Activated CCID 3 (TCP-Friendly Rate Control) [ 1.196450] DCCP is deprecated and scheduled to be removed in 2025, please contact the netdev mailing list [ 1.198194] sctp: Hash tables configured (bind 256/256) [ 1.205325] ata2.00: ATAPI: VBOX CD-ROM, 1.0, max UDMA/133 [ 1.216783] scsi 1:0:0:0: CD-ROM VBOX CD-ROM 1.0 PQ: 0 ANSI: 5 [ 1.219386] NET: Registered PF_RDS protocol family [ 1.220661] Key type dns_resolver registered [ 1.221916] Key type ceph registered [ 1.222630] sr 1:0:0:0: [sr0] scsi3-mmc drive: 32x/32x xa/form2 tray [ 1.224910] cdrom: Uniform CD-ROM driver Revision: 3.20 [ 1.233349] libceph: loaded (mon/osd proto 15/24) [ 1.233793] openvswitch: Open vSwitch switching datapath [ 1.236604] sr 1:0:0:0: Attached scsi generic sg0 type 5 [ 1.239316] NET: Registered PF_VSOCK protocol family [ 1.240485] mpls_gso: MPLS GSO support [ 1.248997] IPI shorthand broadcast: enabled [ 1.250098] AVX version of gcm_enc/dec engaged. [ 1.251336] AES CTR mode by8 optimization enabled [ 1.258422] sched_clock: Marking stable (1116465477, 140642222)->(1256529398, 578301) [ 1.287555] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input5 [ 1.296564] registered taskstats version 1 [ 1.299021] Loading compiled-in X.509 certificates [ 1.313262] Loaded X.509 cert 'Sidero Labs, Inc.: Build time throw-away kernel key: 03e24a1f27ce5748917a15906c223340379346ca' [ 1.322051] AppArmor: AppArmor sha1 policy hashing enabled [ 1.326820] ima: No TPM chip found, activating TPM-bypass! [ 1.328045] ima: Allocated hash algorithm: sha512 [ 1.329168] ima: No architecture policies found [ 1.341346] PM: Magic number: 8:579:126 [ 1.343883] acpi device:01: hash matches [ 1.345028] printk: console [netcon0] enabled [ 1.346461] netconsole: network logging started [ 1.347740] clk: Disabling unused clocks [ 1.411122] Freeing initrd memory: 67484K [ 1.435317] Freeing unused kernel image (initmem) memory: 4984K [ 1.436771] Write protecting the kernel read-only data: 43008k [ 1.440237] Freeing unused kernel image (rodata/data gap) memory: 1600K [ 1.444468] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 1.446927] x86/mm: Checking user space page tables [ 1.448092] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 1.450320] Run /init as init process [ 1.459847] [talos] [initramfs] TPM device is not available [ 1.461703] [talos] [initramfs] TPM device is not available, skipping PCR extension [ 1.466212] [talos] [initramfs] booting Talos v1.7.6 [ 1.468485] [talos] [initramfs] CPU: Intel(R) Core(TM) i5-3320M CPU @ 2.60GHz, 2 core(s), 1 thread(s) per core [ 1.475077] [talos] [initramfs] x86_64 microarchitecture level: 2 [ 1.476932] [talos] [initramfs] mounting the rootfs [ 1.478488] loop0: detected capacity change from 0 to 130136 [ 1.501746] [talos] [initramfs] entering the rootfs [ 1.503978] [talos] [initramfs] moving mounts to the new rootfs [ 1.506883] [talos] [initramfs] changing working directory into /root [ 1.508487] [talos] [initramfs] moving /root to / [ 1.509548] [talos] [initramfs] changing root directory [ 1.510578] [talos] [initramfs] cleaning up initramfs [ 1.511664] [talos] [initramfs] TPM device is not available, skipping PCR extension [ 1.513013] [talos] [initramfs] executing /sbin/init [ 3.292923] [talos] initialize sequence: 11 phase(s) [ 3.294096] [talos] phase systemRequirements (1/11): 6 tasks(s) [ 3.317537] [talos] task setRLimit (6/6): starting [ 3.318839] [talos] task setRLimit (6/6): done, 21.966638ms [ 3.320206] [talos] task setupSystemDirectory (2/6): starting [ 3.321718] [talos] task setupSystemDirectory (2/6): done, 1.521747ms [ 3.323316] [talos] task mountBPFFS (3/6): starting [ 3.334466] [talos] task enforceKSPPRequirements (1/6): starting [ 3.344354] [talos] task mountCgroups (4/6): starting [ 3.347431] [talos] task mountCgroups (4/6): done, 3.122898ms [ 3.395453] [talos] task mountPseudoFilesystems (5/6): starting [ 3.397285] [talos] task mountPseudoFilesystems (5/6): done, 47.505925ms [ 3.410232] [talos] pre-created iptables-nft table 'mangle'/'KUBE-IPTABLES-HINT' {"component": "controller-runtime", "controller": "network.NfTablesChainController"} [ 3.419077] [talos] task enforceKSPPRequirements (1/6): done, 122.397722ms [ 3.423407] [talos] nftables chains updated {"component": "controller-runtime", "controller": "network.NfTablesChainController", "chains": []} [ 3.426555] [talos] task mountBPFFS (3/6): done, 92.1507ms [ 3.427859] [talos] phase systemRequirements (1/11): done, 133.76607ms [ 3.429417] [talos] setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["1.1.1.1", "8.8.8.8"]} [ 3.431743] [talos] setting time servers {"component": "controller-runtime", "controller": "network.TimeServerSpecController", "addresses": ["time.cloudflare.com"]} [ 3.434478] [talos] assigned address {"component": "controller-runtime", "controller": "network.AddressSpecController", "address": "127.0.0.1/8", "link": "lo"} [ 3.437709] [talos] phase integrity (2/11): 1 tasks(s) [ 3.439119] [talos] setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["1.1.1.1", "8.8.8.8"]} [ 3.442627] [talos] setting time servers {"component": "controller-runtime", "controller": "network.TimeServerSpecController", "addresses": ["time.cloudflare.com"]} [ 3.445592] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 3.450678] [talos] task writeIMAPolicy (1/1): starting [ 3.453645] ima: policy update completed [ 3.454874] audit: type=1807 audit(1725365278.687:2): action=dont_measure fsmagic=0x9fa0 res=1 [ 3.456959] audit: type=1807 audit(1725365278.687:3): action=dont_measure fsmagic=0x62656572 res=1 [ 3.460142] audit: type=1807 audit(1725365278.687:4): action=dont_measure fsmagic=0x64626720 res=1 [ 3.461875] audit: type=1807 audit(1725365278.687:5): action=dont_measure fsmagic=0x1021994 res=1 [ 3.472721] audit: type=1807 audit(1725365278.687:6): action=dont_measure fsmagic=0x1cd1 res=1 [ 3.476862] audit: type=1807 audit(1725365278.687:7): action=dont_measure fsmagic=0x42494e4d res=1 [ 3.479780] audit: type=1807 audit(1725365278.687:8): action=dont_measure fsmagic=0x73636673 res=1 [ 3.481632] audit: type=1807 audit(1725365278.687:9): action=dont_measure fsmagic=0xf97cff8c res=1 [ 3.486458] audit: type=1807 audit(1725365278.687:10): action=dont_measure fsmagic=0x43415d53 res=1 [ 3.500910] [talos] task writeIMAPolicy (1/1): done, 58.590999ms [ 3.502723] [talos] phase integrity (2/11): done, 73.234034ms [ 3.504954] [talos] phase etc (3/11): 3 tasks(s) [ 3.506778] [talos] task CreateSystemCgroups (1/3): starting [ 3.508124] [talos] task setUserEnvVars (3/3): starting [ 3.509684] [talos] task setUserEnvVars (3/3): done, 2.906348ms [ 3.511491] [talos] task createOSReleaseFile (2/3): starting [ 3.513280] [talos] task createOSReleaseFile (2/3): done, 6.507091ms [ 3.526651] [talos] task CreateSystemCgroups (1/3): done, 19.904229ms [ 3.529716] [talos] phase etc (3/11): done, 24.759872ms [ 3.530972] [talos] phase earlyServices (4/11): 4 tasks(s) [ 3.532278] [talos] task startContainerd (4/4): starting [ 3.534705] [talos] task startUdevd (1/4): starting [ 3.544945] [talos] task startMachined (2/4): starting [ 3.546265] [talos] TPM device is not available, skipping PCR extension [ 3.549165] [talos] task startSyslogd (3/4): starting [ 3.550918] [talos] servicecontainerd: Starting service [ 3.552836] [talos] servicecontainerd: Running pre state [ 3.554713] [talos] serviceudevd: Starting service [ 3.555899] [talos] serviceudevd: Running pre state [ 3.556974] [talos] servicecontainerd: Creating service runner [ 3.558975] [talos] servicemachined: Starting service [ 3.560188] [talos] servicemachined: Running pre state [ 3.561236] [talos] servicemachined: Creating service runner [ 3.562376] [talos] servicemachined: Service started as goroutine [ 3.563790] [talos] servicesyslogd: Starting service [ 3.564860] [talos] servicesyslogd: Waiting for service "machined" to be "up" [ 3.598714] [talos] task startSyslogd (3/4): done, 66.354901ms [ 4.451822] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 4.571826] [talos] servicemachined: Health check successful [ 4.575725] [talos] task startMachined (2/4): done, 1.043386277s [ 4.579592] [talos] servicesyslogd: Running pre state [ 4.583743] [talos] servicesyslogd: Creating service runner [ 4.589372] [talos] servicesyslogd: Service started as goroutine [ 5.466727] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 5.596826] [talos] servicesyslogd: Health check successful [ 5.984962] [talos] serviceudevd: Creating service runner [ 5.989091] [talos] servicecontainerd: Process Process(["/bin/containerd" "--address" "/system/run/containerd/containerd.sock" "--state" "/system/run/containerd" "--root" "/system/var/lib/containerd"]) started with PID 1103 [ 6.006435] [talos] serviceudevd: Process Process(["/sbin/udevd" "--resolve-names=never"]) started with PID 1104 [ 6.202613] udevd[1104]: starting version 3.2.14 [ 6.221361] udevd[1104]: starting eudev-3.2.14 [ 6.471918] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 7.237579] ahci 0000:00:0d.0: SSS flag set, parallel bus scan disabled [ 7.238272] e1000: Intel(R) PRO/1000 Network Driver [ 7.239342] ahci 0000:00:0d.0: AHCI 0001.0100 32 slots 1 ports 3 Gbps 0x1 impl SATA mode [ 7.239455] e1000: Copyright (c) 1999-2006 Intel Corporation. [ 7.239820] ahci 0000:00:0d.0: flags: 64bit ncq stag only ccc [ 7.287070] scsi host2: ahci [ 7.302567] ata3: SATA max UDMA/133 abar m8192@0xf0806000 port 0xf0806100 irq 21 [ 7.479895] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 7.622046] ata3: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 7.623712] ata3.00: ATA-6: VBOX HARDDISK, 1.0, max UDMA/133 [ 7.624791] ata3.00: 16777216 sectors, multi 128: LBA48 NCQ (depth 32) [ 7.630313] ata3.00: configured for UDMA/133 [ 7.631379] scsi 2:0:0:0: Direct-Access ATA VBOX HARDDISK 1.0 PQ: 0 ANSI: 5 [ 7.633635] sd 2:0:0:0: [sda] 16777216 512-byte logical blocks: (8.59 GB/8.00 GiB) [ 7.636018] sd 2:0:0:0: [sda] Write Protect is off [ 7.637077] sd 2:0:0:0: Attached scsi generic sg1 type 0 [ 7.641579] sd 2:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 7.643926] sd 2:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 7.669119] sd 2:0:0:0: [sda] Attached SCSI disk [ 7.700151] e1000 0000:00:03.0 eth0: (PCI:33MHz:32-bit) 08:00:27:df:64:e5 [ 7.701583] e1000 0000:00:03.0 eth0: Intel(R) PRO/1000 Network Connection [ 7.704007] e1000 0000:00:03.0 enp0s3: renamed from eth0 [ 7.737590] [talos] serviceudevd: Health check successful [ 7.738875] [talos] task startUdevd (1/4): done, 4.206573644s [ 7.765249] 8021q: adding VLAN 0 to HW filter on device enp0s3 [ 8.219483] [talos] servicecontainerd: Health check failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded [ 8.551041] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 9.556671] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 9.600163] [talos] servicecontainerd: Health check successful [ 9.602291] [talos] task startContainerd (4/4): done, 6.070020998s [ 9.603524] [talos] phase earlyServices (4/11): done, 6.072552599s [ 9.604515] [talos] phase usb (5/11): 1 tasks(s) [ 9.605349] [talos] task waitForUSB (1/1): starting [ 9.606349] [talos] task waitForUSB (1/1): waiting 1 second(s) for USB storage [ 9.789376] e1000: enp0s3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 9.846203] [talos] setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["10.11.0.1"]} [ 9.853642] [talos] assigned address {"component": "controller-runtime", "controller": "network.AddressSpecController", "address": "10.11.20.86/16", "link": "enp0s3"} [ 9.866123] [talos] controller failed {"component": "controller-runtime", "controller": "network.RouteSpecController", "error": "1 error occurred:\n\t* error adding route: netlink receive: network is unreachable, message {Family:2 DstLength:0 SrcLength:0 Tos:0 Table:0 Protocol:3 Scope:0 Type:1 Flags:0 Attributes:{Dst: Src:10.11.20.86 Gateway:10.11.0.1 OutIface:8 Priority:1024 Table:254 Mark:0 Pref: Expires: Metrics: Multipath:[]}}\n\n"} [ 9.970516] [talos] changed MTU for the link {"component": "controller-runtime", "controller": "network.LinkSpecController", "link": "enp0s3", "mtu": 1350} [ 9.983923] e1000 0000:00:03.0 enp0s3: Reset adapter [ 10.298015] [talos] created route {"component": "controller-runtime", "controller": "network.RouteSpecController", "destination": "default", "gateway": "10.11.0.1", "table": "main", "link": "enp0s3", "priority": 1024, "family": "inet4"} [ 10.608002] [talos] task waitForUSB (1/1): done, 1.002650788s [ 10.610959] [talos] phase usb (5/11): done, 1.006432334s [ 10.613059] [talos] phase meta (6/11): 1 tasks(s) [ 10.614299] [talos] task reloadMeta (1/1): starting [ 10.621880] [talos] task reloadMeta (1/1): done, 7.578984ms [ 10.623356] [talos] phase meta (6/11): done, 10.295141ms [ 10.625212] [talos] phase dashboard (7/11): 1 tasks(s) [ 10.626634] [talos] task startDashboard (1/1): starting [ 10.633463] [talos] servicedashboard: Starting service [ 10.634932] [talos] servicedashboard: Waiting for service "machined" to be "up", file "/system/run/machined/machine.sock" to exist [ 10.637366] [talos] task startDashboard (1/1): done, 8.378357ms [ 10.639352] [talos] phase dashboard (7/11): done, 14.143344ms [ 10.641235] [talos] servicedashboard: Running pre state [ 10.673118] [talos] servicedashboard: Creating service runner [ 10.678565] [talos] servicedashboard: Process Process(["/sbin/dashboard"]) started with PID 1803 [ 10.681975] [talos] phase config (10/11): 1 tasks(s) [ 10.683036] [talos] task loadConfig (1/1): starting [ 10.684082] [talos] downloading config {"component": "controller-runtime", "controller": "config.AcquireController", "platform": "metal"} [ 10.685713] [talos] entering maintenance service {"component": "controller-runtime", "controller": "config.AcquireController"} [ 10.690741] [talos] server certificate issued {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController", "fingerprint": "KX6+VlASI8zUiizvvBFoYXSTrBGqK75FT2we22WcmjE="} [ 10.836578] [talos] deleted route {"component": "controller-runtime", "controller": "network.RouteSpecController", "destination": "default", "gateway": "10.11.0.1", "table": "main", "link": "enp0s3", "priority": 1024, "family": "inet4"} [ 10.844306] [talos] setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["1.1.1.1", "8.8.8.8"]} [ 10.848592] [talos] removed address 10.11.20.86/16 from "enp0s3" {"component": "controller-runtime", "controller": "network.AddressSpecController"} [ 12.069083] e1000 0000:00:03.0 enp0s3: Detected Tx Unit Hang [ 12.069083] Tx Queue <0> [ 12.069083] TDH <0> [ 12.069083] TDT <2> [ 12.069083] next_to_use <2> [ 12.069083] next_to_clean <0> [ 12.069083] buffer_info[next_to_clean] [ 12.069083] time_stamp [ 12.069083] next_to_watch <0> [ 12.069083] jiffies [ 12.069083] next_to_watch.status <0> [ 12.095849] e1000: enp0s3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 12.212694] e1000 0000:00:03.0 enp0s3: Detected Tx Unit Hang [ 12.212694] Tx Queue <0> [ 12.212694] TDH <0> [ 12.212694] TDT <2> [ 12.212694] next_to_use <2> [ 12.212694] next_to_clean <0> [ 12.212694] buffer_info[next_to_clean] [ 12.212694] time_stamp [ 12.212694] next_to_watch <0> [ 12.212694] jiffies [ 12.212694] next_to_watch.status <0> [ 14.808637] e1000 0000:00:03.0 enp0s3: Detected Tx Unit Hang [ 14.808637] Tx Queue <0> [ 14.808637] TDH <0> [ 14.808637] TDT <2> [ 14.808637] next_to_use <2> [ 14.808637] next_to_clean <0> [ 14.808637] buffer_info[next_to_clean] [ 14.808637] time_stamp [ 14.808637] next_to_watch <0> [ 14.808637] jiffies [ 14.808637] next_to_watch.status <0> [ 15.563781] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 16.128638] e1000 0000:00:03.0 enp0s3: Detected Tx Unit Hang [ 16.128638] Tx Queue <0> [ 16.128638] TDH <0> [ 16.128638] TDT <2> [ 16.128638] next_to_use <2> [ 16.128638] next_to_clean <0> [ 16.128638] buffer_info[next_to_clean] [ 16.128638] time_stamp [ 16.128638] next_to_watch <0> [ 16.128638] jiffies [ 16.128638] next_to_watch.status <0> [ 16.568617] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 17.574510] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 18.581413] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 18.896084] e1000 0000:00:03.0 enp0s3: Detected Tx Unit Hang [ 18.896084] Tx Queue <0> [ 18.896084] TDH <0> [ 18.896084] TDT <2> [ 18.896084] next_to_use <2> [ 18.896084] next_to_clean <0> [ 18.896084] buffer_info[next_to_clean] [ 18.896084] time_stamp [ 18.896084] next_to_watch <0> [ 18.896084] jiffies [ 18.896084] next_to_watch.status <0> [ 19.589002] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 20.336115] e1000 0000:00:03.0 enp0s3: Detected Tx Unit Hang [ 20.336115] Tx Queue <0> [ 20.336115] TDH <0> [ 20.336115] TDT <2> [ 20.336115] next_to_use <2> [ 20.336115] next_to_clean <0> [ 20.336115] buffer_info[next_to_clean] [ 20.336115] time_stamp [ 20.336115] next_to_watch <0> [ 20.336115] jiffies [ 20.336115] next_to_watch.status <0> [ 20.600559] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 21.610722] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 22.176269] ------------[ cut here ]------------ [ 22.178375] NETDEV WATCHDOG: enp0s3 (e1000): transmit queue 0 timed out 10076 ms [ 22.179315] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:525 dev_watchdog+0x236/0x240 [ 22.180352] Modules linked in: ahci e1000 libahci [ 22.180952] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 6.6.43-talos #1 [ 22.181783] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 [ 22.182783] RIP: 0010:dev_watchdog+0x236/0x240 [ 22.183312] Code: ff ff ff 48 89 df c6 05 a3 4f dc 01 01 e8 a2 5d f9 ff 45 89 f0 44 89 e9 48 89 de 48 89 c2 48 c7 c7 90 9d 23 b3 e8 0a 91 11 ff <0f> 0b e9 42 ff ff ff 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 [ 22.186745] RSP: 0018:ffffaa2840003e70 EFLAGS: 00010286 [ 22.187389] RAX: 0000000000000000 RBX: ffff9333c2592000 RCX: 000000000000083f [ 22.188280] RDX: 0000000000000000 RSI: 00000000000000f6 RDI: 000000000000083f [ 22.189086] RBP: ffff9333c2592488 R08: 0000000000000000 R09: 0000000000000a0f [ 22.189858] R10: 000000004454454e R11: 000000004454454e R12: 0000000000000000 [ 22.191526] R13: 0000000000000000 R14: 000000000000275c R15: ffffaa2840003ef0 [ 22.192416] FS: 0000000000000000(0000) GS:ffff93343dc00000(0000) knlGS:0000000000000000 [ 22.193382] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 22.194006] CR2: 000000c000ea7f18 CR3: 0000000002b0a001 CR4: 00000000000706f0 [ 22.194804] Call Trace: [ 22.195146] [ 22.195384] ? dev_watchdog+0x236/0x240 [ 22.195808] ? __warn+0x81/0x120 [ 22.196196] ? dev_watchdog+0x236/0x240 [ 22.196633] ? report_bug+0x15d/0x180 [ 22.197079] ? handle_bug+0x3c/0x80 [ 22.197477] ? exc_invalid_op+0x17/0x70 [ 22.197904] ? asm_exc_invalid_op+0x1a/0x20 [ 22.198378] ? dev_watchdog+0x236/0x240 [ 22.198820] ? pfx_dev_watchdog+0x10/0x10 [ 22.199312] call_timer_fn+0x27/0x110 [ 22.199731] run_timers+0x218/0x2a0 [ 22.200288] run_timer_softirq+0x2c/0x70 [ 22.201087] handle_softirqs+0xea/0x300 [ 22.201686] __irq_exit_rcu+0x68/0x90 [ 22.202198] sysvec_apic_timer_interrupt+0x72/0x90 [ 22.202818] [ 22.203157] [ 22.203535] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 22.204250] RIP: 0010:pv_native_safe_halt+0xf/0x20 [ 22.204827] Code: 0b 90 66 0f 1f 84 00 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 85 75 3f 00 fb f4 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 [ 22.207069] RSP: 0018:ffffffffb3c03e68 EFLAGS: 00000206 [ 22.207977] RAX: ffff93343dc2af20 RBX: 0000000000000000 RCX: 4000000000000000 [ 22.209121] RDX: 0000000000000000 RSI: 0000000000000083 RDI: 00000000000b1cc4 [ 22.209897] RBP: ffffffffb3c0d1c0 R08: ffff93343dc203a0 R09: 0000000000000007 [ 22.210723] R10: 0000000000000000 R11: 000000009b8d39b9 R12: 0000000000000000 [ 22.211553] R13: 0000000000000000 R14: ffffffffb3c0d1c0 R15: 000000000008b000 [ 22.212390] ? ct_kernel_exit.constprop.0+0x63/0x80 [ 22.212959] default_idle+0x9/0x20 [ 22.213409] default_idle_call+0x2c/0xb0 [ 22.213866] do_idle+0x1ff/0x240 [ 22.214267] cpu_startup_entry+0x2a/0x30 [ 22.214706] rest_init+0xc2/0xf0 [ 22.215120] ? acpi_subsystem_init+0x70/0xe0 [ 22.215700] arch_call_rest_init+0xe/0x60 [ 22.216179] start_kernel+0x4f1/0x7b0 [ 22.216592] x86_64_start_reservations+0x18/0x30 [ 22.217247] x86_64_start_kernel+0x75/0x80 [ 22.217730] secondary_startup_64_no_verify+0x178/0x17b [ 22.218321] [ 22.218568] ---[ end trace 0000000000000000 ]--- [ 22.219653] e1000 0000:00:03.0 enp0s3: Reset adapter [ 22.616590] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 23.661638] [talos] failed looking up "time.cloudflare.com", ignored {"component": "controller-runtime", "controller": "time.SyncController", "error": "lookup time.cloudflare.com on 8.8.8.8:53: dial udp 8.8.8.8:53: connect: network is unreachable"} [ 24.463819] e1000: enp0s3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 24.509813] [talos] setting resolvers {"component": "controller-runtime", "controller": "network.ResolverSpecController", "resolvers": ["10.11.0.1"]} [ 24.512843] [talos] assigned address {"component": "controller-runtime", "controller": "network.AddressSpecController", "address": "10.11.20.86/16", "link": "enp0s3"} [ 24.520449] [talos] created route {"component": "controller-runtime", "controller": "network.RouteSpecController", "destination": "default", "gateway": "10.11.0.1", "table": "main", "link": "enp0s3", "priority": 1024, "family": "inet4"} [ 24.525137] [talos] this machine is reachable at: {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.528990] [talos] 10.11.20.86 {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.532765] [talos] upload configuration using talosctl: {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.540870] [talos] talosctl apply-config --insecure --nodes 10.11.20.86 --file {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.540883] [talos] or apply configuration using talosctl interactive installer: {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.540890] [talos] talosctl apply-config --insecure --nodes 10.11.20.86 --mode=interactive {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.540897] [talos] optionally with node fingerprint check: {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.540907] [talos] talosctl apply-config --insecure --nodes 10.11.20.86 --cert-fingerprint 'KX6+VlASI8zUiizvvBFoYXSTrBGqK75FT2we22WcmjE=' --file {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 24.723912] [talos] adjusting time (jump) by -7.713686875s via 162.159.200.1, state TIME_OK, status STA_NANO {"component": "controller-runtime", "controller": "time.SyncController"} [ 24.727375] [talos] synchronized RTC with system clock {"component": "controller-runtime", "controller": "time.SyncController"} [ 24.729271] [talos] server certificate issued {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController", "fingerprint": "GB9Os7OX60KvTUBKiu8rDGn24Qza0MtvI1R60R9qGLQ="} [ 41.254708] [talos] this machine is reachable at: {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 41.259744] [talos] 10.11.20.86 {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 41.262225] [talos] fd0b:a49f:36b2:0:a00:27ff:fedf:64e5 {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController"} [ 41.262606] [talos] server certificate issued {"component": "controller-runtime", "controller": "runtime.MaintenanceServiceController", "fingerprint": "vQu7vYFVlvgKJo7PykHnCQl7F3KW5+SEPNNifFTNT+Y="} [ 56.752749] [talos] adjusting time (slew) by 9.743893ms via 162.159.200.1, state TIME_OK, status STA_PLL | STA_NANO {"component": "controller-runtime", "controller": "time.SyncController"} [ 60.030586] OK [/machine.MachineService/ApplyConfiguration] 5.958574ms unary Success (:authority=10.11.20.86:50000;content-type=application/grpc;grpc-accept-encoding=gzip;runtime=Talos;user-agent=grpc-go/1.63.2) [ 60.035002] [talos] kubeprism KubePrism is enabled {"component": "controller-runtime", "controller": "k8s.KubePrismController", "endpoint": "127.0.0.1:7445"} [ 60.057029] [talos] leaving maintenance service {"component": "controller-runtime", "controller": "config.AcquireController"} [ 60.057133] [talos] machine config loaded successfully {"component": "controller-runtime", "controller": "config.AcquireController", "sources": ["maintenance"]} [ 60.057190] [talos] task loadConfig (1/1): done, 49.37565901s [ 60.057212] [talos] phase config (10/11): done, 49.376754526s [ 60.062634] [talos] created dns upstream {"component": "controller-runtime", "controller": "network.DNSUpstreamController", "addr": "10.11.0.1"} [ 60.068113] [talos] updated dns server nameservers {"component": "dns-resolve-cache", "addrs": ["10.11.0.1:53"]} [ 60.110010] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 60.122305] [talos] initialize sequence: done: 56.830876659s [ 60.132984] [talos] install sequence: 11 phase(s) [ 60.133621] [talos] phase env (1/11): 1 tasks(s) [ 60.134202] [talos] task setUserEnvVars (1/1): starting [ 60.135091] [talos] task setUserEnvVars (1/1): done, 885.978µs [ 60.136570] [talos] phase env (1/11): done, 2.948911ms [ 60.137183] [talos] phase install (2/11): 1 tasks(s) [ 60.137846] [talos] task install (1/1): starting [ 60.147649] [talos] pulling "ghcr.io/siderolabs/installer:v1.7.6" [ 60.917041] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 62.148922] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:42632->10.11.0.1:53: i/o timeout"} [ 62.153231] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:60683->10.11.0.1:53: i/o timeout"} [ 62.614775] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 64.156847] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:34025->10.11.0.1:53: i/o timeout"} [ 64.160743] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:56392->10.11.0.1:53: i/o timeout"} [ 64.162634] [talos] retrying error: failed to pull image "ghcr.io/siderolabs/installer:v1.7.6": failed to resolve reference "ghcr.io/siderolabs/installer:v1.7.6": failed to do request: Head "https://ghcr.io/v2/siderolabs/installer/manifests/v1.7.6": dial tcp: lookup ghcr.io on 127.0.0.53:53: server misbehaving [ 66.167792] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:54673->10.11.0.1:53: i/o timeout"} [ 66.171466] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:51701->10.11.0.1:53: i/o timeout"} [ 67.494877] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 68.174556] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:46403->10.11.0.1:53: i/o timeout"} [ 68.177965] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:41849->10.11.0.1:53: i/o timeout"} [ 75.183060] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:54706->10.11.0.1:53: i/o timeout"} [ 75.185378] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:47477->10.11.0.1:53: i/o timeout"} [ 76.990151] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 77.186907] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:40687->10.11.0.1:53: i/o timeout"} [ 77.189331] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:46251->10.11.0.1:53: i/o timeout"} [ 94.195080] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:36902->10.11.0.1:53: i/o timeout"} [ 94.198324] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:43117->10.11.0.1:53: i/o timeout"} [ 96.199231] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:58432->10.11.0.1:53: i/o timeout"} [ 96.202793] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:49956->10.11.0.1:53: i/o timeout"} [ 96.436534] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 130.804174] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"} [ 133.251051] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:40229->10.11.0.1:53: i/o timeout"} [ 133.254891] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:57576->10.11.0.1:53: i/o timeout"} [ 135.256709] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:60204->10.11.0.1:53: i/o timeout"} [ 135.261069] [talos] error serving dns request {"component": "dns-resolve-cache", "error": "read udp 10.11.20.86:40638->10.11.0.1:53: i/o timeout"} [ 189.184997] [talos] kubernetes endpoint watch error {"component": "controller-runtime", "controller": "k8s.EndpointController", "error": "failed to list v1.Endpoints: Get \"https://10.11.20.86:6443/api/v1/namespaces/default/endpoints?fieldSelector=metadata.name%3Dkubernetes&limit=500&resourceVersion=0\": dial tcp 10.11.20.86:6443: connect: connection refused"}`

looks like internal dns isnt working, but together with the endpoint watch error, it looks like it cant reach itself on its own ip... and when i change external dns, it just gets ignored...

and what is bootstrap? im completley new to talos and kubernetes

smira commented 2 months ago

Please format the logs to be readable.

For a Talos walk-through, please use Getting Started.

LaneaLucy commented 2 months ago

i now changed network and i think i even got it bootstraped, but now something other isnt working... api server would be my guess because it shows n/a on console

log.txt

and im following https://www.talos.dev/v1.7/talos-guides/install/local-platforms/virtualbox/

LaneaLucy commented 2 months ago

ok, it just needed another reboot and now its working. but i still would like to know what was wrong in first network, because every other device in this network is working. so here is the first log again, but formated... log.txt the dns in this network is a little slow, so maybe the timeout is just to short? if this is the problem, is there any config option to change the dns timeout?

smira commented 2 months ago

You can do initial troubleshooting yourself using talosctl health command.

For more in-depth, use Troubleshooting.

If lost, use talosctl support and upload support.zip to GitHub issue.

LaneaLucy commented 2 months ago

@smira everything is working in the second network. but what about a config option to change dns timeout?

smira commented 2 months ago

@smira everything is working in the second network. but what about a config option to change dns timeout?

if you can create a separate issue with detailed logs (attaching logs of talosctl logs dns-resolve-cache).

You can change DNS on the fly as well, but I can't guess what is "slow" specifically.

LaneaLucy commented 2 months ago

i just need a command to change the timeout on dns-resolve-cache

smira commented 2 months ago

i just need a command to change the timeout on dns-resolve-cache

There's no such command, but even the need for it is not obvious until we see a real problem.

If there's a problem, please submit specific logs showing the problem, or a way to reproduce it.

LaneaLucy commented 2 months ago

log.txt

this shows many timeouts and i know that my default dns server, delivered by dhcp, is very slow to respond, when a another specific dns server in my network isnt available. this is because the default dns server trys to use the specific dns server first, and when it timeouts, it uses other dns server. by waiting for the specific dns server, the default dns server isnt responding very fast, and my assumption is, that this time is enough for talos to time out. thats why i would like to test this, by telling talos dns cache server to wait longer...

LaneaLucy commented 2 months ago
talos ---> default dns ---> specific dns -------
|                    |________________________| timeout
|
|_______________________| timeout
smira commented 2 months ago

I don't think raising timeouts on the DNS resolver would help a lot, as in the end the timeout would happen on the application side (resolver), and eventually it all times out.

So I would rather fix your DNS in the network, or use public DNS servers which don't have this issue.

But what I asked is still not in the issue:

attaching logs of talosctl logs dns-resolve-cache.

So if you have a specific DNS issue, please open a GitHub issue with details - timeouts, settings, etc.

This issue is not valid - Talos on Virtual Box works.