Failed to start determination service

[Pterosaur]

Description

Steps to reproduce the issue:

1. Create a typical KVM t0 testbed ./testbed-cli.sh -t vtestbed.yaml -m veos_vtb -k ceos add-topo vms-kvm-t0 password.txt && ./testbed-cli.sh -t vtestbed.yaml -m veos_vtb deploy-mg vms-kvm-t0 veos_vtb password.txt
2. Monitor the console by telnet localhost 9000 3.Reboot the OS and will get following error on the console screen

Describe the results you received:

[   23.086306] rc.local[618]: cat
[   23.090139] rc.local[620]: sed
[   23.093972] rc.local[618]:  /etc/sonic/sonic_version.yml
[   23.109108] rc.local[620]:  -e
[   23.115530] rc.local[620]:  s/build_version: //g;s/'//g
[   23.127494] rc.local[619]: + grep build_version
[   23.135831] rc.local[611]: + SONIC_VERSION=master.580196-1abd0deae
[   23.145618] rc.local[611]: + FIRST_BOOT_FILE=/host/image-master.580196-1abd0deae/platform/firsttime
[   23.153811] rc.local[611]: + SONIC_CONFIG_DIR=/host/image-master.580196-1abd0deae/sonic-config
[   23.162200] rc.local[611]: + SONIC_ENV_FILE=/host/image-master.580196-1abd0deae/sonic-config/sonic-environment
[   23.170743] rc.local[611]: + [ -d /host/image-master.580196-1abd0deae/sonic-config -a -f /host/image-master.580196-1abd0deae/sonic-config/sonic-environment ]
[   23.187121] rc.local[611]: + logger SONiC version master.580196-1abd0deae starting up...
[   23.200895] rc.local[611]: + grub_installation_needed=
[   23.204497] rc.local[611]: + [ ! -e /host/machine.conf ]
[   23.209793] rc.local[611]: + . /host/machine.conf
[   23.214523] rc.local[611]: + onie_arch=x86_64
[   23.219474] rc.local[611]: + onie_bin=
[   23.224216] rc.local[611]: + onie_boot_reason=install
[   23.227663] rc.local[611]: + onie_build_date=2018-11-17T04:18+00:00
[   23.232781] rc.local[611]: + onie_build_machine=kvm_x86_64
[   23.237373] rc.local[611]: + onie_build_platform=x86_64-kvm_x86_64-r0
[   23.242930] rc.local[611]: + onie_config_version=1
[   23.248279] rc.local[611]: + onie_dev=/dev/vda2
[   23.255777] rc.local[611]: + onie_disco_boot_reason=install
[   23.260175] rc.local[611]: + onie_disco_dns=10.0.2.3
[   23.267033] rc.local[611]: + onie_disco_interface=eth0
[   23.280726] rc.local[611]: + onie_disco_ip=10.0.2.15
[   23.285542] rc.local[611]: + onie_disco_lease=86400
[   23.289683] rc.local[611]: + onie_disco_mask=24
[   23.293110] rc.local[611]: + onie_disco_opt53=05
[   23.296566] rc.local[611]: + onie_disco_router=10.0.2.2
[   23.302110] rc.local[611]: + onie_disco_serverid=10.0.2.2
[   23.307457] rc.local[611]: + onie_disco_siaddr=10.0.2.2
[   23.312283] rc.local[611]: + onie_disco_subnet=255.255.255.0
[   23.320454] rc.local[611]: + onie_exec_url=file://dev/vdb/onie-installer.bin
[   23.329199] rc.local[611]: + onie_firmware=auto
[   23.334612] rc.local[611]: + onie_grub_image_name=shimx64.efi
[   23.340459] rc.local[611]: + onie_initrd_tmp=/
[   23.344151] rc.local[611]: + onie_installer=/var/tmp/installer
[   23.349578] rc.local[611]: + onie_kernel_version=4.9.95
[   23.353522] rc.local[611]: + onie_local_parts=
[   23.356557] rc.local[611]: + onie_machine=kvm_x86_64
[   23.364655] rc.local[611]: + onie_machine_rev=0
[   23.372262] rc.local[611]: + onie_neighs=[fe80::2-eth0],
[   23.377023] rc.local[611]: + onie_partition_type=gpt
[   23.388215] rc.local[611]: + onie_platform=x86_64-kvm_x86_64-r0
[   23.396283] rc.local[611]: + onie_root_dir=/mnt/onie-boot/onie
[   23.401675] rc.local[611]: + onie_secure_boot=yes
[   23.404879] rc.local[611]: + onie_skip_ethmgmt_macs=yes
[   23.408310] rc.local[611]: + onie_switch_asic=qemu
[   23.413251] rc.local[611]: + onie_uefi_arch=x64
[   23.418102] rc.local[611]: + onie_uefi_boot_loader=shimx64.efi
[   23.422597] rc.local[611]: + onie_vendor_id=42623
[   23.429918] rc.local[611]: + onie_version=master-201811170418
[   23.433342] rc.local[611]: + program_console_speed
[   23.437950] rc.local[633]: + grep -Eo console=tty(S|AMA)[0-9]+,[0-9]+
[   23.443155] rc.local[632]: + cat /proc/cmdline
[   23.447833] rc.local[636]: + cut -d , -f2
[   23.450566] rc.local[611]: + speed=115200
[   23.453726] rc.local[611]: + [ -z 115200 ]
[   23.457184] rc.local[611]: + CONSOLE_SPEED=115200
[   23.460450] rc.local[642]: + grep agetty /lib/systemd/system/serial-getty@.service
[   23.466035] rc.local[643]: + grep keep-baud
[   23.470468] rc.local[643]: ExecStart=-/sbin/agetty -o '-p -- \\u' --keep-baud 115200,57600,38400,9600 - $TERM
[   23.476803] rc.local[611]: + [ 0 = 0 ]
[   23.480406] rc.local[611]: + sed -i s|\-\-keep\-baud .* %I| 115200 %I|g /lib/systemd/system/serial-getty@.service
[   23.489302] rc.local[611]: + systemctl daemon-reload
[   23.597592] rc.local[611]: + [ -f /host/image-master.580196-1abd0deae/platform/firsttime ]
[   23.604681] rc.local[611]: + [ -f /var/log/fsck.log.gz ]
[   23.641727] rc.local[686]: + gunzip -d -c /var/log/fsck.log.gz
[   23.652322] rc.local[687]: + logger -t FSCK
[   23.655304] rc.local[611]: + rm -f /var/log/fsck.log.gz
[   23.662465] rc.local[611]: + exit 0
[FAILED] Failed to start determine-…eboot cause determination service.

Debian GNU/Linux 12 vlab-01 ttyS0

vlab-01 login:

Describe the results you expected:

Output of show version:

SONiC Software Version: SONiC.master.580196-1abd0deae
SONiC OS Version: 12
Distribution: Debian 12.5
Kernel: 6.1.0-11-2-amd64
Build commit: 1abd0deae
Build date: Tue Jun 25 15:48:56 UTC 2024
Built by: cloudtest@1d79aab9c000000

Platform: x86_64-kvm_x86_64-r0
HwSKU: Force10-S6000
ASIC: vs
ASIC Count: 1
Serial Number: N/A
Model Number: N/A
Hardware Revision: N/A
Uptime: 11:57:14 up 18 min,  1 user,  load average: 0.01, 0.08, 0.15
Date: Wed 26 Jun 2024 11:57:14

This issue also appeared in the commit: 53966e3ff340cc16127d78aa92587aee3b48dd0e Commits on May 17, 2024 So, I feel it was introduced about April or May 2024.

Output of show techsupport:

(paste your output here or download and attach the file here )

Additional information you deem important (e.g. issue happens only occasionally):

[prgeor]

@Pterosaur will check why determine reboot cause service is not able to start in kvm