Wiwynn / fb_openbmc

0 stars 2 forks source link

yosemite4-n: BIC recovery update failed #8

Open RickyWu-wiwynn opened 2 weeks ago

RickyWu-wiwynn commented 2 weeks ago
  1. BIC recovery update on slot 2

    • EID missing after recovery update through uart.
      root@yosemite4-n:~# sh factory_tool/fw-util.sh slot2 --recovery sd_bic pldm_sd_bic_enable_i3c_e7 uart_2024_21_e7.bin
      Recovery sd_bic in slot2 with image uart_2024_21_e7.bin
      Start to Recovery slot 2 sd_bic BIC
      UART is ttyS1
      i2c bus is 1
      Setting BIC boot from UART
      Doing the recovery update...
      UART image name: uart_2024_21_e7.bin
      Complete sending UART image to BIC.
      Recovery BIC is finished.
      Restart MCTP and PLDM service
      └─ /xyz
      └─ /xyz/openbmc_project
      └─ /xyz/openbmc_project/mctp
        └─ /xyz/openbmc_project/mctp/1
          ├─ /xyz/openbmc_project/mctp/1/30
          ├─ /xyz/openbmc_project/mctp/1/40
          ├─ /xyz/openbmc_project/mctp/1/50
          ├─ /xyz/openbmc_project/mctp/1/60
          ├─ /xyz/openbmc_project/mctp/1/8
          ├─ /xyz/openbmc_project/mctp/1/80
          └─ /xyz/openbmc_project/mctp/1/92
      PLDM image name: pldm_sd_bic_enable_i3c_e7_re_wrapped
      Start to Update PLDM component
      Generating software ID...
      software_id = 683106094957694506
      Failed to get property Progress on interface xyz.openbmc_project.Software.ActivationProgress: Unknown interface xyz.openbmc_project.Software.ActivationProgress or property Progress.
      The image does not match with any devices. Please check it.
      Delete software id. software id = 683106094957694506
  2. BIC recovery update on slot 8

    • BIC console would stuck, 12v-cycle SD and BIC would recover.
      
      root@yosemite4-n:~# sh factory_tool/fw-util.sh slot8 --recovery sd_bic pldm_sd_bic_enable_i3c_e7 uart_2024_21_e7.bin
      Recovery sd_bic in slot8 with image uart_2024_21_e7.bin
      Start to Recovery slot 8 sd_bic BIC
      UART is ttyS8
      i2c bus is 7
      Setting BIC boot from UART
      Doing the recovery update...
      UART image name: uart_2024_21_e7.bin
      ^Z
      [1]+  Stopped(SIGTSTP)        sh factory_tool/fw-util.sh slot8 --recovery sd_bic pldm_sd_bic_enable_i3c_e7 uart_2024_21_e7.bin
  3. Saw an abnormal issue that some EID in MCTP tree were missing after BIC recovery update but could still get the TID with pldmtool, reboot BMC and the EID in MCTP tree would recover.

    root@yosemite4-n:~# busctl tree xyz.openbmc_project.MCTP
      └─ /xyz
        └─ /xyz/openbmc_project
          └─ /xyz/openbmc_project/mctp
            └─ /xyz/openbmc_project/mctp/1
              ├─ /xyz/openbmc_project/mctp/1/20
              ├─ /xyz/openbmc_project/mctp/1/40
              ├─ /xyz/openbmc_project/mctp/1/8
              ├─ /xyz/openbmc_project/mctp/1/80
              └─ /xyz/openbmc_project/mctp/1/92
      root@yosemite4-n:~# sh checkTID.sh
      {
          "Response": 10
      }
      {
          "Response": 20
      }
      {
          "Response": 30
      }
      {
          "Response": 40
      }
      {
          "Response": 50
      }
      {
          "Response": 60
      }
      [0] pldm_send_recv error rc -7
      failed to pldm send recv error rc -7
      pldmSendRecv: Failed to receive RC = -7
      {
          "Response": 80
      }
    
Vickie-Chang commented 1 week ago

MB CPLD 00010206 SPD CPLD 00030203 MGMN CPLD B0440202

  1. BMC console
root@yosemite4-n:/tmp/Vickie/CPLD/sd_bic_correct_bic_i3c_pid# pldm-fw-update.sh sd --rcvy 5 uart_2024_21_e7.bin pldm_sd_bic_enable_i3c_e7
Check if other BICs are updating
Start to Recovery slot 5 sd BIC
UART is ttyS5
i2c bus is 4
Setting BIC boot from UART
usb 2-1.3: USB disconnect, device number 7
usb 2-1.3.2: USB disconnect, device number 8
Doing the recovery update...
Recovery BIC is finished.
usb 2-1.3: new high-speed USB device number 9 using npcm7xx-ehci
usb 2-1.3: New USB device found, idVendor=0424, idProduct=2514, bcdDevice= b.b3
usb 2-1.3: New USB device strings: Mfr=0, Product=0, SerialNumber=0
hub 2-1.3:1.0: USB hub found
hub 2-1.3:1.0: 4 ports detected
usb 2-1.3.2: new high-speed USB device number 10 using npcm7xx-ehci
usb 2-1.3.2: config 1 interface 1 altsetting 0 bulk endpoint 0x82 has invalid maxpacket 64
usb 2-1.3.2: config 1 interface 1 altsetting 0 bulk endpoint 0x3 has invalid maxpacket 64
usb 2-1.3.2: New USB device found, idVendor=1d6b, idProduct=0104, bcdDevice= 2.06
usb 2-1.3.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
usb 2-1.3.2: Product: Zephyr CDC ACM
usb 2-1.3.2: Manufacturer: ZEPHYR
usb 2-1.3.2: SerialNumber: 0000018000000180
Restart MCTP/PLDM daemon
i2c i2c-24: __i2c_transfer failed -6
A dependency job for mctpd.service failed. See 'journalctl -xe' for details.
Failed to introspect object / of service xyz.openbmc_project.MCTP: The name is not activatable
No objects discovered.
Start to Update BIC
Check if other BICs are updating
software_id = 683106094957694506
Failed to get property Progress on interface xyz.openbmc_project.Software.ActivationProgress: Unknown object '/xyz/openbmc_project/software/683106094957694506'.
The image does not match with any devices. Please check it.
Delete software id. software id = 683106094957694506
Call failed: Unknown object '/xyz/openbmc_project/software/683106094957694506'.
Failed to delete software id: Exit code 1
  1. BIC console after recovey. The fw is updated to 21.e7 successful.
鱍00:00:00.002,000] <inf> usb_dc_asp*** Booting Zephyr OS build v00.01.06-60-gdd9c71090830  ***
Hello, welcome to Yosemite V4 Sentinel Dome 2024.21.e7
eed: select ep[0x81] as IN endpoint
  1. But the version back to origin after AC cycle
Snipaste_2024-06-24_17-07-18