mixtile-rockchip / mixtile-clusterbox-mt7620a-openwrt

Other
4 stars 1 forks source link

`nodectl` fails to list nodes with custom firmware built from this repo #13

Open srcshelton opened 1 month ago

srcshelton commented 1 month ago

Describe the bug

Mixtile nodectl internally executes:

lspci | grep "^03\|^04\|^05\|^06"

And apparently the intended output is:

03:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)
04:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)
05:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)
06:00.0 Network controller: Mixtile Limited Blade 3 (rev 01)

However, with the full pciutils package (with pciids - but I don't think that either are actually significant to the problem) the output instead reads:

# sudo lspci
00:00.0 PCI bridge: Ralink corp. Device 0801 (rev 01)
01:00.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:00.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:04.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:08.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)
02:0c.0 PCI bridge: ASMedia Technology Inc. ASM2824 PCIe Gen3 Packet Switch (rev 01)

The miop kernel-module is loaded on the clusterbox and the blades have version 1.0.0 of the miop-control package installed, but it appears that only the PCIe Switches are being seen, not any PCIe Network devices behind(?) them.

With the old v1.0 BMC board, the PCIe Network interfaces of these same blades were exposed.

srcshelton commented 1 month ago

From one of the blades:

mixtile@blade3:~$ dpkg -l | grep -i miop
ii  miop-control                                1.0.0                              arm64        miop-control TCP/IP over PCIe device driver.

mixtile@blade3:~$ lsmod
Module                  Size  Used by
miop_ep                16384  0
miop_ep_net            20480  0
pcie_ep_rk35           20480  0
miop_reg               16384  3 miop_ep_net,pcie_ep_rk35,miop_ep
miop_control           16384  0
bcmdhd               1380352  0

mixtile@blade3:~$ lspci
0002:20:00.0 PCI bridge: Fuzhou Rockchip Electronics Co., Ltd Device 3588 (rev 01)
0002:21:00.0 PCI bridge: ASMedia Technology Inc. Device 1182
0002:22:03.0 PCI bridge: ASMedia Technology Inc. Device 1182
0002:22:07.0 PCI bridge: ASMedia Technology Inc. Device 1182
0002:23:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)
0002:24:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)