dledford
commented
3 years ago We shouldn't have any unconnected cards. Likely, it should be connected to both the IB switch and the Ethernet switch and configured for RoCE on the port connected to the Ethernet switch.
On Tue, Jul 27, 2021 at 4:25 PM shall1024 @.***> wrote:
Today when doing sanity checks on which cards were present in node-01 through node-10, I noticed there was a Mellanox MCX556A-ECAT 2-port 100G card that has no connections to it.
The documentation reflects this; according to the documentation it is not expected to be connected to anything (it wasn't even present in ib_fabric.md https://github.com/OpenFabrics/fsdp_docs/blob/main/ib_fabric.md, just in the test_nodes.md https://github.com/OpenFabrics/fsdp_docs/blob/main/test_nodes.md file.
I don't remember if this is intentional or not, but I am going to document this in case we are missing a cable, etc.
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/OpenFabrics/fsdp_docs/issues/57, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAIFQFOZEOJGQ3PJPXZKP33TZ4IZ7ANCNFSM5BC7B6MQ .
-- Doug Ledford @.***> GPG KeyID: B826A3330E572FDD Key fingerprint = AE6B 1BDA 122B 23B4 265B 1274 B826 A333 0E57 2FDD
shall1024
lylavoie
Today when doing sanity checks on which cards were present in node-01 through node-10, I noticed there was a Mellanox MCX556A-ECAT 2-port 100G card that has no connections to it.
The documentation reflects this; according to the documentation it is not expected to be connected to anything (it wasn't even present in ib_fabric.md, just in the test_nodes.md file.
I don't remember if this is intentional or not, but I am going to document this in case we are missing a cable, etc.