search

cornelisnetworks / opa-ff

Other
11 stars 20 forks source link

IPv6/IPv4 address always been zero. #4

Open ghost opened 7 years ago

ghost commented 7 years ago

Hi,

No matter what IPv4 nor IPv6 addresses had been assigned to HFI IPoIB interfaces, opaportinfo always return " IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0". We expect opaportinfo shows the IP addresses be used.

[root@rdma-qe-15 ~]$ ip addr show | grep inet (Only keep Intel HFI/OPA interface info) inet 172.31.20.15/24 brd 172.31.20.255 scope global hfi1_opa0 inet6 fe80::211:7501:167:fb0/64 scope link inet 172.31.22.15/24 brd 172.31.22.255 scope global hfi1_opa0.8022 inet6 fe80::211:7501:167:fb0/64 scope link tentative inet 172.31.24.15/24 brd 172.31.24.255 scope global hfi1_opa0.8024 inet6 fe80::211:7501:167:fb0/64 scope link tentative

[root@rdma-qe-15 ~]$ [root@rdma-qe-15 ~]$ ibstat CA 'hfi1_0' CA type: Number of ports: 1 Firmware version: Hardware version: 10 Node GUID: 0x0011750101670fb0 System image GUID: 0x0011750101670fb0 Port 1: State: Active Physical state: LinkUp Rate: 100 Base lid: 3 LMC: 0 SM lid: 3 Capability mask: 0x00490022 Port GUID: 0x0011750101670fb0 Link layer: InfiniBand [root@rdma-qe-15 ~]$

[root@rdma-qe-15 ~]$ /usr/sbin/opaportinfo -p 1 Present Port State: Port 1 Info Subnet: 0xfe80000000000000 GUID: 0x0011750101670fb0 LocalPort: 1 PortState: Active PhysicalState: LinkUp
OfflineDisabledReason: None
IsSMConfigurationStarted: True NeighborNormal: True BaseLID: 0x00000003 SMLID: 0x00000003 LMC: 0 SMSL: 0 PortType: Unknown LimtRsp/Subnet: 32 us, 536 ms M_KEY: 0x0000000000000000 Lease: 0 s Protect: Read-only LinkWidth Act: 4 En: 4 Sup: 1,2,3,4
LinkWidthDnGrd ActTx: 4 Rx: 4 En: 3,4 Sup: 1,2,3,4
LinkSpeed Act: 25Gb En: 25Gb Sup: 25Gb
PortLinkMode Act: STL En: STL Sup: STL
PortLTPCRCMode Act: 14-bit En: 14-bit,16-bit,48-bit Sup: 14-bit,16-bit,48-bit NeighborMode MgmtAllowed: Yes FWAuthBypass: Off NeighborNodeType: Switch NeighborNodeGuid: 0x00117501026480e3 NeighborPortNum: 36 Capability: 0x00490022: CN DM CM APM SM Capability3: 0x0008: SS SM_TrapQP: 0x0 SA_QP: 0x1 IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0 <----- VLs Active: 8+1 VL: Cap 8+1 HighLimit 0x0000 PreemptLimit 0x0000 VLFlowControlDisabledMask: 0x00000000 ArbHighCap: 16 ArbLowCap: 16 MulticastMask: 0x0 CollectiveMask: 0x0 P_Key Enforcement: In: Off Out: Off MulticastPKeyTrapSuppressionEnabled: 0 ClientReregister 0 PortMode ActiveOptimize: Off PassThru: Off VLMarker: Off 16BTrapQuery: Off FlitCtrlInterleave Distance Max: 1 Enabled: 1 MaxNestLevelTxEnabled: 0 MaxNestLevelRxSupported: 0 FlitCtrlPreemption MinInitial: 0x0000 MinTail: 0x0000 LargePktLim: 0x00 SmallPktLimit: 0x00 MaxSmallPktLimit 0x00 PreemptionLimit: 0x00 PortErrorActions: 0x172000: CE-UVLMCE-BCDCE-BTDCE-BHDR-BVLM BufferUnits:VL15Init 0x0110 VL15CreditRate 0x00 CreditAck 0x0 BufferAlloc 0x3 MTU Supported: (0x7) 10240 bytes MTU Active By VL: 00:10240 01: 0 02: 0 03: 0 04: 0 05: 0 06: 0 07: 0 08: 0 09: 0 10: 0 11: 0 12: 0 13: 0 14: 0 15: 2048 16: 0 17: 0 18: 0 19: 0 20: 0 21: 0 22: 0 23: 0 24: 0 25: 0 26: 0 27: 0 28: 0 29: 0 30: 0 31: 0 StallCnt/VL: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 HOQLife VL[00,07]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 HOQLife VL[08,15]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 HOQLife VL[16,23]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 HOQLife VL[24,31]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 ReplayDepth Buffer 0x80; Wire 0x09 DiagCode: 0x0000 LedEnabled: Off LinkDownReason: None NeighborLinkDownReason: None OverallBufferSpace: 0x0940 Violations M_Key: 0 P_Key: 0 Q_Key: 0
[root@rdma-qe-15 ~]$

weiny2 commented 7 years ago

It is not quite that simple:

1) You can have multiple IPoIB interfaces assigned to a physical port. Which IP Address would you prefer the SMA use?

2) The driver/SMA does not currently have access to the IPoIB layer

3) The PortInfo IPAddrs were really designed to allow finding out of band access to switches which have only 1 IP assigned to them.

For these reasons PortInfo.IP Addresses are currently reserved fields in HFI ports.

Ira

From: HonggangLI [mailto:notifications@github.com] Sent: Monday, August 29, 2016 1:19 AM To: 01org/opa-ff opa-ff@noreply.github.com Subject: [01org/opa-ff] IPv6/IPv4 address always been zero. (#4)

Hi,

No matter what IPv4 nor IPv6 addresses had been assigned to HFI IPoIB interfaces, opaportinfo always return " IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0". We expect opaportinfo shows the IP addresses be used.

[root@rdma-qe-15 ~]$ ip addr show | grep inet (Only keep Intel HFI/OPA interface info) inet 172.31.20.15/24 brd 172.31.20.255 scope global hfi1_opa0 inet6 fe80::211:7501:167:fb0/64 scope link inet 172.31.22.15/24 brd 172.31.22.255 scope global hfi1_opa0.8022 inet6 fe80::211:7501:167:fb0/64 scope link tentative inet 172.31.24.15/24 brd 172.31.24.255 scope global hfi1_opa0.8024 inet6 fe80::211:7501:167:fb0/64 scope link tentative

[root@rdma-qe-15 ~]$ [root@rdma-qe-15 ~]$ ibstat CA 'hfi1_0' CA type: Number of ports: 1 Firmware version: Hardware version: 10 Node GUID: 0x0011750101670fb0 System image GUID: 0x0011750101670fb0 Port 1: State: Active Physical state: LinkUp Rate: 100 Base lid: 3 LMC: 0 SM lid: 3 Capability mask: 0x00490022 Port GUID: 0x0011750101670fb0 Link layer: InfiniBand [root@rdma-qe-15 ~]$

[root@rdma-qe-15 ~]$ /usr/sbin/opaportinfo -p 1 Present Port State: Port 1 Info Subnet: 0xfe80000000000000 GUID: 0x0011750101670fb0 LocalPort: 1 PortState: Active PhysicalState: LinkUp

OfflineDisabledReason: None

IsSMConfigurationStarted: True NeighborNormal: True BaseLID: 0x00000003 SMLID: 0x00000003 LMC: 0 SMSL: 0 PortType: Unknown LimtRsp/Subnet: 32 us, 536 ms M_KEY: 0x0000000000000000 Lease: 0 s Protect: Read-only LinkWidth Act: 4 En: 4 Sup: 1,2,3,4

LinkWidthDnGrd ActTx: 4 Rx: 4 En: 3,4 Sup: 1,2,3,4

LinkSpeed Act: 25Gb En: 25Gb Sup: 25Gb

PortLinkMode Act: STL En: STL Sup: STL

PortLTPCRCMode Act: 14-bit En: 14-bit,16-bit,48-bit Sup: 14-bit,16-bit,48-bit NeighborMode MgmtAllowed: Yes FWAuthBypass: Off NeighborNodeType: Switch NeighborNodeGuid: 0x00117501026480e3 NeighborPortNum: 36 Capability: 0x00490022: CN DM CM APM SM Capability3: 0x0008: SS SM_TrapQP: 0x0 SA_QP: 0x1 IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0 <----- VLs Active: 8+1 VL: Cap 8+1 HighLimit 0x0000 PreemptLimit 0x0000 VLFlowControlDisabledMask: 0x00000000 ArbHighCap: 16 ArbLowCap: 16 MulticastMask: 0x0 CollectiveMask: 0x0 P_Key Enforcement: In: Off Out: Off MulticastPKeyTrapSuppressionEnabled: 0 ClientReregister 0 PortMode ActiveOptimize: Off PassThru: Off VLMarker: Off 16BTrapQuery: Off FlitCtrlInterleave Distance Max: 1 Enabled: 1 MaxNestLevelTxEnabled: 0 MaxNestLevelRxSupported: 0 FlitCtrlPreemption MinInitial: 0x0000 MinTail: 0x0000 LargePktLim: 0x00 SmallPktLimit: 0x00 MaxSmallPktLimit 0x00 PreemptionLimit: 0x00 PortErrorActions: 0x172000: CE-UVLMCE-BCDCE-BTDCE-BHDR-BVLM BufferUnits:VL15Init 0x0110 VL15CreditRate 0x00 CreditAck 0x0 BufferAlloc 0x3 MTU Supported: (0x7) 10240 bytes MTU Active By VL: 00:10240 01: 0 02: 0 03: 0 04: 0 05: 0 06: 0 07: 0 08: 0 09: 0 10: 0 11: 0 12: 0 13: 0 14: 0 15: 2048 16: 0 17: 0 18: 0 19: 0 20: 0 21: 0 22: 0 23: 0 24: 0 25: 0 26: 0 27: 0 28: 0 29: 0 30: 0 31: 0 StallCnt/VL: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 HOQLife VL[00,07]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 HOQLife VL[08,15]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 HOQLife VL[16,23]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 HOQLife VL[24,31]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 ReplayDepth Buffer 0x80; Wire 0x09 DiagCode: 0x0000 LedEnabled: Off LinkDownReason: None NeighborLinkDownReason: None OverallBufferSpace: 0x0940 Violations M_Key: 0 P_Key: 0 Q_Key: 0

[root@rdma-qe-15 ~]$

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/01org/opa-ff/issues/4, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AACVleZZFTwHIdAC0CC5CqemT8viHrtsks5qkpYBgaJpZM4JvP2R.

ghost commented 7 years ago

1) You can have multiple IPoIB interfaces assigned to a physical port. Which IP Address would you prefer the SMA use?

I'd prefer to see the IPv4 and IPv6 addresses of the master IPoIB interface (hfi1_opa0).

Thanks.