search

cisco-system-traffic-generator / trex-core

trex-core site
https://trex-tgn.cisco.com/
Other
1.3k stars 462 forks source link

trex v3.04 show incorrect stats #1091

Open wanghekai opened 9 months ago

wanghekai commented 9 months ago

NIC info [root@netqe03 v3.04]# lspci -s 0d:00.0 -vv 0d:00.0 Ethernet controller: Mellanox Technologies MT2910 Family [ConnectX-7] Subsystem: Mellanox Technologies Device 0077 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- SERR- <PERR- INTx- Latency: 0 Interrupt: pin A routed to IRQ 16 NUMA node: 0 IOMMU group: 17 Region 0: Memory at 96000000 (64-bit, prefetchable) [size=32M] Expansion ROM at 98800000 [disabled] [size=1M] Capabilities: [60] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 75.000W DevCtl: CorrErr- NonFatalErr+ FatalErr+ UnsupReq+ RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset- MaxPayload 512 bytes, MaxReadReq 4096 bytes DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend- LnkCap: Port #0, Speed 32GT/s, Width x16, ASPM not supported ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+ LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 32GT/s (ok), Width x16 (ok) TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range ABC, TimeoutDis+ NROPrPrP- LTR- 10BitTagComp+ 10BitTagReq+ OBFF Not Supported, ExtFmt- EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit- FRS- TPHComp- ExtTPHComp- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- LTR- OBFF Disabled, AtomicOpsCtl: ReqEn+ LnkCap2: Supported Link Speeds: 2.5-32GT/s, Crosslink- Retimer+ 2Retimers+ DRS- LnkCtl2: Target Link Speed: 32GT/s, EnterCompliance- SpeedDis- Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+ EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest- Retimer- 2Retimers- CrosslinkRes: unsupported Capabilities: [48] Vital Product Data Product Name: NVIDIA ConnectX-7 Ethernet adapter card, 400 GbE, Single-port QSFP112, PCIe 5.0 x16, Secure Boot, No Crypto
Read-only fields: [PN] Part number: MCX713105AS-WEAT
[EC] Engineering changes: A3 [V2] Vendor specific: MCX713105AS-WEAT
[SN] Serial number: MT2240XZ039J
[V3] Vendor specific: 8ca611164f4eed118000b83fd2684682 [VA] Vendor specific: MLX:MN=MLNX:CSKU=V2:UUID=V3:PCI=V0:MODL=CX713105A
[V0] Vendor specific: PCIeGen5 x16 [VU] Vendor specific: MT2240XZ039JMLNXS0D0F0 [RV] Reserved: checksum good, 1 byte(s) reserved End Capabilities: [9c] MSI-X: Enable+ Count=64 Masked- Vector table: BAR=0 offset=00002000 PBA: BAR=0 offset=00003000 Capabilities: [c0] Vendor Specific Information: Len=18 <?> Capabilities: [40] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0-,D1-,D2-,D3hot-,D3cold+) Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME- Capabilities: [100 v1] Advanced Error Reporting UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UESvrt: DLP+ SDES- TLP+ FCP+ CmpltTO+ CmpltAbrt+ UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol- CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+ CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+ AERCap: First Error Pointer: 04, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn- MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- HeaderLog: 00000000 00000000 00000000 00000000 Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI) ARICap: MFVC- ACS-, Next Function: 0 ARICtl: MFVC- ACS-, Function Group: 0 Capabilities: [180 v1] Single Root I/O Virtualization (SR-IOV) IOVCap: Migration-, Interrupt Message Number: 000 IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy+ IOVSta: Migration- Initial VFs: 8, Total VFs: 8, Number of VFs: 0, Function Dependency Link: 00 VF offset: 1, stride: 1, Device ID: 101e Supported Page Size: 000007ff, System Page Size: 00000001 Region 0: Memory at 0000000098000000 (64-bit, prefetchable) VF Migration: offset: 00000000, BIR: 0 Capabilities: [1c0 v1] Secondary PCI Express LnkCtl3: LnkEquIntrruptEn- PerformEqu- LaneErrStat: 0 Capabilities: [320 v1] Lane Margining at the Receiver <?> Capabilities: [370 v1] Physical Layer 16.0 GT/s <?> Capabilities: [3b0 v1] Extended Capability ID 0x2a Capabilities: [420 v1] Data Link Feature <?> Kernel driver in use: mlx5_core Kernel modules: mlx5_core

[root@netqe03 v3.04]# ./t-rex-64-debug --no-ofed-check -i Starting Scapy server..... Scapy server is started The ports are bound/configured. Starting TRex v3.04 please wait ... set driver name net_mlx5 driver capability : TCP_UDP_OFFLOAD TSO LRO set dpdk queues mode to DROP_QUE_FILTER Number of ports found: 2 (dummy among them: 1) zmq publisher at: tcp://*:4500 wait 1 sec . port : 0

link : link : Link Up - speed 200000 Mbps - full-duplex promiscuous : 0 number of ports : 2 max cores for 2 ports : 1 tx queues per port : 3

RX core uses TX queue number 1 on all ports core, c-port, c-queue, s-port, s-queue, lat-queue

1 0 0 1 0 2

-Per port stats table ports | 0

opackets | 0 obytes | 0 ipackets | 0 ibytes | 0 ierrors | 0 oerrors | 0 Tx Bw | 0.00 bps

-Global stats enabled Cpu Utilization : 0.0 % Platform_factor : 1.0
Total-Tx : 0.00 bps
Total-Rx : 0.00 bps
Total-PPS : 0.00 pps
Total-CPS : 0.00 cps

Expected-PPS : 0.00 pps
Expected-CPS : 0.00 cps
Expected-BPS : 0.00 bps

Active-flows : 0 Clients : 0 Socket-util : 0.0000 %
Open-flows : 0 Servers : 0 Socket : 0 Socket/Clients : -nan drop-rate : 0.00 bps
current time : 1.8 sec
test duration : 0.0 sec

Send Traffic use this port

[root@netqe03 trex]# python3 trex_send.py --size 1500 --duration 3 --rate 1pps

-Per port stats table ports | 0

opackets | 0 ---------> Here 0 obytes | 0 --------> Here 0 ipackets | 0 ibytes | 0 ierrors | 4500 ---------> Here ierrors show 4500 oerrors | 0 Tx Bw | 0.00 bps

-Global stats enabled Cpu Utilization : 0.0 % Platform_factor : 1.0
Total-Tx : 0.00 bps
Total-Rx : 0.00 bps
Total-PPS : 0.00 pps
Total-CPS : 0.00 cps

Expected-PPS : 0.00 pps
Expected-CPS : 0.00 cps
Expected-BPS : 0.00 bps

Active-flows : 0 Clients : 0 Socket-util : 0.0000 %
Open-flows : 0 Servers : 0 Socket : 0 Socket/Clients : -nan drop-rate : 0.00 bps
current time : 22.0 sec
test duration : 0.0 sec
*** TRex is shutting down - cause: 'CTRL + C detected' All cores stopped !! Killing Scapy server... Scapy server is killed

V3.03 does not have this issue .

il-alexk commented 3 months ago

Same issue with E810, also see the workaround:

E810-CQDA2 initialization in v3.04 is incorrect