search

mcusim / freebsd-src

sys/dev/dpaa2 drivers work-in-progress
https://www.FreeBSD.org/
Other
4 stars 3 forks source link

10G support #24

Open dch opened 9 months ago

dch commented 9 months ago

According to https://forum.traverse.com.au/t/sfp-working-only-in-recovery/177/7 10G does work, but it's not clear to me if this is the case or not, comment https://github.com/mcusim/freebsd-src/issues/19#issuecomment-1705602936 suggests otherwise. Is this perhaps limited to certain SFP modules, for example?

snail59 commented 8 months ago

Hello @dch, I can confirm that 10G works fine; I have been using it for almost a year.

According to https://forum.traverse.com.au/t/sfp-working-only-in-recovery/177/7 10G does work

Yes it does, but did not with my S+RJ10 sfp.

but it's not clear to me if this is the case or not, comment #19 (comment) suggests otherwise.

I m not sure, but I think this comment is more related to this: (https://forum.traverse.com.au/t/sfp-working-only-in-recovery/177/4. To summarize, it works only in legacy mode and won't work in managed mode soon.

I hope it helps

dsalychev commented 8 months ago

@dch

According to https://forum.traverse.com.au/t/sfp-working-only-in-recovery/177/7 10G does work, but it's not clear to me if this is the case or not, comment #19 (comment) suggests otherwise. Is this perhaps limited to certain SFP modules, for example?

I've 10 Gbps Passive Twinax cable, 10GBASE-T SFP+ Copper RJ-45 and 1000BASE-T SFP Copper RJ-45 transceivers, but not a suitable NIC on the other side to test SFP+. RJ-45 transceivers didn't work for me either.

@snail59

I can confirm that 10G works fine; I have been using it for almost a year.

Did you have a chance to stress it with iperf? I'm still wondering what the drivers' performance would be in their current (not optimized) form.

pkubaj commented 7 months ago

Adding my experiences here.

  1. Gentoo Linux on Talos II (ppc64le) with Sonnet McFiver card (detected as Aquantia Corp. AQC113CS NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 03), using atlantic driver on Linux, no driver at all for FreeBSD). Plugged in directly to https://store.10gtek.com/10gbase-t-sfp-transceiver-10g-t-10g-copper-rj-45-sfp-cat-6a-up-to-30-meters-cisc/p-12176 in Ten64. It links up just fine, but trying to e.g. copy files via scp causes connection errors. NFS also works unstably. When I downgrade the link speed to 1Gbps on Talos, connection issues do not change. When I plug the same card into Ten64's 1Gbps port, there are no issues. Kernel version is 6.4.16.

  2. Asus KGPE-D16 with Intel X520-DA2 (detected as Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection, using ix driver on FreeBSD and ixgbe on Linux). Connected via DAC cable directly to Ten64. There is no link at all. ifconfig -vvv on KGPE-D16 detects the cable:

        plugged: SFP/SFP+/SFP28 Unknown (Copper pigtail)
    vendor: OEM PN: SFP-H10GB-CU3M SN: CSC230602390027 DATE: 2023-06-06

    SFF8472 DUMP (0xA0 0..127 range):
     03 04 21 00 00 00 00 00 04 00 00 00 67 00 00 00
     00 00 03 00 4f 45 4d 20 20 20 20 20 20 20 20 20
     20 20 20 20 00 00 40 20 53 46 50 2d 48 31 30 47
     42 2d 43 55 33 4d 20 20 52 20 20 20 01 00 00 f7
     00 00 00 00 43 53 43 32 33 30 36 30 32 33 39 30
     30 32 37 20 32 33 30 36 30 36 20 20 00 00 00 cc
     81 00 11 03 a9 65 12 4c 70 7f 31 19 b6 ca 6d 98
     0b 6a 3e 00 00 00 00 00 00 00 00 00 32 e3 cd d8

    FreeBSD version is 14.0-RELEASE.

pkubaj commented 6 months ago

I just tried Linux 6.6.21 on KGPE-D16 and it seems strange - sometimes I am actually able to get a link and IP via DHCP on ixgbe, but it's like 50% chance. When I can't, only a reboot helps (I have all the modules I need built-in, so can't try reloading).