general-programming / megarepo

megarepo for general programming
https://generalprogramming.org/
Apache License 2.0
0 stars 0 forks source link

Slow ingress to SEA21 hv0 #37

Open opl- opened 2 years ago

opl- commented 2 years ago

Issue seems to be inconsistent, happening with ingress only on some connections. linux mentioned firewall being enabled on the Proxmox interfaces slowing things down, but right now I'm experiencing this issue while it's disabled.

Results from today:

Slow (Serverius, Netherlands):

$ iperf3 -c speedtest.serverius.net -p 5002 -R
Connecting to host speedtest.serverius.net, port 5002
Reverse mode, remote host speedtest.serverius.net is sending
[  5] local 192.168.3.144 port 52156 connected to 178.21.16.76 port 5002
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  72.1 KBytes   591 Kbits/sec                  
[  5]   1.00-2.00   sec  66.5 KBytes   544 Kbits/sec                  
[  5]   2.00-3.00   sec  41.0 KBytes   336 Kbits/sec                  
[  5]   3.00-4.00   sec  18.4 KBytes   151 Kbits/sec                  
[  5]   4.00-5.00   sec  5.66 KBytes  46.3 Kbits/sec                  
[  5]   5.00-6.00   sec  19.8 KBytes   162 Kbits/sec                  
[  5]   6.00-7.00   sec  4.24 KBytes  34.7 Kbits/sec                  
[  5]   7.00-8.00   sec  17.0 KBytes   139 Kbits/sec                  
[  5]   8.00-9.00   sec  19.8 KBytes   162 Kbits/sec                  
[  5]   9.00-10.00  sec  5.66 KBytes  46.3 Kbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   421 KBytes   345 Kbits/sec   35             sender
[  5]   0.00-10.00  sec   270 KBytes   221 Kbits/sec                  receiver

iperf Done.

$ iperf3 -c speedtest.serverius.net -p 5002
Connecting to host speedtest.serverius.net, port 5002
[  5] local 192.168.3.144 port 45896 connected to 178.21.16.76 port 5002
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1.04 MBytes  8.73 Mbits/sec    0    221 KBytes       
[  5]   1.00-2.00   sec  8.05 MBytes  67.5 Mbits/sec    0   6.00 MBytes       
[  5]   2.00-3.00   sec  15.0 MBytes   126 Mbits/sec    0   6.01 MBytes       
[  5]   3.00-4.00   sec  15.0 MBytes   126 Mbits/sec    0   6.01 MBytes       
[  5]   4.00-5.00   sec  13.8 MBytes   115 Mbits/sec    0   6.01 MBytes       
[  5]   5.00-6.00   sec  15.0 MBytes   126 Mbits/sec    0   6.01 MBytes       
[  5]   6.00-7.00   sec  15.0 MBytes   126 Mbits/sec    0   6.01 MBytes       
[  5]   7.00-8.00   sec  13.8 MBytes   115 Mbits/sec    0   6.01 MBytes       
[  5]   8.00-9.00   sec  15.0 MBytes   126 Mbits/sec    0   6.01 MBytes       
[  5]   9.00-10.00  sec  15.0 MBytes   126 Mbits/sec    0   6.01 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   127 MBytes   106 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   126 MBytes   106 Mbits/sec                  receiver

iperf Done.

Apparently fine (Mythic Beasts, Cambridge):

$ iperf3 -c iperf.mythic-beasts.com -R
Connecting to host iperf.mythic-beasts.com, port 5201
Reverse mode, remote host iperf.mythic-beasts.com is sending
[  5] local 192.168.3.144 port 41058 connected to 93.93.134.56 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  2.35 MBytes  19.7 Mbits/sec                  
[  5]   1.00-2.00   sec  22.0 MBytes   185 Mbits/sec                  
[  5]   2.00-3.00   sec  22.3 MBytes   187 Mbits/sec                  
[  5]   3.00-4.00   sec  22.7 MBytes   190 Mbits/sec                  
[  5]   4.00-5.00   sec  22.2 MBytes   187 Mbits/sec                  
[  5]   5.00-6.00   sec  22.8 MBytes   191 Mbits/sec                  
[  5]   6.00-7.00   sec  22.5 MBytes   189 Mbits/sec                  
[  5]   7.00-8.00   sec  22.5 MBytes   189 Mbits/sec                  
[  5]   8.00-9.00   sec  22.5 MBytes   189 Mbits/sec                  
[  5]   9.00-10.00  sec  22.4 MBytes   188 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.13  sec   208 MBytes   172 Mbits/sec    0             sender
[  5]   0.00-10.00  sec   204 MBytes   171 Mbits/sec                  receiver

iperf Done.

$ iperf3 -c iperf.mythic-beasts.com
Connecting to host iperf.mythic-beasts.com, port 5201
[  5] local 192.168.3.144 port 33132 connected to 93.93.134.56 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  4.00 MBytes  33.5 Mbits/sec    0    905 KBytes       
[  5]   1.00-2.00   sec  20.0 MBytes   168 Mbits/sec    0   4.20 MBytes       
[  5]   2.00-3.00   sec  22.5 MBytes   189 Mbits/sec    0   4.20 MBytes       
[  5]   3.00-4.00   sec  21.2 MBytes   178 Mbits/sec    0   4.20 MBytes       
[  5]   4.00-5.00   sec  23.8 MBytes   199 Mbits/sec    0   4.20 MBytes       
[  5]   5.00-6.00   sec  22.5 MBytes   189 Mbits/sec    0   4.20 MBytes       
[  5]   6.00-7.00   sec  21.2 MBytes   178 Mbits/sec    0   4.20 MBytes       
[  5]   7.00-8.00   sec  22.5 MBytes   189 Mbits/sec    0   4.20 MBytes       
[  5]   8.00-9.00   sec  23.8 MBytes   199 Mbits/sec    0   4.20 MBytes       
[  5]   9.00-10.00  sec  21.2 MBytes   178 Mbits/sec    0   4.20 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   203 MBytes   170 Mbits/sec    0             sender
[  5]   0.00-10.13  sec   202 MBytes   167 Mbits/sec                  receiver

iperf Done.
linuxgemini commented 2 years ago

may be routing problems @ wobscale but there is an issue with egress traffic, which:

issue likely caused by generic linux driver for broadcom netxtreme cards (tg3) supplied with proxmox 7 pve-firmware package

another issue might be caused by faulty ethernet cable (netxtreme cards will silently downgrade the line speed in case of a phy connection failure), though that is unlikely