search

stormshift / support

This repo should serve as a central source for reporting issues with stormshift
GNU General Public License v3.0
3 stars 0 forks source link

Erratic Network Performance #181

Closed DanielFroehlich closed 16 hours ago

DanielFroehlich commented 1 week ago

Some MicroShift Demos need to tranfer large amounts of data (>1.6G) over the network. During demos, I noticed a wildly different performance of that part - sometimes its lightning fast, sometimes slow as hell. Hence I did some measurements using ipferf3 running in sender/receiver pods across different nodes. The throughput measurements range from 19 GBit/sec (from inf8 to inf8, local) to only 0.4 GBit/sec (inf7 -> in44). CPU utlisation of the nodes might play a factor (keep in mind, >50% CPU utili tips over the phys. core threshold).

See the measurements results here: https://docs.google.com/spreadsheets/d/1Pd0i9BmikUEwIfqRuDbmh3Skklvu__CimsBamZYnraQ/edit#gid=0

Tooling Deployment can be seen here: https://console-openshift-console.apps.isar.coe.muc.redhat.com/k8s/ns/dfroehli-perftst/apps~v1~Deployment

DanielFroehlich commented 1 week ago

deploy-isar.zip tooling deployment yaml

DanielFroehlich commented 1 week ago

@rbo would you mind to take a look please?

rbo commented 1 week ago
Server Switch
ucs56 arista-rj45
ucs57 arista-rj45
inf8 arista-rj45
inf7 arista-rj45
inf44 arista-sfp
rbo commented 16 hours ago

image I can reproduct...

rbo commented 16 hours ago

How to run the tests: https://github.com/openshift-examples/ipferf3

Feel free to reopen if needed