lock contention (?) while downloading from the gateway/linksharing with high throughput

storj / edge

Storj edge services (including multi-tenant, S3-compatible server to interact with the Storj network)

GNU Affero General Public License v3.0

53 stars 18 forks source link

lock contention (?) while downloading from the gateway/linksharing with high throughput #358

Open amwolff opened 1 year ago

amwolff commented 1 year ago

We found out that a single AMD EPYC 7702P can only push out as much as 7.5-10 Gbps. We think that it might be possible to push out at least as much as twice more, but there's some kind of contention happening deep within the runtime (maybe caused by how we use the language?).

Flamegraph: https://pprof.host/qw0g/flamegraph

pprof host_qw0g_flamegraph

azdagron commented 1 year ago

Do we know what version of the Linux kernel was running on that box?

azdagron commented 1 year ago

And the version of Go used to compile the gateway-mt binary?

halkyon commented 1 year ago

@azdagron

Linux 6.2 (we also saw it with 5.19 before it got upgraded on Ubuntu 22.04 HWE)
Go 1.20.6

amwolff commented 1 year ago

@pwilloughby I bumped the priority of this. Feel free to grab it.