search

0xekez / bencher

benchmarking code for multicloud project
1 stars 0 forks source link

File download times feel too speedy #2

Closed 0xekez closed 3 years ago

0xekez commented 3 years ago

Our request logs suggest that we're completing our file requests in some 8ms. Given that we're downloading a 10mb file this seems more than a little improbable as that would imply we're pulling some 1250 mb/s in download speed.

The code that is measuring this seems reasonably correct so this is a little mysterious to me.

0xekez commented 3 years ago

Here's an alternate hypothesis: there isn't caching involved, the two machines are just in the same AWS data center and are enjoying a gigabit link between each other. The reason that I think this may be the case is that when I run a local instance and time downloads the timing output looks like this:

1613426975911, 49.343904ms
1613427137620, 49.046776ms
1613427306601, 48.531061ms
1613427360184, 48.591316ms

If there was caching causing the really quick download times that we're seeing, we'd expect it to also occur when running it on my local machine but we don't see it.

0xekez commented 3 years ago

Seeing similar, more realistic download times on the east to west coast aws <-> azure setup.

0xekez commented 3 years ago

Closing because the new hot / cold potato measurements also support that these measurements are working as expected.