search

bustle / shep

A framework for building JavaScript Applications with AWS API Gateway and Lambda
MIT License
378 stars 27 forks source link

Compare coldstart times and function size #247

Open reconbot opened 7 years ago

reconbot commented 7 years ago

Let's see how much of an issue this currently is. If we're lucky there's a lower bound of 1-100 mb where it doesn't matter anymore.

reconbot commented 7 years ago

Also maybe do load tests, what's a cold start look like at 100 events/second?

chris-olszewski commented 7 years ago

Just some initial results of performing 10 requests spread over the course of 2 min.

Bundle size Min Avg Max
223 B 0 1 2
223 B 2 6 12
1.74 MB 0 25 110
2.95 MB 1 40 71
2.95 MB 1 51 97
5.57 MB 14 4952 10k
5.57 MB 7371 7716 9522
reconbot commented 7 years ago

What about 100mb?

On Fri, Jun 30, 2017 at 2:07 PM, Chris Olszewski notifications@github.com wrote:

Just some initial results of performing 10 requests spread over the course of 2 min. Bundle size Min Avg Max 223 B 0 1 2 223 B 2 6 12 1.74 MB 0 25 110 2.95 MB 1 40 71 2.95 MB 1 51 97

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/bustle/shep/issues/247#issuecomment-312336023, or mute the thread https://github.com/notifications/unsubscribe-auth/AABlbraFVNkALOKbprMJuP5SdaRFouwdks5sJTltgaJpZM4NzXRo .

-- Francis Gulotta Director of Engineering Bustle.com / @bustlelabs

chris-olszewski commented 7 years ago

Some tests regarding package size, no additional loading of code, but just adding bytes to lambda packages.

Package (unzipped) size Min Avg Max
2.8 KB 0 2 11
51 MB 0 7 50
104 MB 0 10 40
247 MB 0 14 37
247 MB* 0 16 79

Bundle sizes were increased with very basic functions. No funky stuff going on during code loading. All of these tests were done with 100 function invocations

Bundle size Min Avg Max
5 MB 0 11 94
8 MB 0 7 51
18 MB 0 22 99
reconbot commented 7 years ago

250mb is the lambda limit fyi

On Wed, Jul 5, 2017 at 3:50 PM, Chris Olszewski notifications@github.com wrote:

Some tests regarding package size, no additional loading of code, but just adding bytes to lambda packages. Package (unzipped) size Min Avg Max 2.8 KB 0 2 11 51 MB 0 7 50 104 MB 0 10 40

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/bustle/shep/issues/247#issuecomment-313207872, or mute the thread https://github.com/notifications/unsubscribe-auth/AABlbopN0maLLeABB-aLeb9Oav3zj-c6ks5sK-kGgaJpZM4NzXRo .

-- Francis Gulotta Director of Engineering Bustle.com / @bustlelabs