SJSUFall2019-CMPE272 / PlantDiseaseDetector

0 stars 0 forks source link

Possible cold start issue with AWS Lambda #3

Closed siddhantsjsu closed 4 years ago

siddhantsjsu commented 4 years ago

AWS Lambda and other serverless technologies can face cold start issues. These issues can come up in two scenarios -

  1. As these technologies implement dynamic provisioning under the hood, applications that haven't been used in a while take time to start up and serve the incoming requests.
  2. Also whenever the application needs to scale up, one of the idle containers is assigned with the additional incoming requests. This process is time consuming and hence event handling time increases.

This might increase the latency of the application and make it less responsive to the user. I would recommend you to read the following article to learn more about this issue and figure out possible workarounds for it - https://mikhail.io/2018/08/serverless-cold-start-war/

raz4 commented 4 years ago

Noted. We'll look into deploying a service on Kubernetes to avoid the cold start problem.