initialDelaySeconds for healthy probe

aws / apprunner-roadmap

This is the public roadmap for AWS App Runner.

https://aws.amazon.com/apprunner/

Other

292 stars 13 forks source link

initialDelaySeconds for healthy probe #216

Open ShwareAPI opened 7 months ago

ShwareAPI commented 7 months ago

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do * not help prioritize the request If you are interested in working on this issue or have submitted a pull request, please leave a comment

Tell us about your request Support initialDelaySeconds config for healthy probe

Describe alternatives you've considered Because some applications take a long time to start, it is impossible to determine whether they are healthy through repeated requests.

hariohmprasath commented 7 months ago

Hi @ShwareAPI, Thanks for reaching out. If you don't mind can you share how long the test application that you are running here takes for the startup? We are working on few improvements in this area and your input will help us make the experience more delightful.

ShwareAPI commented 7 months ago

@hariohmprasath

The spring boot application takes 30-60 seconds to start, and health checks during this time are useless.

hariohmprasath commented 7 months ago

Hi @ShwareAPI, We are adding some tolerance to our health check systems so if your application takes beyond 1 minute to fully startup we dont fail the service creation in this case. Please watch out for upcoming announcements in the next few weeks.

chai3 commented 7 months ago

@hariohmprasath Python import machine learning library takes 120 seconds in cpu throttled. If CPU is not hrottled, it will about 10 secons.

I'm expecting upcoming announcements

hariohmprasath commented 7 months ago

@hariohmprasath Python import machine learning library takes 120 seconds in cpu throttled. If CPU is not hrottled, it will about 10 secons.

I'm expecting upcoming announcements

Hi @chai3,

Thank you for contacting us. To give you some context, currently, App Runner does not throttle the CPU for one minute after launching the tasks. Therefore, if your application takes only 10 seconds to startup, it should work as expected. However, to better understand the behavior, we would appreciate if you could add additional logging as part of the startup routine and share your service ARN with us.

Please let us know if you have any other queries. Thanks

chai3 commented 7 months ago

App Runner does not throttle the CPU for one minute after launching the tasks

@hariohmprasath Thanks for your reply. I did not notice. That's very good news. I will re-measure and report if there are any problems. If it's not throttled for one minute after launching the tasks, I can remove precompile to pyc and lazy python imports.

chai3 commented 6 months ago

@hariohmprasath cc @hariohmprasath

https://docs.aws.amazon.com/apprunner/latest/relnotes/release-2023-12-07-slowstartup.html

AWS App Runner instance to complete its startup tasks has increased from one to five minutes

It's not configurable, but 5 minutes is plenty for my use case.