GoogleCloudPlatform / cloud-ops-sandbox

Cloud Operations Sandbox is an open source collection of tools that helps practitioners to learn O11y and R9y practices from Google and apply them using Cloud Operations suite of tools.
Apache License 2.0
405 stars 148 forks source link

Hipster shop frontend OOMKilled on Cloud Ops Sandbox v0.7.0 #791

Closed t2tse closed 3 years ago

t2tse commented 3 years ago

The default setup created by sandboxctl with locust running at 100 users, spawn rate of 2 would caused the frontend server container OOMKilled in a crash loop. I followed the guide and didn't expect that out of the box. image

Attached the chart below for what I have been seeing from Locust. image

To workaround the issue, I changed the replica number from 1 to 2 for the trouble container and things stabilized. (Or I could increase the container memory limit)

@simonz130 thinks it is a bug. So I'm logging it here.

simonz130 commented 3 years ago

@Ayelet41 could you please take a look at this?