search

microsoft / contosotraders-cloudtesting

The Contoso Traders app is a sample application showcasing Playwright, Azure Load Testing, Azure Chaos Studio.
https://cloudtesting.contosotraders.com
MIT License
157 stars 311 forks source link

products not loading #335

Closed debs-obrien closed 4 months ago

debs-obrien commented 4 months ago

Products not loading again:

similar to previous issue: https://github.com/microsoft/contosotraders-cloudtesting/issues/333

mithunshanbhag commented 4 months ago

Sure, I'll take a look at this tomorrow morning (am currently out of office on a work-related trip).

debs-obrien commented 4 months ago

reminding you of this for if you have time this week @mithunshanbhag

mithunshanbhag commented 4 months ago

Looks like a couple of nodes are experiencing mem saturation. Investigating....

image

CC: @amalik99, @sumitmalik51

mithunshanbhag commented 4 months ago

Both the test (staging) and prod clusters were exhibiting this issue.

I've managed to revive the staging cluster by deleting it, and re-deploying it from the Azure Devops pipeline.

Now attempting the same with the prod cluster (redeploying via github actions)....

mithunshanbhag commented 4 months ago

@sumitmalik51, @amalik99 : Someone updated the service principal details last week.

Consequently, when the github worklow runs, the deployment happen in some other subscription (that I don't have access to).

Do you know what's happening?

image

mithunshanbhag commented 4 months ago

Aaaaand it's back online now.

PS: I've restored the following secrets & variables to their previous values: