microsoft / azure-container-apps

Roadmap and issues for Azure Container Apps
MIT License
358 stars 27 forks source link

Deploying new Azure Container App environments are hanging in west europe #778

Open maikelvanhaaren opened 1 year ago

maikelvanhaaren commented 1 year ago

This issue is a:

Issue description

Creating new environments in West Europe reach RequestTimeout error

Steps to reproduce

  1. az containerapp env create --name cae-reproduction-provisioning --resource-group rg-test --location westeurope
  2. It will take over 2 hours and then finally reach the RequestTimeout error

Expected behavior

A new environment is created in West Europe.

Actual behavior

A RequestTimeout error occurs after +2 hours

Additional context

DJ4ddi commented 1 year ago

Same issue when deploying through Azure Portal. Deployment starts and changes to status "Created" within a minute or so, then does nothing for 2 hours and times out. The resource is listed and when selected shows a warning that the environment failed to provision. It is not available for selection when creating container apps.

Deletion mostly works, but sometimes takes an hour or more.

torosent commented 1 year ago

Hi,

We are experiencing environment creation latency issues in West Europe that can result in creation failures. We are working to mitigate the issue and will update soon. An RCA will be provided after the mitigation.

torosent commented 1 year ago

The issue was mitigated on June 15

maikelvanhaaren commented 1 year ago

Do you have a RCA?

mmu013asrnl commented 5 months ago

Is there a regression on the Container App environment functionality/was the root cause solved? Our company has the same issue when deploying container apps.

eduards-vavere commented 2 weeks ago

This issue has come back in eu west.

  1. Create new workload profiles container env
  2. Hangs for 2 hours, timeouts
  3. Kinda is created, but under "Workload profiles" says "Provisioning failed"

Can anyone help me with any workaround?

On redeploy: Update environment AKS handler failed: {"title":"SalNotFound","status":404,"detail":"Fail to find sal document in regional db."