search

microsoft / azure-container-apps

Roadmap and issues for Azure Container Apps
MIT License
362 stars 29 forks source link

App job not stopping despite completing task #1145

Closed itallackpure closed 3 months ago

itallackpure commented 5 months ago

Please provide us with the following information:

This issue is a: (mark with an x)

Issue description

On rare occasions (it's not obvious what causes this), my container app job will continue to run even after completing the task. It runs until either it gets killed or reaches the timeout limit. This one completed the job successfully but got killed a minute later:

Console Logs image

System Logs image

In this other case, I had to stop the job manually:

Console Logs image

System Logs image

Steps to reproduce

  1. Not able to reproduce, seems to happen randomly, I would guess <0.5% of the time.

Expected behavior [What you expected to happen.] Container App Job shows 'Succeeded' and finishes, allow new queue messages to be processed.

Actual behavior [What actually happened.] Container App Job doesn't completed, hogging the scaling rule and preventing new messages from being processed.

Screenshots
See above.

Additional context

I have another app job with almost identical code (regarding completion and resources) which has never had this issue. I can't figure out what is causing it.

anandanthony commented 5 months ago

This is an intermittent issue where the ACA Job's container exits but the execution still keeps on running. We have improved the logic for this specific case.