search

Azure / azure-functions-host

The host/runtime that powers Azure Functions
https://functions.azure.com
MIT License
1.93k stars 441 forks source link

v1 : MsDeploy under load can lead to host startup w/o functions #6248

Open mathewc opened 4 years ago

mathewc commented 4 years ago

See ICM incident 192172973. Log analysis shows that a user initiated MsDeploy operation occurred, causing the normal host restarts as the host reacted to file change notifications. As the file system changed, the host recycled multiple times. Usually things stabilize and the final host instance restarts with a view of the newly deployed files. However, in this case, it looks like a race condition lead to the host running with no functions (there was supposed to be 1).

We need to review the file change / restart logic.

yojagad commented 4 years ago

@mathewc Is this related to #5151 by any chance?

mathewc commented 4 years ago

I don't think so - in this case the app was restarting due to file change notifications, and there were multiple host restarts. However, you could run your file system error query for this app/timerange to see if you see any of the signatures we saw before for that issue.