search

Azure / actions

Author and use Azure Actions to automate your GitHub workflows
https://azure.github.io/actions/
MIT License
443 stars 170 forks source link

BuildCanary test workflows for Azure Actions #122

Open kaverma opened 3 years ago

kaverma commented 3 years ago

We have GitHub Actions for Azure which take dependency on hosted runner infra.For example Azure Powershell action and azure/arm-deploy action.

We are looking at a test strategy of having canary test workflows for these Actions which can be run before updating the hosted image. The aim of these tests will be to ensure the tasks do not break with new changes in hosted image.

For example, we recently had an issue in azure/arm-deploy action - https://github.com/Azure/arm-deploy/issues/48 which caused this action to fail with the release of Azure CLI Version 2.24.1 as the new CLI version had a bug. Here is the RCA for this bug for reference - https://github.com/Azure/arm-deploy/discussions/69.

So for such Actions to avoid such breaks we are looking at having canary tests.

We want to understand on how we can have this test infra and the process to maintain the infra and process for the teams adding tests to the canary runs.

github-actions[bot] commented 3 years ago

This issue is idle because it has been open for 14 days with no activity.

raiyanalam commented 2 years ago

@kaverma - Can you update the latest status here?

kaverma commented 2 years ago

We are planning to take this up in this this quarter Q4 2022.