microsoft / azure-pipelines-tasks

Tasks for Azure Pipelines
https://aka.ms/tfbuild
MIT License
3.49k stars 2.61k forks source link

[BUG]: Helm Deployments fail since Azure Agent Version 3.227.2 was deployed to our build agents. #19146

Open TsengSR opened 1 year ago

TsengSR commented 1 year ago

Task name

HelmDeploy@0

Task version

0.228.0

Environment type (Please select at least one enviroment where you face this issue)

Azure DevOps Server type

dev.azure.com (formerly visualstudio.com)

Azure DevOps Server Version (if applicable)

No response

Operation system

Ubuntu 22.04.3 LTS

Task log

Starting: Deploy Helm Chart and wait
==============================================================================
Task         : Package and deploy Helm charts
Description  : Deploy, configure, update a Kubernetes cluster in Azure Container Service by running helm commands
Version      : 0.228.0
Author       : Microsoft Corporation
Help         : https://aka.ms/azpipes-helm-tsg
==============================================================================
##[error]Error: Endpoint auth data not present: 11d3e7c7-7ab5-47f4-82ac-7cfbd478b04e
Finishing: Deploy Helm Chart and wait

Relevant log output

Starting: Initialize job
Agent name: 'Hosted Agent'
Agent machine name: 'fv-az630-569'
Current agent version: '3.227.2'
Operating System
Ubuntu
22.04.3
LTS
Runner Image
Image: ubuntu-22.04
Version: 20231016.1.0
Included Software: https://github.com/actions/runner-images/blob/ubuntu22/20231016.1/images/linux/Ubuntu2204-Readme.md
Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu22%2F20231016.1
Runner Image Provisioner
2.0.312.1
Current image version: '20231016.1.0'
Agent running as: 'vsts'
Prepare build directory.
Set build variables.
Download all required tasks.
Downloading task: HelmInstaller (0.225.0)
Downloading task: HelmDeploy (0.228.0)
Downloading task: PublishPipelineArtifact (1.199.0)
Checking job knob settings.
   Knob: DockerActionRetries = true Source: $(VSTSAGENT_DOCKER_ACTION_RETRIES) 
   Knob: AgentToolsDirectory = /opt/hostedtoolcache Source: ${AGENT_TOOLSDIRECTORY} 
   Knob: AgentPerflog = /home/vsts/perflog Source: ${VSTS_AGENT_PERFLOG} 
   Knob: AgentEnablePipelineArtifactLargeChunkSize = true Source: $(AGENT_ENABLE_PIPELINEARTIFACT_LARGE_CHUNK_SIZE) 
   Knob: ContinueAfterCancelProcessTreeKillAttempt = true Source: $(VSTSAGENT_CONTINUE_AFTER_CANCEL_PROCESSTREEKILL_ATTEMPT) 
   Knob: ProcessHandlerTelemetry = true Source: $(AZP_75787_ENABLE_COLLECT) 
Finished checking job knob settings.
Start tracking orphan processes.
Finishing: Initialize job

Aditional info

Since today (2023-10-20) 12:00 PM CET time we had piplelines/deployments failures with Helm Task, recievingt the error message

##[error]Error: Endpoint auth data not present: 11d3e7c7-7ab5-47f4-82ac-7cfbd478b04e

in the helm deployment Task. The last pipline that was successfully was 11:00 AM on the same day, just 1 hour earlier.

Only thing I noticed is that previously the Azure Hosted agents were running 3.227.1 version and the failing ones run on 3.227.2.

Also previous pipelines that worked successfully fail when rerun.

It seems its failing to gain access to the service connections for the Kubernetes cluster. Credentials and the service account are fine though.

github-actions[bot] commented 6 months ago

This issue is stale because it has been open for 180 days with no activity. Remove the stale label or comment on the issue otherwise this will be closed in 5 days

TsengSR commented 6 months ago

Still don't know what was causing this or how to fix it if it happens again.

github-actions[bot] commented 2 weeks ago

This issue is stale because it has been open for 180 days with no activity. Remove the stale label or comment on the issue otherwise this will be closed in 5 days

TsengSR commented 2 weeks ago

Wow, 6 months and on one even cared to look at this case. Not very motivating to pay people for your services when you don't even care so little to fix such drastic bugs