freddydk
commented
2 years ago This might be because the artifacts are being built at the same time. Will check whether I can detect that and do something about it.
Closed cbrandemann closed 2 years ago
freddydk
commented
2 years ago This might be because the artifacts are being built at the same time. Will check whether I can detect that and do something about it.
freddydk
commented
2 years ago The real problem here is that the artifact downloaded is corrupt: Unexpected end of architve. and you do have sufficient disk space to download and unpack the artifacts?
cbrandemann
commented
2 years ago The real problem here is that the artifact downloaded is corrupt: Unexpected end of architve. and you do have sufficient disk space to download and unpack the artifacts?
Diskspace is not the issue (more than 200 gb free space)
cbrandemann
commented
2 years ago This might be because the artifacts are being built at the same time. Will check whether I can detect that and do something about it.
Yes, maybe this is the issue. Cleaning up the cache will solve the issue, however in the next run the error occurs with a different country
freddydk
commented
2 years ago So, it is almost every time? That is very weird - that more sounds like something is wrong with the download.
cbrandemann
commented
2 years ago So, it is almost every time? That is very weird - that more sounds like something is wrong with the download.
Yes, its almost every time. Sometime it's stable a couple of hours. Normally only 1 country has been checked, however in a release build we are checking more countries. I have checked the download. And indeed, the manifest.json is missing.
freddydk
commented
2 years ago But I expect that more is missing due to this:
2022-10-10T13:56:40.1255578Z Downloading application artifact /sandbox/21.1.47623.0/au
2022-10-10T13:56:40.1281398Z Downloading C:\Windows\TEMP\3ca07bec-e83f-40cd-b9a5-c6e4d721a4ad.zip
2022-10-10T13:56:59.9146529Z Unpacking application artifact to tmp folder using 7zip
2022-10-10T13:56:59.9427440Z
2022-10-10T13:56:59.9428025Z ERRORS:
2022-10-10T13:56:59.9428226Z Unexpected end of archive
2022-10-10T13:56:59.9428399Z
2022-10-10T13:57:04.0455072Z ERROR: Data Error : BusinessCentral-AU.bakLooks like the file is not complete and it will expand what it can.
The artifacts you are using in this build were uploaded 40 minutes before the run - maybe the CDN isn't completely updated. I will add some resilience to this - if the file is corrupt - then I will re-download from the blob.windows.core endpoint to avoid issues with the CDN. I will let you know when you can test this.
freddydk
commented
2 years ago Will be in a prerelease in a few hours
cbrandemann
commented
2 years ago The same error occurs. I am using BCContainerhelper version: 4.0.6-preview731
Starting: Run AL Validation
==============================================================================
Task : PowerShell
Description : Run a PowerShell script on Linux, macOS, or Windows
Version : 2.210.0
Author : Microsoft Corporation
Help : https://docs.microsoft.com/azure/devops/pipelines/tasks/utility/powershell
==============================================================================
Generating script.
Formatted command: . 'C:\agent\_work\1\s\Build\Scripts\RunALValidation.ps1' -containerName "TI-IEM-Bld" -apps "TI-Advanced Job Management,TI-Common" -CurrentAppsFolder "C:\agent\_work\1\b/CurrentVersion" -PreviousAppsFolder "C:\agent\_work\1\b/PrevVersion" -affixes "IEM" -countries "at,au,be,ca,ch,cz,dk,ee,es,fi,fr,gb,gr,hr,hu,ie,is,it,lt,lu,lv,mt,nl,no,nz,pl,pt,rs,se,si,sk,us" -ValidateNextMinor:("true" -eq "True") -ValidateNextMajor:("false" -eq "True")
========================== Starting Command Output ===========================
"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'C:\agent\_work\_temp\9f67e995-4eea-406f-80bb-a329aeea963e.ps1'"
Current Apps Folders: C:\agent\_work\1\b/CurrentVersion
Previous App Folders: C:\agent\_work\1\b/PrevVersion
Previous App Foldersa: at,au,be,ca,ch,cz,dk,ee,es,fi,fr,gb,gr,hr,hu,ie,is,it,lt,lu,lv,mt,nl,no,nz,pl,pt,rs,se,si,sk,us
Previous App Foldersa: at,au,be,ca,ch,cz,dk,ee,es,fi,fr,gb,gr,hr,hu,ie,is,it,lt,lu,lv,mt,nl,no,nz,pl,pt,rs,se,si,sk,us
VERBOSE: Loading module from path 'C:\agent\_work\1\s\Build\Scripts\GetAppFolders.psm1'.
VERBOSE: Importing function 'GetAppFolders'.
Apps: TI-Advanced Job Management,TI-Common
Current Apps Folders: 21.0.79543.0/IEM Cloud/apps/IEM Budgetting/app 21.0.79543.0/TIC19.0.78390.0/apps/TISystem/app
Previous App Folders: 21.0.79222.0/IEM Cloud/apps/IEM Budgetting/app 21.0.79222.0/TIC19.0.78390.0/apps/TISystem/app
C:\agent\_work\1\b\PrevVersion\21.0.79222.0\IEM Cloud\apps\IEM Budgetting\app
C:\agent\_work\1\b\PrevVersion\21.0.79222.0\IEM Cloud\apps\IEM Budgetting\app
C:\agent\_work\1\b\PrevVersion\21.0.79222.0\TIC19.0.78390.0\apps\TISystem\app
Current Apps: C:\agent\_work\1\b\CurrentVersion\21.0.79543.0\IEM Cloud\apps\IEM Budgetting\app\To-Increase B.V._TI-Advanced Job Management_20.4.79543.0.app
Previous Apps: C:\agent\_work\1\b\PrevVersion\21.0.79222.0\IEM Cloud\apps\IEM Budgetting\app\To-Increase B.V._TI-Advanced Job Management_20.4.79222.0.app
Dependency Apps: C:\agent\_work\1\b\CurrentVersion\21.0.79543.0\TIC19.0.78390.0\apps\TISystem\app\To-Increase B.V._TI-Common_19.0.78390.0.app
BcContainerHelper version 4.0.6-preview731
BcContainerHelper emits usage statistics telemetry to Microsoft
2022-10-18T08:13:50.8614396Z Running AppSourceCop took 29 seconds
2022-10-18T08:13:50.8621411Z
2022-10-18T08:13:50.8621907Z _____ _ _ _ _
2022-10-18T08:13:50.8622172Z / ____| | | (_) | | (_)
2022-10-18T08:13:50.8623224Z | | _ __ ___ __ _| |_ _ _ __ __ _ ___ ___ _ __ | |_ __ _ _ _ __ ___ _ __
2022-10-18T08:13:50.8623695Z | | | '__/ _ \/ _` | __| | '_ \ / _` | / __/ _ \| '_ \| __/ _` | | '_ \ / _ \ '__|
2022-10-18T08:13:50.8624162Z | |____| | | __/ (_| | |_| | | | | (_| | | (__ (_) | | | | |_ (_| | | | | | __/ |
2022-10-18T08:13:50.8624698Z \_____|_| \___|\__,_|\__|_|_| |_|\__, | \___\___/|_| |_|\__\__,_|_|_| |_|\___|_|
2022-10-18T08:13:50.8624978Z __/ |
2022-10-18T08:13:50.8625219Z |___/
2022-10-18T08:13:50.8625327Z
2022-10-18T08:13:50.8632070Z Creating container for country lt
2022-10-18T08:13:51.0688363Z BcContainerHelper is version 4.0.6-preview731
2022-10-18T08:13:51.0695013Z BcContainerHelper is running as administrator
2022-10-18T08:13:51.8036840Z Hyper-V is Disabled
2022-10-18T08:13:51.8044708Z UsePsSession is True
2022-10-18T08:13:51.8052639Z Host is Microsoft Windows Server 2022 Datacenter Azure Edition - ltsc2022
2022-10-18T08:13:51.8628873Z Docker Client Version is 20.10.9
2022-10-18T08:13:51.8638462Z Docker Server Version is 20.10.9
2022-10-18T08:13:52.0829815Z Removing Session TI-IEM-Bld
2022-10-18T08:13:52.1413594Z Removing container TI-IEM-Bld
2022-10-18T08:13:53.0149867Z Removing entries from hosts
2022-10-18T08:13:53.0254154Z Removing TI-IEM-Bld from container hosts file
2022-10-18T08:13:53.0362458Z Removing TI-IEM-Bld-* from container hosts file
2022-10-18T08:13:53.0390532Z Removing Desktop shortcuts
2022-10-18T08:13:53.0503878Z Removing C:\ProgramData\BcContainerHelper\Extensions\TI-IEM-Bld
2022-10-18T08:13:53.0632120Z Downloading application artifact /sandbox/21.1.47907.0/lt
2022-10-18T08:13:53.0646940Z https://bcinsider.azureedge.net/sandbox/21.1.47907.0/lt?sv=2021-06-08&ss=b&srt=sco&spr=https&st=2022-09-15T00%3A00%3A00Z&se=2023-04-01T00%3A00%3A00Z&sp=rl&sig=rBQiC8y0zbuWC66i2BJcVhydR3XD2aaz47aJ6q6zEss%3D
2022-10-18T08:13:53.0663228Z Downloading C:\Windows\TEMP\bc7ce879-ba9f-42d9-8444-4b6d3d363673.zip
2022-10-18T08:14:36.8891415Z Unpacking application artifact to tmp folder using 7zip
2022-10-18T08:14:36.9179171Z
2022-10-18T08:14:36.9179620Z ERRORS:
2022-10-18T08:14:36.9179882Z Unexpected end of archive
2022-10-18T08:14:36.9179985Z
2022-10-18T08:14:40.4252595Z ERROR: Data Error : BusinessCentral-LT.bak
2022-10-18T08:14:40.9552479Z Download-Artifacts Telemetry Correlation Id: 0f58f1f8-2f09-4676-bfad-9f7ecb9c0990
2022-10-18T08:14:41.3774159Z New-BcContainer Telemetry Correlation Id: 161cd02f-e63b-4669-8ec1-787b64477450
2022-10-18T08:14:41.9924761Z Unexpected error while validating app. Error is: Cannot find path 'C:\bcartifacts.cache\sandbox\21.1.47907.0\lt\manifest.json' because it does not exist.
2022-10-18T08:14:41.9942147Z at Download-Artifacts, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\Misc\Download-Artifacts.ps1: line 135
2022-10-18T08:14:41.9942746Z at New-BcContainer, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\ContainerHandling\New-NavContainer.ps1: line 534
2022-10-18T08:14:41.9943271Z at <ScriptBlock>, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\AppHandling\Run-AlValidation.ps1: line 319
2022-10-18T08:14:41.9943798Z at <ScriptBlock>, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\AppHandling\Run-AlValidation.ps1: line 465
2022-10-18T08:14:41.9944539Z at <ScriptBlock>, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\AppHandling\Run-AlValidation.ps1: line 444
2022-10-18T08:14:41.9945048Z at <ScriptBlock>, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\AppHandling\Run-AlValidation.ps1: line 428
2022-10-18T08:14:41.9945586Z at <ScriptBlock>, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\AppHandling\Run-AlValidation.ps1: line 392
2022-10-18T08:14:41.9946097Z at Run-AlValidation, C:\Program Files\WindowsPowerShell\Modules\BcContainerHelper\4.0.6\AppHandling\Run-AlValidation.ps1: line 390
2022-10-18T08:14:41.9946560Z at <ScriptBlock>, C:\agent\_work\1\s\Build\Scripts\RunALValidation.ps1: line 106
2022-10-18T08:14:41.9946942Z at <ScriptBlock>, C:\agent\_work\_temp\9f67e995-4eea-406f-80bb-a329aeea963e.ps1: line 4
2022-10-18T08:14:41.9947484Z at <ScriptBlock>, <No file>: line 1
2022-10-18T08:14:42.2719183Z
2022-10-18T08:14:42.2719786Z _____ _ _____ _ _
2022-10-18T08:14:42.2720093Z | __ \ (_) / ____| | | (_)
2022-10-18T08:14:42.2720413Z | |__) |___ _ __ ___ _____ ___ _ __ __ _ | | ___ _ __ | |_ __ _ _ _ __ ___ _ __
2022-10-18T08:14:42.2720745Z | _ // _ \ '_ ` _ \ / _ \ \ / / | '_ \ / _` | | | / _ \| '_ \| __/ _` | | '_ \ / _ \ '__|
2022-10-18T08:14:42.2721029Z | | \ \ __/ | | | | | (_) \ V /| | | | | (_| | | |____ (_) | | | | |_ (_| | | | | | __/ |
2022-10-18T08:14:42.2721379Z |_| \_\___|_| |_| |_|\___/ \_/ |_|_| |_|\__, | \_____\___/|_| |_|\__\__,_|_|_| |_|\___|_|
2022-10-18T08:14:42.2721662Z __/ |
2022-10-18T08:14:42.2721915Z |___/
2022-10-18T08:14:42.2722030Z
2022-10-18T08:14:42.4530841Z Removing Desktop shortcuts
2022-10-18T08:14:42.4766110Z
2022-10-18T08:14:42.4767693Z Removing container took 0 seconds
2022-10-18T08:14:42.4842845Z
2022-10-18T08:14:42.4844256Z AL Validation finished in 2203 seconds
2022-10-18T08:14:42.4851236Z __ __ _ _ _ _ _ _____ _ _
2022-10-18T08:14:42.4851545Z \ \ / / | (_) | | | | (_) | __ \ | | |
2022-10-18T08:14:42.4851818Z \ \ / /_ _| |_ __| | __ _| |_ _ ___ _ __ | |__) |___ ___ _ _| | |_ ___
2022-10-18T08:14:42.4852356Z \ \/ / _` | | |/ _` |/ _` | __| |/ _ \| '_ \ | _ // _ \ __| | | | | __/ __|
2022-10-18T08:14:42.4852618Z \ / (_| | | | (_| | (_| | |_| | (_) | | | | | | \ \ __\__ \ |_| | | |_\__ \
2022-10-18T08:14:42.4852928Z \/ \__,_|_|_|\__,_|\__,_|\__|_|\___/|_| |_| |_| \_\___|___/\__,_|_|\__|___/
2022-10-18T08:14:42.4853578Z
2022-10-18T08:14:42.4864133Z Unexpected error while validating app. Error is: Cannot find path 'C:\bcartifacts.cache\sandbox\21.1.47907.0\lt\manifest.json' because it does not exist.
2022-10-18T08:14:42.4869401Z _____ ___ __ _ _ _ _ _ ______ _ _
2022-10-18T08:14:42.4869733Z | __ \ /\ | \ \ / / | (_) | | | | (_) | ____| (_) |
2022-10-18T08:14:42.4870056Z | |__) | _ _ __ ______ / \ | |\ \ / /_ _| |_ __| | __ _| |_ _ ___ _ __ | |__ __ _ _| |_ _ _ __ ___
2022-10-18T08:14:42.4870420Z | _ / | | | '_ \______/ /\ \ | | \ \/ / _` | | |/ _` |/ _` | __| |/ _ \| '_ \ | __/ _` | | | | | | '__/ _ \
2022-10-18T08:14:42.4870727Z | | \ \ |_| | | | | / ____ \| | \ / (_| | | | (_| | (_| | |_| | (_) | | | | | | | (_| | | | |_| | | | __/
2022-10-18T08:14:42.4871082Z |_| \_\__,_|_| |_| /_/ \_\_| \/ \__,_|_|_|\__,_|\__,_|\__|_|\___/|_| |_| |_| \__,_|_|_|\__,_|_| \___|
2022-10-18T08:14:42.4871270Z
2022-10-18T08:14:43.0918911Z Validation Results
2022-10-18T08:14:43.0925298Z ******************
2022-10-18T08:14:43.0931746Z Unexpected error while validating app. Error is: Cannot find path 'C:\bcartifacts.cache\sandbox\21.1.47907.0\lt\manifest.json' because it does not exist.
2022-10-18T08:14:43.1790783Z Unexpected error while validating app. Error is: Cannot find path
2022-10-18T08:14:43.1791260Z 'C:\bcartifacts.cache\sandbox\21.1.47907.0\lt\manifest.json' because it does not exist.
2022-10-18T08:14:43.1791686Z At C:\agent\_work\1\s\Build\Scripts\RunALValidation.ps1:116 char:9
2022-10-18T08:14:43.1792007Z + throw $test
2022-10-18T08:14:43.1792215Z + ~~~~~~~~~~~
2022-10-18T08:14:43.1792545Z + CategoryInfo : OperationStopped: (Unexpected erro...does not exist.:String) [], RuntimeException
2022-10-18T08:14:43.1793033Z + FullyQualifiedErrorId : Unexpected error while validating app. Error is: Cannot find path 'C:\bcartifacts.cache\
2022-10-18T08:14:43.1793681Z sandbox\21.1.47907.0\lt\manifest.json' because it does not exist.
2022-10-18T08:14:43.1793935Z
2022-10-18T08:14:43.3263017Z ##[error]PowerShell exited with code '1'.
2022-10-18T08:14:43.3582752Z ##[section]Finishing: Run AL Validation
Shipped in 4.0.6
The Run-AlValidation is not stable. There is an error about a missing manifest.json. In this example, it's a "gr" artifact. The country of the missing manifest.json is not always the same.
Unexpected error while validating app. Error is: Cannot find path 'C:\bcartifacts.cache\sandbox\21.1.47652.0\gr\manifest.json' because it does not exist.