search

actions / runner

The Runner for GitHub Actions :rocket:
https://github.com/features/actions
MIT License
4.92k stars 967 forks source link

v2.321.0 linux-x64 Runner.Listener fails with segfault when emulated on s390x system #3583

Open theihor opened 2 days ago

theihor commented 2 days ago

Describe the bug

v2.321.0 linux-x64 Runner.Listener fails with segfault on startup when running emulated on s390x system.

To Reproduce

The docker image is ghcr.io/kernel-patches/runner:main-noble-s390x@sha256:0e7347243a42f87e06520ab71dbe44250a7e59ba45f569b16c9cf001d2f7f236

Dockerfile

We get this failure on a Linux s390x host with binfmt configured to execute x86_64 binaries via qemu.

Expected behavior

The setup with binfmt has been used successfully for quite a while by Linux Kernel BPF CI.

Revert to v2.320.0 mitigates the issue, which suggests that the cause was introduced recently.

Runner Version and Platform

What's not working?

The runner fails to start.

Job Log Output

Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: main-noble-s390x: Pulling from kernel-patches/runner
Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: Digest: sha256:0e7347243a42f87e06520ab71dbe44250a7e59ba45f569b16c9cf001d2f7f236
Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: Status: Image is up to date for ghcr.io/kernel-patches/runner:main-noble-s390x
Nov 18 18:30:01 bpf-ci-runner-s390x-03 docker[3005311]: ghcr.io/kernel-patches/runner:main-noble-s390x
Nov 18 18:30:01 bpf-ci-runner-s390x-03 systemd[1]: Started actions-runner-kernel-patches@00.service - Ephemeral GitHub Actions Runner Container for kernel-patches - 00.
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Runner reusage is disabled
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Obtaining the token of the runner
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Ephemeral option is enabled
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Disable auto update option is enabled
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]: Configuring
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]:         not a dynamic executable
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]:         not a dynamic executable
Nov 18 18:30:02 bpf-ci-runner-s390x-03 docker[3005352]:         not a dynamic executable
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: --------------------------------------------------------------------------------
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |        ____ _ _   _   _       _          _        _   _                      |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |       / ___(_) |_| | | |_   _| |__      / \   ___| |_(_) ___  _ __  ___      |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |      | |  _| | __| |_| | | | | '_ \    / _ \ / __| __| |/ _ \| '_ \/ __|     |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |      | |_| | | |_|  _  | |_| | |_) |  / ___ \ (__| |_| | (_) | | | \__ \     |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |       \____|_|\__|_| |_|\__,_|_.__/  /_/   \_\___|\__|_|\___/|_| |_|___/     |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |                                                                              |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |                       Self-hosted runner registration                        |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: |                                                                              |
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: --------------------------------------------------------------------------------
Nov 18 18:30:09 bpf-ci-runner-s390x-03 docker[3005352]: # Authentication
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]: Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.UTF8Encoding.GetCharsWithFallback(System.ReadOnlySpan`1<Byte>, Int32, System.Span`1<Char>, Int32, System.Text.DecoderNLS, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.Encoding.GetCharsWithFallback(Byte*, Int32, Char*, Int32, Int32, Int32, System.Text.DecoderNLS)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.DecoderNLS.Convert(Byte*, Int32, Char*, Int32, Boolean, Int32 ByRef, Int32 ByRef, Boolean ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Text.DecoderNLS.Convert(Byte[], Int32, Int32, Char[], Int32, Int32, Boolean, Int32 ByRef, Int32 ByRef, Boolean ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.GetChars(Int32)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ReadData()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ParseQName(Boolean, Int32, Int32 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ParseElement()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlTextReaderImpl.ParseElementContent()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlLoader.LoadNode(Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlLoader.LoadDocSequence(System.Xml.XmlDocument)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Xml.XmlDocument.Load(System.Xml.XmlReader)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.Internal.XmlUtility.OpenFileHelper(System.String, System.IO.FileShare, Boolean, Boolean, System.Xml.XmlDocument ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.Internal.XmlUtility.OpenXmlFile(System.IO.FileStream ByRef, System.String, System.IO.FileShare, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationCacheManager.EnsureDiskCacheLoadedHelper()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationCacheManager.EnsureDiskCacheLoaded()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationCacheManager.GetLastChangeId()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<FindServiceDefinitionAsync>d__35.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<FindServiceDefinitionAsync>d__35, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<FindServiceDefinitionAsync>d__35 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<FindServiceDefinitionAsync>d__35, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<FindServiceDefinitionAsync>d__35 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider.FindServiceDefinitionAsync(System.String, System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<LocationForCurrentConnectionAsync>d__29.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<LocationForCurrentConnectionAsync>d__29, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<LocationForCurrentConnectionAsync>d__29 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.VssServerDataProvider+<LocationForCurrentConnectionAsync>d__29, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<LocationForCurrentConnectionAsync>d__29 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider.LocationForCurrentConnectionAsync(System.String, System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService+<ResolveLocationDataAsync>d__3.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.LocationService+<ResolveLocationDataAsync>d__3, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<ResolveLocationDataAsync>d__3 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.LocationService+<ResolveLocationDataAsync>d__3, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<ResolveLocationDataAsync>d__3 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService.ResolveLocationDataAsync(System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService+<GetLocationDataAsync>d__2.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.Location.LocationService+<GetLocationDataAsync>d__2, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetLocationDataAsync>d__2 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.Location.LocationService+<GetLocationDataAsync>d__2, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetLocationDataAsync>d__2 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.LocationService.GetLocationDataAsync(System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection+<GetClientInstanceAsync>d__13.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.VssConnection+<GetClientInstanceAsync>d__13, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientInstanceAsync>d__13 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.VssConnection+<GetClientInstanceAsync>d__13, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientInstanceAsync>d__13 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientInstanceAsync(System.Type, System.Guid, System.Threading.CancellationToken, GitHub.Services.Common.VssHttpRequestSettings, System.Net.Http.DelegatingHandler[])
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientInstanceAsync(System.Type, System.Guid, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection+<GetClientServiceImplAsync>d__11.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.VssConnection+<GetClientServiceImplAsync>d__11, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientServiceImplAsync>d__11 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.VssConnection+<GetClientServiceImplAsync>d__11, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientServiceImplAsync>d__11 ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientServiceImplAsync(System.Type, System.Guid, System.Func`4<System.Type,System.Guid,System.Threading.CancellationToken,System.Threading.Tasks.Task`1<System.Object>>, System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection+<GetClientAsync>d__10`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[GitHub.Services.WebApi.VssConnection+<GetClientAsync>d__10`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientAsync>d__10`1<System.__Canon> ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Start[[GitHub.Services.WebApi.VssConnection+<GetClientAsync>d__10`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]](<GetClientAsync>d__10`1<System.__Canon> ByRef)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClientAsync[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]](System.Threading.CancellationToken)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssConnection.GetClient[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]]()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerServer+<ConnectAsync>d__9, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task+WhenAllPromise`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].Invoke(System.Threading.Tasks.Task)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Runner.Common.RunnerService+<EstablishVssConnection>d__11, Runner.Common, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.Threading.Tasks.VoidTaskResult>, System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.SetResult()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<ConnectAsync>d__41, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.Location.VssServerDataProvider+<GetConnectionDataAsync>d__56, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Location.Client.LocationHttpClient+<GetConnectionDataAsync>d__6, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__47`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.WebApi.VssHttpClientBase+<SendAsync>d__51, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpClient+<<SendAsync>g__Core|83_0>d, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpRetryMessageHandler+<SendAsync>d__4, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[GitHub.Services.Common.VssHttpMessageHandler+<SendAsync>d__17, Sdk, Version=2.321.0.0, Culture=neutral, PublicKeyToken=null]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.DecompressionHandler+<SendAsync>d__16.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.DecompressionHandler+<SendAsync>d__16, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.DecompressionHandler+<SendAsync>d__16, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.DecompressionHandler+<SendAsync>d__16, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithAuthAsync>d__17, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnectionPool+<SendWithVersionDetectionAndRetryAsync>d__89, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.AuthenticationHelper+<SendWithNtAuthAsync>d__52, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.__Canon>, System.__Canon)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpConnection+<SendAsync>d__57.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<SendAsync>d__57, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<SendAsync>d__57, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.__Canon, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<SendAsync>d__57, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.AwaitTaskContinuation.RunOrScheduleAction(System.Runtime.CompilerServices.IAsyncStateMachineBox, Boolean)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task.RunContinuations(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.Tasks.Task`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].TrySetResult(System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].SetExistingTaskResult(System.Threading.Tasks.Task`1<System.Threading.Tasks.VoidTaskResult>, System.Threading.Tasks.VoidTaskResult)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncValueTaskMethodBuilder.SetResult()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Http.HttpConnection+<InitialFillAsync>d__82.MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<InitialFillAsync>d__82, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<InitialFillAsync>d__82, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext(System.Threading.Thread)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Http.HttpConnection+<InitialFillAsync>d__82, System.Net.Http, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Security.SslStream+<ReadAsyncInternal>d__163`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<ReadAsyncInternal>d__163`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<ReadAsyncInternal>d__163`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Security.SslStream+<EnsureFullTlsFrameAsync>d__161`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<EnsureFullTlsFrameAsync>d__161`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].ExecutionContextCallback(System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1+StateMachineBox`1[[System.Int32, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***],[System.Net.Security.SslStream+<EnsureFullTlsFrameAsync>d__161`1[[System.Net.Security.AsyncReadWriteAdapter, System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]], System.Net.Security, Version=8.0.0.0, Culture=neutral, PublicKeyToken=***hidden***]].MoveNext()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Sockets.SocketAsyncEventArgs.TransferCompletionCallbackCore(Int32, System.Memory`1<Byte>, System.Net.Sockets.SocketFlags, System.Net.Sockets.SocketError)
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Net.Sockets.SocketAsyncEngine.System.Threading.IThreadPoolWorkItem.Execute()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.ThreadPoolWorkQueue.Dispatch()
Nov 18 18:30:19 bpf-ci-runner-s390x-03 docker[3005352]:    at System.Threading.PortableThreadPool+WorkerThread.WorkerThreadStart()
Nov 18 18:30:21 bpf-ci-runner-s390x-03 docker[3005352]: ./config.sh: line 81:    39 Aborted                 (core dumped) ./bin/Runner.Listener configure "$@"
Nov 18 18:30:28 bpf-ci-runner-s390x-03 docker[3005352]: An error occurred: Not configured. Run config.(sh/cmd) to configure the runner.
Nov 18 18:30:30 bpf-ci-runner-s390x-03 systemd[1]: actions-runner-kernel-patches@00.service: Main process exited, code=exited, status=1/FAILURE
Nov 18 18:30:30 bpf-ci-runner-s390x-03 systemd[1]: actions-runner-kernel-patches@00.service: Failed with result 'exit-code'.

Runner and Worker's Diagnostic Logs

Unfortunately these are lost, because unhealthy runners are automatically restarted.

theihor commented 2 days ago

CC: @chantra

This issue puts Kernel BPF CI in an unfortunate position:

Best case for us: this is just a bug in the application code and it's fixed.

I realize that s390x is not an officially supported platform at the moment, although people did request it: https://github.com/actions/runner/issues/2263

And there have been attempts to add the support for s390x, but they all seem to be out of date:

.NET is officially supported by Canonical for Ubuntu s390x, and .NET platform is cross-arch. So official s390x runner binaries seem at least feasible.

It would be great to hear from the Github team what is their stance on s390x support. Are there any plans to implement it? A clear "no" would also be helpful, if that is the answer.

Thank you!

ChristopherHX commented 2 days ago

FYI You have still ca. 20 days left with the last .net6.0 runner v2.230. Make shure to use the disableupdate configuration option for config.sh, after these timespan it won't process any jobs (if this happens earlier it is a bug, because you should have 30 days after a new release to hold back the update)

The current agent switched to .net8, by v.2.231.0, because of end of live of .net6.0.

I do my best to keep my unofficial custom actions runner compatible that has native binaries out of box (aka https://github.com/christopherhx/github-act-runner), but in December it will possible have an outage due to github actions service updates that alters the protocol until I'm affected myself

ChristopherHX commented 2 days ago

Did you try emulating the arm64 binary? I mean it's a .net8 framework issue not application code

theihor commented 1 day ago

Did you try emulating the arm64 binary? I mean it's a .net8 framework issue not application code

Hi. Thank you for suggestion. I've tried arm64 binary, and it does not crash with segfault. So now we at least have a workaround.

Still, would be great to get a comment on the issue from the GitHub team.