dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.29k stars 4.74k forks source link

System.Security.Cryptography.X509Certificates test failures #70320

Closed carlossanlop closed 2 years ago

carlossanlop commented 2 years ago

Failing in coreclr x86 windows release

https://dev.azure.com/dnceng/public/_build/results?buildId=1809920&view=logs&j=457f7e88-dfa2-5bd9-f871-fdf124c2477d&t=bfe52dfb-2099-5c7f-ee52-70a1d81c544e

PR that hit this: https://github.com/dotnet/runtime/pull/70313

@bartonjs @vcsjones

Runfo Tracking Issue: system.security.cryptography.x509certificates.tests failing on Spanish machines Build Definition Kind Run Name Console Core Dump Test Results Run Client
1861964 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-(Centos.7.Amd64.Open)Ubuntu.1604.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:centos-7-mlnet-helix-20220601183719-dde38af console.log core dump runclient.py
1861964 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open console.log core dump runclient.py
1861964 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 console.log core dump runclient.py
1861964 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-Ubuntu.1804.Amd64.Open console.log core dump runclient.py
1861964 runtime PR 71203 net7.0-Linux-Debug-arm64-Mono_release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8-20220427172132-97d8652 console.log core dump runclient.py
1861964 runtime PR 71203 net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 console.log core dump runclient.py
1861964 runtime PR 71203 net7.0-OSX-Debug-x64-Mono_release-OSX.1200.Amd64.Open console.log runclient.py
1857551 runtime PR 71498 net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 console.log core dump runclient.py
1857419 runtime PR 71203 net7.0-Linux-Debug-arm64-Mono_release-(Ubuntu.1804.ArmArch.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm64v8-20220427172132-97d8652 console.log core dump runclient.py
1857419 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-(Centos.7.Amd64.Open)Ubuntu.1604.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:centos-7-mlnet-helix-20220601183719-dde38af console.log core dump runclient.py
1857419 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-RedHat.7.Amd64.Open console.log core dump runclient.py
1857419 runtime PR 71203 net7.0-Linux-Debug-x64-Mono_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 console.log core dump runclient.py
1857419 runtime PR 71203 net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 console.log core dump runclient.py
1855952 runtime PR 71498 net7.0-Linux-Debug-x64-mono_interpreter_release-(Debian.10.Amd64.Open)Ubuntu.1804.Amd64.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-20210304164434-56c6673 console.log core dump runclient.py
1845759 runtime PR 70941 net7.0-Linux-Release-x64-CoreCLR_checked-Ubuntu.1804.Amd64.Open console.log core dump runclient.py
1845759 runtime PR 70941 net7.0-Linux-Release-arm64-CoreCLR_checked-(Alpine.314.Arm64.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.14-helix-arm64v8-20210910135810-8a6f4f3 console.log core dump runclient.py
1845759 runtime PR 70941 net7.0-Linux-Release-arm-CoreCLR_checked-(Alpine.314.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.14-helix-arm32v7-20210910135806-8a6f4f3 console.log core dump runclient.py
1843032 runtime PR 71245 net7.0-Linux-Release-arm-CoreCLR_checked-(Alpine.314.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.14-helix-arm32v7-20210910135806-8a6f4f3 console.log core dump runclient.py
1837106 runtime Rolling net6.0-Linux-Release-x64-Mono_release-(Mariner.1.0.Amd64.Open)ubuntu.1604.amd64.open@mcr.microsoft.com/dotnet-buildtools/prereqs:cbl-mariner-1.0-helix-20210528192219-92bf620 console.log core dump runclient.py
1834299 runtime PR 70608 net7.0-windows-Release-x86-CoreCLR_release-Windows.7.Amd64.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py
1833586 runtime PR 70608 net7.0-windows-Debug-x64-CoreCLR_release-Windows.10.Amd64.Server2022.ES.Open console.log runclient.py

Displaying 100 of 1003 results

Build Result Summary Day Hit Count Week Hit Count Month Hit Count
0 4 14
ghost commented 2 years ago

Tagging subscribers to this area: @dotnet/area-system-security, @vcsjones See info in area-owners.md if you want to be subscribed.

Issue Details
Failing in coreclr x86 windows release https://dev.azure.com/dnceng/public/_build/results?buildId=1809920&view=logs&j=457f7e88-dfa2-5bd9-f871-fdf124c2477d&t=bfe52dfb-2099-5c7f-ee52-70a1d81c544e PR that hit this: https://github.com/dotnet/runtime/pull/70313/checks?check_run_id=6765867128 @bartonjs @vcsjones
Author: carlossanlop
Assignees: -
Labels: `area-System.Security`, `blocking-clean-ci`, `test-failure`
Milestone: -
tarekgh commented 2 years ago

I am seeing other crypto tests are failing too in other CI runs https://github.com/dotnet/runtime/pull/70309/checks?check_run_id=6765682382

.packages\microsoft.dotnet.helix.sdk\7.0.0-beta.22266.1\tools\azure-pipelines\AzurePipelines.MultiQueue.targets(43,5): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Test System.Security.Cryptography.Cose.Tests.CoseSign1MessageTests_SignStream_Async.SignWithNullKey has failed. Check the Test tab or this console log: https://helix.dot.net/api/2019-06-17/jobs/6d0c1aa2-093a-4df9-b531-10a0e11b55ca/workitems/System.Security.Cryptography.Cose.Tests/console
vcsjones commented 2 years ago

Failures below. Seems like the common theme here is they are running on a different locale?

System.Security.Cryptography.Cose.Tests.CoseSign1MessageTests_VerifyDetached.VerifyReturnsTrueAfterAttemptWithWrongContent [FAIL]
      System.Security.Cryptography.CryptographicException : No hay m�s extremos disponibles desde el asignador de extremos.
      Stack Trace:
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/CngHelpers.cs(32,0): at System.Security.Cryptography.CngHelpers.OpenStorageProvider(CngProvider provider)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/CngKey.Import.cs(124,0): at System.Security.Cryptography.CngKey.Import(ReadOnlySpan`1 keyBlob, String curveName, CngKeyBlobFormat format, CngProvider provider)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/CngKey.Import.cs(112,0): at System.Security.Cryptography.CngKey.Import(Byte[] keyBlob, String curveName, CngKeyBlobFormat format, CngProvider provider)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/CngKey.Import.cs(35,0): at System.Security.Cryptography.CngKey.Import(Byte[] keyBlob, String curveName, CngKeyBlobFormat format)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/ECCng.ImportExport.cs(13,0): at System.Security.Cryptography.ECCng.ImportKeyBlob(Byte[] ecBlob, String curveName, Boolean includePrivateParameters)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/ECDsaCng.cs(88,0): at System.Security.Cryptography.ECDsaCng.ImportKeyBlob(Byte[] ecfullKeyBlob, String curveName, Boolean includePrivateParameters)
        /_/src/libraries/Common/src/System/Security/Cryptography/ECDsaCng.ImportExport.cs(69,0): at System.Security.Cryptography.ECDsaCng.ImportParameters(ECParameters parameters)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/ECDsa.Create.Windows.cs(37,0): at System.Security.Cryptography.ECDsa.Create(ECParameters parameters)
        /_/src/libraries/System.Security.Cryptography.Cose/tests/CoseTestHelpers.cs(291,0): at System.Security.Cryptography.Cose.Tests.CoseTestHelpers.CreateECDsa(ECParameters parameters, Boolean includePrivateKey)
        /_/src/libraries/System.Security.Cryptography.Cose/tests/CoseTestHelpers.cs(243,0): at System.Security.Cryptography.Cose.Tests.CoseTestHelpers.get_ES256()
        /_/src/libraries/System.Security.Cryptography.Cose/tests/CoseTestHelpers.cs(258,0): at System.Security.Cryptography.Cose.Tests.CoseTestHelpers.get_DefaultKey()
        /_/src/libraries/System.Security.Cryptography.Cose/tests/CoseSign1MessageTests.Verify.cs(118,0): at System.Security.Cryptography.Cose.Tests.CoseSign1MessageTests_Verify.VerifyReturnsTrueAfterAttemptWithWrongContent()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
        /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs(64,0): at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

and

System.Security.Cryptography.X509Certificates.Tests.CertTests.X509Certificate2ToStringVerbose_WithPrivateKey_FromSpans(keyStorageFlags: EphemeralKeySet) [FAIL]
      System.Security.Cryptography.CryptographicException : Datos incorrectos.
      Stack Trace:
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/X509Certificates/CertificatePal.Windows.Import.cs(158,0): at System.Security.Cryptography.X509Certificates.CertificatePal.FilterPFXStore(ReadOnlySpan`1 rawData, SafePasswordHandle password, PfxCertStoreFlags pfxCertStoreFlags)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/X509Certificates/CertificatePal.Windows.Import.cs(83,0): at System.Security.Cryptography.X509Certificates.CertificatePal.FromBlobOrFile(ReadOnlySpan`1 rawData, String fileName, SafePasswordHandle password, X509KeyStorageFlags keyStorageFlags)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/X509Certificates/CertificatePal.Windows.Import.cs(16,0): at System.Security.Cryptography.X509Certificates.CertificatePal.FromBlob(ReadOnlySpan`1 rawData, SafePasswordHandle password, X509KeyStorageFlags keyStorageFlags)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/X509Certificates/X509Certificate.cs(123,0): at System.Security.Cryptography.X509Certificates.X509Certificate..ctor(ReadOnlySpan`1 rawData, ReadOnlySpan`1 password, X509KeyStorageFlags keyStorageFlags)
        /_/src/libraries/System.Security.Cryptography/src/System/Security/Cryptography/X509Certificates/X509Certificate2.cs(111,0): at System.Security.Cryptography.X509Certificates.X509Certificate2..ctor(ReadOnlySpan`1 rawData, ReadOnlySpan`1 password, X509KeyStorageFlags keyStorageFlags)
        /_/src/libraries/System.Security.Cryptography.X509Certificates/tests/CertTests.cs(258,0): at System.Security.Cryptography.X509Certificates.Tests.CertTests.X509Certificate2ToStringVerbose_WithPrivateKey_FromSpans(X509KeyStorageFlags keyStorageFlags)
           at InvokeStub_CertTests.X509Certificate2ToStringVerbose_WithPrivateKey_FromSpans(Object, Object, IntPtr*)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
maraf commented 2 years ago

Also failure on rolling build #20220606.61 console.log

agocke commented 2 years ago

This appears to be some problem with the tests on Spanish machines. Failures are happening pretty regularly.

@bartonjs Who should I assign this to?

vcsjones commented 2 years ago

Is it possible this is infrastructure related? The Spanish error, based on the text, appears to be EPT_S_NOT_REGISTERED (0x800706D9) indicating an RPC error coming from NCryptOpenStorageProvider.

I find that to be... very odd.

Is this happening on all runs of this locale? Is it happening on one particular machine, or multiple machines with this locale?

agocke commented 2 years ago

looks like it's not constant -- some runs succeed. Also looks like it's failing on multiple machines

karelz commented 2 years ago

New hits in Rolling test runs:

Overall hits as of 6/20 (using random test name):

agocke commented 2 years ago

Stopped failing for some reason. Removing blocking-clean-ci, but investigation would still be good.

bartonjs commented 2 years ago

As @vcsjones pointed out, this is a failure of the Windows RPC system, which the Windows crypto stack depends on.

The English version of the error is "There are no more endpoints available from the endpoint mapper." (which corresponds to EPT_S_NOT_REGISTERED)

There's nothing we can do in the .NET layer to deal with this... something was busted in the OS on those test machines.