search

microsoft / vstest

Visual Studio Test Platform is the runner and engine that powers test explorer and vstest.console.
MIT License
898 stars 323 forks source link

Command Line Tool Version 17.3.0-preview-20220626-01 - Failing to execute tests in Azure Devops pipeline #3945

Closed ncoussemacq closed 4 months ago

ncoussemacq commented 2 years ago

Description

An Azure Devops pipeline have worked without any issue fora long time but now failing with Visual Studio version 17.3.0-preview-20220626-01

The logs contain a line with "No suitable test runtime provider was found" (similar to https://github.com/microsoft/vstest/issues/3737 ?) but in the end, the tests seem to be executed. The pipeline task finally fails due to an issue related to test summary not being available.

2022-08-18T13:26:05.7503982Z Failure attempting to call the test run summary and retry counter is exhausted Microsoft.TeamFoundation.DistributedTask.Task.TestResults.RetryCountExhaustedException: Max retries count: 3 is exhausted ---> Microsoft.TeamFoundation.TestManagement.WebApi.TestObjectNotFoundException: Run summary is not available, It is recommended to try again after 1 sec.

The same pipeline ran properly in the past with version 17.2.0-preview-20220401-07.

I'm attaching log files for both versions (17.2 & 17.3) vs-17.2.txt vs-17.3.txt

Switching to "Visual Studio 2019" as Test platform version is a temporary workaround for this issue on my side.

Steps to reproduce

Expected behavior

Test should execute correctly

Actual behavior

Pipeline task fails due to an issue related to test summary not being available.

Diagnostic logs

2022-08-18T13:24:12.1240805Z **** Starting test execution * 2022-08-18T13:24:12.1332209Z [command]C:\Program Files\Microsoft Visual Studio\2022\Enterprise\Common7\IDE\Extensions\TestPlatform\vstest.console.exe "@D:\a_work\1\b\2_work_temp\yedlrxrxyco.tmp" 2022-08-18T13:24:12.2438720Z Microsoft (R) Test Execution Command Line Tool Version 17.3.0-preview-20220626-01 (x64) 2022-08-18T13:24:12.2439258Z Copyright (c) Microsoft Corporation. All rights reserved. 2022-08-18T13:24:12.2496644Z vstest.console.exe "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\DocumentDbWrapperTests.dll" 2022-08-18T13:24:12.2497778Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll" 2022-08-18T13:24:12.2498820Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.Interface.dll" 2022-08-18T13:24:12.2499946Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll" 2022-08-18T13:24:12.2501276Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll" 2022-08-18T13:24:12.2502311Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.TestFramework.dll" 2022-08-18T13:24:12.2503338Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll" 2022-08-18T13:24:12.2504057Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.Interface.dll" 2022-08-18T13:24:12.2504737Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll" 2022-08-18T13:24:12.2505530Z "D:\a_work\1\b\2_work\1\s\Componen ts\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.TestFramework.dll" 2022-08-18T13:24:12.2506180Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\cs\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2506867Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\cs\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2507541Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\cs\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2508204Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\de\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2509549Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\de\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2510239Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\de\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2510901Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\es\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2511578Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\es\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2512245Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\es\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2512891Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\fr\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2513560Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\fr\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2514227Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\fr\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2514874Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\it\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2515643Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\it\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2516312Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\it\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2516973Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ja\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2517646Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ja\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2518322Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ja\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2518974Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ko\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2519641Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ko\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2520299Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ko\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2520946Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pl\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2521679Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pl\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2522344Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pl\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2523006Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pt\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2523677Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pt\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2524345Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pt\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2525008Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ru\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2525677Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ru\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2526343Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ru\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2526988Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\tr\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2527704Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\tr\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2528373Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\tr\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2529030Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hans\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2529735Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hans\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2530426Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hans\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2531098Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hant\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll" 2022-08-18T13:24:12.2531802Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hant\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll" 2022-08-18T13:24:12.2532486Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hant\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll" 2022-08-18T13:24:12.2533158Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build\netcoreapp1.0\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll" 2022-08-18T13:24:12.2533848Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build\uap10.0\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll" 2022-08-18T13:24:12.2534552Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\net45\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll" 2022-08-18T13:24:12.2535189Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\net45\Microsoft.VisualStudio.TestPlatform.TestFramework.dll" 2022-08-18T13:24:12.2535825Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\netstandard1.0\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll" 2022-08-18T13:24:12.2536472Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\netstandard1.0\Microsoft.VisualStudio.TestPlatform.TestFramework.dll" 2022-08-18T13:24:12.2537115Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\uap10.0\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll" 2022-08-18T13:24:12.2537741Z "D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\uap10.0\Microsoft.VisualStudio.TestPlatform.TestFramework.dll" 2022-08-18T13:24:12.2538217Z /Settings:"D:\a_work\1\b\2_work_temp\kbnkqfrmlh1.tmp.runsettings" 2022-08-18T13:24:12.2538494Z /Logger:"trx" 2022-08-18T13:24:12.2538764Z /TestAdapterPath:"D:\a_work\1\b\2_work\1\s\Components\Libraries" 2022-08-18T13:24:12.2539048Z /Platform:x64 2022-08-18T13:24:12.8634515Z Starting test execution, please wait... 2022-08-18T13:24:14.3712812Z Test run detected DLL(s) which would use different framework and platform versions. Following DLL(s) do not match current settings, which are .NETFramework,Version=v4.0 framework and X64 platform. 2022-08-18T13:24:14.3713877Z DocumentDbWrapperTests.dll would use Framework .NETFramework,Version=v4.6.1 and Platform X64. 2022-08-18T13:24:14.3714568Z Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3715179Z Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.Interface.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3715777Z Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll would use Framework .NETFramework,Version=v4.5 and Platform X64. 2022-08-18T13:24:14.3716321Z Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll would use Framework .NETFramework,Version=v4.5 and Platform X64. 2022-08-18T13:24:14.3716862Z Microsoft.VisualStudio.TestPlatform.TestFramework.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3717442Z Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3718050Z Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.Interface.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3718637Z Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll would use Framework .NETFramework,Version=v4.5 and Platform X64. 2022-08-18T13:24:14.3719185Z Microsoft.VisualStudio.TestPlatform.TestFramework.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3719937Z Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll would use Framework .NETStandard,Version=v1.5 and Platform X64. 2022-08-18T13:24:14.3720784Z Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll would use Framework .NETCore,Version=v5.0 and Platform X64. 2022-08-18T13:24:14.3721341Z Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll would use Framework .NETFramework,Version=v4.5 and Platform X64. 2022-08-18T13:24:14.3722443Z Microsoft.VisualStudio.TestPlatform.TestFramework.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3723307Z Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3723886Z Microsoft.VisualStudio.TestPlatform.TestFramework.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3724610Z Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll would use Framework .NETCore,Version=v5.0 and Platform X64. 2022-08-18T13:24:14.3725147Z Microsoft.VisualStudio.TestPlatform.TestFramework.dll would use Framework .NETPortable,Version=v4.5,Profile=Profile259 and Platform X64. 2022-08-18T13:24:14.3725647Z Go to https://aka.ms/tp/vstest/multitargetingdoc?view=vs-2019 for more details on managing these settings. 2022-08-18T13:24:14.5012165Z No suitable test runtime provider was found: 2022-08-18T13:24:14.5012923Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5013828Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.Interface.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5014667Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.TestFramework.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5015493Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5016622Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.Interface.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5017495Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.TestFramework.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5018333Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\net45\Microsoft.VisualStudio.TestPlatform.TestFramework.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5019172Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\netstandard1.0\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5020031Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\netstandard1.0\Microsoft.VisualStudio.TestPlatform.TestFramework.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5020863Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\uap10.0\Microsoft.VisualStudio.TestPlatform.TestFramework.dll (.NETPortable,Version=v4.5,Profile=Profile259, X64) 2022-08-18T13:24:14.5021672Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build\uap10.0\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll (.NETCore,Version=v5.0, X64) 2022-08-18T13:24:14.5022477Z Skipping source: D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\uap10.0\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll (.NETCore,Version=v5.0, X64) 2022-08-18T13:24:14.5150347Z A total of 57 test files matched the specified pattern. 2022-08-18T13:24:15.9199574Z Blame: Attaching crash dump utility to process testhost.net461 (5820). 2022-08-18T13:24:20.3790596Z Passed SimpleStoredProcWorks [889 ms] 2022-08-18T13:24:20.3791277Z Passed FunctionStoredProcWorks [38 ms] 2022-08-18T13:24:20.3791826Z Passed FunctionStoredProcWithParametersWorks [10 ms] 2022-08-18T13:24:20.3792233Z Passed FunctionStoredProcWithPocoParametersWorks [9 ms] 2022-08-18T13:24:20.3792529Z Passed PocoStoredProcWorks [97 ms] 2022-08-18T13:24:20.3792806Z Passed DocDbQueryWorks [619 ms] 2022-08-18T13:24:20.3793067Z Passed DocDbReplaceWorks [25 ms] 2022-08-18T13:24:20.3793474Z Passed DocDbCreateWorks [23 ms] 2022-08-18T13:24:20.3794390Z Passed DocDbReadWorks [20 ms] 2022-08-18T13:24:21.1276897Z Blame: Attaching crash dump utility to process testhost (4792). 2022-08-18T13:24:23.0403521Z No test is available in D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\DocumentDbWrapperTests\bin\Release\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestFramework.1.2.1\lib\net45\Microsoft.VisualStudio.TestPlatform.TestFramework.Extensions.dll. Make sure that test discoverer & executors are registered and platform & framework version settings are appropriate and try again. 2022-08-18T13:24:24.7396376Z Blame: Attaching crash dump utility to process testhost (6028). 2022-08-18T13:24:26.4243115Z No test is available in D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\cs\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\cs\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\cs\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\de\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\de\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\de\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\es\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\es\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\es\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\fr\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\fr\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\fr\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\it\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\it\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\it\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ja\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ja\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ja\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ko\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ko\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ko\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pl\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pl\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pl\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pt\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pt\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\pt\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ru\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ru\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\ru\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\tr\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\tr\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\tr\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hans\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hans\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hans\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hant\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hant\Microsoft.VisualStudio.TestPlatform.MSTestAdapter.PlatformServices.resources.dll D:\a_work\1\b\2_work\1\s\Components\Libraries\DocumentDbWrapper\packages\MSTest.TestAdapter.1.2.1\build_common\zh-Hant\Microsoft.VisualStudio.TestPlatform.TestFramework.resources.dll. Make sure that test discoverer & executors are registered and platform & framework version settings are appropriate and try again. 2022-08-18T13:24:28.3000321Z ##[error]Could not find testhost 2022-08-18T13:25:58.2403366Z Results File: D:\a_work\1\b\2_work_temp\TestResults\svccbld_73fe69c4c000000_2022-08-18_13_24_20.trx 2022-08-18T13:25:58.2534260Z ##[error]Test Run Aborted. 2022-08-18T13:25:58.2534968Z Total tests: Unknown 2022-08-18T13:25:58.2535189Z Passed: 9 2022-08-18T13:25:58.2544472Z Total time: 1.7282 Minutes 2022-08-18T13:25:58.2843920Z Vstest.console.exe exited with code 1. 2022-08-18T13:25:58.2844668Z **** Completed test execution * 2022-08-18T13:25:58.2911738Z Test results files: D:\a_work\1\b\2_work_temp\TestResults\svccbld_73fe69c4c000000_2022-08-18_13_24_20.trx 2022-08-18T13:25:58.6941832Z Created test run: 248769016 2022-08-18T13:25:58.6943330Z Publishing test results: 9 2022-08-18T13:25:58.8668830Z Publishing test results to test run '248769016'. 2022-08-18T13:25:58.8692552Z TestResults To Publish 9, Test run id:248769016 2022-08-18T13:25:58.8756301Z Test results publishing 9, remaining: 0. Test run id: 248769016 2022-08-18T13:25:58.9678802Z Published test results: 9 2022-08-18T13:25:58.9682916Z Publishing Attachments: 1 2022-08-18T13:25:59.5477129Z Execution Result Code 1 is non zero, checking for failed results 2022-08-18T13:26:05.7500402Z Retry count is exhausted while performing System.Threading.Tasks.Task1[Microsoft.TeamFoundation.TestManagement.WebApi.TestRunStatistic] <GetTestRunSummaryByOutcome>b__0() 2022-08-18T13:26:05.7503982Z Failure attempting to call the test run summary and retry counter is exhausted Microsoft.TeamFoundation.DistributedTask.Task.TestResults.RetryCountExhaustedException: Max retries count: 3 is exhausted ---> Microsoft.TeamFoundation.TestManagement.WebApi.TestObjectNotFoundException: Run summary is not available, It is recommended to try again after 1 sec. 2022-08-18T13:26:05.7505025Z at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<HandleResponseAsync>d__53.MoveNext() 2022-08-18T13:26:05.7505506Z --- End of stack trace from previous location where exception was thrown --- 2022-08-18T13:26:05.7505943Z at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() 2022-08-18T13:26:05.7506719Z at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) 2022-08-18T13:26:05.7507240Z at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__51.MoveNext() 2022-08-18T13:26:05.7507652Z --- End of stack trace from previous location where exception was thrown --- 2022-08-18T13:26:05.7508044Z at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() 2022-08-18T13:26:05.7510167Z at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) 2022-08-18T13:26:05.7510743Z at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.<SendAsync>d__471.MoveNext() 2022-08-18T13:26:05.7511157Z --- End of stack trace from previous location where exception was thrown --- 2022-08-18T13:26:05.7511538Z at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() 2022-08-18T13:26:05.7513131Z at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) 2022-08-18T13:26:05.7513677Z at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.d28`1.MoveNext() 2022-08-18T13:26:05.7514083Z --- End of stack trace from previous location where exception was thrown --- 2022-08-18T13:26:05.7514456Z at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() 2022-08-18T13:26:05.7514886Z at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) 2022-08-18T13:26:05.7515364Z at Microsoft.TeamFoundation.TestClient.PublishTestResults.TestRunPublisher.d9.MoveNext() 2022-08-18T13:26:05.7515807Z --- End of stack trace from previous location where exception was thrown --- 2022-08-18T13:26:05.7516176Z at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() 2022-08-18T13:26:05.7516579Z at Microsoft.TeamFoundation.DistributedTask.Task.TestResults.RetryHelper.d1`1.MoveNext() 2022-08-18T13:26:05.7516936Z --- End of inner exception stack trace --- 2022-08-18T13:26:05.7517300Z at Microsoft.TeamFoundation.DistributedTask.Task.TestResults.RetryHelper.d1`1.MoveNext() 2022-08-18T13:26:05.7517700Z --- End of stack trace from previous location where exception was thrown --- 2022-08-18T13:26:05.7518056Z at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() 2022-08-18T13:26:05.7518688Z at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) 2022-08-18T13:26:05.7519174Z at Microsoft.TeamFoundation.DistributedTask.Task.TestResults.TestRunSummaryManager.d__3.MoveNext() 2022-08-18T13:26:05.7637879Z ##[warning]Unable to fetch test run summary from the Test Management Server due to exception: One or more errors occurred. 2022-08-18T13:26:05.7638907Z PERF WARNING: TestRunCompletionPhase:GetTestRunOutcomeFromPublishTestResultLibrary: took 6185.1728 ms 2022-08-18T13:26:05.7903628Z Completed TestExecution Model... 2022-08-18T13:26:05.8087919Z ##[warning]Vstest failed with error. Check logs for failures. There might be failed tests. 2022-08-18T13:26:05.8089377Z ##[error]Error: The process 'D:\a_work\1\b\2_work_tasks\VSTest_ef087383-ee5e-42c7-9a53-ab56c98420f9\2.205.0\Modules\DTAExecutionHost.exe' failed with exit code 1 2022-08-18T13:26:05.8092140Z ##[error]Vstest failed with error. Check logs for failures. There might be failed tests. 2022-08-18T13:26:05.8193762Z ##[section]Finishing: Unit tests libs

nohwnd commented 2 years ago

Please see the solution in https://github.com/microsoft/vstest/issues/3939, your test run includes all dlls that match test. This makes test platform inspect all the dlls, and because of a bug it cannot execute netstandard dlls. In 17.2 these dlls would be filtered out, but that logic also can lead to skipping legitimate test projects.

Selecting only the dlls that actually contain tests will hopefully make your run pass, and it will make it faster.

Evangelink commented 1 year ago

@ncoussemacq Could you confirm it worked for you and that we can close this issue?