microsoft / azure-pipelines-tasks

Tasks for Azure Pipelines
https://aka.ms/tfbuild
MIT License
3.5k stars 2.61k forks source link

TestSelector does not understand MSTestV2 DataRow attribute #6193

Closed Mertsch closed 6 years ago

Mertsch commented 6 years ago

Environment

Error logs

C:\Build\_work\_tasks\VSTest_ef087383-ee5e-42c7-9a53-ab56c98420f9\2.3.8\TestSelector\TestSelector.exe UpdateTestResults
***************************** Section 'Update test results' Starting *****************************
Attachment location: C:\Build\_work\14\s\TestResults\VSTSBuildAgent_BUILDSERVER_2018-01-10_18_04_03\In
Setting run start and finish times.
Total test results: 5
Test results remaining to be updated: 5
TcmTestResultPublisher.ConvertResults : No matching tcm test case result found for test case result given by agent to publisher. Adding test case : xxx.DisplayNameTest (CN=TestFirst\, AndLastName,TestFirst, AndLastName (Full Control, SID=S-1-88-1)) to test run.
TcmTestResultPublisher.ConvertResults : No matching tcm test case result found for test case result given by agent to publisher. Adding test case : yyyTests.Load step configuration after restoring settings to test run.
TcmTestResultPublisher.ConvertResults : No matching tcm test case result found for test case result given by agent to publisher. Adding test case : yyyTests.Load step configuration before restoring settings to test run.
TcmTestResultPublisher.ConvertResults : No matching tcm test case result found for test case result given by agent to publisher. Adding test case : xxx.DisplayNameTest () to test run.
TcmTestResultPublisher.ConvertResults : No matching tcm test case result found for test case result given by agent to publisher. Adding test case : xxx.DisplayNameTest (TestName,TestName (Full Control, SID=S-1-88-1)) to test run.
UnMatched Results found. Adding them to test run.5
Total not impacted test: 272
***************************** Section 'Update test results' Ended ********************************
C:\Build\_work\_tasks\VSTest_ef087383-ee5e-42c7-9a53-ab56c98420f9\2.3.8\TestSelector\TestSelector.exe GetImpactedtests
***************************** Section 'Get Impacted Tests' Starting *****************************
Following tests are impacted.
xxx.DisplayNameTest
yyyTests.RestoreConfigurationTest
***************************** Section 'Get Impacted Tests' Ended ********************************
acesiddhu commented 6 years ago

@Mertsch this is a known issue in TIA today. Check https://blogs.msdn.microsoft.com/devops/2017/03/02/accelerated-continuous-testing-with-test-impact-analysis-part-1/ for known issues. TIA today always run data driven test cases in TIA mode.