Closed arator68 closed 3 years ago
This is probably not related to GTA, but to your tests. First try to run them on the console without VsTest.Console.exe and see whether that invocation behaves differently.
Works fine without VSTest.Console.exe. All tests are passed
Then I need more information (settings, log output etc). What happens if the tests are run from inside Visual Studio?
Any news on this one? As I said, I will need much more information if I shall try to help...
Ok, this shows that everything appears to be working fine in Visual Studio (this is the output of the VS Test output window, right?)
First, make sure that this command, executed on the console, works as desired - it should result in the same output as in Log2.txt (except beginning and end):
r:\bin\UnitTesting.exe --gtest_output="xml:C:\MyTemp\MyTemp\tmpC4B2.tmp" --gtest_catch_exceptions=1 --gtest_break_on_failure=0 --unattended --gtest_filter=*__UNITTEST__*
If this is the case, please post your file c:\temp\unittesting.gta.runsettings
, the result.trx
file as well as any output VsTestConsole.exe
produces with your above call.
As a side note: You are using different filtering mechanisms: --gtest_filter
within VS, TestCaseFilter
(and whatever is contained in your runsettings file) for VsTestConsole.exe
.
Hi, here some additional infos
vstest.console calls unittesting.exe with this parameter "r:\bin\unittesting.exe" --gtest_output="xml:C:\MyTemp\MyTemp\tmpCB42.tmp" --gtest_catch_exceptions=1 --gtest_break_on_failure=0 --gtest_filter=UNITTESTCachingUnitTest.:UNITTESTComosArrayObjectTest.:UNITTESTD3ObjectTests.:UNITTESTDeletingDatabaseTables.:UNITTESTNumberOfCreatedObjectsPure.:UNITTESTNumberOfCreatedObjectsTests.:UNITTESTDelayedHierarchyUpdaterTests.:UNITTESTGetCDeviceBySystemFullNameTests.:UNITTESTCPLTObjectCollectionTests.:UNITTESTCPLTTimestampTests.:UNITTESTSoftDeletionUnitTests.:UNITTESTTrying_to_change_description_in_workinglayer_display_mode.:UNITTESTGetLinkedSpecificationTests.:UNITTESTScanCDevicesTest.:UNITTESTScanDocumentsTest.:UNITTESTSpecificationScannerTests.:UNITTESTScanDevicesTest.:UNITTESTTrigger.:UNITTESTPastingObjectFromAnotherProject.:UNITTESTReferenceCountingTests.:UNITTESTTranslatedTextWithDelimiterTests.:UNITTESTIndexDefinition.:UNITTESTTableImplementationTests.:UNITTESTFreePropertyModificationTests.:UNITTESTWithPreservedClipboardObjectTests.:UNITTESTProviderTests.:UNITTESTExceptionWithSettingStatusTests.:UNITTESTFakingTranslationsTests.:UNITTESTIteratingOverUsedFreePropertyGroups.:UNITTESTCollectionsMemoryTests.:UNITTESTMEMORYCollections.*:UNITTESTCDeviceDereferentiationTests.*:UNITTESTChangedObjectsCollectionsTests.*:UNITTESTComosUIDValidityTests.*:UNITTESTDeviceCollectionsTests.*:UNITTESTCreatingInteractiveReport.*:UNITTESTDocumentTypeTests.*:UNITTESTCreateElementTests.*:UNITTESTElementGroupsDbVersionTests.*:UNITTESTElementGroupsTests.*:UNITTESTElementGroupsInfoTests.*:UNITTESTElementCountTests.*:UNITTESTElementTreeTraversalEndlessLoopTests.*:UNITTESTElementTreeTraversalTests.*:UNITTESTGetInheritParent.*:UNITTESTOverlayIdTests.*:UNITTESTPathFullNameTests.*:UNITTESTUndoStateTests.*:UNITTESTWorksetTerminateTests.*:UNITTESTXObjTests.*:UNITTESTClassIdTest.*:UNITTESTCleanerForexternalCallTest.*:UNITTESTCPLTCollectionTests.*:UNITTESTLanguageSelectorImplementationTests.*:UNITTESTShadowCollectionTests.*:UNITTESTLayerTests.*:UNITTESTRightsForCollectionsTests.*:UNITTESTDeriveBaseHolderTest.*:UNITTESTGetSpecificationByNameTests.*:UNITTESTHelpTextOfSpecsTests.*:UNITTESTInheritanceTests.*:UNITTESTSiValueTests.*:UNITTESTXValuesTests.*:UNITTESTStandardValueTests.*:UNITTESTSystemTypeTests.*:UNITTESTTempCollectionTests.*:UNITTESTWorksetDependentTempCollectionTests.*:UNITTESTUndoStateHandlingTests.*:UNITTESTWithProgressBarTests.*:UNITTESTCurrentProject.*:UNITTESTProjectContextTests.*:UNITTESTCPLTXDataWrapperTest.*:UNITTESTCreationTimestampTests.*:UNITTESTSecurityUnionTests.*:UNITTESTInWorkingLayerDisplayMode.*:UNITTESTRightsSimulationTests.*:UNITTESTSpecificationSetRightsTests.*:UNITTESTSettingDocumentVersion.*:UNITTESTRevisionsBasedOnModificationOfDataSource_ProjectOptionTests.:UNITTESTScriptResultCacheTests.:UNITTESTScriptStackTests.:UNITTESTSearchConditionTest.:UNITTESTSearchManagerTest.:UNITTESTSearchManagerValidationTest.:UNITTESTSessionIdRangeTests.:UNITTESTSessionIdSelectionTests.:UNITTESTLicenseTests.:UNITTESTXmlSpecificationTests.:UNITTESTIteratingOverLoadedSpecifications.:UNITTESTNumberRangeGeneratorTests.:UNITTESTNrgNameAndLabelAdjustmentTests.:UNITTESTGiven_an_overlay_release_in_a_sql_database.:UNITTESTA_new_free_property.:UNITTESTVbScriptEngineTests.:UNITTESTFindingSpecificationsByFreePropertyTests.:UNITTESTSetOwnLinkObjectTest.:UNITTESTMEMORYGetMemoryUsageTests.*:UNITTESTRollbackTests.*:UNITTESTBackCollectionIdTests.*:UNITTESTBackCollectionTests.*:UNITTESTResourceToolTests.*:UNITTESTDatabaseTests.*:UNITTESTClipboardTests.*:UNITTESTPltStringArrayTest.*:UNITTESTComosMapIterationTests.*:UNITTESTLoadedExtensionsContainerTests.*:UNITTESTExternalRightsRestrictionTests.*:UNITTESTExternalRightsExtensionPointTests.*:UNITTESTRightsRestrictionExceptionTest.*:UNITTESTSystemFullNameTest.*:UNITTESTObjectRightsRestrictionTests/0.*:UNITTESTObjectRightsRestrictionTests/1.*:UNITTESTObjectRightsRestrictionTests/2.*:UNITTESTObjectRightsRestrictionTests/3.*:UNITTESTObjectRightsRestrictionTests/4.*:UNITTESTObjectRightsRestrictionTests/5.*:UNITTESTObjectRightsRestrictionTests/6.*:UNITTESTObjectRightsRestrictionTests/7.*:UNITTESTObjectRightsRestrictionTests/8.*:UNITTESTObjectRightsRestrictionTests/9.*:UNITTESTObjectRightsRestrictionTests/10.*:UNITTESTObjectRightsRestrictionTests/11.*:UNITTESTObjectRightsRestrictionTests/12.*:UNITTESTObjectRightsRestrictionTests/13.*:UNITTESTObjectRightsRestrictionTests/14.*:UNITTESTObjectRightsRestrictionTests/15.*:UNITTESTLinkInfoTests.*:UNITTESTLinkInfoOnSpecificationTests.*:UNITTESTStaticLinkInfoOnSpecificationTests.*:UNITTESTcom_ptr_tests.*:UNITTESTUndoStateCheckAndCorrectObjectsTests.*:UNITTESTUndoStateUndoTests.*:UNITTESTWorksetInitTests.*:UNITTESTHierarchicalScannerTest.*:UNITTESTCheckObjectPropertiesTests.*:UNITTESTLoopDetectorTests.*:UNITTESTOverlayPathTests.*:UNITTESTSettingBaseOverlayTests.*:UNITTESTOverlayOrReleasedAreaTests.*:UNITTESTTranslationTests.*:UNITTESTComosUidTests.*:UNITTESTUsingDatabaseTransactionTests.*:UNITTESTOverlayReleaseAssumptionTests.*:UNITTESTSetting_extension_on_a_filename.*:UNITTESTCombining_folder_path.*:UNITTESTExtracting_drive_letter.*:UNITTESTLoginTestForInvalidUserCredentials.*:UNITTESTFileNameCalculatorTests.*:UNITTESTObjectStructureUnitTests.*:UNITTESTBaseObjectPointerTest.*:UNITTESTObjectTestTests.*:UNITTESTProjectTests.*:UNITTESTResettingRevisionsTests.*:UNITTESTAfterPasteScriptsTests.*:UNITTESTBeforePasteScriptsTests.*:UNITTESTCanBeCopiedScriptTests.*:UNITTESTCanBeCutScriptTests.*:UNITTESTScriptingTests.*:UNITTESTSessionTimestampTests.*:UNITTESTTimestampTests.*:UNITTESTDepthFirstSearchTest.*:UNITTESTReachableNodesTest.*:UNITTESTPhysUnitTests.*:UNITTESTComosUIDTests.*:UNITTESTVarstorageTest.*:UNITTESTConnectorTests.*:UNITTESTComosMapTest.*:UNITTESTCharEscapingTest.*:UNITTESTConvertPatternTest.*:UNITTESTDatabaseVersionChangeTests.*:UNITTESTWithTempFolderTests.*:UNITTESTRollbackStateItemTest.*:UNITTESTAdminRightsTest.*:UNITTESTGetInternationalDisplayValueTest.*:UNITTESTComosLibraryTest.*:UNITTESTLiteralCharacterConversionTests.*:UNITTESTStringToLongTests.*:UNITTESTVariantToStringTest.*:UNITTESTVariantToDoubleTest.*:UNITTESTVariantToIntTest.*:UNITTESTVariantToLongLongTest.*:UNITTESTCopyableUniquePointerTests.*:UNITTESTExecutionProgressVisualizerTests.*:UNITTESTFinallyTests.*:UNITTESTShowing_message_boxes_through_GlobalFunctions.*:UNITTESTMultiThreadingToolForMainThreadTests.*:UNITTESTOverlayLoginTest.*:UNITTESTSimpleListItemTest.*:UNITTESTStringSerializableArrayTests.*:UNITTESTSplitStringTest.*:UNITTESTContainsCIWithLocaleTests.*:UNITTESTStringToolsTests.*:UNITTESTVectorToolsTests.*:UNITTESTWithTemporaryValueTests.*:UNITTESTCopyContentsWithOwnerChainTests.*:UNITTESTHeartbeatTest.*:UNITTESTNumericLibTest.*:UNITTESTA_new_workset.*:UNITTESTSetting_a_message_box_handler.*:UNITTEST__Undoing_all_via_workset.*:UNITTESTAfter_workset_is_terminated.:UNITTESTDuring_workset_termination.:UNITTESTAfter_workset_termination.:UNITTESTCallStackTests.:DisplayValueAndNumericValuesTestCases/UNITTESTDisplayValueAndNumericValuesTest.:DistanceScenarios/UNITTESTDistanceCalculatorTests.:TestCases/UNITTESTSystemTypeOwnerRelations.:LoadedNotChanged_IS_releasable/UNITTESTCanBeReleasedFromCacheTest.:Changed_is_NOT_releasable/UNITTESTCanBeReleasedFromCacheTest.*:CreatedThenDeleted_IS_releasable/UNITTEST__CanBeReleasedFromCacheTest.:LoadedThenDeleted_is_NOT_releasable/UNITTESTCanBeReleasedFromCacheTest.:
This is the generatet tempfile
This is the runnsettings file that i used
unittesting.gta.runsettings.txt
it stops at the last test
I don't see any obvious issues. Since the tempfile appears to be complete (these is the closing testsuites
tag), my guess would be that this is not an issue of GTA, but of vstest.console.exe
itself. My suggestion would be to have a try with the MS flavor of GTA, and if this has the same problem, to contact MS about it (and in case that it works with TAfGT, please let me know)...
When i use the GTA from Microsoft, it works. With the GTA Adapter from here (get with nuget) it not works
That's interesting - thanks for letting me know...
However, the only thing I can offer to you is that you run the exact same command with GTA and TAfGT, and then provide all resulting artefacts (logs, output, result files) - maybe I can then see what's the difference...
The only alternative would be to provide your solution (or test executables, config files etc.) such that I can try to reproduce the issue locally.
Closed due to inactivity - feel free to reopen...
GTA version 0.18.0.1432
GTA stops working after some test.
My UnitTest.exe has round about 7000 Test (5000 with name UNITTEST. When i call it via vsTest.Console i use the following parameter:
"C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\Common7\IDE\Extensions\TestPlatform\vstest.console" r:\bin\unittesting.exe /Settings:"c:\temp\unittesting.gta.runsettings" /logger:trx;LogFileName="result.trx" /TestCaseFilter:FullyQualifiedName~UNITTEST
Runsettings: <?xml version="1.0" encoding="utf-8"?>
Problem: Testrun never ends