search

csoltenborn / GoogleTestAdapter

Visual studio extension that adds support for the C++ testing framework Google Test.
Other
143 stars 100 forks source link

GTA stops after some tests #326

Closed arator68 closed 3 years ago

arator68 commented 3 years ago

GTA version 0.18.0.1432

GTA stops working after some test.

My UnitTest.exe has round about 7000 Test (5000 with name UNITTEST. When i call it via vsTest.Console i use the following parameter:

"C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\Common7\IDE\Extensions\TestPlatform\vstest.console" r:\bin\unittesting.exe /Settings:"c:\temp\unittesting.gta.runsettings" /logger:trx;LogFileName="result.trx" /TestCaseFilter:FullyQualifiedName~UNITTEST

Runsettings: <?xml version="1.0" encoding="utf-8"?>

c:\temp\TestResults x86 0 \packages\GoogleTestAdapter.0.18.0\build\_common result.trx 4

Problem: Testrun never ends

csoltenborn commented 3 years ago

This is probably not related to GTA, but to your tests. First try to run them on the console without VsTest.Console.exe and see whether that invocation behaves differently.

arator68 commented 3 years ago

Works fine without VSTest.Console.exe. All tests are passed

csoltenborn commented 3 years ago

Then I need more information (settings, log output etc). What happens if the tests are run from inside Visual Studio?

csoltenborn commented 3 years ago

Any news on this one? As I said, I will need much more information if I shall try to help...

arator68 commented 3 years ago

hi and sorry for the delay.

Log1.txt Log2.txt

i hope this is what you need

csoltenborn commented 3 years ago

Ok, this shows that everything appears to be working fine in Visual Studio (this is the output of the VS Test output window, right?)

First, make sure that this command, executed on the console, works as desired - it should result in the same output as in Log2.txt (except beginning and end):

r:\bin\UnitTesting.exe --gtest_output="xml:C:\MyTemp\MyTemp\tmpC4B2.tmp" --gtest_catch_exceptions=1 --gtest_break_on_failure=0 --unattended --gtest_filter=*__UNITTEST__*

If this is the case, please post your file c:\temp\unittesting.gta.runsettings, the result.trx file as well as any output VsTestConsole.exe produces with your above call.

As a side note: You are using different filtering mechanisms: --gtest_filter within VS, TestCaseFilter (and whatever is contained in your runsettings file) for VsTestConsole.exe.

arator68 commented 3 years ago

Hi, here some additional infos

vstest.console calls unittesting.exe with this parameter "r:\bin\unittesting.exe" --gtest_output="xml:C:\MyTemp\MyTemp\tmpCB42.tmp" --gtest_catch_exceptions=1 --gtest_break_on_failure=0 --gtest_filter=UNITTESTCachingUnitTest.:UNITTESTComosArrayObjectTest.:UNITTESTD3ObjectTests.:UNITTESTDeletingDatabaseTables.:UNITTESTNumberOfCreatedObjectsPure.:UNITTESTNumberOfCreatedObjectsTests.:UNITTESTDelayedHierarchyUpdaterTests.:UNITTESTGetCDeviceBySystemFullNameTests.:UNITTESTCPLTObjectCollectionTests.:UNITTESTCPLTTimestampTests.:UNITTESTSoftDeletionUnitTests.:UNITTESTTrying_to_change_description_in_workinglayer_display_mode.:UNITTESTGetLinkedSpecificationTests.:UNITTESTScanCDevicesTest.:UNITTESTScanDocumentsTest.:UNITTESTSpecificationScannerTests.:UNITTESTScanDevicesTest.:UNITTESTTrigger.:UNITTESTPastingObjectFromAnotherProject.:UNITTESTReferenceCountingTests.:UNITTESTTranslatedTextWithDelimiterTests.:UNITTESTIndexDefinition.:UNITTESTTableImplementationTests.:UNITTESTFreePropertyModificationTests.:UNITTESTWithPreservedClipboardObjectTests.:UNITTESTProviderTests.:UNITTESTExceptionWithSettingStatusTests.:UNITTESTFakingTranslationsTests.:UNITTESTIteratingOverUsedFreePropertyGroups.:UNITTESTCollectionsMemoryTests.:UNITTESTMEMORYCollections.*:UNITTESTCDeviceDereferentiationTests.*:UNITTESTChangedObjectsCollectionsTests.*:UNITTESTComosUIDValidityTests.*:UNITTESTDeviceCollectionsTests.*:UNITTESTCreatingInteractiveReport.*:UNITTESTDocumentTypeTests.*:UNITTESTCreateElementTests.*:UNITTESTElementGroupsDbVersionTests.*:UNITTESTElementGroupsTests.*:UNITTESTElementGroupsInfoTests.*:UNITTESTElementCountTests.*:UNITTESTElementTreeTraversalEndlessLoopTests.*:UNITTESTElementTreeTraversalTests.*:UNITTESTGetInheritParent.*:UNITTESTOverlayIdTests.*:UNITTESTPathFullNameTests.*:UNITTESTUndoStateTests.*:UNITTESTWorksetTerminateTests.*:UNITTESTXObjTests.*:UNITTESTClassIdTest.*:UNITTESTCleanerForexternalCallTest.*:UNITTESTCPLTCollectionTests.*:UNITTESTLanguageSelectorImplementationTests.*:UNITTESTShadowCollectionTests.*:UNITTESTLayerTests.*:UNITTESTRightsForCollectionsTests.*:UNITTESTDeriveBaseHolderTest.*:UNITTESTGetSpecificationByNameTests.*:UNITTESTHelpTextOfSpecsTests.*:UNITTESTInheritanceTests.*:UNITTESTSiValueTests.*:UNITTESTXValuesTests.*:UNITTESTStandardValueTests.*:UNITTESTSystemTypeTests.*:UNITTESTTempCollectionTests.*:UNITTESTWorksetDependentTempCollectionTests.*:UNITTESTUndoStateHandlingTests.*:UNITTESTWithProgressBarTests.*:UNITTESTCurrentProject.*:UNITTESTProjectContextTests.*:UNITTESTCPLTXDataWrapperTest.*:UNITTESTCreationTimestampTests.*:UNITTESTSecurityUnionTests.*:UNITTESTInWorkingLayerDisplayMode.*:UNITTESTRightsSimulationTests.*:UNITTESTSpecificationSetRightsTests.*:UNITTESTSettingDocumentVersion.*:UNITTESTRevisionsBasedOnModificationOfDataSource_ProjectOptionTests.:UNITTESTScriptResultCacheTests.:UNITTESTScriptStackTests.:UNITTESTSearchConditionTest.:UNITTESTSearchManagerTest.:UNITTESTSearchManagerValidationTest.:UNITTESTSessionIdRangeTests.:UNITTESTSessionIdSelectionTests.:UNITTESTLicenseTests.:UNITTESTXmlSpecificationTests.:UNITTESTIteratingOverLoadedSpecifications.:UNITTESTNumberRangeGeneratorTests.:UNITTESTNrgNameAndLabelAdjustmentTests.:UNITTESTGiven_an_overlay_release_in_a_sql_database.:UNITTESTA_new_free_property.:UNITTESTVbScriptEngineTests.:UNITTESTFindingSpecificationsByFreePropertyTests.:UNITTESTSetOwnLinkObjectTest.:UNITTESTMEMORYGetMemoryUsageTests.*:UNITTESTRollbackTests.*:UNITTESTBackCollectionIdTests.*:UNITTESTBackCollectionTests.*:UNITTESTResourceToolTests.*:UNITTESTDatabaseTests.*:UNITTESTClipboardTests.*:UNITTESTPltStringArrayTest.*:UNITTESTComosMapIterationTests.*:UNITTESTLoadedExtensionsContainerTests.*:UNITTESTExternalRightsRestrictionTests.*:UNITTESTExternalRightsExtensionPointTests.*:UNITTESTRightsRestrictionExceptionTest.*:UNITTESTSystemFullNameTest.*:UNITTESTObjectRightsRestrictionTests/0.*:UNITTESTObjectRightsRestrictionTests/1.*:UNITTESTObjectRightsRestrictionTests/2.*:UNITTESTObjectRightsRestrictionTests/3.*:UNITTESTObjectRightsRestrictionTests/4.*:UNITTESTObjectRightsRestrictionTests/5.*:UNITTESTObjectRightsRestrictionTests/6.*:UNITTESTObjectRightsRestrictionTests/7.*:UNITTESTObjectRightsRestrictionTests/8.*:UNITTESTObjectRightsRestrictionTests/9.*:UNITTESTObjectRightsRestrictionTests/10.*:UNITTESTObjectRightsRestrictionTests/11.*:UNITTESTObjectRightsRestrictionTests/12.*:UNITTESTObjectRightsRestrictionTests/13.*:UNITTESTObjectRightsRestrictionTests/14.*:UNITTESTObjectRightsRestrictionTests/15.*:UNITTESTLinkInfoTests.*:UNITTESTLinkInfoOnSpecificationTests.*:UNITTESTStaticLinkInfoOnSpecificationTests.*:UNITTESTcom_ptr_tests.*:UNITTESTUndoStateCheckAndCorrectObjectsTests.*:UNITTESTUndoStateUndoTests.*:UNITTESTWorksetInitTests.*:UNITTESTHierarchicalScannerTest.*:UNITTESTCheckObjectPropertiesTests.*:UNITTESTLoopDetectorTests.*:UNITTESTOverlayPathTests.*:UNITTESTSettingBaseOverlayTests.*:UNITTESTOverlayOrReleasedAreaTests.*:UNITTESTTranslationTests.*:UNITTESTComosUidTests.*:UNITTESTUsingDatabaseTransactionTests.*:UNITTESTOverlayReleaseAssumptionTests.*:UNITTESTSetting_extension_on_a_filename.*:UNITTESTCombining_folder_path.*:UNITTESTExtracting_drive_letter.*:UNITTESTLoginTestForInvalidUserCredentials.*:UNITTESTFileNameCalculatorTests.*:UNITTESTObjectStructureUnitTests.*:UNITTESTBaseObjectPointerTest.*:UNITTESTObjectTestTests.*:UNITTESTProjectTests.*:UNITTESTResettingRevisionsTests.*:UNITTESTAfterPasteScriptsTests.*:UNITTESTBeforePasteScriptsTests.*:UNITTESTCanBeCopiedScriptTests.*:UNITTESTCanBeCutScriptTests.*:UNITTESTScriptingTests.*:UNITTESTSessionTimestampTests.*:UNITTESTTimestampTests.*:UNITTESTDepthFirstSearchTest.*:UNITTESTReachableNodesTest.*:UNITTESTPhysUnitTests.*:UNITTESTComosUIDTests.*:UNITTESTVarstorageTest.*:UNITTESTConnectorTests.*:UNITTESTComosMapTest.*:UNITTESTCharEscapingTest.*:UNITTESTConvertPatternTest.*:UNITTESTDatabaseVersionChangeTests.*:UNITTESTWithTempFolderTests.*:UNITTESTRollbackStateItemTest.*:UNITTESTAdminRightsTest.*:UNITTESTGetInternationalDisplayValueTest.*:UNITTESTComosLibraryTest.*:UNITTESTLiteralCharacterConversionTests.*:UNITTESTStringToLongTests.*:UNITTESTVariantToStringTest.*:UNITTESTVariantToDoubleTest.*:UNITTESTVariantToIntTest.*:UNITTESTVariantToLongLongTest.*:UNITTESTCopyableUniquePointerTests.*:UNITTESTExecutionProgressVisualizerTests.*:UNITTESTFinallyTests.*:UNITTESTShowing_message_boxes_through_GlobalFunctions.*:UNITTESTMultiThreadingToolForMainThreadTests.*:UNITTESTOverlayLoginTest.*:UNITTESTSimpleListItemTest.*:UNITTESTStringSerializableArrayTests.*:UNITTESTSplitStringTest.*:UNITTESTContainsCIWithLocaleTests.*:UNITTESTStringToolsTests.*:UNITTESTVectorToolsTests.*:UNITTESTWithTemporaryValueTests.*:UNITTESTCopyContentsWithOwnerChainTests.*:UNITTESTHeartbeatTest.*:UNITTESTNumericLibTest.*:UNITTESTA_new_workset.*:UNITTESTSetting_a_message_box_handler.*:UNITTEST__Undoing_all_via_workset.*:UNITTESTAfter_workset_is_terminated.:UNITTESTDuring_workset_termination.:UNITTESTAfter_workset_termination.:UNITTESTCallStackTests.:DisplayValueAndNumericValuesTestCases/UNITTESTDisplayValueAndNumericValuesTest.:DistanceScenarios/UNITTESTDistanceCalculatorTests.:TestCases/UNITTESTSystemTypeOwnerRelations.:LoadedNotChanged_IS_releasable/UNITTESTCanBeReleasedFromCacheTest.:Changed_is_NOT_releasable/UNITTESTCanBeReleasedFromCacheTest.*:CreatedThenDeleted_IS_releasable/UNITTEST__CanBeReleasedFromCacheTest.:LoadedThenDeleted_is_NOT_releasable/UNITTESTCanBeReleasedFromCacheTest.:

This is the generatet tempfile

tmpCB42.txt

This is the runnsettings file that i used

unittesting.gta.runsettings.txt

it stops at the last test

csoltenborn commented 3 years ago

I don't see any obvious issues. Since the tempfile appears to be complete (these is the closing testsuites tag), my guess would be that this is not an issue of GTA, but of vstest.console.exe itself. My suggestion would be to have a try with the MS flavor of GTA, and if this has the same problem, to contact MS about it (and in case that it works with TAfGT, please let me know)...

arator68 commented 3 years ago

When i use the GTA from Microsoft, it works. With the GTA Adapter from here (get with nuget) it not works

csoltenborn commented 3 years ago

That's interesting - thanks for letting me know...

However, the only thing I can offer to you is that you run the exact same command with GTA and TAfGT, and then provide all resulting artefacts (logs, output, result files) - maybe I can then see what's the difference...

The only alternative would be to provide your solution (or test executables, config files etc.) such that I can try to reproduce the issue locally.

csoltenborn commented 3 years ago

Closed due to inactivity - feel free to reopen...