MobileNativeFoundation / bluepill

Bluepill is a reliable iOS testing tool that runs UI tests using multiple simulators on a single machine
BSD 2-Clause "Simplified" License
3.19k stars 232 forks source link

Tests have status 'testToSkip' #133

Closed BuddyArifin closed 7 years ago

BuddyArifin commented 7 years ago

I write my test using XCode UI Testing with swift. Then i try to running these config

{ "app": "./build/Products/Debug-iphonesimulator/UITests-Runner.app", "scheme-path": "./UI.xcodeproj/xcshareddata/xcschemes/UITests.xcscheme", "output-dir": "./build/" }

and my output

`

FirstTest

{37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] repeatTestsCount: 1 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] errorRetriesCount: 4 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] stuckTimeout: 300 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] testCaseTimeout: 300 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] noSplit: (null) {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] junitOutput: 1 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] plainOutput: 1 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] jsonOutput: 1 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] failureTolerance: 0 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] onlyRetryFailed: 0 {37043} 20170504.062959 [ DEBUG ] (SIM-2) [CONFIGURATION] testCasesToSkip: ( "LoginSampleTest/testOnboarding" )

SecondTest

{37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] repeatTestsCount: 1 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] errorRetriesCount: 4 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] stuckTimeout: 300 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] testCaseTimeout: 300 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] noSplit: (null) {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] junitOutput: 1 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] plainOutput: 1 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] jsonOutput: 1 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] failureTolerance: 0 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] onlyRetryFailed: 0 {37006} 20170504.062958 [ DEBUG ] (SIM-1) [CONFIGURATION] testCasesToSkip: ( "LoginWithValidLoginTest/testLogin" ) ` Why my test labeled as 'testToSkip'?

Any help would be much appreciated.

Many Thanks,

Buddy

ob commented 7 years ago

These are just internal bluepill debugging messages. The way the test packing works is by marking some of the tests as "toSkip" and passing the actual testing job to bp. I.e you have two tests and each of the two simulators is going to run one so each sim will have one of the tests marked as "toSkip".

BuddyArifin commented 7 years ago

I able to run parallel test, using XCUI Test,

Just add, -u and -t.. Thanks