multi_scan crashes when include_simulator_logs is set to true from Circle CI job

dimirey commented 4 years ago

New Issue Checklist

[x] Updated fastlane-plugin-test_center to the latest version
[x] I read the README.md
[x] I reviewed the example(s) for the action(s) I am using
[x] I have removed any sensitive data such as passwords, authentication tokens, or anything else I do not want to world to see

If you love this fastlane plugin, consider sponsoring it or asking your company to sponsor it. I would really appreciate any gesture: https://github.com/sponsors/lyndsey-ferguson. 😍

Issue Description

When using multi_scan to run tests on circle CI, the initial test run is complete but when additional retries are attempted none of them are able to run.

Complete output when running fastlane, including the stack trace and command used

Selected tests
Test Suite BurnerUITests.xctest started
BulkActionsDeleteMessage
    ✗ testBulkDeleteMessage, XCTAssertEqual failed: ("true") is not equal to ("false")

BurnerUITests.BulkActionsDeleteMessage
  testBulkDeleteMessage, XCTAssertEqual failed: ("true") is not equal to ("false")
  BulkDeleteMessages.swift:73

     Executed 1 test, with 1 failure (0 unexpected) in 11.985 (11.987) seconds

2020-09-02 22:20:04.586 xcodebuild[7759:92960] [MT] IDETestOperationsObserverDebug: 50.679 elapsed -- Testing started completed.
2020-09-02 22:20:04.586 xcodebuild[7759:92960] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
2020-09-02 22:20:04.587 xcodebuild[7759:92960] [MT] IDETestOperationsObserverDebug: 50.679 sec, +50.679 sec -- end
Failing tests:
    BurnerUITests:
        BulkActionsDeleteMessage.testBulkDeleteMessage()

** TEST EXECUTE FAILED **
[22:20:08]: Exit status: 65
+--------------------+---+
|      Test Results      |
+--------------------+---+
| Number of tests    | 1 |
| Number of failures | 1 |
+--------------------+---+

[22:20:08]: ------------------------------
[22:20:08]: --- Collecting system logs ---
[22:20:08]: ------------------------------
[22:20:08]: $ xcrun simctl spawn 0DAA5DBA-5796-4030-A0C6-EF4530577677 log collect --output /Users/distiller/project/output/scan/system_logs-iPhone\ 11_iOS_13.3.logarchive 2>/dev/null

[22:20:08]: Exit status: 124
+---------------------------+---------------------------------------------------------------+
|                                       Lane Context                                        |
+---------------------------+---------------------------------------------------------------+
| DEFAULT_PLATFORM          | ios                                                           |
| PLATFORM_NAME             | ios                                                           |
| LANE_NAME                 | ios ui_tests                                                  |
| ORIGINAL_DEFAULT_KEYCHAIN | "/Users/distiller/Library/Keychains/fastlane_tmp_keychain-db" |
+---------------------------+---------------------------------------------------------------+
[22:20:08]: Exit status: 124

+------+----------------------------+-------------+
|                fastlane summary                 |
+------+----------------------------+-------------+
| Step | Action                     | Time (in s) |
+------+----------------------------+-------------+
| 1    | Verifying fastlane version | 0           |
| 2    | default_platform           | 0           |
| 3    | xcversion                  | 0           |
| 4    | setup_circle_ci            | 0           |
| 💥   | multi_scan                 | 123         |
+------+----------------------------+-------------+

[22:20:08]: fastlane finished with errors

[!] Exit status: 124

Environment

project distiller$ bundle exec fastlane env
[✔] 🚀
[23:18:59]: Generating fastlane environment output, this might take a few seconds...
🚫 fastlane environment 🚫

### Stack

| Key                         | Value                                                          |
| --------------------------- | -------------------------------------------------------------- |
| OS                          | 10.15.1                                                        |
| Ruby                        | 2.6.3                                                          |
| Bundler?                    | true                                                           |
| Git                         | git version 2.25.0                                             |
| Installation Source         | ~/project/vendor/bundle/ruby/2.6.0/bin/fastlane                |
| Host                        | Mac OS X 10.15.1 (19B88)                                       |
| Ruby Lib Dir                | /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib |
| OpenSSL Version             | LibreSSL 2.8.3                                                 |
| Is contained                | false                                                          |
| Is homebrew                 | false                                                          |
| Is installed via Fabric.app | false                                                          |
| Xcode Path                  | /Applications/Xcode-11.3.1.app/Contents/Developer/             |
| Xcode Version               | 11.3.1                                                         |

### System Locale

| Variable | Value       |   |
| -------- | ----------- | - |
| LANG     | en_US.UTF-8 | ✅ |
| LC_ALL   | en_US.UTF-8 | ✅ |
| LANGUAGE |             |   |

### fastlane files:

`./fastlane/Fastfile`

```ruby
# https://github.com/fastlane/fastlane/tree/master/fastlane/docs

fastlane_version "2.145.0"
default_platform :ios
xcversion(version: "~> 11.3.1")

# CONST

_REPO_PATH = "/-iOS"
BETA_BUILD_SUPPORTED_FOLDERS = { 'epic' => :true }
PLIST_PATHS = ["/Supporting Files/-Info.plist", "s/Info.plist", "Intents/Info.plist", "Directory/Info.plist", "NotificationService/Info.plist"]

platform :ios do
  before_all do
    setup_circle_ci
  end

  def determine_details_for_uploading_build(branch_name)
    # Find the folder name and the Jira Ticket
    branch_folder = branch_name.match(/^[^\/]*/)
    jira_ticket = branch_name.match(/BUR2-[^-]*/)
    build_name_to_upload = nil
    # Strip the folder and ticket (and surrounding special characters)
    if (jira_ticket && branch_folder)
      build_name_to_upload = branch_name.sub(branch_folder.to_s + '/', '')
    end
    # Ensure the branch is named properly and not missing any aspect of the format.
    should_upload_build = BETA_BUILD_SUPPORTED_FOLDERS.has_key?(branch_folder.to_s) &&
                             !branch_folder.to_s.empty? && !jira_ticket.to_s.empty? &&
                             !build_name_to_upload.empty?

    details = {
      should_upload_build: should_upload_build,
      folder: branch_folder.to_s,
      jira_ticket: (!jira_ticket.to_s.empty?) ? jira_ticket.to_s : nil,
      name: build_name_to_upload,
      xcode_bundle_name: get_info_plist_value({ key: "CFBundleShortVersionString", path: "/Supporting Files/-Info.plist"}),
      xcode_bundle_version: get_info_plist_value({ key: "CFBundleVersion", path: "/Supporting Files/-Info.plist"}).to_i
    }
  end

  lane :regression_build do |options|
    bundle_version = sh("git rev-list --all --count")
    sha = sh("git rev-parse --verify HEAD")
    set_info_plist_value({ key: "CFBundleVersion", value: bundle_version.to_s.strip, path: "/Supporting Files/-Info.plist"})

    match( type: "" )
    run_tests(scheme: "")
    build_app(
      scheme: "",
      workspace: ".xcworkspace",
      configuration: "Beta",
      export_method: "ad-hoc",
      export_team_id: "",
      include_bitcode: false,
      export_options: {
          "provisioningProfiles": {
                                   "com..": "match  com..",
                                   "com...-Intents": "match  com...-Intents",
                                   "com...sToday": "match  com...sToday",
                                   "com...NotificationService": "match  com...NotificationService"
                                 },
          "compileBitcode": false
        }
    )

    puts "Notes = Commit: #{sha}"
    appcenter_upload(
      api_token: ENV["APP_CENTER_API_TOKEN"],
      owner_name: ENV["APP_CENTER_OWNER_NAME"],
      app_name: "-iOS",
      release_notes: "Commit: #{sha}",
      destinations: "*",
      notify_testers: true # Set to false if you don't want to notify testers of your new release (default: `false`)
    )
  end

  # Fastlane Workflow Starts
  lane :feature do |options|
    build_info = determine_details_for_uploading_build(git_branch)

    if( build_info[:should_upload_build] == false)
      raise """
        This lane only supports builds from folders: #{BETA_BUILD_SUPPORTED_FOLDERS.keys}

        Please follow the format /BURXXX-my-great-description format
      """
    end

    bundle_version = build_info[:xcode_bundle_version]

    if ( build_info[:xcode_bundle_name] == build_info[:name] )
      bundle_version = bundle_version + 1
    else
      set_info_plist_value({ key: "CFBundleShortVersionString", value: build_info[:name], path: "/Supporting Files/-Info.plist"})
      bundle_version = 1
    end
    set_info_plist_value({ key: "CFBundleVersion", value: bundle_version.to_s, path: "/Supporting Files/-Info.plist"})

    match( type: "" )
    run_tests(scheme: "")
    build_app(
      scheme: "",
      workspace: ".xcworkspace",
      configuration: "Beta",
      export_method: "ad-hoc",
      export_team_id: "",
      export_options: {
          "provisioningProfiles": {
                                   "com..": "match  com..",
                                   "com...-Intents": "match  com...-Intents",
                                   "com...sToday": "match  com...sToday",
                                   "com...NotificationService": "match  com...NotificationService"
                                  }
        }
    )

    puts "Notes = https://.atlassian.net/browse/#{build_info[:jira_ticket]}"
    crashlytics(
      api_token: ENV['CRASHLYTICS_API_TOKEN'],
      build_secret: ENV['CRASHLYTICS_BUILD_SECRET'],
      notes: "Jira Ticket : https://.atlassian.net/browse/#{build_info[:jira_ticket]}",
      groups: ['qa'],
      debug: true
    )
    git_commit( path: "/Supporting Files/-Info.plist", message: "Fastlane: Version Bump [skip ci]" )
    push_to_git_remote( local_branch: git_branch )
  end

  lane :unit_tests do
    run_tests(scheme: "")
  end

  lane :ui_tests do
    multi_scan(device: "iPhone 11",
      testplan: "./UITests.xctestplan",
      try_count: 5,
      workspace: ".xcworkspace",
      scheme: "UITests",
      configuration: "Debug",
      reset_simulator: true,
      result_bundle: true,
      fail_build: false
    )
  end

  desc 'Publish a build to BitBar'
    lane :uploadToTestdroid do
      begin

        upload_dir = File.expand_path(File.join(File.dirname(__FILE__), '..', 'build'))
        upload_file = File.join(upload_dir, "test.ipa")
        Dir.mkdir(upload_dir)

        bundle_version = sh("git rev-list --all --count")
        sha = sh("git rev-parse --verify HEAD")
        set_info_plist_value({ key: "CFBundleVersion", value: bundle_version.to_s.strip, path: "/Supporting Files/-Info.plist"})

        match( type: "" )
        build_app(
          scheme: "",
          workspace: ".xcworkspace",
          configuration: "Debug",
          export_method: "ad-hoc",
          export_team_id: "",
          include_bitcode: false,
          output_directory: upload_dir,
          output_name: File.basename(upload_file),
          include_symbols: true,
          export_options: {
              "provisioningProfiles": {
                                       "com..": "match  com..",
                                       "com...-Intents": "match  com...-Intents",
                                       "com...sToday": "match  com...sToday",
                                       "com...NotificationService": "match  com...NotificationService"
                                     },
              "compileBitcode": false
            }
        )

        puts "Notes = Commit: #{sha}"
        upload_testdroid(application_file: upload_file)
      ensure
        FileUtils.rm_rf(upload_dir)
    end
  end

  lane :development do
    match( type: "development" )
    build_app(
      scheme: "",
      workspace: ".xcworkspace",
      configuration: "Release",
      export_method: "development",
      export_team_id: "",
      export_options: "./fastlane/development.plist"
    )

    crashlytics(
      api_token: ENV['CRASHLYTICS_API_TOKEN'],
      build_secret: ENV['CRASHLYTICS_BUILD_SECRET']
    )
  end

  lane :beta do
    match( type: "appstore" )
    build_app(
      scheme: "",
      workspace: ".xcworkspace",
      configuration: "Release",
      export_method: "app-store",
      export_team_id: "",
      export_options: {
          "provisioningProfiles": {
                                    "com..": "match AppStore com..",
                                   "com...-Intents": "match AppStore com...-Intents",
                                   "com...sToday": "match AppStore com...sToday",
                                   "com...NotificationService": "match AppStore com...NotificationService"
                                  }
        }
    )
    upload_to_testflight(
      skip_waiting_for_build_processing: true,
      skip_submission: true
    )
    bump_build_number
    git_commit(
      path: PLIST_PATHS,
      message: "Fastlane: Version Bump [skip ci]"
    )
    push_to_git_remote( local_branch: git_branch )
  end

  lane :bump_build_number do |options|
    version = options[:version]
    bundle_version = get_info_plist_value({ key: "CFBundleVersion", path: "/Supporting Files/-Info.plist"}).to_i
    bundle_version = bundle_version + 1
    for path in PLIST_PATHS do
      set_info_plist_value({ key: "CFBundleVersion", value: bundle_version.to_s, path: path})
    end
  end

  lane :set_version do |options|
    version = options[:version]
    build_number = options[:build_number]
    if (version == nil)
      raise "Please specify the version using version:"
    end
    if (build_number == nil)
      raise "Please specify the build number using build_number:"
    end
    for path in PLIST_PATHS do
      set_info_plist_value({ key: "CFBundleVersion", value: build_number, path: path})
      set_info_plist_value({ key: "CFBundleShortVersionString", value: version, path: path})
    end
  end

  lane :tag_release do |options|
    tag = options[:tag]
    if (tag == nil)
      raise "Please specify the version to be tagged using tag:"
    end

    last_tag = sh("git describe --abbrev=0 --tags")
    puts "Generating notes since last tag: #{last_tag.strip}"
    log_command = "git log #{last_tag.strip}..HEAD --no-merges --pretty=format:%s"
    release_notes = sh(log_command)
    add_git_tag(tag: tag)
    set_github_release(
      repository_name: _REPO_PATH,
      api_token: ENV["GITHUB_TOKEN"],
      name: tag,
      tag_name: tag,
      description: release_notes,
    )
  end

  lane :release do
    # snapshot
    gym
    deliver(force: true)
    # frameit
  end

  after_all do |lane|
  end
end

```


`./fastlane/Appfile`

```ruby
app_identifier "com.." # The bundle identifier of your app
apple_id "doug@.co" # Your Apple email address

team_id "" # Developer Portal Team ID

# you can even provide different app identifiers, Apple IDs and team names per lane:
# More information: https://github.com/fastlane/fastlane/blob/master/fastlane/docs/Appfile.md

```


### fastlane gems

| Gem      | Version | Update-Status      |
| -------- | ------- | ------------------ |
| fastlane | 2.145.0 | 🚫 Update available |

### Loaded fastlane plugins:

| Plugin                           | Version | Update-Status |
| -------------------------------- | ------- | ------------- |
| fastlane-plugin-appcenter        | 1.9.0   | ✅ Up-To-Date  |
| fastlane-plugin-testdroid_runner | 1.0.0   | ✅ Up-To-Date  |
| fastlane-plugin-aws_device_farm  | 0.3.17  | ✅ Up-To-Date  |
| fastlane-plugin-test_center      | 3.14.2  | ✅ Up-To-Date  |

Loaded gems

| Gem                                     | Version      |
| --------------------------------------- | ------------ |
| did_you_mean                            | 1.3.0        |
| bundler                                 | 2.1.4        |
| rake                                    | 13.0.1       |
| CFPropertyList                          | 3.0.2        |
| public_suffix                           | 2.0.5        |
| addressable                             | 2.7.0        |
| atomos                                  | 0.1.3        |
| aws-eventstream                         | 1.1.0        |
| aws-partitions                          | 1.296.0      |
| aws-sigv4                               | 1.1.1        |
| jmespath                                | 1.4.0        |
| aws-sdk-core                            | 3.94.0       |
| aws-sdk-accessanalyzer                  | 1.7.0        |
| aws-sdk-acm                             | 1.31.0       |
| aws-sdk-acmpca                          | 1.24.0       |
| aws-sdk-alexaforbusiness                | 1.36.0       |
| aws-sdk-amplify                         | 1.17.0       |
| aws-sdk-apigateway                      | 1.42.0       |
| aws-sdk-apigatewaymanagementapi         | 1.14.0       |
| aws-sdk-apigatewayv2                    | 1.21.0       |
| aws-sdk-appconfig                       | 1.6.0        |
| aws-sdk-applicationautoscaling          | 1.40.0       |
| aws-sdk-applicationdiscoveryservice     | 1.27.0       |
| aws-sdk-applicationinsights             | 1.10.0       |
| aws-sdk-appmesh                         | 1.24.0       |
| aws-sdk-appstream                       | 1.41.0       |
| aws-sdk-appsync                         | 1.26.0       |
| aws-sdk-athena                          | 1.27.0       |
| aws-sdk-augmentedairuntime              | 1.5.0        |
| aws-sdk-autoscaling                     | 1.37.0       |
| aws-sdk-autoscalingplans                | 1.23.0       |
| aws-sdk-backup                          | 1.15.0       |
| aws-sdk-batch                           | 1.31.0       |
| aws-sdk-budgets                         | 1.30.0       |
| aws-sdk-chime                           | 1.28.0       |
| aws-sdk-cloud9                          | 1.23.0       |
| aws-sdk-clouddirectory                  | 1.24.0       |
| aws-sdk-cloudformation                  | 1.36.0       |
| aws-sdk-cloudfront                      | 1.29.0       |
| aws-sdk-cloudhsm                        | 1.22.0       |
| aws-sdk-cloudhsmv2                      | 1.23.0       |
| aws-sdk-cloudsearch                     | 1.20.0       |
| aws-sdk-cloudsearchdomain               | 1.17.0       |
| aws-sdk-cloudtrail                      | 1.23.0       |
| aws-sdk-cloudwatch                      | 1.38.0       |
| aws-sdk-cloudwatchevents                | 1.29.0       |
| aws-sdk-cloudwatchlogs                  | 1.31.0       |
| aws-sdk-codebuild                       | 1.52.0       |
| aws-sdk-codecommit                      | 1.33.0       |
| aws-sdk-codedeploy                      | 1.31.0       |
| aws-sdk-codeguruprofiler                | 1.5.0        |
| aws-sdk-codegurureviewer                | 1.6.0        |
| aws-sdk-codepipeline                    | 1.31.0       |
| aws-sdk-codestar                        | 1.21.0       |
| aws-sdk-codestarconnections             | 1.4.0        |
| aws-sdk-codestarnotifications           | 1.3.0        |
| aws-sdk-cognitoidentity                 | 1.22.0       |
| aws-sdk-cognitoidentityprovider         | 1.36.0       |
| aws-sdk-cognitosync                     | 1.19.0       |
| aws-sdk-comprehend                      | 1.32.0       |
| aws-sdk-comprehendmedical               | 1.17.0       |
| aws-sdk-computeoptimizer                | 1.3.0        |
| aws-sdk-configservice                   | 1.45.0       |
| aws-sdk-connect                         | 1.25.0       |
| aws-sdk-connectparticipant              | 1.3.0        |
| aws-sdk-costandusagereportservice       | 1.21.0       |
| aws-sdk-costexplorer                    | 1.42.0       |
| aws-sdk-databasemigrationservice        | 1.34.0       |
| aws-sdk-dataexchange                    | 1.4.0        |
| aws-sdk-datapipeline                    | 1.19.0       |
| aws-sdk-datasync                        | 1.20.0       |
| aws-sdk-dax                             | 1.22.0       |
| aws-sdk-detective                       | 1.6.0        |
| aws-sdk-devicefarm                      | 1.33.0       |
| aws-sdk-directconnect                   | 1.30.0       |
| aws-sdk-directoryservice                | 1.28.0       |
| aws-sdk-dlm                             | 1.29.0       |
| aws-sdk-docdb                           | 1.17.0       |
| aws-sdk-dynamodb                        | 1.48.0       |
| aws-sdk-dynamodbstreams                 | 1.19.0       |
| aws-sdk-ebs                             | 1.4.0        |
| aws-sdk-ec2                             | 1.165.0      |
| aws-sdk-ec2instanceconnect              | 1.6.0        |
| aws-sdk-ecr                             | 1.30.0       |
| aws-sdk-ecs                             | 1.63.0       |
| aws-sdk-efs                             | 1.29.0       |
| aws-sdk-eks                             | 1.37.0       |
| aws-sdk-elasticache                     | 1.36.0       |
| aws-sdk-elasticbeanstalk                | 1.31.0       |
| aws-sdk-elasticinference                | 1.5.0        |
| aws-sdk-elasticloadbalancing            | 1.22.0       |
| aws-sdk-elasticloadbalancingv2          | 1.44.0       |
| aws-sdk-elasticsearchservice            | 1.36.0       |
| aws-sdk-elastictranscoder               | 1.21.0       |
| aws-sdk-emr                             | 1.29.0       |
| aws-sdk-eventbridge                     | 1.7.0        |
| aws-sdk-firehose                        | 1.28.0       |
| aws-sdk-fms                             | 1.26.0       |
| aws-sdk-forecastqueryservice            | 1.5.0        |
| aws-sdk-forecastservice                 | 1.5.0        |
| aws-sdk-frauddetector                   | 1.4.0        |
| aws-sdk-fsx                             | 1.20.0       |
| aws-sdk-gamelift                        | 1.31.0       |
| aws-sdk-glacier                         | 1.29.0       |
| aws-sdk-globalaccelerator               | 1.18.0       |
| aws-sdk-glue                            | 1.57.0       |
| aws-sdk-greengrass                      | 1.31.0       |
| aws-sdk-groundstation                   | 1.8.0        |
| aws-sdk-guardduty                       | 1.34.0       |
| aws-sdk-health                          | 1.25.0       |
| aws-sdk-iam                             | 1.39.0       |
| aws-sdk-imagebuilder                    | 1.7.0        |
| aws-sigv2                               | 1.0.1        |
| aws-sdk-importexport                    | 1.19.0       |
| aws-sdk-inspector                       | 1.26.0       |
| aws-sdk-iot                             | 1.50.0       |
| aws-sdk-iot1clickdevicesservice         | 1.21.0       |
| aws-sdk-iot1clickprojects               | 1.21.0       |
| aws-sdk-iotanalytics                    | 1.29.0       |
| aws-sdk-iotdataplane                    | 1.19.0       |
| aws-sdk-iotevents                       | 1.15.0       |
| aws-sdk-ioteventsdata                   | 1.8.0        |
| aws-sdk-iotjobsdataplane                | 1.20.0       |
| aws-sdk-iotsecuretunneling              | 1.3.0        |
| aws-sdk-iotsitewise                     | 1.4.0        |
| aws-sdk-iotthingsgraph                  | 1.7.0        |
| aws-sdk-kafka                           | 1.21.0       |
| aws-sdk-kendra                          | 1.6.0        |
| aws-sdk-kinesis                         | 1.23.0       |
| aws-sdk-kinesisanalytics                | 1.24.0       |
| aws-sdk-kinesisanalyticsv2              | 1.16.0       |
| aws-sdk-kinesisvideo                    | 1.25.0       |
| aws-sdk-kinesisvideoarchivedmedia       | 1.24.0       |
| aws-sdk-kinesisvideomedia               | 1.21.0       |
| aws-sdk-kinesisvideosignalingchannels   | 1.3.0        |
| aws-sdk-kms                             | 1.30.0       |
| aws-sdk-lakeformation                   | 1.4.0        |
| aws-sdk-lambda                          | 1.42.0       |
| aws-sdk-lambdapreview                   | 1.19.0       |
| aws-sdk-lex                             | 1.26.0       |
| aws-sdk-lexmodelbuildingservice         | 1.30.0       |
| aws-sdk-licensemanager                  | 1.14.0       |
| aws-sdk-lightsail                       | 1.32.0       |
| aws-sdk-machinelearning                 | 1.20.0       |
| aws-sdk-macie                           | 1.20.0       |
| aws-sdk-macie2                          | 1.2.0        |
| aws-sdk-managedblockchain               | 1.11.0       |
| aws-sdk-marketplacecatalog              | 1.3.0        |
| aws-sdk-marketplacecommerceanalytics    | 1.23.0       |
| aws-sdk-marketplaceentitlementservice   | 1.19.0       |
| aws-sdk-marketplacemetering             | 1.25.0       |
| aws-sdk-mediaconnect                    | 1.22.0       |
| aws-sdk-mediaconvert                    | 1.50.0       |
| aws-sdk-medialive                       | 1.46.0       |
| aws-sdk-mediapackage                    | 1.28.0       |
| aws-sdk-mediapackagevod                 | 1.14.0       |
| aws-sdk-mediastore                      | 1.25.0       |
| aws-sdk-mediastoredata                  | 1.22.0       |
| aws-sdk-mediatailor                     | 1.27.0       |
| aws-sdk-migrationhub                    | 1.24.0       |
| aws-sdk-migrationhubconfig              | 1.4.0        |
| aws-sdk-mobile                          | 1.19.0       |
| aws-sdk-mq                              | 1.27.0       |
| aws-sdk-mturk                           | 1.22.0       |
| aws-sdk-neptune                         | 1.24.0       |
| aws-sdk-networkmanager                  | 1.3.0        |
| aws-sdk-opsworks                        | 1.24.0       |
| aws-sdk-opsworkscm                      | 1.34.0       |
| aws-sdk-organizations                   | 1.41.0       |
| aws-sdk-outposts                        | 1.5.0        |
| aws-sdk-personalize                     | 1.13.0       |
| aws-sdk-personalizeevents               | 1.7.0        |
| aws-sdk-personalizeruntime              | 1.11.0       |
| aws-sdk-pi                              | 1.19.0       |
| aws-sdk-pinpoint                        | 1.41.0       |
| aws-sdk-pinpointemail                   | 1.19.0       |
| aws-sdk-pinpointsmsvoice                | 1.16.0       |
| aws-sdk-polly                           | 1.30.0       |
| aws-sdk-pricing                         | 1.19.0       |
| aws-sdk-qldb                            | 1.5.0        |
| aws-sdk-qldbsession                     | 1.4.0        |
| aws-sdk-quicksight                      | 1.21.0       |
| aws-sdk-ram                             | 1.17.0       |
| aws-sdk-rds                             | 1.85.0       |
| aws-sdk-rdsdataservice                  | 1.18.0       |
| aws-sdk-redshift                        | 1.43.0       |
| aws-sdk-rekognition                     | 1.38.0       |
| aws-sdk-resourcegroups                  | 1.24.0       |
| aws-sdk-resourcegroupstaggingapi        | 1.26.0       |
| aws-sdk-robomaker                       | 1.24.0       |
| aws-sdk-route53                         | 1.35.0       |
| aws-sdk-route53domains                  | 1.22.0       |
| aws-sdk-route53resolver                 | 1.14.0       |
| aws-sdk-s3                              | 1.61.2       |
| aws-sdk-s3control                       | 1.19.0       |
| aws-sdk-sagemaker                       | 1.59.0       |
| aws-sdk-sagemakerruntime                | 1.22.0       |
| aws-sdk-savingsplans                    | 1.5.0        |
| aws-sdk-schemas                         | 1.4.0        |
| aws-sdk-secretsmanager                  | 1.36.0       |
| aws-sdk-securityhub                     | 1.26.0       |
| aws-sdk-serverlessapplicationrepository | 1.27.0       |
| aws-sdk-servicecatalog                  | 1.40.0       |
| aws-sdk-servicediscovery                | 1.24.0       |
| aws-sdk-servicequotas                   | 1.6.0        |
| aws-sdk-ses                             | 1.30.0       |
| aws-sdk-sesv2                           | 1.5.0        |
| aws-sdk-shield                          | 1.26.0       |
| aws-sdk-signer                          | 1.21.0       |
| aws-sdk-simpledb                        | 1.19.0       |
| aws-sdk-sms                             | 1.20.0       |
| aws-sdk-snowball                        | 1.27.0       |
| aws-sdk-sns                             | 1.24.0       |
| aws-sdk-sqs                             | 1.26.0       |
| aws-sdk-ssm                             | 1.80.0       |
| aws-sdk-sso                             | 1.4.0        |
| aws-sdk-ssooidc                         | 1.3.0        |
| aws-sdk-states                          | 1.28.0       |
| aws-sdk-storagegateway                  | 1.41.0       |
| aws-sdk-support                         | 1.21.0       |
| aws-sdk-swf                             | 1.20.0       |
| aws-sdk-synthetics                      | 1.3.0        |
| aws-sdk-textract                        | 1.15.0       |
| aws-sdk-transcribeservice               | 1.43.0       |
| aws-sdk-transcribestreamingservice      | 1.15.0       |
| aws-sdk-transfer                        | 1.21.0       |
| aws-sdk-translate                       | 1.22.0       |
| aws-sdk-waf                             | 1.30.0       |
| aws-sdk-wafregional                     | 1.31.0       |
| aws-sdk-wafv2                           | 1.5.0        |
| aws-sdk-workdocs                        | 1.23.0       |
| aws-sdk-worklink                        | 1.16.0       |
| aws-sdk-workmail                        | 1.25.0       |
| aws-sdk-workmailmessageflow             | 1.4.0        |
| aws-sdk-workspaces                      | 1.37.0       |
| aws-sdk-xray                            | 1.26.0       |
| aws-sdk-resources                       | 3.73.0       |
| aws-sdk                                 | 3.0.1        |
| babosa                                  | 1.0.3        |
| claide                                  | 1.0.3        |
| colored2                                | 3.1.2        |
| cork                                    | 0.3.0        |
| nap                                     | 1.1.0        |
| open4                                   | 1.3.4        |
| claide-plugins                          | 0.9.2        |
| colored                                 | 1.2          |
| colorize                                | 0.8.1        |
| highline                                | 1.7.10       |
| commander-fastlane                      | 4.4.6        |
| multipart-post                          | 2.0.0        |
| faraday                                 | 0.17.3       |
| faraday-http-cache                      | 2.0.0        |
| git                                     | 1.5.0        |
| kramdown                                | 2.1.0        |
| kramdown-parser-gfm                     | 1.1.0        |
| no_proxy_fix                            | 0.1.2        |
| sawyer                                  | 0.8.2        |
| octokit                                 | 4.14.0       |
| unicode-display_width                   | 1.7.0        |
| terminal-table                          | 1.8.0        |
| danger                                  | 6.1.0        |
| thor                                    | 0.20.3       |
| danger-swiftlint                        | 0.23.0       |
| declarative                             | 0.0.10       |
| declarative-option                      | 0.1.0        |
| deep_merge                              | 1.2.1        |
| digest-crc                              | 0.5.1        |
| unf_ext                                 | 0.0.7.7      |
| unf                                     | 0.1.4        |
| domain_name                             | 0.5.20190701 |
| dotenv                                  | 2.7.5        |
| emoji_regex                             | 1.0.1        |
| excon                                   | 0.73.0       |
| http-cookie                             | 1.0.3        |
| faraday-cookie_jar                      | 0.0.6        |
| faraday_middleware                      | 0.13.1       |
| fastimage                               | 2.1.7        |
| gh_inspector                            | 1.1.3        |
| jwt                                     | 2.1.0        |
| memoist                                 | 0.16.2       |
| multi_json                              | 1.14.1       |
| os                                      | 1.1.0        |
| signet                                  | 0.14.0       |
| googleauth                              | 0.11.0       |
| httpclient                              | 2.8.3        |
| mini_mime                               | 1.0.2        |
| uber                                    | 0.1.0        |
| representable                           | 3.0.4        |
| retriable                               | 3.1.2        |
| google-api-client                       | 0.36.4       |
| google-cloud-env                        | 1.3.1        |
| google-cloud-errors                     | 1.0.0        |
| google-cloud-core                       | 1.5.0        |
| google-cloud-storage                    | 1.26.0       |
| json                                    | 2.3.0        |
| mini_magick                             | 4.10.1       |
| multi_xml                               | 0.6.0        |
| plist                                   | 3.5.0        |
| rubyzip                                 | 1.3.0        |
| security                                | 0.1.3        |
| naturally                               | 2.2.0        |
| simctl                                  | 1.6.8        |
| slack-notifier                          | 2.3.2        |
| terminal-notifier                       | 2.0.0        |
| tty-screen                              | 0.7.1        |
| tty-cursor                              | 0.7.1        |
| tty-spinner                             | 0.9.3        |
| word_wrap                               | 1.0.0        |
| nanaimo                                 | 0.2.6        |
| xcodeproj                               | 1.15.0       |
| rouge                                   | 2.0.7        |
| xcpretty                                | 0.3.0        |
| xcpretty-travis-formatter               | 1.0.0        |
| fastlane-plugin-appcenter               | 1.9.0        |
| fastlane-plugin-aws_device_farm         | 0.3.17       |
| trainer                                 | 0.9.1        |
| xctest_list                             | 1.2.1        |
| fastlane-plugin-test_center             | 3.14.2       |
| rack                                    | 2.2.3        |
| oauth2                                  | 1.4.4        |
| http-accept                             | 1.7.0        |
| mime-types-data                         | 3.2020.0512  |
| mime-types                              | 3.3.1        |
| netrc                                   | 0.11.0       |
| rest-client                             | 2.1.0        |
| testdroid-api-client                    | 0.5.0        |
| fastlane-plugin-testdroid_runner        | 1.0.0        |
| xcode-install                           | 2.5.0        |


*generated on:* **2020-09-03**

[23:19:01]: Take notice that this output may contain sensitive information, or simply information that you don't want to make public.
[23:19:01]: Open https://github.com/fastlane/fastlane/issues/new to submit a new issue ✅

#######################################################################
# fastlane 2.157.2 is available. You are on 2.145.0.
# You should use the latest version.
# Please update using `bundle update fastlane`.
#######################################################################

2.157.2 Improvements
* [spaceship] share tunes and portal session when logging in with apple id from connect api (#17110) via Josh Holtz

2.157.1 Improvements
* [deliver] fix upload screenshot when display type not yet created (#17106) via Josh Holtz
* [screengrab] handle permission denied during screengrab `adb pull` (#17101) via Aman Gupta Karmani
* [screengrab] pass adb_path into AdbHelper (#17099) via Aman Gupta Karmani
* [spaceship] separate portal team id and tunes team id (#17104) via Josh Holtz

2.157.0 Improvements
* [deliver] improve screenshot uploading verification (#17060) via Satoshi Namai
* [screengrab] Wait for device to reconnect after adb root (#17077) via Olivier Halligon
* [action] fix formatting syntax error on commit_version_bump (#17092) via Sandeep M
* [gym] safer logic getting last 5 lines of logs (#17096) via Christian Schmidt
* [pilot][spaceship][action] set ASC API key in pilot, new app_store_connect_api_key action, and spaceship fixes for both of those (#17061) via Josh Holtz
* [spaceship] improve multiple sessions and multiple auth types (#17042) via Josh Holtz
* [action] Add support to exclude files from sonar qube analysis (#17049) via David Cacenabes

## Using the App Store Connect API Key
- `pilot` is the first tool to fully support authorization with the API Key
- Go to https://docs.fastlane.tools/app-store-connect-api/ to read more on _fastlane_ and the App Store Connect API
  - Learn about the new `app_store_connect_api_key` action
  - Learn about the _fastlane_ App Store Connect JSON API Key file format
  - See that status of tools that support the App Store Connect API Key

To see all new releases, open https://github.com/fastlane/fastlane/releases

Please update using `bundle update fastlane

lyndsey-ferguson commented 4 years ago

@dimirey thank you for the issue report and for using multi_scan. I suspect that there is a problem collecting simulator logs as the last step is:

22:20:08: $ xcrun simctl spawn 0DAA5DBA-5796-4030-A0C6-EF4530577677 log collect --output /Users/distiller/project/output/scan/system_logs-iPhone\ 11_iOS_13.3.logarchive 2>/dev/null

Before a failure. Now, I don't see that you have requested include_simulator_logs, but is that requested in a Scanfile?

If so, can you take that option out to see if that makes a difference?

Of course, multi_scan is intended to work with that option; it will help me to understand if this is an issue with that feature, or if something else is going on.

dimirey commented 3 years ago

@lyndsey-ferguson it turns out that circle enabled include_simulator_logs to true by default. changing it to include_simulator_logs: false resolved the issue.

lyndsey-ferguson commented 3 years ago

Huh, interesting. So CircleCI snuck that in, perhaps there is an environment variable as part of the job that made this happen and multi_scan is not picking up on that. You can also try include_simulator_logs: true in your call to multi_scan directly and it should work.

The crashing problem occurs because the previous simulator logs are already there: the command to extract the logs fails because it cannot overwrite the logs and it crashes. multi_scan will move the log files if it knows that include_simulator_logs is true so that the command can work without crashing.

lyndsey-ferguson commented 3 years ago

@dimirey is your circle ci enabling include_simulator_logs via the setup_circle_ci action? How does it enable it? Can you remove the option to set include_simulator_logs from multi_scan and provide more of the of the logs with the --verbose flag?

Specifically, I want to see the scan summary table and the debug logs stating what values it assigning to each key.

debug logs before multi_scan calls scan:

DEBUG [2020-09-17 18:14:10.79]: retrying_scan #update_scan_options
DEBUG [2020-09-17 18:14:10.79]:         Setting project to /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/AtomicBoy/AtomicBoy.xcodeproj
DEBUG [2020-09-17 18:14:10.79]:         Setting scheme to AtomicBoy
DEBUG [2020-09-17 18:14:10.79]:         Setting fail_build to false
DEBUG [2020-09-17 18:14:10.79]:         Setting output_types to html,junit
DEBUG [2020-09-17 18:14:10.79]:         Setting skip_detect_devices to false
DEBUG [2020-09-17 18:14:10.79]:         Setting reset_simulator to false
DEBUG [2020-09-17 18:14:10.79]:         Setting disable_slide_to_type to true
DEBUG [2020-09-17 18:14:10.79]:         Setting reinstall_app to false
DEBUG [2020-09-17 18:14:10.79]:         Setting only_testing to [ ...tests.. ]
DEBUG [2020-09-17 18:14:10.79]:         Setting xctestrun to /Users/lyndsey.ferguson/Library/Developer/Xcode/DerivedData/AtomicBoy-flqqvvvzbouqymbyffgdbtjoiufr/Build/Products/AtomicBoy_iphonesimulator13.6-x86_64.xctestrun
DEBUG [2020-09-17 18:14:10.79]:         Setting clean to false
DEBUG [2020-09-17 18:14:10.79]:         Setting open_report to false
DEBUG [2020-09-17 18:14:10.79]:         Setting output_directory to /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/scan/AtomicBoyUITests-batch-2
DEBUG [2020-09-17 18:14:10.79]:         Setting output_files to report.html,report.junit
DEBUG [2020-09-17 18:14:10.79]:         Setting buildlog_path to fastlane/test_output/buildlogs/scan
DEBUG [2020-09-17 18:14:10.79]:         Setting include_simulator_logs to true
DEBUG [2020-09-17 18:14:10.79]:         Setting derived_data_path to /Users/lyndsey.ferguson/Library/Developer/Xcode/DerivedData/AtomicBoy-flqqvvvzbouqymbyffgdbtjoiufr
DEBUG [2020-09-17 18:14:10.79]:         Setting should_zip_build_products to false
DEBUG [2020-09-17 18:14:10.79]:         Setting result_bundle to false
DEBUG [2020-09-17 18:14:10.79]:         Setting use_clang_report_name to false
DEBUG [2020-09-17 18:14:10.79]:         Setting disable_concurrent_testing to true
DEBUG [2020-09-17 18:14:10.79]:         Setting build_for_testing to false
DEBUG [2020-09-17 18:14:10.79]:         Setting xcargs to  -parallel-testing-enabled NO 
DEBUG [2020-09-17 18:14:10.79]:         Setting slack_use_webhook_configured_username_and_icon to false
DEBUG [2020-09-17 18:14:10.79]:         Setting slack_username to fastlane
DEBUG [2020-09-17 18:14:10.79]:         Setting slack_icon_url to https://fastlane.tools/assets/img/fastlane_icon.png
DEBUG [2020-09-17 18:14:10.79]:         Setting skip_slack to false
DEBUG [2020-09-17 18:14:10.79]:         Setting slack_only_on_failure to false
DEBUG [2020-09-17 18:14:10.79]:         Setting destination to ["platform=iOS Simulator,id=0C16EF00-1237-424C-BE75-6BEB676EFC00"]
DEBUG [2020-09-17 18:14:10.79]:         Setting xcodebuild_command to env NSUnbufferedIO=YES xcodebuild
DEBUG [2020-09-17 18:14:10.79]:         Setting skip_build to false

Note that:

DEBUG [2020-09-17 18:14:10.79]:         Setting include_simulator_logs to true

And my scan summary when I use the setup_circle_ci action with the force:true parameter to make it work locally:

+------------------------------------------------+-------------------------------------------------------------------------------------------+
|                                                          Summary for scan 2.151.2                                                          |
+------------------------------------------------+-------------------------------------------------------------------------------------------+
| project                                        | /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/AtomicBoy/AtomicBoy.xcodeproj    |
| scheme                                         | AtomicBoy                                                                                 |
| fail_build                                     | false                                                                                     |
| output_types                                   | html,junit                                                                                |
| skip_detect_devices                            | false                                                                                     |
| force_quit_simulator                           | false                                                                                     |
| reset_simulator                                | false                                                                                     |
| disable_slide_to_type                          | true                                                                                      |
| reinstall_app                                  | false                                                                                     |
| only_testing                                   | ["AtomicBoyUITests/AtomicBoyUITests/testExample10",                                       |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample17",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample20",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample25",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample34",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample35",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample37",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample43",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample47",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample48",                                        |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample8",                                         |
|                                                | "AtomicBoyUITests/AtomicBoyUITests/testExample"]                                          |
| xctestrun                                      | /Users/lyndsey.ferguson/Library/Developer/Xcode/DerivedData/AtomicBoy-flqqvvvzbouqymbyff  |
|                                                | gdbtjoiufr/Build/Products/AtomicBoy_iphonesimulator13.6-x86_64.xctestrun                  |
| clean                                          | false                                                                                     |
| open_report                                    | false                                                                                     |
| output_directory                               | /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/scan/Atomi  |
|                                                | cBoyUITests-batch-2                                                                       |
| output_files                                   | report-3.html,report-3.junit                                                              |
| buildlog_path                                  | fastlane/test_output/buildlogs/scan                                                       |
| derived_data_path                              | /Users/lyndsey.ferguson/Library/Developer/Xcode/DerivedData/AtomicBoy-flqqvvvzbouqymbyff  |
|                                                | gdbtjoiufr                                                                                |
| should_zip_build_products                      | false                                                                                     |
| use_clang_report_name                          | false                                                                                     |
| disable_concurrent_testing                     | true                                                                                      |
| xcargs                                         |  -parallel-testing-enabled NO                                                             |
| slack_use_webhook_configured_username_and_icon | false                                                                                     |
| slack_username                                 | fastlane                                                                                  |
| slack_icon_url                                 | https://fastlane.tools/assets/img/fastlane_icon.png                                       |
| skip_slack                                     | false                                                                                     |
| slack_only_on_failure                          | false                                                                                     |
| xcodebuild_command                             | env NSUnbufferedIO=YES xcodebuild                                                         |
| include_simulator_logs                         | true                                                                                      |
| skip_build                                     | false                                                                                     |
| xcode_path                                     | /Applications/Xcode11.6.app                                                               |
| result_bundle                                  | false                                                                                     |
| build_for_testing                              | false                                                                                     |
+------------------------------------------------+-------------------------------------------------------------------------------------------+

Note:

| include_simulator_logs                         | true                                                                                      |

Is true, and multi_scan does not crash as it moves logs after each test run:

INFO [2020-09-17 18:16:55.63]: $ xcrun simctl spawn 0C16EF00-1237-424C-BE75-6BEB676EFC00 log collect --output /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/scan/AtomicBoyUITests-batch-2/system_logs-iPhone\ SE_iOS_13.2.2.logarchive 2>/dev/null
INFO [2020-09-17 18:17:00.00]: ▸ Archive successfully written to /Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/scan/AtomicBoyUITests-batch-2/system_logs-iPhone SE_iOS_13.2.2.logarchive
DEBUG [2020-09-17 18:17:00.00]: Moving simulator log '/Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/scan/AtomicBoyUITests-batch-2/system_logs-iPhone SE_iOS_13.2.2.logarchive' to '/Users/lyndsey.ferguson/repo/fastlane-plugin-test_center/fastlane/test_output/scan/AtomicBoyUITests-batch-2/batch-2-try-0-system_logs-iPhone SE_iOS_13.2.2.logarchive'

lyndsey-ferguson commented 3 years ago

Closing as cannot reproduce.

lyndsey-ferguson / fastlane-plugin-test_center