search

lyndsey-ferguson / fastlane-plugin-test_center

🎯 The best fastlane plugin to understand and tame misbehaving iOS tests 🎉
MIT License
285 stars 66 forks source link

How can I collect all skipped tests from xcresult? #327

Closed alexnot95 closed 3 years ago

alexnot95 commented 3 years ago

New Issue Checklist

If you love this fastlane plugin, consider sponsoring it or asking your company to sponsor it. I would really appreciate any gesture: https://github.com/sponsors/lyndsey-ferguson. 😍

Complete output when running fastlane, including the stack trace and command used
[INSERT OUTPUT HERE]

Environment

[INSERT OUTPUT HERE]

Hi, I'm using tests_from_xcresult action after the run to collect all failed + passed tests, but for now, I have several tests where I'm doing try XCTSkipIf() at the test start, and after this I see that skipped tests added to failed one :( Maybe you know why skipped tests goes into failed section? Thanks

lyndsey-ferguson commented 3 years ago

Can you submit a sample of an *.xcresult bundle that exhibits this issue? I can take a look at it.

alexnot95 commented 3 years ago

Sure, here is the example with 1 success 1 failure, and 1 skipped test @lyndsey-ferguson

Test-testProject-2021.02.09_10-35-49-+0200.xcresult.zip

alexnot95 commented 3 years ago

I believe that there is 5 lines fix for it, here - tests_from_xcresult.rb 

all_tests.each do |t|
            if t.test_status == 'Success'
              passing << "#{target_name}/#{t.identifier.sub('()', '')}"
            else
              test_identifier = "#{target_name}/#{t.identifier.sub('()', '')}"
              failed << test_identifier
              failure = t.find_failure(failures)
              if failure
                failure_details[test_identifier] = {
                  message: failure.failure_message
                }
              end

just add one more elsif and collect skipped array ?

lyndsey-ferguson commented 3 years ago

Can you modify your Pluginfile per my instructions below, run bundle install, and then run your fastlane again (with the --verbose flag)?

Pluginfile:

gem 'fastlane-plugin-test_center', :git => "https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git", :branch => "issue-327-skipped-xcresult-tests"

If there are still problems, please let me know and attach the console output as a text file to this issue (makes it easier for me to review). If it works, please let me know.

alexnot95 commented 3 years ago

@lyndsey-ferguson Thank you very much for the support, but looks like I can't get count of skipped tests on your branch :(

bundle install

alexeysomov@MacBook-Pro-Alexey test_project % bundle install
Fetching https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git
Updating files: 100% (3587/3587), done.
Fetching gem metadata from https://rubygems.org/.........
Fetching gem metadata from https://rubygems.org/.
Resolving dependencies...
Using rake 13.0.3
Using CFPropertyList 3.0.3
Using concurrent-ruby 1.1.7
Using i18n 0.9.5
Using minitest 5.14.2
Using thread_safe 0.3.6
Using tzinfo 1.2.7
Using activesupport 4.2.11.3
Using public_suffix 4.0.6
Using addressable 2.7.0
Using httpclient 2.8.3
Using json 2.5.1
Using algoliasearch 1.27.3
Using artifactory 3.0.15
Using jwt 2.1.0
Using atlassian-jwt 0.2.0
Using atomos 0.1.3
Using aws-eventstream 1.1.0
Using aws-partitions 1.424.0
Using aws-sigv4 1.2.2
Using jmespath 1.4.0
Using aws-sdk-core 3.112.0
Using aws-sdk-kms 1.42.0
Using aws-sdk-s3 1.88.0
Using babosa 1.0.4
Using curb 0.9.11
Using fastimage 2.2.2
Using bundler 2.1.4
Using colored 1.2
Using highline 1.7.10
Using commander-fastlane 4.4.6
Using dotenv 2.7.6
Using emoji_regex 3.2.1
Using excon 0.79.0
Using faraday-net_http 1.0.1
Using multipart-post 2.0.0
Using ruby2_keywords 0.0.4
Using faraday 1.3.0
Using unf_ext 0.0.7.7
Using unf 0.1.4
Using domain_name 0.5.20190701
Using http-cookie 1.0.3
Using faraday-cookie_jar 0.0.7
Using faraday_middleware 1.0.0
Using gh_inspector 1.1.3
Using memoist 0.16.2
Using multi_json 1.15.0
Using os 1.1.1
Using signet 0.14.1
Using googleauth 0.15.0
Using mini_mime 1.0.2
Using declarative 0.0.20
Using declarative-option 0.1.0
Using uber 0.1.0
Using representable 3.0.4
Using retriable 3.1.2
Using google-api-client 0.38.0
Using digest-crc 0.6.3
Using rexml 3.2.4
Using webrick 1.7.0
Using google-apis-core 0.2.1
Using google-apis-iamcredentials_v1 0.1.0
Using google-apis-storage_v1 0.1.0
Using google-cloud-env 1.4.0
Using google-cloud-errors 1.0.1
Using google-cloud-core 1.5.0
Using google-cloud-storage 1.30.0
Using mini_magick 4.11.0
Using plist 3.6.0
Using rubyzip 2.3.0
Using security 0.1.3
Using naturally 2.2.1
Using simctl 1.6.8
Using slack-notifier 2.3.2
Using terminal-notifier 2.0.0
Using unicode-display_width 1.7.0
Using terminal-table 1.8.0
Using tty-screen 0.8.1
Using tty-cursor 0.7.1
Using tty-spinner 0.9.3
Using word_wrap 1.0.0
Using claide 1.0.3
Using colored2 3.1.2
Using nanaimo 0.3.0
Using xcodeproj 1.19.0
Using rouge 2.0.7
Using xcpretty 0.3.0
Using xcpretty-travis-formatter 1.0.1
Using fastlane 2.173.0
Using badge 0.12.0
Using blockenspiel 0.5.0
Using cork 0.3.0
Using nap 1.1.0
Using open4 1.3.4
Using claide-plugins 0.9.2
Using clamp 1.3.2
Using fuzzy_match 2.0.4
Using netrc 0.11.0
Using ffi 1.13.1
Using ethon 0.12.0
Using typhoeus 1.4.0
Using cocoapods-core 1.9.3
Using cocoapods-deintegrate 1.0.4
Using cocoapods-downloader 1.4.0
Using cocoapods-plugins 1.0.0
Using cocoapods-search 1.0.0
Using cocoapods-stats 1.1.0
Using cocoapods-trunk 1.5.0
Using cocoapods-try 1.2.0
Using escape 0.0.4
Using fourflusher 2.3.1
Using molinillo 0.6.6
Using ruby-macho 1.4.0
Using cocoapods 1.9.3
Using colorize 0.8.1
Using faraday-http-cache 2.2.0
Using rchardet 1.8.0
Using git 1.7.0
Using kramdown 2.3.0
Using kramdown-parser-gfm 1.1.0
Using no_proxy_fix 0.1.2
Using sawyer 0.8.2
Using octokit 4.18.0
Using danger 8.0.5
Using danger-plugin-api 1.0.0
Using danger-swiftformat 0.7.0
Using danger-xcode_summary 0.5.2
Using fastlane-plugin-appcenter 1.11.0
Using fastlane-plugin-badge 1.4.0
Using fastlane-plugin-slack_train 0.2.0
Using trainer 0.9.1
Using xctest_list 1.2.1
Using fastlane-plugin-test_center 3.15.2 (was 3.14.8) from https://github.com/lyndsey-ferguson/fastlane-plugin-test_center.git (at issue-327-skipped-xcresult-tests@9d39393)
Using fastlane-plugin-update_provisioning_profile_specifier 1.3.1
Using fastlane-plugin-versioning 0.4.4
Using fastlane-plugin-xchtmlreport 0.1.1
Using mini_portile2 2.4.0
Using nokogiri 1.10.10
Using google_drive 3.0.5
Using oauth 0.5.4
Using jira-ruby 2.1.3
Using slather 2.5.0
Using versionomy 0.5.0
Using xcpretty-json-formatter 0.1.1
Bundle complete! 19 Gemfile dependencies, 145 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.

After I run with verbose flag:

alexeysomov@MacBook-Pro-Alexey test_project % fastlane test_run --verbose
[✔] 🚀 
[12:19:43]: fastlane detected a Gemfile in the current directory
[12:19:43]: However, it seems like you didn't use `bundle exec`
[12:19:43]: To launch fastlane faster, please use
[12:19:43]: 
[12:19:43]: $ bundle exec fastlane test_run --verbose
[12:19:43]: 
[12:19:43]: Get started using a Gemfile for fastlane https://docs.fastlane.tools/getting-started/ios/setup/#use-a-gemfile
DEBUG [2021-02-16 12:19:44.54]: Checking if there are any plugins that should be loaded...
DEBUG [2021-02-16 12:19:44.61]: Loading 'fastlane-plugin-update_provisioning_profile_specifier' plugin
INFO [2021-02-16 12:19:44.69]: gem 'fastlane-plugin-update_provisioning_profile_specifier' is already installed
DEBUG [2021-02-16 12:19:44.73]: Loading 'fastlane-plugin-versioning' plugin
INFO [2021-02-16 12:19:44.73]: gem 'fastlane-plugin-versioning' is already installed
DEBUG [2021-02-16 12:19:44.77]: Loading 'fastlane-plugin-badge' plugin
INFO [2021-02-16 12:19:44.77]: gem 'fastlane-plugin-badge' is already installed
DEBUG [2021-02-16 12:19:44.81]: Loading 'fastlane-plugin-slack_train' plugin
INFO [2021-02-16 12:19:44.81]: gem 'fastlane-plugin-slack_train' is already installed
DEBUG [2021-02-16 12:19:44.85]: Loading 'fastlane-plugin-xchtmlreport' plugin
INFO [2021-02-16 12:19:44.85]: gem 'fastlane-plugin-xchtmlreport' is already installed
DEBUG [2021-02-16 12:19:44.89]: Loading 'fastlane-plugin-appcenter' plugin
INFO [2021-02-16 12:19:44.90]: gem 'fastlane-plugin-appcenter' is already installed
DEBUG [2021-02-16 12:19:45.00]: Loading 'fastlane-plugin-test_center' plugin
INFO [2021-02-16 12:19:45.00]: gem 'fastlane-plugin-test_center' is already installed
+------------------------------------+---------+------------------------------------+
|                                   Used plugins                                    |
+------------------------------------+---------+------------------------------------+
| Plugin                             | Version | Action                             |
+------------------------------------+---------+------------------------------------+
| fastlane-plugin-update_provisioni  | 1.3.1   | update_provisioning_profile_speci  |
| ng_profile_specifier               |         | fier                               |
| fastlane-plugin-versioning         | 0.4.4   | get_version_number_from_git_branc  |
|                                    |         | h                                  |
|                                    |         | increment_build_number_in_xcodepr  |
|                                    |         | oj get_version_number_from_plist   |
|                                    |         | get_build_number_from_plist        |
|                                    |         | ci_build_number                    |
|                                    |         | get_version_number_from_xcodeproj  |
|                                    |         | increment_version_number_in_xcode  |
|                                    |         | proj                               |
|                                    |         | increment_version_number_in_plist  |
|                                    |         | get_app_store_version_number       |
|                                    |         | get_info_plist_path                |
|                                    |         | get_build_number_from_xcodeproj    |
|                                    |         | increment_build_number_in_plist    |
| fastlane-plugin-badge              | 1.4.0   | add_badge                          |
| fastlane-plugin-slack_train        | 0.2.0   | slack_train_crash                  |
|                                    |         | slack_train_start slack_train      |
| fastlane-plugin-xchtmlreport       | 0.1.1   | xchtmlreport                       |
| fastlane-plugin-appcenter          | 1.11.0  | appcenter_fetch_version_number     |
|                                    |         | appcenter_fetch_devices            |
|                                    |         | appcenter_upload                   |
| fastlane-plugin-test_center        | 3.15.2  | suppressed_tests suppress_tests    |
|                                    |         | tests_from_xcresult                |
|                                    |         | suppress_tests_from_junit          |
|                                    |         | tests_from_xctestrun               |
|                                    |         | quit_core_simulator_service        |
|                                    |         | collate_test_result_bundles        |
|                                    |         | tests_from_junit multi_scan        |
|                                    |         | test_options_from_testplan         |
|                                    |         | collate_html_reports               |
|                                    |         | collate_junit_reports              |
|                                    |         | collate_json_reports               |
|                                    |         | testplans_from_scheme              |
|                                    |         | collate_xcresults                  |
+------------------------------------+---------+------------------------------------+

Successfully loaded Appfile at path '/Users/alexeysomov/Documents/github/test_project/fastlane/Appfile'
- app_identifier: 'test_project'
- apple_id: test_project'
- team_id: 'test_project'
- itc_team_id: 'test_project'
- itc_team_name: 'test_project'
-------
INFO [2021-02-16 12:19:47.75]: ----------------------------------------
INFO [2021-02-16 12:19:47.75]: --- Step: Verifying fastlane version ---
INFO [2021-02-16 12:19:47.75]: ----------------------------------------
INFO [2021-02-16 12:19:47.75]: Your fastlane version 2.173.0 matches the minimum requirement of 2.173.0  ✅
INFO [2021-02-16 12:19:47.75]: ------------------------------
INFO [2021-02-16 12:19:47.75]: --- Step: default_platform ---
INFO [2021-02-16 12:19:47.75]: ------------------------------
INFO [2021-02-16 12:19:47.85]: gem 'uri' is already installed
INFO [2021-02-16 12:19:47.85]: gem 'json' is already installed
INFO [2021-02-16 12:19:47.97]: gem 'net/http' is already installed
INFO [2021-02-16 12:19:47.97]: gem 'fileutils' is already installed
INFO [2021-02-16 12:19:48.06]: gem 'set' is already installed
INFO [2021-02-16 12:19:48.06]: gem 'aws-sdk-s3' is already installed
INFO [2021-02-16 12:19:48.16]: gem 'net/http' is already installed
INFO [2021-02-16 12:19:48.23]: gem 'uri' is already installed
INFO [2021-02-16 12:19:48.23]: gem 'json' is already installed
INFO [2021-02-16 12:19:48.23]: gem 'plist' is already installed
INFO [2021-02-16 12:19:48.24]: -----------------------------
INFO [2021-02-16 12:19:48.24]: --- Step: import_from_git ---
INFO [2021-02-16 12:19:48.24]: -----------------------------
INFO [2021-02-16 12:19:48.24]: Cloning remote git repo...
INFO [2021-02-16 12:19:48.24]: $ git clone git@github.com:test_project/Fastlane.git /var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git --depth 1 --no-checkout 
INFO [2021-02-16 12:19:48.27]: ▸ Cloning into '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git'...
INFO [2021-02-16 12:19:50.41]: $ cd /var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git && git checkout HEAD Fastfile 
INFO [2021-02-16 12:19:50.43]: ▸ Updated 1 path from 2999c28
INFO [2021-02-16 12:19:50.43]: $ cd /var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git && git checkout HEAD ./actions
INFO [2021-02-16 12:19:50.45]: ▸ Updated 11 paths from 2999c28
INFO [2021-02-16 12:19:50.45]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/verification_format.rb'.
INFO [2021-02-16 12:19:50.46]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/global_generate_analytics.rb'.
INFO [2021-02-16 12:19:50.47]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/download_translations.rb'.
INFO [2021-02-16 12:19:50.47]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/find_localization_dublicates.rb'.
INFO [2021-02-16 12:19:50.48]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/resolve_release_build_number.rb'.
INFO [2021-02-16 12:19:50.48]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/format_target_translations_verification.rb'.
INFO [2021-02-16 12:19:50.49]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/upload_target_translations.rb'.
INFO [2021-02-16 12:19:50.49]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/download_target_translations.rb'.
INFO [2021-02-16 12:19:50.50]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/check_lost_files.rb'.
INFO [2021-02-16 12:19:50.50]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/download_analytics.rb'.
INFO [2021-02-16 12:19:50.51]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-38868-1rdtr95/Fastlane.git/actions/resolve_release_build_version.rb'.
INFO [2021-02-16 12:19:50.51]: gem 'spaceship' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'fastlane-plugin-update_provisioning_profile_specifier' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'fastlane-plugin-versioning' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'fastlane-plugin-badge' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'fastlane-plugin-slack_train' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'json' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'xcodeproj' is already installed
INFO [2021-02-16 12:19:50.69]: gem 'jira-ruby' is already installed
INFO [2021-02-16 12:19:51.70]: gem 'versionomy' is already installed
INFO [2021-02-16 12:19:51.86]: ----------------------------------------
INFO [2021-02-16 12:19:51.86]: --- Step: Verifying fastlane version ---
INFO [2021-02-16 12:19:51.86]: ----------------------------------------
INFO [2021-02-16 12:19:51.86]: Your fastlane version 2.173.0 matches the minimum requirement of 2.158.0  ✅
INFO [2021-02-16 12:19:51.87]: ------------------------------
INFO [2021-02-16 12:19:51.87]: --- Step: default_platform ---
INFO [2021-02-16 12:19:51.87]: ------------------------------
INFO [2021-02-16 12:19:51.87]: Driving the lane 'test_run' 🚀
INFO [2021-02-16 12:19:51.88]: gem 'fastlane-plugin-test_center' is already installed
INFO [2021-02-16 12:19:51.88]: ---------------------------------
INFO [2021-02-16 12:19:51.88]: --- Step: tests_from_xcresult ---
INFO [2021-02-16 12:19:51.88]: ---------------------------------
WARN [2021-02-16 12:19:51.97]: Failed count: 2
WARN [2021-02-16 12:19:51.97]: Success count: 1
WARN [2021-02-16 12:19:51.97]: Fail? with 'test_run' Exception undefined method `count' for nil:NilClass 
WARN [2021-02-16 12:19:51.97]: Lane Context:
INFO [2021-02-16 12:19:51.97]: {:DEFAULT_PLATFORM=>:ios, :PLATFORM_NAME=>nil, :LANE_NAME=>"test_run"}
ERROR [2021-02-16 12:19:51.97]: Error in your Fastfile at line 82
ERROR [2021-02-16 12:19:51.97]:     80:     UI.important "Failed count: #{result[:failed].count}"
ERROR [2021-02-16 12:19:51.97]:     81:     UI.important "Success count: #{result[:passing].count}"
ERROR [2021-02-16 12:19:51.97]:  => 82:     UI.important "Skipped count: #{result[:skipped].count}"
ERROR [2021-02-16 12:19:51.97]:     83: end
INFO [2021-02-16 12:19:51.98]: Successfully generated documentation at path '/Users/alexeysomov/Documents/github/test_project/fastlane/README.md'

+------+----------------------------+-------------+
|                fastlane summary                 |
+------+----------------------------+-------------+
| Step | Action                     | Time (in s) |
+------+----------------------------+-------------+
| 1    | Verifying fastlane version | 0           |
| 2    | default_platform           | 0           |
| 3    | Verifying fastlane version | 0           |
| 4    | default_platform           | 0           |
| 5    | import_from_git            | 3           |
| 6    | tests_from_xcresult        | 0           |
+------+----------------------------+-------------+

DEBUG [2021-02-16 12:19:51.98]: All plugins are up to date
ERROR [2021-02-16 12:19:51.98]: fastlane finished with errors

Looking for related GitHub issues on fastlane/fastlane...
Search query: undefined method `count' for nil

URL: https://api.github.com/search/issues?q=undefined%20method%20%60count%27%20for%20nil+repo:fastlane/fastlane
➡️   firebase_app_distribution: Faraday::ForbiddenError: [!] the server responded with status 403
    https://github.com/fastlane/fastlane/issues/18170 [closed] 4 💬
    4 days ago

➡️  Dead link provided when `fastlane run appledoc`
    https://github.com/fastlane/fastlane/issues/17503 [closed] 1 💬
    6 weeks ago

➡️  Produce fails to create app on AppStoreConnect with error Bundle ID already used
    https://github.com/fastlane/fastlane/issues/16649 [closed] 37 💬
    11 Oct 2020

and 48 more at: https://github.com/fastlane/fastlane/search?q=undefined%20method%20%60count%27%20for%20nil&type=Issues&utf8=✓

🔗  You can ⌘ + double-click on links to open them directly in your browser.
DEBUG [2021-02-16 12:19:53.50]: All plugins are up to date

#######################################################################
# fastlane 2.174.0 is available. You are on 2.173.0.
# You should use the latest version.
# Please update using `sudo gem install fastlane`.
#######################################################################
# Run `sudo gem cleanup` from time to time to speed up fastlane
#######################################################################

2.174.0 Improvements
* [action] app_store_connect_api_key update App Store Connect API token generation documentation (#18068) via David Brunow
* [action] appetize add timeout support (#18074) via Raul Riera
* [spaceship] expose error also from source (#18150) via Alisher Ulugbekov
* [spaceship] added ASC endpoints for bundle id & bundle id capability (#18080) via Dinsen
* [action] - cocoapods - add allow_root option (#18076) via Atsuto Yamashita
* [fastlane_core] improve config item validation conversion and use UI.error instead of puts to report validation exception (#18088) via Gio Lodi
* [action]  push_to_git_remote - fix "undefined method 'each' for NilClass" error (#18153) via Neil Cowburn
* [spaceship] explicitly allow to continue 2FA in non-interactive mode (#18109) via Oleg Kohtenko
* [action] carthage - add use_xcframeworks option (#18090) via Atsuto Yamashita
* [carthage] Add archive option (#18077) via Atsuto Yamashita
* [spaceship] fixed typo (#18103) via Atsuto Yamashita
* [action] xcov - fix compatibility issues for plugins depending on FastlaneCore::Project (#18053) via Satoshi Namai

Please update using `sudo gem install fastlane`
Traceback (most recent call last):
    18: from /Users/alexeysomov/.rbenv/versions/2.5.0/bin/fastlane:23:in `<main>'
    17: from /Users/alexeysomov/.rbenv/versions/2.5.0/bin/fastlane:23:in `load'
    16: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/bin/fastlane:23:in `<top (required)>'
    15: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/cli_tools_distributor.rb:122:in `take_off'
    14: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/commands_generator.rb:41:in `start'
    13: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/commands_generator.rb:352:in `run'
    12: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/delegates.rb:15:in `run!'
    11: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane_core/lib/fastlane_core/ui/fastlane_runner.rb:76:in `run!'
    10: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/runner.rb:476:in `run_active_command'
     9: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:153:in `run'
     8: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:178:in `call'
     7: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/commands_generator.rb:108:in `block (2 levels) in run'
     6: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/command_line_handler.rb:36:in `handle'
     5: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/lane_manager.rb:47:in `cruise_lane'
     4: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:45:in `execute'
     3: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:45:in `chdir'
     2: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:49:in `block in execute'
     1: from /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/lane.rb:33:in `call'
Fastfile:82:in `block in parsing_binding': [!] undefined method `count' for nil:NilClass (NoMethodError)

And that's a test lane:

desc 'Test run'
lane :test_run do |options|
    fastlane_require 'fastlane-plugin-test_center'

    result = tests_from_xcresult(xcresult: File.join("./fastlane/", "test.xcresult"))

    UI.important "Failed count: #{result[:failed].count}"
    UI.important "Success count: #{result[:passing].count}"
    UI.important "Skipped count: #{result[:skipped].count}"
end

Using the same xcresult I sent before

lyndsey-ferguson commented 3 years ago

It doesn't look like it is actually using the gem with the change. Can you run it via:

bundle exec fastlane test_run --verbose

?

alexnot95 commented 3 years ago

Weird, now receiving shell error

alexeysomov@MacBook-Pro-Alexey test_project % bundle exec fastlane test_run --verbose
[✔] 🚀 
DEBUG [2021-02-16 15:54:26.47]: Checking if there are any plugins that should be loaded...
DEBUG [2021-02-16 15:54:26.47]: Loading 'fastlane-plugin-update_provisioning_profile_specifier' plugin
INFO [2021-02-16 15:54:26.47]: gem 'fastlane-plugin-update_provisioning_profile_specifier' is already installed
DEBUG [2021-02-16 15:54:26.47]: Loading 'fastlane-plugin-versioning' plugin
INFO [2021-02-16 15:54:26.47]: gem 'fastlane-plugin-versioning' is already installed
DEBUG [2021-02-16 15:54:26.49]: Loading 'fastlane-plugin-badge' plugin
INFO [2021-02-16 15:54:26.49]: gem 'fastlane-plugin-badge' is already installed
DEBUG [2021-02-16 15:54:26.49]: Loading 'fastlane-plugin-slack_train' plugin
INFO [2021-02-16 15:54:26.49]: gem 'fastlane-plugin-slack_train' is already installed
DEBUG [2021-02-16 15:54:26.49]: Loading 'fastlane-plugin-xchtmlreport' plugin
INFO [2021-02-16 15:54:26.49]: gem 'fastlane-plugin-xchtmlreport' is already installed
DEBUG [2021-02-16 15:54:26.50]: Loading 'fastlane-plugin-appcenter' plugin
INFO [2021-02-16 15:54:26.50]: gem 'fastlane-plugin-appcenter' is already installed
DEBUG [2021-02-16 15:54:26.53]: Loading 'fastlane-plugin-test_center' plugin
INFO [2021-02-16 15:54:26.53]: gem 'fastlane-plugin-test_center' is already installed
+------------------------------------------+---------+-----------------------------------------+
|                                         Used plugins                                         |
+------------------------------------------+---------+-----------------------------------------+
| Plugin                                   | Version | Action                                  |
+------------------------------------------+---------+-----------------------------------------+
| fastlane-plugin-update_provisioning_pro  | 1.3.1   | update_provisioning_profile_specifier   |
| file_specifier                           |         |                                         |
| fastlane-plugin-versioning               | 0.4.4   | get_version_number_from_git_branch      |
|                                          |         | increment_build_number_in_xcodeproj     |
|                                          |         | get_version_number_from_plist           |
|                                          |         | get_build_number_from_plist             |
|                                          |         | ci_build_number                         |
|                                          |         | get_version_number_from_xcodeproj       |
|                                          |         | increment_version_number_in_xcodeproj   |
|                                          |         | increment_version_number_in_plist       |
|                                          |         | get_app_store_version_number            |
|                                          |         | get_info_plist_path                     |
|                                          |         | get_build_number_from_xcodeproj         |
|                                          |         | increment_build_number_in_plist         |
| fastlane-plugin-badge                    | 1.4.0   | add_badge                               |
| fastlane-plugin-slack_train              | 0.2.0   | slack_train_crash slack_train_start     |
|                                          |         | slack_train                             |
| fastlane-plugin-xchtmlreport             | 0.1.1   | xchtmlreport                            |
| fastlane-plugin-appcenter                | 1.11.0  | appcenter_fetch_version_number          |
|                                          |         | appcenter_fetch_devices                 |
|                                          |         | appcenter_upload                        |
| fastlane-plugin-test_center              | 3.15.2  | suppressed_tests suppress_tests         |
|                                          |         | tests_from_xcresult                     |
|                                          |         | suppress_tests_from_junit               |
|                                          |         | tests_from_xctestrun                    |
|                                          |         | quit_core_simulator_service             |
|                                          |         | collate_test_result_bundles             |
|                                          |         | tests_from_junit multi_scan             |
|                                          |         | test_options_from_testplan              |
|                                          |         | collate_html_reports                    |
|                                          |         | collate_junit_reports                   |
|                                          |         | collate_json_reports                    |
|                                          |         | testplans_from_scheme collate_xcresults |
+------------------------------------------+---------+-----------------------------------------+

Successfully loaded Appfile at path '/Users/alexeysomov/Documents/github/test_project/fastlane/Appfile'
- app_identifier: 'test_project'
- apple_id: 'test_project'
- team_id: 'test_project'
- itc_team_id: 'test_project'
- itc_team_name: 'test_project'
-------
INFO [2021-02-16 15:54:28.99]: ----------------------------------------
INFO [2021-02-16 15:54:28.99]: --- Step: Verifying fastlane version ---
INFO [2021-02-16 15:54:28.99]: ----------------------------------------
INFO [2021-02-16 15:54:28.99]: Your fastlane version 2.173.0 matches the minimum requirement of 2.173.0  ✅
INFO [2021-02-16 15:54:29.00]: ------------------------------
INFO [2021-02-16 15:54:29.00]: --- Step: default_platform ---
INFO [2021-02-16 15:54:29.00]: ------------------------------
INFO [2021-02-16 15:54:29.28]: gem 'uri' is already installed
INFO [2021-02-16 15:54:29.28]: gem 'json' is already installed
INFO [2021-02-16 15:54:29.57]: gem 'net/http' is already installed
INFO [2021-02-16 15:54:29.81]: gem 'fileutils' is already installed
INFO [2021-02-16 15:54:30.12]: gem 'set' is already installed
INFO [2021-02-16 15:54:30.12]: gem 'aws-sdk-s3' is already installed
INFO [2021-02-16 15:54:30.43]: gem 'net/http' is already installed
INFO [2021-02-16 15:54:30.70]: gem 'uri' is already installed
INFO [2021-02-16 15:54:30.70]: gem 'json' is already installed
INFO [2021-02-16 15:54:30.70]: gem 'plist' is already installed
INFO [2021-02-16 15:54:30.70]: -----------------------------
INFO [2021-02-16 15:54:30.70]: --- Step: import_from_git ---
INFO [2021-02-16 15:54:30.70]: -----------------------------
INFO [2021-02-16 15:54:30.70]: Cloning remote git repo...
INFO [2021-02-16 15:54:30.70]: $ git clone git@github.com:test_project/Fastlane.git /var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git --depth 1 --no-checkout 
INFO [2021-02-16 15:54:30.73]: ▸ Cloning into '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git'...
INFO [2021-02-16 15:54:32.95]: $ cd /var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git && git checkout HEAD Fastfile 
INFO [2021-02-16 15:54:32.96]: ▸ Updated 1 path from 2999c28
INFO [2021-02-16 15:54:32.96]: $ cd /var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git && git checkout HEAD ./actions
INFO [2021-02-16 15:54:32.98]: ▸ Updated 11 paths from 2999c28
INFO [2021-02-16 15:54:32.98]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/verification_format.rb'.
INFO [2021-02-16 15:54:32.98]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/global_generate_analytics.rb'.
INFO [2021-02-16 15:54:32.98]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/download_translations.rb'.
INFO [2021-02-16 15:54:32.98]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/find_localization_dublicates.rb'.
INFO [2021-02-16 15:54:32.98]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/resolve_release_build_number.rb'.
INFO [2021-02-16 15:54:32.99]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/format_target_translations_verification.rb'.
INFO [2021-02-16 15:54:32.99]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/upload_target_translations.rb'.
INFO [2021-02-16 15:54:32.99]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/download_target_translations.rb'.
INFO [2021-02-16 15:54:32.99]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/check_lost_files.rb'.
INFO [2021-02-16 15:54:32.99]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/download_analytics.rb'.
INFO [2021-02-16 15:54:32.99]: Successfully loaded custom action '/var/folders/tq/1n2j7ky11b95mdnxd3__k4c40000gn/T/fl_clone20210216-45735-1pg3fmv/Fastlane.git/actions/resolve_release_build_version.rb'.
INFO [2021-02-16 15:54:33.83]: gem 'spaceship' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'fastlane-plugin-update_provisioning_profile_specifier' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'fastlane-plugin-versioning' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'fastlane-plugin-badge' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'fastlane-plugin-slack_train' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'json' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'xcodeproj' is already installed
INFO [2021-02-16 15:54:33.91]: gem 'jira-ruby' is already installed
INFO [2021-02-16 15:54:34.29]: gem 'versionomy' is already installed
INFO [2021-02-16 15:54:34.33]: ----------------------------------------
INFO [2021-02-16 15:54:34.33]: --- Step: Verifying fastlane version ---
INFO [2021-02-16 15:54:34.33]: ----------------------------------------
INFO [2021-02-16 15:54:34.33]: Your fastlane version 2.173.0 matches the minimum requirement of 2.158.0  ✅
INFO [2021-02-16 15:54:34.33]: ------------------------------
INFO [2021-02-16 15:54:34.33]: --- Step: default_platform ---
INFO [2021-02-16 15:54:34.33]: ------------------------------
INFO [2021-02-16 15:54:34.34]: Driving the lane 'test_run' 🚀
INFO [2021-02-16 15:54:34.34]: gem 'fastlane-plugin-test_center' is already installed
INFO [2021-02-16 15:54:34.34]: ---------------------------------
INFO [2021-02-16 15:54:34.34]: --- Step: tests_from_xcresult ---
INFO [2021-02-16 15:54:34.34]: ---------------------------------
WARN [2021-02-16 15:54:34.39]: Fail? with 'test_run' Exception Shell command exited with exit status 1 instead of 0. 
WARN [2021-02-16 15:54:34.39]: Lane Context:
INFO [2021-02-16 15:54:34.39]: {:DEFAULT_PLATFORM=>:ios, :PLATFORM_NAME=>nil, :LANE_NAME=>"test_run"}
ERROR [2021-02-16 15:54:34.39]: Shell command exited with exit status 1 instead of 0.
INFO [2021-02-16 15:54:34.39]: Successfully generated documentation at path '/Users/alexeysomov/Documents/github/test_project/fastlane/README.md'

+------+----------------------------+-------------+
|                fastlane summary                 |
+------+----------------------------+-------------+
| Step | Action                     | Time (in s) |
+------+----------------------------+-------------+
| 1    | Verifying fastlane version | 0           |
| 2    | default_platform           | 0           |
| 3    | Verifying fastlane version | 0           |
| 4    | default_platform           | 0           |
| 5    | import_from_git            | 3           |
| 💥   | tests_from_xcresult        | 0           |
+------+----------------------------+-------------+

DEBUG [2021-02-16 15:54:34.41]: All plugins are up to date
ERROR [2021-02-16 15:54:34.41]: fastlane finished with errors

Looking for related GitHub issues on fastlane/fastlane...
Search query: Shell command exited with exit status 1 instead of 0.

URL: https://api.github.com/search/issues?q=Shell%20command%20exited%20with%20exit%20status%201%20instead%20of%200.+repo:fastlane/fastlane
➡️  Improve Beta Setup
    https://github.com/fastlane/fastlane/pull/1 [closed] 1 💬
    04 Feb 2017

➡️  fastlane notarize fails during staple even though the package is approved
    https://github.com/fastlane/fastlane/issues/17667 [open] 6 💬
    3 days ago

➡️  FastlaneCore::Interface::FastlaneShellError: [!] Shell command exited with exit status 51 instead of 0.
    https://github.com/fastlane/fastlane/issues/16885 [closed] 1 💬
    19 Sep 2020

and 83 more at: https://github.com/fastlane/fastlane/search?q=Shell%20command%20exited%20with%20exit%20status%201%20instead%20of%200.&type=Issues&utf8=✓

🔗  You can ⌘ + double-click on links to open them directly in your browser.
DEBUG [2021-02-16 15:54:35.91]: All plugins are up to date

#######################################################################
# fastlane 2.174.0 is available. You are on 2.173.0.
# You should use the latest version.
# Please update using `bundle update fastlane`.
#######################################################################

2.174.0 Improvements
* [action] app_store_connect_api_key update App Store Connect API token generation documentation (#18068) via David Brunow
* [action] appetize add timeout support (#18074) via Raul Riera
* [spaceship] expose error also from source (#18150) via Alisher Ulugbekov
* [spaceship] added ASC endpoints for bundle id & bundle id capability (#18080) via Dinsen
* [action] - cocoapods - add allow_root option (#18076) via Atsuto Yamashita
* [fastlane_core] improve config item validation conversion and use UI.error instead of puts to report validation exception (#18088) via Gio Lodi
* [action]  push_to_git_remote - fix "undefined method 'each' for NilClass" error (#18153) via Neil Cowburn
* [spaceship] explicitly allow to continue 2FA in non-interactive mode (#18109) via Oleg Kohtenko
* [action] carthage - add use_xcframeworks option (#18090) via Atsuto Yamashita
* [carthage] Add archive option (#18077) via Atsuto Yamashita
* [spaceship] fixed typo (#18103) via Atsuto Yamashita
* [action] xcov - fix compatibility issues for plugins depending on FastlaneCore::Project (#18053) via Satoshi Namai

Please update using `bundle update fastlane`
bundler: failed to load command: fastlane (/Users/alexeysomov/.rbenv/versions/2.5.0/bin/fastlane)
FastlaneCore::Interface::FastlaneShellError: [!] Shell command exited with exit status 1 instead of 0.
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane_core/lib/fastlane_core/ui/interface.rb:153:in `shell_error!'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane_core/lib/fastlane_core/ui/ui.rb:17:in `method_missing'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/helper/sh_helper.rb:80:in `sh_control_output'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/bundler/gems/fastlane-plugin-test_center-9d39393fee86/lib/fastlane/plugin/test_center/actions/tests_from_xcresult.rb:16:in `run'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:263:in `block (2 levels) in execute_action'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/actions/actions_helper.rb:69:in `execute_action'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:255:in `block in execute_action'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:229:in `chdir'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:229:in `execute_action'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:157:in `trigger_action_by_name'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/fast_file.rb:159:in `method_missing'
  Fastfile:76:in `block in parsing_binding'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/lane.rb:33:in `call'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:49:in `block in execute'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:45:in `chdir'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/runner.rb:45:in `execute'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/lane_manager.rb:47:in `cruise_lane'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/command_line_handler.rb:36:in `handle'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/commands_generator.rb:108:in `block (2 levels) in run'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:178:in `call'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/command.rb:153:in `run'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/runner.rb:476:in `run_active_command'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane_core/lib/fastlane_core/ui/fastlane_runner.rb:76:in `run!'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/commander-fastlane-4.4.6/lib/commander/delegates.rb:15:in `run!'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/commands_generator.rb:352:in `run'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/commands_generator.rb:41:in `start'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/fastlane/lib/fastlane/cli_tools_distributor.rb:122:in `take_off'
  /Users/alexeysomov/.rbenv/versions/2.5.0/lib/ruby/gems/2.5.0/gems/fastlane-2.173.0/bin/fastlane:23:in `<top (required)>'
  /Users/alexeysomov/.rbenv/versions/2.5.0/bin/fastlane:23:in `load'
  /Users/alexeysomov/.rbenv/versions/2.5.0/bin/fastlane:23:in `<top (required)>'
lyndsey-ferguson commented 3 years ago

Run this command

xcrun xcresulttool get --path ./fastlane/test.xcresult --format json

From fastlane's parent directory. It should fail and tell you what the problem is.

alexnot95 commented 3 years ago

@lyndsey-ferguson found the problem, looks like everything works as expected, thank you for your support, I think you can merge your PR :)

lyndsey-ferguson commented 3 years ago

Released in v3.15.3