cats-oss / fastlane-plugin-firebase_test_lab_android

Test your app with Firebase Test Lab with ease using fastlane for Android
MIT License
48 stars 8 forks source link

Processing does not complete #12

Closed iaia closed 4 years ago

iaia commented 4 years ago

fastlane-plugin-firebase_test_lab_android (1.1.0)

I tried this fastlane plugin, but processing didn't complete. This is the log I tried on bitrise. Timeout occurs, because the processing is not completed.

.....
[16:46:49]: ▸ 16:46:49 Stopped logcat recording.
[16:46:49]: ▸ 16:46:49 Done. Test time = 102 (secs)
[16:47:01]: ▸ 16:47:01 Starting results processing. Attempt: 1
[16:49:14]: ▸ 16:49:14 Completed results processing. Time taken = 132 (secs)
[16:49:14]: ▸ 16:49:14 Test is Finished
[16:49:14]: ▸ Robo testing complete.
[16:49:14]: ▸ More details are available at [https://console.firebase.google.com/project/locoguide-android-test/testlab/histories/bh.7839fbe1ad175410/matrices/5612529911411096723].
[16:49:14]: ▸ API [toolresults.googleapis.com] not enabled on project
[16:49:14]: ▸ [321805086667]. Would you like to enable and retry (this will take a
timeout after 5400 seconds

Do I need to set anything configure?

  lane :roboTest do
    firebase_test_lab_android(
      project_id: "XXXX",
      gcloud_service_key_file: "XXXX.json"
      type: "robo",
      devices: [
        {
          model: "walleye",
          version: "28",
          locale: "en_US",
          orientation: "portrait"
        },
      ],
      app_apk: "app/build/outputs/apk/product/debug/app-product-debug.apk",
      timeout: "90s",
      firebase_test_lab_results_bucket: "XXXXXXX",
      extra_options: "--robo-directives mail=MAIL,password=PASS,ignore:layout_forgot_password="
    )
  end
lcdsmao commented 4 years ago

Maybe the timeout: "90s" is too short for your tests? How about set a long timeout?

iaia commented 4 years ago

I change to timeout: "10m". but the result did not change. so I aborted it.

[03:27:53]: ▸ 03:27:53 Test is Pending
[03:28:05]: ▸ 03:28:05 Starting attempt 1.
[03:28:05]: ▸ 03:28:05 Test is Running
[03:28:17]: ▸ 03:28:17 Started logcat recording.
[03:28:17]: ▸ 03:28:17 Preparing device.
[03:28:29]: ▸ 03:28:29 Logging in to Google account on device.
[03:28:41]: ▸ 03:28:41 Installing apps.
[03:28:41]: ▸ 03:28:41 Retrieving Pre-Test Package Stats information from the device.
[03:28:41]: ▸ 03:28:41 Retrieving Performance Environment information from the device.
[03:28:41]: ▸ 03:28:41 Started crash detection.
[03:28:41]: ▸ 03:28:41 Started crash monitoring.
[03:28:41]: ▸ 03:28:41 Started performance monitoring.
[03:28:53]: ▸ 03:28:53 Started video recording.
[03:28:53]: ▸ 03:28:53 Starting robo test.
[03:29:29]: ▸ 03:29:29 Completed robo test.
[03:29:29]: ▸ 03:29:29 Stopped video recording.
[03:29:41]: ▸ 03:29:41 Stopped performance monitoring.
[03:29:41]: ▸ 03:29:41 Stopped crash monitoring.
[03:29:41]: ▸ 03:29:41 Retrieving Post-test Package Stats information from the device.
[03:29:41]: ▸ 03:29:41 Logging out of Google account on device.
[03:29:41]: ▸ 03:29:41 Stopped logcat recording.
[03:29:41]: ▸ 03:29:41 Done. Test time = 40 (secs)
[03:29:41]: ▸ 03:29:41 Starting results processing. Attempt: 1
[03:29:53]: ▸ 03:29:53 Completed results processing. Time taken = 15 (secs)
[03:29:53]: ▸ 03:29:53 Test is Finished
[03:30:06]: ▸ Robo testing complete.
[03:30:06]: ▸ More details are available at [https://console.firebase.google.com/project/locoguide-android-test/testlab/histories/bh.7839fbe1ad175410/matrices/6981922964327614352].
[03:30:06]: ▸ API [toolresults.googleapis.com] not enabled on project
[03:30:06]: ▸ [321805086667]. Would you like to enable and retry (this will take a
Task was aborted
wasabeef commented 4 years ago

@iaia

Thank you for using our tools.

If you look at that log it says you need to enable the Google Cloud Testing API and Cloud Tool Results API.Then search for them from the Google Developers Console API Library page and enable them.

iaia commented 4 years ago

Thanks! I enabled Cloud Tool Results API and solved it. Thank you!

[05:59:51]: ▸ 05:59:51 Test is Finished
[05:59:51]: ▸ Robo testing complete.
[05:59:51]: ▸ More details are available at [https://console.firebase.google.com/project/XXX/testlab/histories/bh.7839fbe1ad175410/matrices/8706470083386246827].
[05:59:52]: Test status: [{"axis_value"=>"walleye-28-en_US-portrait", "outcome"=>"Passed", "test_details"=>"--"}]
[05:59:52]: Finishing...