Flank / flank

:speedboat: Massively parallel Android and iOS test runner for Firebase Test Lab
https://firebase.community/
Apache License 2.0
680 stars 115 forks source link

new yaml-config throws permission error for gcloud storage bucket -> old config is working #529

Closed andreschab90 closed 5 years ago

andreschab90 commented 5 years ago

Exception in thread "main" picocli.CommandLine$ExecutionException: Error while running command (ftl.cli.firebase.test.android.AndroidRunCommand@70efb718): com.google.cloud.storage.StorageException: xxx@yyy.com does not have storage.buckets.list access to project 1234.

Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden { "code" : 403, "errors" : [ { "domain" : "global", "message" : "xxx@yyy.com does not have storage.buckets.list access to project 1234.", "reason" : "forbidden" } ], "message" : "xxx@yyy.com does not have storage.buckets.list access to project 1234." }

old yaml config

gcloud:
  results-bucket: 123
  results-dir: build-$BITRISE_BUILD_NUMBER
  record-video: true
  timeout: 30m
  async: false
  project: 1234
  results-history-name: xxx
  flaky-test-attempts: 1
  app: $BITRISE_APK_PATH
  test: $BITRISE_TEST_APK_PATH
  auto-google-login: false
  use-orchestrator: true
  environment-variables:
    clearPackageData: true
  performance-metrics: true
  device:
  - model: walleye
    version: 28
    locale: en
    orientation: portrait

flank:
  testShards: 8
  shardTime: -1
  repeatTests: 1
  smartFlankGcsPath: gs://xxx/yyy/results.xml
  disableSharding: false

new yaml config

gcloud:
  results-bucket: 123
  results-dir: build-$BITRISE_BUILD_NUMBER
  record-video: true
  timeout: 30m
  async: false
  results-history-name: xxx
  flaky-test-attempts: 1
  app: $BITRISE_APK_PATH
  test: $BITRISE_TEST_APK_PATH
  auto-google-login: false
  use-orchestrator: true
  environment-variables:
    clearPackageData: true
  performance-metrics: true
  device:
  - model: walleye
    version: 28
    locale: en
    orientation: portrait

flank:
  max-test-shards: 8
  shard-time: -1
  repeat-tests: 1
  smart-flank-gcs-path: gs://xxx/yyy/results.xml
  disable-sharding: false
  project: 1234
bootstraponline commented 5 years ago

I pushed a fix here: https://github.com/TestArmada/flank/issues/531

Bintray is down which is breaking all the builds. You can test locally with these commands:

git clone --recursive https://github.com/TestArmada/flank.git
cd test_runner/
./gradlew clean build fatJar
java -jar ./build/libs/flank-*.jar android run

Let me know if that resolves the issue.

andreschab90 commented 5 years ago

./gradlew clean build fatJar -> failed because tests were failing -> i can also wait until it's pushed to the snapshot

andreschab90 commented 5 years ago

works with snapshot version