Failing test(s): TestAccComposer1Environment_withNodeConfig

[SarahFrench]

Failure rates

• 42% since test added on 13th April 2023 (3/7 runs)

Impacted tests

• TestAccComposer1Environment_withNodeConfig

Affected Resource(s)

• google_composer_environment

Nightly build test history

• Link

Message(s)

vcr_utils.go:144: Step 1/3 error: Error running apply: exit status 1
Error: Error waiting to create Environment: Error waiting for Creating Environment: Error code 9, message: Failed to create environment, but no error was surfaced. This can be caused by a lack of proper permissions. Check if this environment's service account tf-test-517893798866630840@[PROJECT_ID].iam.gserviceaccount.com has the 'roles/composer.worker' role and there is no firewall inhibiting internal communications set. In case, it is a Compute default service account it should have Editor permissions. For the required permissions information, please, refer to https://cloud.google.com/composer/docs/how-to/access-control  https://cloud.google.com/composer/docs/troubleshooting-environment-creation page contains more troubleshooting instructions
Couldn't bring up ['airflow-worker'] in time.
Essential objects couldn't be created: ['airflow-worker']
with google_composer_environment.test,
on terraform_plugin_test.tf line 4, in resource "google_composer_environment" "test":
4: resource "google_composer_environment" "test" {
--- FAIL: TestAccComposer1Environment_withNodeConfig (2744.88s)
FAIL

The permission the error mentioned is in place, but maybe could benefit from an explicit dependency set via depends_on

------- Stdout: -------
=== RUN   TestAccComposer1Environment_withNodeConfig
=== PAUSE TestAccComposer1Environment_withNodeConfig
=== CONT  TestAccComposer1Environment_withNodeConfig
    vcr_utils.go:152: Step 1/3 error: Error running apply: exit status 1
        Error: Error waiting to create Environment: Error waiting for Creating Environment: Error code 9, message: Some of the GKE pods failed to become healthy. Please check the GKE logs for details, and retry the operation.
          with google_composer_environment.test,
          on terraform_plugin_test.tf line 4, in resource "google_composer_environment" "test":
           4: resource "google_composer_environment" "test" {
--- FAIL: TestAccComposer1Environment_withNodeConfig (2779.82s)
FAIL

b/299600609

[melinath]

New failure message:

Error: Error waiting to create Environment: Error waiting for Creating Environment: Error code 9, message: Some of the GKE pods failed to become healthy. Please check the GKE logs for details, and retry the operation.

[PeWu]

These are flaky tests. This issue can be closed.

[melinath]

The idea would be to fix the flakiness - leaving open.

[SarahFrench]

I've added another error seen for this test to the issue description - Error code 9, message: Some of the GKE pods failed to become healthy. Please check the GKE logs for details, and retry the operation..

I don't have access to the test environment but it'd be interesting if someone could look at those logs.