googleapis / google-cloud-java

Google Cloud Client Library for Java
https://cloud.google.com/java/docs/reference
Apache License 2.0
1.89k stars 1.06k forks source link

`ITAddressesTest` is flaky #10902

Open diegomarquezp opened 3 months ago

diegomarquezp commented 3 months ago

https://github.com/googleapis/google-cloud-java/blob/main/java-compute/google-cloud-compute/src/test/java/com/google/cloud/compute/v1/integration/ITAddressesTest.java

Failing integration test check

com.google.cloud.compute.v1.integration.ITAddressesTest
20:21:17:526 [ERROR] com.google.cloud.compute.v1.integration.ITAddressesTest.testList -- Time elapsed: 1.558 s <<< ERROR!
java.lang.RuntimeException: Insert operation failed.
    at com.google.cloud.compute.v1.integration.ITAddressesTest.insertAddress(ITAddressesTest.java:121)
   ...
Caused by: java.util.concurrent.ExecutionException: com.google.api.gax.rpc.PermissionDeniedException: Operation with name "operation-1717014073929-6199d7df36e08-985f4196-d106a138" failed with status = HttpJsonStatusCode{statusCode=PERMISSION_DENIED} and message = FORBIDDEN

Links:

diegomarquezp commented 3 months ago

A local run of the tests was successful

[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.07 s -- in com.google.cloud.compute.v1.integration.ITHeadersTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.46 s -- in com.google.cloud.compute.v1.integration.ITAddressesTest
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.63 s -- in com.google.cloud.compute.v1.integration.ITPaginationTest
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 856.7 s -- in com.google.cloud.compute.v1.integration.ITSmokeInstancesTest
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.07 s -- in com.google.cloud.compute.v1.integration.ITHeadersTest
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.46 s -- in com.google.cloud.compute.v1.integration.ITAddressesTest
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.63 s -- in com.google.cloud.compute.v1.integration.ITPaginationTest
[INFO] Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 856.7 s -- in com.google.cloud.compute.v1.integration.ITSmokeInstancesTest

I set the GOOGLE_APPLICATION_CREDENTIALS env var + setting GOOGLE_CLOUD_PROJECT to a personal one

diegomarquezp commented 3 months ago

It has lately passed, so this is a flake

diegomarquezp commented 3 months ago

The GraalVM ones started to consistently fail after 15:23 of today image

The plain integration job is failing in a flaky fashion image

diegomarquezp commented 3 months ago

Quick note: me and @blakeli0 confirmed that the tests pass on a local run using a different GCP project.