ops-java-e2e-cloud-functions-gen2 check is continuously failing for all PRs

GoogleCloudPlatform / opentelemetry-operations-java

Apache License 2.0

71 stars 38 forks source link

ops-java-e2e-cloud-functions-gen2 check is continuously failing for all PRs #268

Closed psx95 closed 10 months ago

psx95 commented 10 months ago

Last PR with passing check for ops-java-e2e-cloud-functions-gen2 was #256 (merged on Jun 16, 2023).

Since then, there have been 2 PRs which were merged with failing checks (#257 and #260)

Error Description:

The tests failing in this check is - TestBasicTrace - other supporting tests are passing. Error:

Retrying GetTrace: googleapi: Error 404: Requested entity was not found., notFound

Notes

Re-ran this failing check multiple times to rule out the possibility of a transient error.

dashpole commented 10 months ago

As the likely cause of failures, i'll take an initial look at this

dashpole commented 10 months ago

My finding is that the span is correctly generated, but doesn't appear for a significant amount of time after the current test finishes. Increasing the timeout from 10s to 90s here results in the test passing: https://github.com/GoogleCloudPlatform/opentelemetry-operations-java/pull/270/checks?check_run_id=18730374111.

Given that the test passes consistently for other languages, I suspect it is an issue with the java function, rather than the test framework. I'm going to try switching from the batch span processor to the synchronous one