search

pulumi / pulumi-yaml

YAML language provider for Pulumi
Apache License 2.0
38 stars 11 forks source link

TestExampleGettingStarted is flaky #481

Open abhinav opened 1 year ago

abhinav commented 1 year ago

Hello!

Issue details

TestExampleGettingStarted fails intermittently in CI with output like:

=== NAME  TestExampleGettingStarted
    command.go:103: Wrote output to /tmp/p-it-fv-az622-6-getting-st-2f79f1d3-1677874519/command-output/pulumi-stack-import.20230801-221918.a98fd.log
    program.go:1388: Performing empty preview and update(no changes expected)
    command.go:34: **** Invoke '/opt/hostedtoolcache/pulumi/3.76.1/x64/pulumi preview --non-interactive --diff --expect-no-changes' in '/tmp/p-it-fv-az622-6-getting-st-2f79f1d3-1677874519'

=== NAME  TestExampleGettingStarted
    command.go:83: Invoke '/opt/hostedtoolcache/pulumi/3.76.1/x64/pulumi preview --non-interactive --diff --expect-no-changes' failed: exit status 255
Previewing update (p-it-fv-az622-6-getting-st-2f79f1d3):
  pulumi:pulumi:Stack: (same)
    [urn=urn:pulumi:p-it-fv-az622-6-getting-st-2f79f1d3::simple-yaml::pulumi:pulumi:Stack::simple-yaml-p-it-fv-az622-6-getting-st-2f79f1d3]
    ~ aws:s3/bucketPublicAccessBlock:BucketPublicAccessBlock: (update)
        [id=my-bucket-66b803f]
        [urn=urn:pulumi:p-it-fv-az622-6-getting-st-2f79f1d3::simple-yaml::aws:s3/bucketPublicAccessBlock:BucketPublicAccessBlock::publicAccessBlock]
      ~ blockPublicAcls      : true => false
      ~ blockPublicPolicy    : true => false
      ~ ignorePublicAcls     : true => false
      ~ restrictPublicBuckets: true => false
Resources:
    ~ 1 to update
    4 unchanged
error: error: no changes were expected but changes were proposed

    command.go:103: Wrote output to /tmp/p-it-fv-az622-6-getting-st-2f79f1d3-1677874519/command-output/pulumi-preview-empty.20230801-221923.86eee.log
    program.go:1335: Destroying stack
    command.go:34: **** Invoke '/opt/hostedtoolcache/pulumi/3.76.1/x64/pulumi destroy --non-interactive --yes --skip-preview' in '/tmp/p-it-fv-az622-6-getting-st-2f79f1d3-1677874519'

=== NAME  TestExampleGettingStarted
    command.go:103: Wrote output to /tmp/p-it-fv-az622-6-getting-st-2f79f1d3-1677874519/command-output/pulumi-stack-rm.20230801-221927.ec8a9.log
    program.go:795: 
            Error Trace:    /home/runner/go/pkg/mod/github.com/pulumi/pulumi/pkg/v3@v3.76.1/testing/integration/program.go:795
                                        /home/runner/work/pulumi-yaml/pulumi-yaml/pkg/tests/utils.go:186
                                        /home/runner/work/pulumi-yaml/pulumi-yaml/pkg/tests/example_test.go:61
            Error:          Received unexpected error:
                            running test preview, update, and edits: empty preview: [/opt/hostedtoolcache/pulumi/3.76.1/x64/pulumi preview --non-interactive --diff --expect-no-changes] did not succeed after 1 tries
            Test:           TestExampleGettingStarted
--- FAIL: TestExampleGettingStarted (43.15s)

Example run: https://github.com/pulumi/pulumi-yaml/actions/runs/5732360219/job/15535154654

Affected area/feature