storagetransfer.event_driven_aws_transfer_test: test_event_driven_aws_transfer failed

[flaky-bot[bot]]

Note: #11068 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

---

commit: bffae0451f0d6dd4e1346cb513db20e0682c507b buildURL: Build Status, Sponge status: failed

[flaky-bot[bot]]

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (bffae0451f0d6dd4e1346cb513db20e0682c507b), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).

[frankyn]

@JesseLovelace guessing clean up isn't happening after test run and leaving orphaned buckets in AWS account1. Can you take a look at deleting old buckets in tests?

_______________ ERROR at setup of test_event_driven_aws_transfer _______________
Traceback (most recent call last):
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/runner.py", line 341, in from_call
    result: Optional[TResult] = func()
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/runner.py", line 241, in <lambda>
    lambda: runtest_hook(item=item, **kwds), when=when, reraise=reraise
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_hooks.py", line 513, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 139, in _multicall
    raise exception.with_traceback(exception.__traceback__)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 122, in _multicall
    teardown.throw(exception)  # type: ignore[union-attr]
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/unraisableexception.py", line 85, in pytest_runtest_setup
    yield from unraisable_exception_runtest_hook()
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/unraisableexception.py", line 65, in unraisable_exception_runtest_hook
    yield
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 122, in _multicall
    teardown.throw(exception)  # type: ignore[union-attr]
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/logging.py", line 844, in pytest_runtest_setup
    yield from self._runtest_for(item, "setup")
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/logging.py", line 833, in _runtest_for
    yield
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 122, in _multicall
    teardown.throw(exception)  # type: ignore[union-attr]
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/capture.py", line 873, in pytest_runtest_setup
    return (yield)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 122, in _multicall
    teardown.throw(exception)  # type: ignore[union-attr]
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/threadexception.py", line 82, in pytest_runtest_setup
    yield from thread_exception_runtest_hook()
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/threadexception.py", line 63, in thread_exception_runtest_hook
    yield
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 103, in _multicall
    res = hook_impl.function(*args)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/runner.py", line 159, in pytest_runtest_setup
    item.session._setupstate.setup(item)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/runner.py", line 515, in setup
    raise exc
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/runner.py", line 512, in setup
    col.setup()
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/python.py", line 1630, in setup
    self._request._fillfixtures()
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/fixtures.py", line 683, in _fillfixtures
    item.funcargs[argname] = self.getfixturevalue(argname)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/fixtures.py", line 518, in getfixturevalue
    fixturedef = self._get_active_fixturedef(argname)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/fixtures.py", line 603, in _get_active_fixturedef
    fixturedef.execute(request=subrequest)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/fixtures.py", line 1073, in execute
    result = ihook.pytest_fixture_setup(fixturedef=self, request=request)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_hooks.py", line 513, in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_manager.py", line 120, in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 139, in _multicall
    raise exception.with_traceback(exception.__traceback__)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 122, in _multicall
    teardown.throw(exception)  # type: ignore[union-attr]
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/setuponly.py", line 36, in pytest_fixture_setup
    return (yield)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/pluggy/_callers.py", line 103, in _multicall
    res = hook_impl.function(*args)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/fixtures.py", line 1122, in pytest_fixture_setup
    result = call_fixture_func(fixturefunc, request, kwargs)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/_pytest/fixtures.py", line 877, in call_fixture_func
    fixture_result = next(generator)
  File "/workspace/storagetransfer/conftest.py", line 230, in aws_source_bucket
    s3_client.create_bucket(Bucket=bucket_name)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/botocore/client.py", line 565, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/workspace/storagetransfer/.nox/py-3-8/lib/python3.8/site-packages/botocore/client.py", line 1021, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (TooManyBuckets) when calling the CreateBucket operation: You have attempted to create more buckets than allowed
-------- generated xml file: /workspace/storagetransfer/sponge_log.xml ---------

[cojenco]

See https://github.com/GoogleCloudPlatform/python-docs-samples/pull/12044