CI Failure (key symptom) in `RedpandaUpgradeTest.test_workloads_through_releases`

[vbotbuildovich]

https://buildkite.com/redpanda/vtools/builds/15979

Module: rptest.tests.workload_upgrade_runner_test
Class: RedpandaUpgradeTest
Method: test_workloads_through_releases
Arguments: {
    "cloud_storage_type": 1
}

test_id:    RedpandaUpgradeTest.test_workloads_through_releases
status:     FAIL
run time:   1493.243 seconds

ClientError('An error occurred (AuthenticationRequired) when calling the ListBuckets operation: Authentication required.')
Traceback (most recent call last):
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 530, in list_objects
    res = self._list_objects(bucket=bucket,
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 47, in do_retry
    return fn(*args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 503, in _list_objects
    return client.list_objects_v2(Bucket=bucket,
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 964, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AuthenticationRequired) when calling the ListObjectsV2 operation: Authentication required.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 215, in wrapped
    self.redpanda.stop_and_scrub_object_storage()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 4719, in stop_and_scrub_object_storage
    report = self._get_object_storage_report(timeout=scrub_timeout)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 4650, in _get_object_storage_report
    bucket_arity = sum(1 for _ in self.get_objects_from_si())
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 4650, in <genexpr>
    bucket_arity = sum(1 for _ in self.get_objects_from_si())
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 541, in list_objects
    for k, v in self.list_buckets(client=client).items():
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 564, in list_buckets
    return client.list_buckets()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 964, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AuthenticationRequired) when calling the ListBuckets operation: Authentication required.

JIRA Link: CORE-6666

[rpdevmp]

Duplicate of #21624 That GH issue has all the details of many tests failing, and what are the steps to avoid similar cases in the future, where many CI failures got opened based on similar infra errors. Updating Github automatically and AWS with FIPS run should be fixed by https://github.com/redpanda-data/vtools/pull/3018

[rpdevmp]

Re-opening, looks like this is a different issues and might need investigation