Adds support for IRSA (IAM Roles for SerivceAccount) authentication for S3. IRSA is a mechanism to tie IAM permissions to a particular service account.
This PR also ensures that we do not recreate the storage provider during the checkpointing and compaction processes and removes some GCS-specific caching infrastructure that is no longer necessary.
Adds support for IRSA (IAM Roles for SerivceAccount) authentication for S3. IRSA is a mechanism to tie IAM permissions to a particular service account.
This PR also ensures that we do not recreate the storage provider during the checkpointing and compaction processes and removes some GCS-specific caching infrastructure that is no longer necessary.
Closes #645