Feature Request: Update S3 module with AWS CLI 2.0 SSO integration

mozilla / sccache

Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.

Apache License 2.0

5.85k stars 552 forks source link

Feature Request: Update S3 module with AWS CLI 2.0 SSO integration #2150

Open RobertAlbus opened 7 months ago

RobertAlbus commented 7 months ago

Hi Folks,

This issue in an unrelated project explains the same issue. Currently sccache doesn't pick up credentials when logged into AWS CLI v2 with SSO.

Is it possible to add support for this?

sylvestre commented 7 months ago

To set expectation: as we, Mozilla, don't need it currently, aren't going to work on it. So, contributions are welcome

RobertAlbus commented 6 months ago

Alright, I can look into it. Thanks.

Do you folks not use the S3 back end internally, or are you folks just still using AWS CLI V1? If it's the latter I encourage looking into upgrading.

sylvestre commented 6 months ago

We moved to gcp :)

Saruniks commented 4 months ago

Does anyone know if this should be part of opendal?

RobertAlbus commented 4 months ago

@Saruniks From what I recall when digging into this, the behavior is due to sccache integrating with opendal when opendal only supported environment variables for AWS auth. Today, opendal can automatically load credentials for valid AWS CLI sessions without the use of environment variables. It's been a while since I investigated this, so the details are a bit fuzzy but hopefully correct.