search

aws / aws-cli

Universal Command Line Interface for Amazon Web Services
Other
15.44k stars 4.09k forks source link

Add S3 Config Parameters as Command Line Options #4130

Open mwhouser opened 5 years ago

mwhouser commented 5 years ago

There are several config options for S3 that can be configured via aws configure set and through the config file:

https://docs.aws.amazon.com/cli/latest/topic/s3-config.html

I'd like to see these added as command line options for aws s3 cp. For example:

$ aws s3 cp . s3://bucket/ --recursive --max_concurrent_requests 20

My use case:

Using a CI/CD automation system, I want to copy artifacts to S3. But I want some of these settings to be configurable per build, and to support parallel builds. So setting these via config file would not work for differing values during parallel builds.

justnance commented 5 years ago

@mwhouser - Thank you for your post. I am labeling this as a feature request pending review with the S3 service team. It is possible this feature request needs to be submitted to the service team on their forums first.

tim-finnigan commented 1 year ago

Checking in as this issue hasn't had any activity in a while. @mwhouser have you tried configuring named profiles for this use case? I saw a related issue (https://github.com/aws/aws-cli/issues/5948) where --profile was used to reference a profile with max_concurrent_requests configured.

mwhouser commented 1 year ago

Our build systems are using ephemeral servers. We do not utilize config profiles at all. All parameters we use are command line parameters and credentials come from EC2 instance profiles. Trying to utilize config profiles would require non-trivial changes to our build system.