hashicorp / go-getter

Package for downloading things from a string URL using a variety of protocols.
Mozilla Public License 2.0
1.65k stars 232 forks source link

Downloading an un-archived file from artifact does not work (S3) #486

Open agarfer1 opened 5 months ago

agarfer1 commented 5 months ago

This is failing for private buckets, I have not tried in a public one.

Nomad version:

Nomad v1.7.7 BuildDate 2024-04-16T19:26:43Z Revision 0f34c85ee63f6472bd2db1e2487611f4b176c70c

Ubuntu 22.04.3 LTS x64

Downloading a simple file that is not archived:

artifact {
      source = "s3://random-bucket-54548.s3-us-east-1.amazonaws.com/results/random-file.json"
      destination = "local/random-file.json"
}

Does not work, it generates this error:

failed to download artifact "s3://random-bucket-54548.s3-us-east-1.amazonaws.com/results/random-file.json":
 getter subprocess failed: exit status 1: failed to download artifact: AccessDenied: Access Denied status code: 403,
 request id: SDF7[...], host id: bpJJ[...]

If the same file is compressed as .tar.gz , it will be unarchived correctly.