aws requester pays

[MichaelLukowski]

Changing from using https://github.com/uc-cdis/cdis-python-utils/ for generating S3 presigned urls to the new presigned url generator https://github.com/uc-cdis/cirrus/

The main reason this change was made was to enable the requester pays bucket presigned url generation.

To enable requester pays buckets a boolean flag must be added to the bucket configuration. example below

requestor-pays-test-public:
    cred: cdistest
    requester_pays: true
    region: 'us-east-1'

New Features

• Add support for generating presigned urls for requester pay enabled AWS S3 buckets

Improvements

• Use boto3 for AWS S3 presigned url generation
• Move AWS S3 presigned url generation related functionality into gen3cirrus

Deployment changes

• New configuration has been added into Fence config for requester pay enabled AWS S3 buckets, please refer to /fence/config-default.yaml for details

Dependency updates

• gen3cirrus to 3.1.0
• boto3 to 1.35.6

[coveralls]

Pull Request Test Coverage Report for Build 10581704084

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 56 unchanged lines in 2 files lost coverage.
• Overall coverage increased (+0.06%) to 75.333%

---

Files with Coverage Reduction	New Missed Lines	%
blueprints/data/multipart_upload.py	23	26.92%
blueprints/data/indexd.py	33	94.48%
<!--	Total:	56		-->

Totals
Change from base Build 10290555822:	0.06%
Covered Lines:	7803
Relevant Lines:	10358

---

💛 - Coveralls

[mfshao]

not sure why some unit tests begin to fail all of sudden with seems to be harmless changes... still checking