search

TkTech / ckanext-cloudstorage

Implements support for resource storage against multiple popular providers via apache-libcloud (S3, Azure Storage, etc...)
MIT License
35 stars 55 forks source link

Add S3 Requester Pays support #9

Open jqnatividad opened 7 years ago

jqnatividad commented 7 years ago

Data publishers should not be penalized for success.

For data publishers that want to control their bandwidth costs, but still want to give "fast lane" access for high-volume, commercial users, S3's Requester Pays feature is a great option.

When this option is selected when publishing a file, the file will also be published in a Requester Pays bucket.

Since this is an option for advanced users, I think there's no need to go beyond exposing the file download link in the requester pays bucket, with instructions to use s3cmd CLI or a tool like s3browser.

Note this is how Cornell university is distributing bulk data from arxiv.org - https://arxiv.org/help/bulk_data_s3

TkTech commented 7 years ago

Do you have an idea/mockup of how you'd display this in the resource UI? This is simple from a functional standpoint, but harder to display without cluttering the UX. Will definitely need the "How to use" blurb next to it.

Maybe we only show it on the individual resource explorer view, and keep it off the list views?