datamade / how-to

📚 Doing all sorts of things, the DataMade way
MIT License
89 stars 12 forks source link

Proposal: Switch to R2 for large file hosting #363

Closed fgregg closed 2 months ago

fgregg commented 7 months ago

Proposal: Switch to R2 for file hosting.

R2 is a drop-in replacement for S3 sold by cloudflare.

R2's big advantage is ease of setup, and more particularly ease of setting up access credentials.

R2 does not use IAM's instead, you can create API credentials. Here's what that looks like:

Screenshot 2024-04-08 at 12-28-37 Fgregg@datamade us's Account Cloudflare

Click create gives you credentials that you can use everywhere boto or any other client expects AWS credentials.

Disadvantages

antidipyramid commented 2 months ago

The linked s3-credentials patterns seems to be sufficient. And it's best to not have two different s3 providers.