Open ryscheng opened 6 months ago
Another option if we want IPFS support https://filebase.com/pricing/
Let's do this monthly for now, we can increase frequency later
Sharing that the R2 + Filebase combo is really sweet! You can use the same S3 API (probably a Dagster resource) to push data to both. The only requirements for Filebase would be to package all the tables into a car
archie though.
This might be superceded by a better lakehouse approach https://github.com/opensource-observer/oso/issues/1209
TBD
CC @ravenac95 apparently Cloudflare R2 has free egress! https://developers.cloudflare.com/r2/pricing/