dwyl / technology-stack

🚀 Detailed description + diagram of the Open Source Technology Stack we use for dwyl projects.
284 stars 26 forks source link

Research: Cloud Object Storage #63

Open nelsonic opened 5 years ago

nelsonic commented 5 years ago

We need to decide where to place our "bet" for cloud storage. AWS S3 is one of the most expensive Object Storage Options. BackBlaze is by far the cheapest: https://www.backblaze.com/b2/cloud-storage-pricing.html image According to this post on Reddit: https://www.reddit.com/r/DataHoarder/comments/877z0s/options_for_uk_or_eu_based_cloud_storage_similar BackBlaze are planning to open a Data Centre in Europe in Q3 of 2018 ... If that happens we can use "B2" for all our backups and save 75% of the cost over s3! 😮

matrixik commented 5 years ago

http://gaul.org/object-store-comparison/

nelsonic commented 5 years ago

@matrixik fantastic thanks! 🥇 looks like https://www.online.net/en/c14#pricing is worth considering.

matrixik commented 5 years ago

You need to take into account that some of this services have some catches that are not described on this page (like Wasabi want you to pay up front for 90 days of storage for every file if I remember correctly).

nelsonic commented 5 years ago

@matrixik yeah, Wasabi are catering to people who can plan/forecast their usage requirements. To be fair, if people don't have at least some forecast-ability, they don't really "understand" their App.

https://www.scaleway.com are not yet in the comparison table , because they haven't released their Object Store, but I suspect that their prices are going to be pretty competitive once they release! Considering the price of their SSD-based Virtual Private servers and even "Bare Metal": image https://www.scaleway.com/baremetal-cloud-servers/ image

I'm thinking of using https://www.scaleway.com for my "pet project" (which has no revenue so costs need to be kept as low as possible...)

matrixik commented 5 years ago

https://blog.online.net/2018/10/04/scaleway-object-storage-beta/

nelsonic commented 5 years ago

@matrixik Thanks for sharing! 🥇 Looks like the bandwidth is where they will be making up for their "cheap" storage price: scaleway-object-storage-bandwidth-cost

We may need to do some "arbitrage" when it comes to our object storage costs ... 🤔 but for now, I think Scaleway looks to be the best option for storing large volumes of arbitrary data. 👍 Thanks again! ✨

matrixik commented 5 years ago

BackBlaze and C14 still looks cheaper.

nelsonic commented 5 years ago

@matrixik yeah, our only issue with BackBlaze is location ... 🌎 If they open their EU-based data centre we can comply with EU-only storage laws ⚖️ for some of our more "demanding" clients which have forced us to use AWS S3 until now. 💸

nelsonic commented 11 months ago

Meanwhile ... since the last comment in this thread, BackBlaze has a datacenter in Amsterdam: https://help.backblaze.com/hc/en-us/articles/360034360834-EU-Region-FAQ 🇳🇱 This is perfect for us to stay EU GDPR compliant. 👌