robinrodricks / FluentStorage

A polycloud .NET cloud storage abstraction layer. Provides Blob storage (AWS S3, GCP, FTP, SFTP, Azure Blob/File/Event Hub/Data Lake) and Messaging (AWS SQS, Azure Queue/ServiceBus). Supports .NET 5+ and .NET Standard 2.0+. Pure C#.
MIT License
263 stars 33 forks source link
abstraction aws aws-s3 aws-sqs azure azure-data-lake azure-event-hub azure-queue azure-service-bus blob blob-storage file file-storage ftp ftps gcp

FluentStorage

Version Downloads GitHub contributors Codacy Badge License

FluentStorage is free, but powered by your donations

One Interface To Rule Them All

FluentStorage, originally known as Storage.NET, is a field-tested polycloud .NET cloud storage library that helps you interface with multiple cloud providers from a single unified interface.

It provides a generic interface for Blob storage across all cloud storage providers (AWS S3, GCP, FTP, SFTP, Azure Blob/File/Event Hub/Data Lake) and cloud messaging providers (AWS SQS, Azure Queue/ServiceBus).

It is written entirely in C#. Supports .NET 5+ and .NET Standard 2.0+. External dependencies are only added by FluentStorage sub-packages.

FluentStorage is released under the permissive MIT License, so it can be used in both proprietary and free/open source applications.

Features

Architecture

Without FluentStorage

Today, most cloud applications and services are developed against vendor-specific APIs like Amazon S3 API or Azure Blob API for cloud storage capabilities.

Using multiple vendor-specific APIs can increase your vendor lock-in, and makes your application more complex and harder to maintain. And sometimes these APIs may not offer all the functionality you need for your application. Polycloud also becomes very hard to implement.

Arch

With FluentStorage

What if we had a single, consistent API to deal with all types of cloud storage? That would solve these issues and bring more flexibility in switching cloud providers or cloud services.

Thus was born the idea for FluentStorage.

You can use a single, consistent API to interact with multiple cloud providers, where each provider is supported through its own special Nuget package.

Arch

Benefits

  1. Easy to write code that is not tied to a specific cloud provider.

  2. Easily switch between different providers without having to rewrite any part of their application or service.

  3. Easily migrate to using a new storage technology for some part of your cloud application (S3 buckets, Azure Blobs, FTP, etc.)

  4. Natively implement polycloud (support for multiple public clouds)

Storage Providers

FluentStorage supports the following cloud storage providers:

Storage Provider Documentation
AWS S3 FluentStorage.AWS
Azure Blobs FluentStorage.Azure.Blobs
Azure Files FluentStorage.Azure.Files
Azure DataLake FluentStorage.Azure.DataLake
Google Cloud Storage FluentStorage.GCP
MinIO FluentStorage.AWS -> MinIO
DigitalOcean Spaces FluentStorage.AWS -> DigitalOcean Spaces
Wasabi FluentStorage.AWS -> Wasabi

Packages

Stable binaries are released on NuGet, and contain everything you need to use Cloud Storage in your .NET app.

Package Latest Version Downloads Documentation
FluentStorage Version Downloads Standard
FluentStorage.AWS Version Downloads S3, SQS
FluentStorage.GCP Version Downloads GCP
FluentStorage.Databricks Version Downloads Databricks
FluentStorage.FTP Version Downloads FTP
FluentStorage.SFTP Version Downloads SFTP
FluentStorage.Azure.Blobs Version Downloads Blob
FluentStorage.Azure.Files Version Downloads File
FluentStorage.Azure.EventHub Version Downloads EventHub
FluentStorage.Azure.ServiceBus Version Downloads ServiceBus
FluentStorage.Azure.KeyVault Version Downloads KeyVault
FluentStorage.Azure.ServiceFabric Version Downloads ServiceFabric
FluentStorage.Azure.Queues Version Downloads Queue
FluentStorage.Azure.DataLake Version Downloads DataLake

Platform Support

FluentStorage works on .NET and .NET Standard/.NET Core.

Platform Binaries Folder
.NET 5.0 net50
.NET 6.0 net60
.NET Standard 2.0 netstandard2.0
.NET Standard 2.1 netstandard2.1

FluentStorage is also supported on these platforms: (via .NET Standard)

Binaries for all platforms are built from a single Visual Studio Project. You will need the latest Visual Studio to build or contribute to FluentStorage.

Documentation

Check the Wiki.

What's New

In 2024, we added:

In 2023, we added:

Supported Cloud Services

Slide

Similar Libraries

Sponsorship

Has FluentStorage made a difference for you or your organization? If so, consider becoming a sponsor to help keep the project thriving. Even a small monthly contribution, like $20, can make a meaningful impact.

As a seasoned freelancer with over a decade of experience, your support helps me continue dedicating time to these open-source projects while also supporting my family. Your contributions directly fuel the work that makes a difference to millions of developers around the world.

Contributors

Special thanks to these awesome people who helped create FluentStorage! Shoutout to Ivan Gavryliuk for the original project Storage.Net.

<img src="https://github.com/robinrodricks/FluentStorage/raw/develop/.github/contributors.png" />