Aiven-Open / tiered-storage-for-apache-kafka

RemoteStorageManager for Apache Kafka® Tiered Storage

Apache License 2.0

95 stars 20 forks source link

Tiered Storage Plugin Implementation for Azure Blob Storage #421

Closed piyush-gupta1999 closed 9 months ago

piyush-gupta1999 commented 1 year ago

What is currently missing?

Currently, this implementation is missing a plugin for Azure Blob Storage.

How could this be improved?

We need a TS plugin to push data to Azure Blob Storage.

Is this a feature you would work on yourself?

I can work on this feature. I need some guidance to work.

ivanyu commented 1 year ago

Hi @piyush-gupta1999 Thanks for your interest in the plugin! The team is working on it at the moment and soon the PR will be created. You're welcome to review!

piyush-gupta1999 commented 1 year ago

Hi @ivanyu, Thank you for your quick response. I am from the HDInsight Team from Microsoft India. Our Team offers Managed Service Kafka on Azure Infra. I am interested in understanding which storage accounts you are offering from Azure. Example - WASB, ABFS.

ivanyu commented 1 year ago

And here comes the PR: https://github.com/Aiven-Open/tiered-storage-for-apache-kafka/pull/424 @piyush-gupta1999 if you have a chance to look, your review is most welcome!

ivanyu commented 1 year ago

I am interested in understanding which storage accounts you are offering from Azure. Example - WASB, ABFS

If I understand this right, we're basically focusing on Blob Storage on HTTP.

jeqo commented 9 months ago

Closing this as azure blob storage is already implemented.

@piyush-gupta1999 let us know if the current implementation looks good to you or if there's any missing feature to consider. Thanks!