qubole / streamx

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Apache License 2.0
97 stars 54 forks source link

Support Openstack Swift object store #42

Open airbots opened 7 years ago

airbots commented 7 years ago

Openstack Swift is also widely used object store. Many vendors like rackspace, Oracle, etc. It will be nice to support Openstack Swift as well.

PraveenSeluka commented 7 years ago

Hi @airbots Do you have your own deployment of Swift ? if hadoop file system for swift is stable, it will be easy to make it work with StreamX - do you have any experience with that ?

airbots commented 6 years ago

Yes, I create cloudstream (similar changes as streamx did for s3 based on hdfs connector) for kafka to access swift object store. It is in my github repository.