Xuanwo commented 2 years ago

This tracking issue intends to track the implementations of different underlying storage schemes. Please feel free to take any of them.

Need Tests

This section is used to track services that are waiting for passing integration tests.

[ ] onedrive
[ ] vercel_artifacts
[ ] upyun
[ ] chainsafe
[ ] foundationdb
[ ] atomicserver
[ ] ipfs
[ ] ipmfs
[ ] pcloud

Need Implementation

This section is used to track services that are working on their first release.

[ ] #377
[ ] #408
[ ] https://github.com/apache/incubator-opendal/issues/2639
[ ] https://github.com/apache/incubator-opendal/issues/2640
[ ] #2641
[ ] https://github.com/apache/incubator-opendal/issues/3143
[ ] https://github.com/apache/incubator-opendal/issues/2753
[ ] #3859
[ ] https://github.com/apache/incubator-opendal/issues/2627
[ ] Box

No Started Yet

This section is used to track services that no developers interested in. Please feel free to take one of them.

[ ] Skynet
[ ] Fichier
[ ] Akamai Netstorage
[ ] Citrix ShareFile
[ ] Scaleway Glacier
[ ] Digi Storage
[ ] Dreamhost
[ ] Enterprise File Fabric
[ ] Hetzner Storage Box
[ ] HiDrive
[ ] Hubic
[ ] Jottacloud
[ ] IDrive e2
[ ] Mail.ru Cloud
[ ] OVH
[ ] premiumize.me
[ ] put.io
[ ] Rackspace Cloud Files
[ ] Seagate Lyve Cloud
[ ] StackPath
[ ] Uptobox
[ ] Zoho WorkDrive
[ ] #4035
[ ] https://github.com/apache/incubator-opendal/issues/2708
[x] #3415

Notes

ssh removed: https://github.com/apache/incubator-opendal/issues/2643
China Mobile Ecloud Elastic Object Storage (EOS) removed: No native API (only S3).
github removed: no use cases.
gitlab removed: no use cases.
rsync.net removed: no usable API, requires ssh

teckick commented 2 years ago

Hi! I want to implement the Huawei Object Storage Service backend. Please assign to me. ^_^

Xuanwo commented 2 years ago

Hi! I want to implement the Huawei Object Storage Service backend. Please assign to me. ^_^

Thanks for taking part!

I have created an issue for you: https://github.com/datafuselabs/opendal/issues/512

theshashankpal commented 2 years ago

Hi @Xuanwo , This issue seems to be a good initiation of my journey towards contribution to FOSS projects. Can you please assign this to me?

Xuanwo commented 2 years ago

This issue seems to be a good initiation of my journey towards contribution to FOSS projects.

Thanks for your interest! Which service do you want to work on? I can create a sub-issue and assign it to you.

theshashankpal commented 2 years ago

Hi @Xuanwo , thanks for the reply. I would love to work on Google Drive Storage Service

Xuanwo commented 2 years ago

I would love to work on Google Drive Storage Service

I have created a sub-issue of google drive support at https://github.com/datafuselabs/opendal/issues/654

damooo commented 1 year ago

Next Cloud support in some random future may be worthwhile.

Xuanwo commented 1 year ago

Next Cloud support in some random future may be worthwhile.

Thanks for suggestion, added!

piaoger commented 1 year ago

indexeddb support can be interesting.

imWildCat commented 1 year ago

@Xuanwo do you want to create issues to track dropbox and OneDrive? I can take one or two.

Xuanwo commented 1 year ago

@Xuanwo do you want to create issues to track dropbox and OneDrive? I can take one or two.

Thanks for your interest! https://github.com/datafuselabs/opendal/issues/1098 and https://github.com/datafuselabs/opendal/issues/1099 has been created.

teckick commented 1 year ago

To support https://github.com/datafuselabs/databend/issues/7974, we need delta backend first.

Xuanwo commented 1 year ago

To support datafuselabs/databend#7974, we need delta backend first.

delta is not a storage backend. Instead, we need to port delta to opendal based.

For example:

/// An S3 implementation of the [ObjectStore] trait
///
/// The backend can optionally use [dynamodb_lock] to better support concurrent writers.
pub struct S3StorageBackend {
    inner: Arc<DynObjectStore>,
    s3_lock_client: Option<S3LockClient>,
    /// Whether allowed to performance rename_if_not_exist as rename
    allow_unsafe_rename: bool,
}

Implement this client with opendal.

knight42 commented 1 year ago

Is it reasonable to add etcd to the list? given that etcd is also widely used nowadays.

Xuanwo commented 1 year ago

Is it reasonable to add etcd to the list? given that etcd is also widely used nowadays.

Added.

Gnosnay commented 1 year ago

Do we have any plan to support zookeeper? thx

Xuanwo commented 1 year ago

Do we have any plan to support zookeeper? thx

As of now, there is no existing plan. Would you be interested in utilizing opendal for accessing data stored in zookeeper? Could you provide further information regarding your specific use case?

Gnosnay commented 1 year ago

Do we have any plan to support zookeeper? thx

As of now, there is no existing plan. Would you be interested in utilizing opendal for accessing data stored in zookeeper? Could you provide further information regarding your specific use case?

sorry i dont have actual use case, it is just one idea. (´ཀ`」 ∠)

feel free to close this comment if no plan to do so. thank you for your reply.

Xuanwo commented 1 year ago

sorry i dont have actual use case, it is just one idea. (´ཀ`」 ∠)

Haha, got it. I will add it into the list.

mcronce commented 1 year ago

Is this an appropriate place to request a new storage service be added? If so, I'd like to add Ceph RADOS to the list. If not, apologies!

Xuanwo commented 1 year ago

If so, I'd like to add Ceph RADOS to the list

Thanks for the advice, already added!

gouwazi commented 12 months ago

Hi, can I try opendrive? @Xuanwo

Xuanwo commented 11 months ago

Hi, can I try opendrive? @Xuanwo

Sorry for missing this message. I have created a new issue for you: https://github.com/apache/incubator-opendal/issues/3143

Have fun!

hoslo commented 10 months ago

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

Xuanwo commented 10 months ago

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

This is cool! However, remember that OpenDAL requires its own HttpClient for all HTTP-based services and don't allow third-party crates like alluxio-rs. Are you still interested in implementing it in OpenDAL?

hoslo commented 10 months ago

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

This is cool! However, remember that OpenDAL requires its own HttpClient for all HTTP-based services and don't allow third-party crates like alluxio-rs. Are you still interested in implementing it in OpenDAL?

I think i can

Xuanwo commented 10 months ago

I think i can

Created a new issue at https://github.com/apache/incubator-opendal/issues/3548

hoslo commented 10 months ago

request assign Backblaze B2 support

Xuanwo commented 10 months ago

request assign Backblaze B2 support

Thanks a lot! I have created https://github.com/apache/incubator-opendal/issues/3585, please take a look.

hoslo commented 9 months ago

request assign seafile web api support

Xuanwo commented 9 months ago

seafile

Thanks a lot! Let me create an issue for you.

bokket commented 9 months ago

How about let's support graphql service? In the future,may develop in the direction of webwasm.

Xuanwo commented 9 months ago

How about let's support graphql service? In the future,may develop in the direction of webwasm.

Hi, would you like to share more details about GraphQL? It seems more like a spec instead of a service. We can't implement service upon graphql directly.

hoslo commented 8 months ago

@Xuanwo request assign upyun support

Xuanwo commented 8 months ago

@Xuanwo request assign upyun support

Thank you so much for your enthusiasm! But we can't afford the cost for upyun account so far, would you like to take other services (open source or has free tier) first?

hoslo commented 8 months ago

@Xuanwo request assign upyun support

Thank you so much for your enthusiasm! But we can't afford the cost for upyun account so far, would you like to take other services (open source or has free tier) first?

upyun also has free tier

hoslo commented 8 months ago

@Xuanwo request assign upyun support

Thank you so much for your enthusiasm! But we can't afford the cost for upyun account so far, would you like to take other services (open source or has free tier) first?

upyun also has free tier

@Xuanwo

Xuanwo commented 8 months ago

upyun also has free tier

Feel free to go if you want to do this :heart:

I have created an issue for you: https://github.com/apache/incubator-opendal/issues/3789

hoslo commented 8 months ago

@Xuanwo request assign chainsafe support

https://docs.storage.chainsafe.io/

Xuanwo commented 8 months ago

@Xuanwo request assign chainsafe support

https://docs.storage.chainsafe.io/

Tracked at https://github.com/apache/incubator-opendal/issues/3823

ankit-pn commented 8 months ago

I would like to work on rsync.net. it would be great if you assign this to me. thanks.

Xuanwo commented 8 months ago

I would like to work on rsync.net. it would be great if you assign this to me. thanks.

Hi, upon reviewing rsync.net again, I've confirmed that it doesn't offer an API for interaction; instead, it only supports SSH commands. So I think it's not a good service for use to implement. Would you like to try others?

ankit-pn commented 8 months ago

how about mega?

Xuanwo commented 8 months ago

how about mega?

Looks promising, but it lacks clear API documentation, requiring you to review the source code at https://github.com/t3rm1n4l/go-mega or https://github.com/meganz/sdk/.

ankit-pn commented 8 months ago

I will do it. Pls assign it to me.

hoslo commented 8 months ago

@Xuanwo request assign pCloud support

Xuanwo commented 8 months ago

@Xuanwo request assign pCloud support

I have created https://github.com/apache/incubator-opendal/issues/3888 for you.

bokket commented 8 months ago

Pls assign iCloud.

Xuanwo commented 8 months ago

Pls assign iCloud.

Please take a look at https://github.com/apache/incubator-opendal/issues/2627

shbhmrzd commented 8 months ago

@Xuanwo request assign Box.

apache / opendal

Tracking issue of services support #5

Need Tests

Need Implementation

No Started Yet

Notes