search

apache / opendal

Apache OpenDAL: access data freely.
https://opendal.apache.org
Apache License 2.0
3.26k stars 454 forks source link

new feature: Options API for `object_store` #5115

Open linhr opened 1 week ago

linhr commented 1 week ago

Feature Description

The object_store::ObjectStore trait has APIs such as put_opts(), put_multipart_opts() and get_opts(). It would be desirable to implement these APIs in the OpenDAL integration.

Problem and Solution

In the OpenDAL integration, these APIs return an "unimplemented" error, since #3713. I guess it might be possible to process the object_store options in the arguments and convert them to OpenDAL operations. I'm not sure if all the options can be supported though.

Additional Context

I'm using Apache DataFusion to build query engines. DataFusion uses the object_store::ObjectStore trait and its options API, and I'd like to adapt it to OpenDAL so that more data sources can be integrated.

Are you willing to contribute to the development of this feature?

Xuanwo commented 1 week ago

Thank you very much for completing this. I will look into the API to see how we can implement it.