search

apache / opendal

Apache OpenDAL: access data freely.
https://opendal.apache.org
Apache License 2.0
3.24k stars 449 forks source link

new feature: support apache hudi and other open table formats #5065

Closed alberttwong closed 5 days ago

alberttwong commented 2 weeks ago

Feature Description

Would love to see Apache Hudi along with other open table formats

Problem and Solution

support data lakehouse where you have the data in open formats and then you can move your query engine to the data.

Additional Context

Apache Hudi has a rust library that I think you can use https://github.com/apache/hudi-rs

Are you willing to contribute to the development of this feature?

Xuanwo commented 2 weeks ago

Hi, @alberttwong. I believe this issue has been mistakenly raised, as OpenDAL can't support Apache Hudi. Instead, we can integrate OpenDAL support into hudi-rs to access more storage services.

Xuanwo commented 5 days ago

Replaced by https://github.com/apache/hudi-rs/issues/131