apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.48k stars 970 forks source link

[Feature] 添加 华为云obs支持 #4142

Closed fengDianDemaNong closed 2 months ago

fengDianDemaNong commented 2 months ago

Search before asking

Motivation

华为云对象存储分为两种: 普通对象存储obs:https://support.huaweicloud.com/helppanel-obs/obs_98_0001.html 大数据场景下对象存储 obs(并行文件系统):https://support.huaweicloud.com/usermanual-obs/obs_13_0007.html 其中并行文件系统不支持s3协议,没法通过s3协议的方式访问。导致使用paimon没法使用,只能使用低性能的 普通obs。

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

fengDianDemaNong commented 2 months ago

这是我的实现:https://github.com/apache/paimon/pull/4149

JingsongLi commented 2 months ago

Hi @fengDianDemaNong , this is in Apache community, please use English. Thanks!

JingsongLi commented 2 months ago

Close this first, feel free to re-open this if you can use English.