opencurve / curve

Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file storage.
https://opencurve.io
Apache License 2.0
2.31k stars 519 forks source link

CurveFS:Support KV storage with better performance as backend #2577

Open ilixiaocui opened 1 year ago

ilixiaocui commented 1 year ago

Some applications of big data, such as Kafka, do not have such high requirements for storage reliability, but have relatively high performance requirements. We hope that Curvefs can support such scenarios.

Currently, Curvefs supports persistence to S3 and Curvebs, but the performance of S3 cannot meet the requirements, and Curvebs has multiple copies, and the cost is relatively high. So I hope that curvefs can support data persistence to kv databases with high performance, such as Redis\Pika\KVRocks and so on.

guojidan commented 8 months ago

I am interested in this issue, please assgin to me

guojidan commented 8 months ago

In my opinion, kv storage same like S3, we can use S3 design, except store data in kv storage

Ziy1-Tan commented 8 months ago

I am interested in this issue, please assgin to me

welcome:)