cubefs / cubefs

cloud-native distributed storage
https://cubefs.io
Apache License 2.0
4.7k stars 668 forks source link

Reduce metadata storage costs, persist metadata in metadata storage, and dynamically load into memory #1502

Open leonrayang opened 2 years ago

leonrayang commented 2 years ago

Is your feature request related to a problem? Please describe. Reduce metadata storage costs, persist metadata in metadata storage, and dynamically load into memory Not all metadata is accessed frequntly, the cost of metadata in EB data cluster is absolutely considerable

Describe the solution you'd like compatibility , performance, statbility take Rocksdb into consideration

Huweicai commented 2 years ago

Maybe we can expose this feature by adding a switch for volume, sometimes some volumes are only used for data backup, may no access traffic at all.