search

ciao-project / ciao

Ciao - Cloud Integrated Advanced Orchestrator
Apache License 2.0
214 stars 51 forks source link

keep metadata for storage with ceph rbd volume #620

Open kaccardi opened 8 years ago

kaccardi commented 8 years ago

Ideally we would store metadata such as an {attribute: value} pair with the actual ceph volume in the ceph cluster. This would allow us to rebuild the controller database by querying the ceph cluster if the storage table is wiped, or else even allow us to stop using the controller database for persistent storage for storage devices.

tpepper commented 7 years ago

NOTE: this would be an improvement for both "image" and "volume" in the OpenStack Glance/Cinder terms. Our metadata stored objects will have metadata. That metadata in ceph instead of disjoint in a separate store is a nice enhancement.

tpepper commented 7 years ago

Rbd supports object key value mappings. I've successfully stored and retrieved key:value data in ceph with the 'rados' command line.

tpepper commented 7 years ago

It looks like the problem is that if using the kernel rbd driver and image format 2, the object-map feature is not (yet?) supported. It works with image format 1.

tpepper commented 7 years ago

See also: http://www.spinics.net/lists/ceph-users/msg27787.html