uccross / skyhookdm-ceph-cls

Skyhook Data Management: Storage and management of tabular data in Ceph.
https://www.skyhookdm.com
GNU Lesser General Public License v2.1
13 stars 9 forks source link

Write append new flatbuffer layout to Ceph #23

Closed jlefevre closed 4 years ago

jlefevre commented 5 years ago

Replace the local file write of binary flatbuffer object data with our Ceph writer client to perform write append of binary flatbuffers to their respective object ids (Ceph oid = flatbuffer bucket_id).

Originally Ceph write append flatbuffers was mixed in with issue uccross/skyhookdm-ceph#3; closing that issue and moving Ceph writer portion into this issue.

jlefevre commented 4 years ago

Closing this append for Flatbuffers since we are focusing on Arrow now.