search

syndicate-storage / syndicate

Internet-scale software-defined storage system
Apache License 2.0
56 stars 10 forks source link

Get RG drivers up to speed with stable interface #63

Open jcnelson opened 10 years ago

jcnelson commented 10 years ago

We already have disk and S3 working. Make sure that we can get them installed and configured automatically.

Glacier, GStorage, Dropbox, and Box.net DO NOT WORK right now. They need to be tested and upgraded to use the latest RG driver API.

muneeb-ali commented 10 years ago

I'll look at this over the weekend and upgrade to the latest driver API.

jcnelson commented 10 years ago

Take a look at the S3 driver architecture--it's already updated :)

muneeb-ali commented 10 years ago

Just looked at it and liking the new organization/interface! I noticed that the other drivers have also moved into folders with respective replica.py files etc. I'm assuming that only S3 complies right now and others need fixing. Looking at Dropbox first.

jcnelson commented 10 years ago

Right. S3 works; disk should work; everything else is as you left it.

I've updated the RG wiki page to describe the new interface. Link: https://github.com/jcnelson/syndicate/wiki/Replica-Gateways

muneeb-ali commented 10 years ago

Very helpful. Thanks! I'll first push Dropbox and we can test it out to see if it complies correctly and then upgrade others in a similar way

jcnelson commented 10 years ago

One aspect of this that needs attention is that the UG will need to pass driver directives to the RG.

To do this, we should add an "RG" and "RG_secret" namespace. RG.$ATTRNAME values will be passed as keyword arguments to the RG, and RG_secret.$ATTRNAME values will be encrypted with the RG's public key first before being sent.

EDIT: Now tracked in issue #105