syndicate-storage / syndicate

Internet-scale software-defined storage system
Apache License 2.0
56 stars 10 forks source link

AG-iRODS #101

Open jcnelson opened 10 years ago

jcnelson commented 10 years ago

Develop AG-iRODS; see Illyoung's work.

iychoi commented 10 years ago

Currently, AG and iRODS can be connected via AG-disk driver and iRODS FUSE. Using FUSE interface for conneting iRODS is the simplest but cannot provide notifications of immediate server-side (iRODS side) file system changes.

I'm going to research this part (getting immediate notification from iRODS server and make the complete AG for iRODS) later once I finish polishing iRODS-FUSE modification source code. :-)

jcnelson commented 10 years ago

I went to the iRODS user group meeting in Boston a couple weeks ago. Apparently, iRODS 4.0 (as well as Nirav's installation at Arizona) both implement a message queue that the AG can subscribe to in order to learn when files and metadata get updated.

I got a link from one of the developers to set up our own message queue: https://github.com/DICE-UNC/indexing-irods/blob/master/install.sh

iychoi commented 9 years ago

Jude, are you going to add a new iRODS driver for AG? Just for clear. Currently iRODS can be connected to Syndicate via AG disk driver. However, it seems adding subscribe features to disk driver is improper.

jcnelson commented 9 years ago

Hey Illyoung,

For closing this issue, I think I'm going to leverage your work on iRODS-FUSE and create a recipe for deploying a read-only iRODS AG. I'll go back and add read-write support once this milestone passes.