Distributed filesystem - Githubissues

hammerlab / stratocumulus

DEPRECATED: we don't really maintain this any more, we use Coclobas:

https://github.com/hammerlab/coclobas

Apache License 2.0

2 stars 0 forks source link

Distributed filesystem #7

Open smondet opened 8 years ago

smondet commented 8 years ago

http://www.gluster.org/ ?
http://ceph.com/
http://www.orangefs.org/

hammer commented 8 years ago

It would be useful to know why we want a distributed filesystem to help guide our selection

smondet commented 8 years ago

@hammer I think we want a /scratch directory with something that provides a POSIX filesystem but faster than NFS when a bunch nodes/processes are read/writing simultaneously.

hammer commented 8 years ago

@smondet what do you mean by "faster"? which resource are we saturating on a single-node NFS mount?

smondet commented 8 years ago

@hammer I think at home, we saturate the server itself. But I have no real data. And maybe, on GCloud, one NFS server per "Dataset" will be fast enough for our use-cases.