search

mar-file-system / marfs

MarFS provides a scalable near-POSIX file system by using one or more POSIX file systems as a scalable metadata component and one or more data stores (object, file, etc) as a scalable data component.
Other
96 stars 27 forks source link

marfs_pipe #124

Closed jti-lanl closed 8 years ago

jti-lanl commented 8 years ago

The idea is something like this:

tar -czvf - /scratch/mydir | marfspipe /marfs/mydir.tgz

So, we read from stdin, and write a single stream to a marfs-file named on the commmand-line. More criteria TBD ...

jti-lanl commented 8 years ago

There's a first-cut available:

as root:

cd fuse/src

make marfs_pipe

as user (or root):

$ cat ~jti/source/1x11G/f01 | marfs_pipe /marfs/jti/world/test

Copied 11811160064 bytes (11264.00 MiB) 53.322 sec, 211.2 MiB/s