Closed agstephens closed 2 years ago
Requirements:
Level of abstraction: simplify:
putf
Cataloguing and metadata:
Wildcard search:
mc find
mc cp
$ mc find namestore/ag1 --regex ".*.txt" namestore/ag1/output-1.txt namestore/ag1/random/a.txt namestore/ag1/random/b.txt
]$ mc find namestore/ag1 --regex ".*.txt" --exec "mc cp {} random/second/" ....uk/ag1/random/b.txt: 5 B / 5 B ┃▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓┃ 29 B/s 0s
Need a command-line tool
minio
jos
Could you stream it directly from object store into Fortran process?
cat
mc cat namestore/ag1/random/a.txt | sed 's/a/b/g'
Requirements:
Level of abstraction: simplify:
putf
exists to PUT the file, so this exists in minio.Cataloguing and metadata:
Wildcard search:
mc find
andmc cp
, e.g.:]$ mc find namestore/ag1 --regex ".*.txt" --exec "mc cp {} random/second/" ....uk/ag1/random/b.txt: 5 B / 5 B ┃▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓┃ 29 B/s 0s
Need a command-line tool
minio
for this - does it meet the stuff above?minio
gives us most of what we need (https://docs.min.io/docs/minio-client-complete-guide.html#find)jos
command-line options as extensions if neededCould you stream it directly from object store into Fortran process?
cat
the contents of an object and pipe it where you likemc cat namestore/ag1/random/a.txt | sed 's/a/b/g'