search

tdegeus / GooseSLURM

SLURM command line tools and scripts
https://gooseslurm.rtfd.io
MIT License
10 stars 2 forks source link

Adding script to find which files to copy #18

Closed tdegeus closed 3 years ago

tdegeus commented 4 years ago

Fixes #17

tdegeus commented 4 years ago

A nice API could be with a yaml file:

find:
- source: ssh remote "find ~/foo -iname '*.hdf5'"
- dest: find . -iname '*.hdf5'

check:
- size: different-size.log
- push: on-source-but-not-on-remote.log
- pull: on-dest-but-not-on-source.log
tdegeus commented 3 years ago

Better API could be to input a list of files with sha256 and to check the checksum on the other side

tdegeus commented 3 years ago

Externalised to shelephant : https://github.com/tdegeus/shelephant