script-F-postprocessing-upload: use rsync instead of scp

crs-tools / crs-scripts

CRS Worker scripts

Apache License 2.0

4 stars 5 forks source link

script-F-postprocessing-upload: use rsync instead of scp #22

Closed Kunsi closed 5 months ago

Kunsi commented 5 months ago

This allows us to resume transfers in case the upload fails due to a wonky internet connection.

This also removes the tracker properties Publishing.UploadOptions and Processing.Postprocessing.Options. For ssh options, operators are advised to deploy a ssh config instead.

Also, add log to tracker in any case.

Kunsi commented 5 months ago

Yes, this adds an implicit dependency to rsync to these scripts. Should be fine though, since this is available on all *nix platforms i know (and even on windows).