fermitools / declad

BSD 3-Clause "New" or "Revised" License
1 stars 2 forks source link

Support https / gfal2 transfers for file tranfers on local dropboxes. #49

Closed marcmengel closed 4 days ago

marcmengel commented 6 days ago

Currently xrdcp --cksum into fndcadoor DCache is not working INC000001183287 ; while the DCache folks think they can fix that, it led me to try switching a local-disk dropbox Declad to transferring files with gfal-copy. This led to two problems: 1) when it builds a ${dest} value from host and path, it currently always makes a root://host/path URL 2) when it checks remote file sizes it calls the xrootd-scanner code, thus requiring an xrootd host:port

So I'm wokring on a change for this to: 1) allow you to specify a transfer_protocol (defaulting to 'root' for backwards compat) for that ${dest} URL 2) Calling gfal-stat instead of the xrdfs stat if you've specifed 'htttps' in your tranfer_protocol Which on initial testing seems to work...