search

umccr / icav2-cli-plugins

A set of additional subcommands for icav2
MIT License
2 stars 0 forks source link

Add command icav2 projectdata rclone #244

Closed alexiswl closed 1 month ago

alexiswl commented 9 months ago

We have the icav2 projectdata copy command, but we should also introduce a projectdata rclone command that can take 

s3:// uris as an input and output (assuming s3 credentials are provided)
icav2:// uris as both input and output (assuming access token is present), should also support tenant_id / name as a query parameter and should be able to collect an access token for the said tenant id / name as a query parameter
gds:// uris, as an input and output (assuming s3 credentials are provided) - likely going to need to be an administrative token

Should also be able to do parameters such as --include and --exclude.

alexiswl commented 9 months ago

We should also have the ability to have a --background parameter so that the rclone process runs in the background and the user can continue to use their computer

alexiswl commented 1 month ago

Would recommend using icav2 projectdata copy instead