cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.1k stars 3.81k forks source link

roachprod: Add the ability to scp between roachprod instances #105650

Open inata4 opened 1 year ago

inata4 commented 1 year ago

Is your feature request related to a problem? Please describe. We need to be able to scp files from one roachprod instance to another. This will help avoid uploading very large files from local machines to roachprod instances (e.g. tsdump.gob).

Describe the solution you'd like SCP between roachprod instances, e.g.:

rochprod scp INSTANCE1(source) INSTANCE2(destination) filename

Describe alternatives you've considered It is currently possible to just use scp from one machine to another, but certificates make it tricky. Example process:

  1. ssh into destination instance.
  2. copy private key
  3. ssh into source instance
  4. create key from copied key
  5. run scp -i pointing to new key, e.g. scp -i ~/.ssh/instance2_key /mnt/data1/example.txt X.X.X.X:/mnt/data1/example.txt

Jira issue: CRDB-29138

blathers-crl[bot] commented 1 year ago

cc @cockroachdb/test-eng

srosenberg commented 1 year ago

Internal slack thread: https://cockroachlabs.slack.com/archives/C023S0V4YEB/p1687900754388229?thread_ts=1687893094.814859&cid=C023S0V4YEB