OARS-SAFS / resources

Open and Reproducible Science Resources
17 stars 0 forks source link

port 22 issue while transferring files to hyak #5

Closed nclowell closed 5 years ago

nclowell commented 5 years ago

Hauser lab mates and I are trying to rsync some files onto the Roberts lab hyak node. We are already logged in to hyak, and using your wiki. We get this error about port 22:

image

Do you know where we went wrong? Do we need to swap public SSH keys first? Or use SFTP?

github-actions[bot] commented 5 years ago

Message that will be displayed on users' first issue

sr320 commented 5 years ago

Sorry about the bot post 😺 - still working out the 🐛 s.

I am going to guess that this refers to the fact your 205.... machine has port 22 blocked.

You could try the reverse where you are logged onto your 205.... machine and rsync other direction.

(helpful hint - you can just copy and paste terminal output as code in markdown in an issue) - no image necessary.

kubu4 commented 5 years ago

First thing to to test is whether or not you can SSH from Mox to that computer:

From your Mox login node:

ssh ubuntu@205.175.118.227

When you do that, what happens? Do you get prompted for a password? Have you been able to SSH from Mox to that computer before?

Also, I'm a bit surprised that the username listed above is "ubuntu". Is your target computer actually a Linux computer? Is it Windows 10 running Ubuntu?

nclowell commented 5 years ago

Thanks @sr320 we'll try the reverse rsync and see if that helps. And also try @kubu4's rec to ssh from mox to the computer.

Yea that machine's username is indeed ubuntu 😬 it was not my doing. It's a linux virtual machine running on windows.

kubu4 commented 5 years ago

It's a linux virtual machine running on windows.

Well, I think this will complicate things.

I'd guess that port 22 is closed (as was mentioned above). You'll likely have to make this change in the Windows firewall settings.

Some internet searching should get you pointed in the right direction.

Also, you'll want to verify that the openssh program is installed on the Linux VM and also confirm that it's actually running.

nclowell commented 5 years ago

It's a linux virtual machine running on windows.

Well, I think this will complicate things.

It might, but I also work on a linux virtual machine and Steven hasn't had any problems rysncing my files to hyak.

I used a VM on Google Cloud a few weeks ago, and got a similar port 22 error before the SSH connection was properly set up. I didn't change my firewall settings. But I'll look into it!! First I'll check if openssh is installed on that computer. Thanks @kubu4!

kubu4 commented 5 years ago

similar port 22 error before the SSH connection was properly set up

This implies that you fixed an error like this previously. Have you taken the same steps on this computer that you did on the Google Cloud VM?

kubu4 commented 5 years ago

First I'll check if openssh is installed on that computer.

Specifically, run the following:

sudo dpkg -l openssh-server

You should get an output like:

||/ Name                                          Version                     Architecture                Description
+++-=============================================-===========================-===========================-===============================================================================================
ii  openssh-server                                1:7.2p2-4ubuntu2.8          amd64                       secure shell (SSH) server, for secure access from remote machines

(Don't worry if you get some weird other messages above those lines).

nclowell commented 5 years ago

similar port 22 error before the SSH connection was properly set up

This implies that you fixed an error like this previously. Have you taken the same steps on this computer that you did on the Google Cloud VM?

I haven't yet, but that's why I asked at the beginning whether we need to swap SSH public keys first in order for rsync to work. When Steven has come in to help us and rysnced our files, we couldn't remember if he first established an SSH connection between our computers and hyak (and we were both under the impression that he didn't need to, or that setting up the rsync created the ssh access). The tutorial I followed for Google Cloud implied that I had to. Should I go ahead and add the hyak public SSH key to my computer and vice versa?

@EleniLPetrou can chime in about whether openssh-server is installed using your suggestion

sr320 commented 5 years ago

again - the simpler solution would be when you are logged onto ubuntu rsync with mox using ssh. That is what I did.

EleniLPetrou commented 5 years ago

Hi y'all! Here is an update of what I have tried so far and what has worked:

  1. I was able to use rsync from my ubuntu@ubuntu machine (you don't like the name? :) ) to transfer files to hyak, no problem, using this:
rsync --archive --progress --verbose path/bcftools.sh uwnetid@mox.hyak.uw.edu:/gscratch/scrubbed/uwnetid
  1. I was able to use sftp to move files from my computer to mox using this script:
sftp -oPort=22 uwnetid@mox.hyak.uw.edu
put *.txt

I also followed @kubu4 advice (thank you!) to check whether openssh was installed on my beloved ubuntu@ubuntu using sudo dpkg -l openssh-server

This is the output:

Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name           Version      Architecture Description
+++-==============-============-============-=================================
un  openssh-server <none>       <none>       (no description available)

I will try installing openssh next, and let you know how that goes. Thank you for all the help!!

kubu4 commented 5 years ago

rsync with mox using ssh

@sr320 Isn't that what is shown in the initial post?

sr320 commented 5 years ago

no she was logged into mox, doing it from mox.

What I was suggesting is what @EleniLPetrou got to work

I was able to use rsync from my ubuntu@ubuntu machine (you don't like the name? :) ) to transfer files to hyak, no problem, using this:

kubu4 commented 5 years ago

Oh, oh, I see. I read that sentence differently.

kubu4 commented 5 years ago

I will try installing openssh next, and let you know how that goes.

@EleniLPetrou : No need. You should be all set for moving files to/from Mox.

Plus, the subsequent process to set up your computer for receiving SSH connections is kind of a pain...

nclowell commented 5 years ago

Thanks so much @kubu4 and @sr320! I think we're all good now.

Just as a heads-up, the examples on the wikipage on File Transfers are for using rsync when logged into Mox (I think!). This might snag future users if they're anything like us 😅