jade-hpc-gpu / jade-hpc-gpu.github.io

Joint Academic Data Science Endeavour (JADE) is the largest GPU facility in the UK supporting world-leading research in machine learning (and this is the repo that powers its website)
http://www.jade.ac.uk/
Other
24 stars 8 forks source link

can't scp or use git over ssh from remote sites #15

Open sbutcher opened 6 years ago

sbutcher commented 6 years ago

Using JADE I can't scp from a remote system, and i can't perform git operations from a repo using the preferred git over ssh (to use key based auth) this heavily impacts workflow.

charliejhadley commented 6 years ago

@sbutcher does this remain an issue?

sbutcher commented 6 years ago

@martinjhnhadley yes, i've seen no indication of any progress on it - does it need raising separately on hartree service now?

LiamATOS commented 6 years ago

Can you try using HTTPS for GIT, the DGX Nodes do not have direct internet access

sbutcher commented 6 years ago

@LiamATOS git over HTTPS requires username and password for each git operation, and if you use 2FA on github it is even more tedious. This totally disrupts workflow, RSEs and researchers will need to be able to use git commands seamlessly using key based auth to use the service (as do the other tier2 services).

LiamATOS commented 6 years ago

Is it just github.com? STFC will only amend the firewall for specific website's for security reasons?

Thanks

Liam

sbutcher commented 6 years ago

we also heavily use github.research.its.qmul.ac.uk our onsite github enterpise. i expect other sites will have similar. it seems a strange restriction because other T2 aren't affected?

LiamATOS commented 6 years ago

Requests to STFC networks have gone in, need to check and test.

LiamATOS commented 6 years ago

This should now be resolved, please check

sbutcher commented 6 years ago

Hi I still cannot access github.research.its.qmul.ac.uk on git/ssh protocol (port 22 and 443 required) github.com does work fine with keys but we also need the QMUL one please. thanks

we-taper commented 6 years ago

Hi I confirm that bitbucket via ssh isn't available as well. It looks like via HTTPS is general working, though it is not a good idea to enter my passwords every time.

Hope it could be done in the future.

we-taper commented 6 years ago

Dear all,

Now I think that git with ssh over https is not working as well. For example the following works on my Mac: git clone ssh://git@altssh.bitbucket.org:443/me/xxx.git

But it gives on the jade:

ssh: connect to host altssh.bitbucket.org port 443: Network is unreachable
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
agniszczotka commented 5 years ago

Issue remains. I use git@cmiclab.cs.ucl.ac.uk which is internal gitlab. How to set up git connection?

twinkarma commented 5 years ago

Is this still an issue?

agniszczotka commented 5 years ago

Yes. I generated my public key with Jade account and registered with my repository account, which usually allows me access to git@cmiclab.cs.ucl.ac.uk from any machine. It did not work for Jade. Error is: ssh: connect to host cmiclab.cs.ucl.ac.uk port 22: Connection timed out fatal: Could not read from remote repository.

martinengelcke commented 5 years ago

I also usually access Github repos via ssh. This worked before but then suddenly stopped working for me on Jade last week. Access via https works fine.

It is possible that something has gone wrong with my ssh configuration but I cannot spot anything.

TreeLLi commented 4 years ago

I also have the problem of connecting Git via SSH and solved by switching to HTTPS. It seems that JADE administrator has closed the port for ssh according to the post from Hartree. Besides, if you are also considering HTTPS solution, you may want to have a look at this #123 regarding setting proxy for https connection working.