runpod / runpodctl

🧰 | RunPod CLI for pod management
https://www.runpod.io/
GNU General Public License v3.0
257 stars 37 forks source link

Add filtering for public IP on community cloud #31

Open hyperknot opened 1 year ago

hyperknot commented 1 year ago

Right now, there is no way to make sure a newly created instance will have a public IP, when selecting from the community cloud. Please add a feature like on the UI.

image

all-mute commented 7 months ago

+1

lipsumar commented 5 months ago

+1 - and Internet Speed 🙏

pdlje82 commented 5 months ago

+1 🙏

pdlje82 commented 5 months ago

As I am developing on a runpod instance, I need the public IP / SSH over exposed TCP, otherwise my IDE cant connect to the instance

jojje commented 3 weeks ago

From what I can tell, community cloud pods always get public IP addresses.

E.g.

$ runpodctl create pod --name no-ssh-test --communityCloud --gpuType "NVIDIA GeForce RTX 3070" --templateId runpod-torch-v21 --imageName runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04
pod "jkkvu1e917mdgb" created for $0.130 / hr

$ runpodctl get pod -a jkkvu1e917mdgb
ID              NAME            GPU             IMAGE NAME                                                      STATUS  POD TYPE        VCPU    MEM     CONTAINER DISK  VOLUME DISK     LOCATION        $/HR    PORTS                        
jkkvu1e917mdgb  no-ssh-test     1 RTX 3070      runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04        RUNNING RESERVED        16      31      20              1               US              0.130   100.65.23.156:60305->19123 (prv,http),70.167.32.130:31042->22 (pub,tcp),100.65.23.156:60304->8888 (prv,http)

However a SSH connection can not be made because the SSH daemon isn't running in the pod.

$ runpodctl ssh connect jkkvu1e917mdgb
ssh root@70.167.32.130 -p 31042

$ ssh root@70.167.32.130 -p 31042
ssh: connect to host 70.167.32.130 port 31042: Connection refused

That said, I have a PR open for review that would solve this last hurdle.

$ runpodctl create pod --name with-ssh-test --communityCloud --gpuType "NVIDIA GeForce RTX 3070" --templateId runpod-torch-v21 --imageName runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04 --startSSH
pod "8drbwukudwl39u" created for $0.130 / hr

$ runpodctl get pod -a 8drbwukudwl39u
ID              NAME            GPU             IMAGE NAME                                                      STATUS  POD TYPE        VCPU    MEM     CONTAINER DISK  VOLUME DISK     LOCATION        $/HR    PORTS                        
8drbwukudwl39u  with-ssh-test   1 RTX 3070      runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04        RUNNING RESERVED        16      31      20              1               US              0.130   100.65.20.202:60107->8888 (prv,http),100.65.20.202:60106->19123 (prv,http),70.167.32.130:30052->22 (pub,tcp)

$ runpodctl ssh connect 8drbwukudwl39u
ssh root@70.167.32.130 -p 30052

$ ssh root@70.167.32.130 -p 30052
Welcome to Ubuntu 22.04.3 LTS (GNU/Linux 5.15.0-97-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

This system has been minimized by removing packages and content that are
not required on a system that users do not log into.

To restore this content, you can run the 'unminimize' command.

The programs included with the Ubuntu system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Ubuntu comes with ABSOLUTELY NO WARRANTY, to the extent permitted by
applicable law.

 ______                 ______            _
(_____ \               (_____ \          | |
 _____) ) _   _  ____   _____) )___    __| |
|  __  / | | | ||  _ \ |  ____// _ \  / _  |
| |  \ \ | |_| || | | || |    | |_| |( (_| |
|_|   |_||____/ |_| |_||_|     \___/  \____|

For detailed documentation and guides, please visit:
https://docs.runpod.io/ and https://blog.runpod.io/

root@4745698eda3c:~#