spotty-cloud / spotty

Training deep learning models on AWS and GCP instances
https://spotty.cloud
MIT License
491 stars 43 forks source link

Cannot mount second volume #82

Closed turian closed 3 years ago

turian commented 3 years ago

I have an old volume I am trying to attach to a new instance. I renamed the old instance so it should be fine.

Here is my config:

  - name: ietl
    provider: aws
    parameters:
      region: eu-central-1
      # These GPU instances are more reliable to create with the GPU docker so ¯\_(ツ)_/¯
      instanceType: p3.2xlarge
#      instanceType: t3.2xlarge
#      instanceType: t4g.2xlarge
      spotInstance: True
      ports: [6006, 8888]
      dockerDataRoot: /docker
      volumes:
        - name: workspace
          parameters:
            size: 1000
            deletionPolicy: retain
            mountDir: /workspace
        - name: oldworkspace
          parameters:
            size: 600
            deletionPolicy: retain
            mountDir: /oldworkspace
        - name: docker
          parameters:
            size: 20
            mountDir: /docker

While it's loading, I get this message:


Volumes:
+--------------+------------+------------+-----------------+
| Name         | Mount Path | Type       | Deletion Policy |
+==============+============+============+=================+
| workspace    | /workspace | EBS volume | Retain Volume   |
+--------------+------------+------------+-----------------+
| oldworkspace | -          | EBS volume | Retain Volume   |
+--------------+------------+------------+-----------------+
| docker       | -          | EBS volume | Retain Volume   |
+--------------+------------+------------+-----------------+

Note there is no mount path. I don't see it in the machine!

apls777 commented 3 years ago

@turian I think you forgot to create a volumeMount for this volume in the container config. Can you show me your container config?

turian commented 3 years ago

Thank you Oleg that fixed it!

One question while we're on the topic: How do I break out of docker in spotty if I want to mount or resize a volume? I don't think I can do it within the docker.

p.s. I'm curious what you're up to. Feel free to email me at lastname at gmail dot com

apls777 commented 3 years ago

How do I break out of docker in spotty if I want to mount or resize a volume?

Just use the -H flag to connect to the host OS: spotty sh -H