search

diux-dev / cluster

train on AWS
75 stars 15 forks source link

make imagenet18 snapshots available #67

Closed yaroslavvb closed 6 years ago

yaroslavvb commented 6 years ago

Right now it's called "imagenet_blank snapshot [Copied snap-0d37b903e01bb794a from us-east-1] "

need to rename/replicate this over regions

yaroslavvb commented 6 years ago

@bearpelican can you give me name of folder/stopped instance/ebs disk which has the 352 folder? I want to make new snapshots with that folder since some of your conf's use it

bearpelican commented 6 years ago

snapshot: snap-042f31eb766e01edb name: imagenet_high_perf_v3_anaconda region: us-west-2 (note: this has some deprecated anaconda files stored on the snapshot)

volume: vol-0757534e1b6abfca5 name: imagenet_00 region: us-west-2

ami: pytorch.imagenet.source.v7 region: us-west-2, us-east-2, us-east-1

instance: i-0a1b9db0a6825d4f4, i-0e186a603f7035a5a, i-0db03b7b1262aee52, i-0db1b9e1e9bc76db0 region: us-east-1

bearpelican commented 6 years ago

In the meantime, I'll launch a t2.medium instance (with ami pytorch.imagenet.source.v7) and just upload all those files to the yaroslavvb s3.

yaroslavvb commented 6 years ago

Wait, the AMI also has the dataset? Looks like I should use the source.v7 ami + imagenet_high_perf_v3_anaconda snapshot for 8-machine experiments

yaroslavvb commented 6 years ago

PS, t3 instances were launched last week. They are faster and cheaper

bearpelican commented 6 years ago

ah nice. I'll use that!

Yup AMI has it. So you could just use those instances data without attaching a separate EBS volume. Note: if you go that route, you must create the instance with --attach-volume '' so that the iops limit is higher

It use to be on EFS, but I forgot to upload to S3.

yaroslavvb commented 6 years ago

Oh nice, that simplifies things a bit, no need to have expensive EBS's hanging around

On Wed, Aug 29, 2018 at 10:36 AM Andrew Shaw notifications@github.com wrote:

ah nice. I'll use that!

Yup AMI has it. So you could just use those instances data without attaching a separate EBS volume. Note: if you go that route, you must create the instance with --attach-volume '' so that the iops limit is higher

It use to be on EFS, but I forgot to upload to S3.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/diux-dev/cluster/issues/67#issuecomment-417039866, or mute the thread https://github.com/notifications/unsubscribe-auth/AABaHNbr2KYrlMlAxNocjKwwPRXpP_oQks5uVtEZgaJpZM4WIENK .

bearpelican commented 6 years ago

This has all the imagenet resizes. Should be all that we need https://s3.amazonaws.com/yaroslavvb/imagenet-sz-all.tar @yaroslavvb

yaroslavvb commented 6 years ago

this is no longer needed for release since AMI has the files needed