mosqueteiro / scalable_DS_envs

Building scalable data science environments using Docker and other tools

MIT License

0 stars 0 forks source link

Instance template and EBS volume snapshot setup tutorial #27

Closed mosqueteiro closed 5 years ago

mosqueteiro commented 5 years ago

mounting an EBS filesystem

Setup EBS volume:

[x] start t2 instance with EBS volume
[x] mount EBS volume
[x] download data zip
[x] unzip to EBS volume
[x] rm data zip
[x] save snapshot of EBS volume note: space consumed
[x] tear down instance
[x] update training instance template with EBS snapshot(s)
- other datasets can be added and used in the same way and with their own volume snapshots

Setup Instance template:

[x] create training instance template with EBS attached and using the dataset snapshot

Tensorflow tutorial

[x] write some basics about using the tensorflow container
[x] using Jupyter notebook

mosqueteiro commented 5 years ago

26