geoschem / geos-chem-cloud

Run GEOS-Chem easily on AWS cloud
http://cloud.geos-chem.org
MIT License
39 stars 9 forks source link

Tutorials on AWS data storage services #3

Closed JiaweiZhuang closed 6 years ago

JiaweiZhuang commented 6 years ago

The biggest difference between cloud and local machines is perhaps data management. Doing small-scale computation is not too different because they are all just Linux servers...

Here're several ways to preserve data after the work is done, listing from fast&expensive to slow&cheap:

  1. Just stop the EC2 instance. Will pay for the EBS volume. $0.10 / GB-month by default.
  2. Save EBS volumes into EBS Snapshots. Storage cost is 50% of the first option ($0.05 / GB-month).
  3. Move data to S3 and pull them back later. Bandwidth is 100~200 MB/s by default. cost is 23% of the first option ($0.023 / GB-month).
  4. Cheaper versions of S3 like or S3-IA ($0.0125 / GB-month) and glacier ($0.004 / GB-month)

The latest pricing can be found at:

Will need to go through them one-by-one. S3 tutorials can use other Earth science data on AWS to show additional benefits of the cloud.

JiaweiZhuang commented 6 years ago

New tutorials are added.

S3: http://cloud-gc.readthedocs.io/en/latest/chapter02_beginner-tutorial/use-s3.html EBS: http://cloud-gc.readthedocs.io/en/latest/chapter02_beginner-tutorial/use-ebs.html