search

pangeo-forge / pangeo-forge-cloud-federation

Infrastructure for running pangeo-forge across multiple bakeries
Apache License 2.0
3 stars 6 forks source link

Spot instances #10

Open thodson-usgs opened 10 months ago

thodson-usgs commented 10 months ago

Has anyone investigated using spot instances? If not, I would.

For example, https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/jobruns-flink-decommission.html

yuvipanda commented 10 months ago

Nope, but I think they sound like a great idea.

thodson-usgs commented 9 months ago

11 enables spot instances

14 discusses the two main configurations necessary to make Flink failure tolerant