search

ocean-transport / scale-aware-air-sea

Repo for collaborative project on scale-aware air-sea fluxes
2 stars 0 forks source link

Save out xESMF weights for reuse in the cloud #14

Closed jbusecke closed 2 years ago

jbusecke commented 2 years ago

This would be a solution to the problems in #12.

rabernat commented 2 years ago

Possibly related https://github.com/pangeo-data/xESMF/issues/141

jbusecke commented 2 years ago

Quick update: I was just able to compute the xESMF weights for CM2.6 on gyre, and it never exceeded 2% memory. So I presume we could get away with 32GB in the cloud. Would there be a way to get 'custom' higher memory servers @rabernat ?

jbusecke commented 2 years ago

Ill look into saving/reuising the weights in the cloud tomorrow.

paigem commented 2 years ago

Now have more memory on the cloud, so can resume!