Restrict max num of workers for recipes?

leap-stc / data-management

Collection of code to manually populate the persistent cloud bucket with data

https://catalog.leap.columbia.edu/

Apache License 2.0

0 stars 5 forks source link

Restrict max num of workers for recipes? #20

Closed jbusecke closed 1 year ago

jbusecke commented 1 year ago

https://github.com/pangeo-forge/pangeo-forge-runner/issues/72#issuecomment-1542710710 Might be worth exploring for #16 (which scaled up to 69 workers), but given that it did not cost that much, I consider this low priority.

jbusecke commented 1 year ago

I just discovered that dataflow gives cost estimates now, and given those (seeing how cheap they are) I see no further reason to implement this for now.