We have to do more performance testing and memory profiling on different machines and clusters, in order to make recommendations to the user for what kind of dask clusters to use:
thread-based vs. process based
how many workers for a given total amount of memory (making sure every worker has enough memory)
41 adds the
AtmosphericForcing
class.We have to do more performance testing and memory profiling on different machines and clusters, in order to make recommendations to the user for what kind of dask clusters to use: