We appear to have ~250GB RAM on the GPU node according to free -g, so we could increase the memory_limit parameter in the Cytokit config processor.args field, to limit warnings from Dask, e.g.
distributed.worker - WARNING - Memory use is high but worker has no data to store to disk. Perhaps some other process is leaking memory? Process memory: 54.30 GB -- Worker memory limit: 64.00 GB
We appear to have ~250GB RAM on the GPU node according to
free -g, so we could increase thememory_limitparameter in the Cytokit configprocessor.argsfield, to limit warnings from Dask, e.g.