search

coiled / dask-community

Issue tracker for the Dask community team
MIT License
2 stars 0 forks source link

[Stack Overflow] Why does dask.distributed auto memory trimming not work? #522

Open github-actions[bot] opened 2 years ago

github-actions[bot] commented 2 years ago

The unmanaged memory usage is high when I'm read files and process the data. After manually triggering the memory trimming function, the unmanaged memory usage decrease significantly.

import ctypes

def trim_memory() -> int:
    libc = ctypes.CDLL("l…

Would you like to know more?

Read the full article on the following website:

https://stackoverflow.com/questions/71203077/why-does-dask-distributed-auto-memory-trimming-not-work

pavithraes commented 2 years ago