Code and documentation for the first machine learning focused mock data challenge hosted by the Albert-Einstein-Institut Hannover and the Friedrich-Schiller Universität Jena.
Running generate_data.py --duration 2592000 on the ARA cluster, even with 128 GB of memory allocated the script crashes due to insufficient memory once 743300 seconds of data have been saved in the background output file, irrespective of the -d option. Adding some garbage collection seems to be helpful, probably a memory leak.
MarlinSchaefer
commented
2 years ago
Running
generate_data.py --duration 2592000on the ARA cluster, even with 128 GB of memory allocated the script crashes due to insufficient memory once 743300 seconds of data have been saved in the background output file, irrespective of the-doption. Adding some garbage collection seems to be helpful, probably a memory leak.