search

STEllAR-GROUP / hpx

The C++ Standard Library for Parallelism and Concurrency
https://hpx.stellar-group.org
Boost Software License 1.0
2.51k stars 428 forks source link

Memory issues during benchmarking. #786

Closed mnlesane closed 11 years ago

mnlesane commented 11 years ago

Submitted to HPX bug reports at Bryce's suggestion for additional reviewing.

https://github.com/mnlesane/benchmark-data/blob/master/err.txt

The above error output was generated while executing the default (e.g., no modifications) build of osu_bibw: srun -p marvin -N 2 osu_bibw -t 2

Similar outputs are generated for srun ... osu_bibw when any number of threads greater than 1 is used, or for any number of threads when compression is enabled.

No such errors occur when executed normally on Hermione without srun.

sithhell commented 11 years ago

Those are not really errors, just messages printed to stderr for your information. In any case, the messages are strange. Investigating.

sithhell commented 11 years ago

The messages you are seeing from tcmalloc is what is to be expected.

After investigating, i observed that the allocated chunks are approx. 2500 times larger than what is the reported buffer size. There are 2048 parcels sent and recieved at the same time. This means, those messages merely indicate that parcel buffering is working as expected.