search

cms-sw / cmssw

CMS Offline Software
http://cms-sw.github.io/
Apache License 2.0
1.07k stars 4.28k forks source link

[ASAN] SubmitPVsplit and test_MC_23_setup failing for unknown reason #45751

Open iarspider opened 3 weeks ago

iarspider commented 3 weeks ago

Log for SubmitPVsplit:

./batchHarvester_Prompt_0.sh: line 15: 2055448 Killed                  ls -lh .
Failure running PVSplit script: status 137

ASAN reports memory leaks in bash, could be the cause?

Leaks ``` ==2055325==ERROR: LeakSanitizer: detected memory leaks Direct leak of 18 byte(s) in 1 object(s) allocated from: #0 0x1528256b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55669b68a691 in xmalloc (/usr/bin/bash+0x8a691) SUMMARY: AddressSanitizer: 18 byte(s) leaked in 1 allocation(s). ================================================================= ==2055331==ERROR: LeakSanitizer: detected memory leaks Direct leak of 19 byte(s) in 1 object(s) allocated from: #0 0x1528256b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55669b68a691 in xmalloc (/usr/bin/bash+0x8a691) SUMMARY: AddressSanitizer: 19 byte(s) leaked in 1 allocation(s). ================================================================= ==2055337==ERROR: LeakSanitizer: detected memory leaks Direct leak of 17 byte(s) in 1 object(s) allocated from: #0 0x1528256b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55669b68a691 in xmalloc (/usr/bin/bash+0x8a691) SUMMARY: AddressSanitizer: 17 byte(s) leaked in 1 allocation(s). ================================================================= ==2055344==ERROR: LeakSanitizer: detected memory leaks Direct leak of 11 byte(s) in 1 object(s) allocated from: #0 0x14a62f4b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55579c68a691 in xmalloc (/usr/bin/bash+0x8a691) SUMMARY: AddressSanitizer: 11 byte(s) leaked in 1 allocation(s). ================================================================= ==2055351==ERROR: LeakSanitizer: detected memory leaks Direct leak of 32 byte(s) in 1 object(s) allocated from: #0 0x14b927cb8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x561e4d28a691 in xmalloc (/usr/bin/bash+0x8a691) Indirect leak of 88 byte(s) in 3 object(s) allocated from: #0 0x14b927cb8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x561e4d28a691 in xmalloc (/usr/bin/bash+0x8a691) SUMMARY: AddressSanitizer: 120 byte(s) leaked in 4 allocation(s). ================================================================= ==2055354==ERROR: LeakSanitizer: detected memory leaks Direct leak of 11 byte(s) in 1 object(s) allocated from: #0 0x14a62f4b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55579c68a691 in xmalloc (/usr/bin/bash+0x8a691) SUMMARY: AddressSanitizer: 11 byte(s) leaked in 1 allocation(s). ```

Log for test_MC_23_setup doesn't provide any details (not even error code), only leak reports in Python3.6 and bash:

Leaks ``` ================================================================= ==2027053==ERROR: LeakSanitizer: detected memory leaks Direct leak of 1534027 byte(s) in 177 object(s) allocated from: #0 0x14f1126b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1645 #2 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1638 Direct leak of 2066 byte(s) in 2 object(s) allocated from: #0 0x14f1126b7ae5 in __interceptor_realloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:85 #1 0x14f112322796 in resize_compact Objects/unicodeobject.c:1084 Direct leak of 96 byte(s) in 3 object(s) allocated from: #0 0x14f1126b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x14f1123ea775 in PyThread_allocate_lock Python/thread_pthread.h:389 Indirect leak of 197575 byte(s) in 209 object(s) allocated from: #0 0x14f1126b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1645 #2 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1638 SUMMARY: AddressSanitizer: 1733764 byte(s) leaked in 391 allocation(s). ================================================================= ==2027044==ERROR: LeakSanitizer: detected memory leaks Direct leak of 32 byte(s) in 1 object(s) allocated from: #0 0x1506114b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55a184c8a691 in xmalloc (/usr/bin/bash+0x8a691) Indirect leak of 88 byte(s) in 3 object(s) allocated from: #0 0x1506114b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69 #1 0x55a184c8a691 in xmalloc (/usr/bin/bash+0x8a691) ```
cmsbuild commented 3 weeks ago

cms-bot internal usage

cmsbuild commented 3 weeks ago

A new Issue was created by @iarspider.

@Dr15Jones, @antoniovilela, @makortel, @mandrenguyen, @rappoccio, @sextonkennedy, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

makortel commented 3 weeks ago

Is the LeakSanitizer something new?