falkTX / Carla

Audio plugin host
https://kx.studio/carla
1.59k stars 145 forks source link

Heap corruption leading to crashes #1434

Open sammko opened 3 years ago

sammko commented 3 years ago

I experience regular crashes of Carla (75ea9f5b) on top of pipewire (0.3.28). Some specific conditions need to be met for this to happen, I have yet to find out what those are.

My use-case is mostly just input microphone processing. I have a virtual pipewire device constructed as such:

{   factory = adapter
    args = {
        factory.name     = support.null-audio-sink
        node.name        = "processed-mic"
        node.description = "Processed-Microphone"
        media.class      = "Audio/Source/Virtual"
        audio.position   = "F"
    }
}

The crash is reproducible for me when using a chromium based microphone client (a mic test website in chrome itself, discord, slack etc.). It crashes either when Carla is already running and suddenly a wild chromium appears, and also crashes instantly upon loading my project file (attached) when chromium is already running.

The project contains a Carla-patchbay plugin (of the internal type) Microphone-processing with the Focusrite interface connected to its input, and its output connected to the virtual device. This is the graph at the moment of crash image

The crash itself happens at various locations, generally inside a call to malloc, which strongly suggests heap corruption. The most common occurrence is a LinkedList<CarlaBackend::CarlaEngineJack::PostPonedJackEvent>::_allocate(), see the stack trace below. (this is Carla built with make debug and glibc with debug symbols)

(gdb) bt
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:49
#1  0x00007ffff7a0a862 in __GI_abort () at abort.c:79
#2  0x00007ffff7a62d28 in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0x7ffff7b727eb "%s\n") at ../sysdeps/posix/libc_fatal.c:155
#3  0x00007ffff7a6a92a in malloc_printerr (str=str@entry=0x7ffff7b70aef "malloc(): corrupted top size") at malloc.c:5626
#4  0x00007ffff7a6e334 in _int_malloc (av=av@entry=0x7fffc4000020, bytes=bytes@entry=792) at malloc.c:4330
#5  0x00007ffff7a6f4e1 in __GI___libc_malloc (bytes=792) at malloc.c:3237
#6  0x00007fffe2d4e816 in LinkedList<CarlaBackend::CarlaEngineJack::PostPonedJackEvent>::_allocate() (this=0x5555562d9790) at ../../utils/LinkedList.hpp:526
#7  0x00007fffe2d4d012 in AbstractLinkedList<CarlaBackend::CarlaEngineJack::PostPonedJackEvent>::_add(CarlaBackend::CarlaEngineJack::PostPonedJackEvent const&, bool, AbstractLinkedList<CarlaBackend::CarlaEngineJack::PostPonedJackEvent>::ListHead*) (this=0x5555562d9790, value=..., inTail=true, queue=0x5555562d97a0) at ../../utils/LinkedList.hpp:397
#8  0x00007fffe2d4b572 in AbstractLinkedList<CarlaBackend::CarlaEngineJack::PostPonedJackEvent>::append(CarlaBackend::CarlaEngineJack::PostPonedJackEvent const&)
    (this=0x5555562d9790, value=...) at ../../utils/LinkedList.hpp:244
#9  0x00007fffe2d47c9d in CarlaBackend::CarlaEngineJack::postPoneJackCallback(CarlaBackend::CarlaEngineJack::PostPonedJackEvent&) (this=0x5555562d94b0, ev=...) at CarlaEngineJack.cpp:4191
#10 0x00007fffe2d4896d in CarlaBackend::CarlaEngineJack::carla_jack_property_change_callback(unsigned long, char const*, JackPropertyChange, void*)
    (subject=8589934622, key=0x5555568a5170 "https://kx.studio/ns/carla/position", change=PropertyChanged, arg=0x5555562d94b0) at CarlaEngineJack.cpp:4437
#11 0x00007fffe855b3f5 in  () at /usr/lib/pipewire-0.3/jack/libjack.so.0
#12 0x00007fffe00bcf2c in  () at /usr/lib/pipewire-0.3/libpipewire-module-metadata.so
#13 0x00007fffe00d3bc4 in  () at /usr/lib/pipewire-0.3/libpipewire-module-protocol-native.so
#14 0x00007fffe00d41b0 in  () at /usr/lib/pipewire-0.3/libpipewire-module-protocol-native.so
#15 0x00007fffe812eefb in  () at /usr/lib/spa-0.2/support/libspa-support.so
#16 0x00007fffe821c706 in  () at /usr/lib/libpipewire-0.3.so.0
#17 0x00007ffff79cc259 in start_thread (arg=0x7fffd2ffd640) at pthread_create.c:481
#18 0x00007ffff7ae25e3 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95

In this case malloc notices that something's not quite right, complains (malloc(): corrupted top size) and aborts. Another common way for it to go is a segmentation fault (about half of the time for me). This is my project file (gzipped because github): main.carxp.gz

Running Carla under valgrind or a similar tool would be how I would proceed, but when I tried it, I got bombarded by errors, suggesting that valgrind was getting confused. I am not familiar enough with the structure of Carla to figure out how to meaningfully use valgrind on it.

sammko commented 3 years ago

Turns out the issue with valgrind is the python allocator, setting PYTHONMALLOC=malloc seems to help. I will look at this some more later, although removing the K14 stereo meter from the output monitor maybe helps with the crashes (?)

falkTX commented 3 years ago

Note that while this could very well be carla, it can also be a rogue plugin.

There is an experimental option to always run plugins as bridges (put into action after you change settings, save project, and reload the project again). Might be worth trying as well.

sammko commented 3 years ago

I have tried that, it still crashes the main carla window. Not sure how I can tell that the plugin is actually running in its own process though.

falkTX commented 3 years ago

I found a race condition around this area a few days ago, the 2.3.1 release includes the fix. Please try it and report back, I believe this issue should be fixed now.

sammko commented 3 years ago

Thanks for letting me know. I will not be using Carla for some time, but I will get back when I have time to test.

lbenard commented 3 years ago

I've been having this kind of issue for a while (using Pipewire), Carla works perfectly until something is routed to actual hardware. Adding plugins works fine until they're routed to either my microphone or speakers. Using sinks created through pactl does not seem to cause crashes. I actually have myself too a Scarlett Solo, I would be kinda surprised if the issue comes from this specific interface, but I figured out it might be worth pointing out.

➜  ~ carla -v
Using Carla version 2.4.0
  Python version: 3.9.7
  Qt version:     5.15.2
  PyQt version:   5.15.4
  Binary dir:     /usr/lib/carla
  Resources dir:  /usr/share/carla/resources
➜  ~ pipewire --version
pipewire
Compiled with libpipewire 0.3.35
Linked with libpipewire 0.3.35

For some reasons I haven't had the time to figure out yet, I'm unable to get back the stack trace through coredumpctl when Carla crashes. Nonetheless I have a service that loads a Carla preset which often crashes too (although that might be related to #1469) which prints me back this entire stack trace. This one uses a version of Carla (https://github.com/falkTX/Carla/commit/6230e96) compiled with make debug:

× jack-carla-rack.service - Load Carla Rack JACK host
     Loaded: loaded (/home/lbenard/.config/systemd/user/jack-carla-rack.service; enabled; vendor preset: enabled)
    Drop-In: /home/lbenard/.config/systemd/user/jack-carla-rack.service.d
             └─override.conf
     Active: failed (Result: core-dump) since Sat 2021-09-11 13:47:59 CEST; 2min 6s ago
    Process: 7490 ExecStart=/usr/bin/pw-jack /tmp/Carla/source/frontend/carla -n /home/lbenard/.carla/rack.carxp (code=dumped, signal=SEGV)
   Main PID: 7490 (code=dumped, signal=SEGV)
        CPU: 376ms

Sep 11 13:47:59 lbenard-pc pw-jack[7490]: CarlaPipeCommon::CarlaPipeCommon()
Sep 11 13:47:59 lbenard-pc pw-jack[7490]: CarlaPipeServer::CarlaPipeServer()
Sep 11 13:47:59 lbenard-pc pw-jack[7490]: CarlaPluginLV2::CarlaPluginLV2(0x55583fe7d730, 1)
Sep 11 13:47:59 lbenard-pc pw-jack[7490]: Carla assertion failure: "nframes == pData->bufferSize" in file CarlaEngineJack.cpp, line 2889, v1 2048, v2 1024
Sep 11 13:47:59 lbenard-pc systemd-coredump[7504]: Process 7490 (carla) of user 1000 dumped core.

                                                   Found module /tmp/Carla/bin/libcarla_utils.so with build-id: 0be17d42d2a8ea6e498c3ad9d32fe125478e70b8
                                                   Found module /tmp/Carla/bin/libcarla_standalone2.so with build-id: cf544b70be56f77631c81f5a9920c656b9a7c153
                                                   Found module /tmp/Carla/bin/styles/carlastyle.so with build-id: 7158bb108e3b3fd9d229905b2455c012594e9a1b
                                                   Found module linux-vdso.so.1 with build-id: 769e227227c49da74218ef612c41377c30d80327
                                                   Found module libpixman-1.so.0 with build-id: 341f793dcada3a48a306a793d265a517e3f2e7d6
                                                   Found module libxcb-shm.so.0 with build-id: fb797f299a446f559a95afcc168227482cc800d1
                                                   Found module libxcb-render.so.0 with build-id: a37bdb37744b508be9dd29fd9ccb9bb0170d43e5
                                                   Found module libXrender.so.1 with build-id: 97e0b9ab6ba96ebc86527cc2b3c3078aad8616b3
                                                   Found module libfontconfig.so.1 with build-id: 1103a641395c7d3b42e49b793d3a9ea927c77bf6
                                                   Found module libcairo.so.2 with build-id: 06820af9cf79c2deb207d9533a61caf04e67a8ad
                                                   Found module lsp-plugins-lv2.so with build-id: f4dd69e4a60bfe6f0503f294c555f8b22297296a
                                                   Found module librnnoise_ladspa.so with build-id: 2c00e77e201b41f4f4bf2bb2ee63ac40e43ab0d9
                                                   Found module libpipewire-module-metadata.so with build-id: a9751ac0eb1a623fce9a6088d8cca24c1feef4dd
                                                   Found module libpipewire-module-client-node.so with build-id: a2e33aa0cfa427b5ea501a3bf3d3bdeb8cb90b9f
                                                   Found module libpipewire-module-protocol-native.so with build-id: 276a805b4237eb5e34335bd94c27e7d1a5dcebb4
                                                   Found module libpipewire-module-rt.so with build-id: bf1dd252ff0566b9b5aca399fa0c52f4c23454b5
                                                   Found module libnss_files.so.2 with build-id: 1a36dfc01d3a1010b2ee79766a24a8090a3266d5
                                                   Found module libspa-dbus.so with build-id: 7f65bdaad708ac9fbdf3166b23bac444ae2b5017
                                                   Found module libquadmath.so.0 with build-id: 150b56e19c55382453ff358099c27a0b79173c67
                                                   Found module libfftw3q.so.3 with build-id: 379f35239a73f21fbfd3db102975d80218efe259
                                                   Found module libfftw3q_threads.so.3 with build-id: d2a866e1ecb87e42bc58deaf47b7476cb4f86ba9
                                                   Found module libfftw3l.so.3 with build-id: 18a43cd33e6c1ae603ae9a5f7070fbaa01a5d8a2
                                                   Found module libfftw3l_threads.so.3 with build-id: 55cf11625b601401e2b570b3897377bb3d25d67c
                                                   Found module libfftw3f.so.3 with build-id: 54fcd276a00d415f10613e278c9b83fd2f5545c1
                                                   Found module libfftw3f_threads.so.3 with build-id: bd606fb8c9e76390138404cec85e96a269f18744
                                                   Found module libfftw3.so.3 with build-id: 92d83d28091b426f04108d71a38d1cfdc4005ddb
                                                   Found module libfftw3_threads.so.3 with build-id: 6f07a37617e65c97191d5f706120742ddebf8674
                                                   Found module libspa-journal.so with build-id: 38c88d8fc212988f786aa1247b68d6dfab730823
                                                   Found module libspa-support.so with build-id: 95ddb02c8e90b0e2b938e201534054a802dd9da0
                                                   Found module libncursesw.so.6 with build-id: 4118a7b0a2a0de8f6359df5b61c6c59a9e13a4d5
                                                   Found module libpipewire-0.3.so.0 with build-id: 88ce3b6d2dd306f21294d65806d382340b4cee8f
                                                   Found module libinstpatch-1.0.so.2 with build-id: be6cf8f475d8e460ce2046e6cb8d822c11008398
                                                   Found module libgomp.so.1 with build-id: 1cb25691b8e34e1ce54698066bce0fb29f5cf9fa
                                                   Found module libreadline.so.8 with build-id: 50c2746af3cf9fa7373e6ba6d9b2bc0a2ef7735a
                                                   Found module libSDL2-2.0.so.0 with build-id: 70c49ed8e8ed7e64426d58d94174682886394c28
                                                   Found module libportaudio.so.2 with build-id: 305f95e5abdce86725f76773b241fbe88342102f
                                                   Found module libjack.so.0 with build-id: 464e12928cc03e488bf012fe31c8defaa75261cf
                                                   Found module libpulse-simple.so.0 with build-id: 5891a9b3e33b7dd638e4ca6839b837e42343c8e2
                                                   Found module libasound.so.2 with build-id: 9288c92ff737b1999761df2018fcd0e7cbf46d5a
                                                   Found module libXext.so.6 with build-id: d70f24beb4fad748d6becffdcc13e51be0a2ebfa
                                                   Found module libfluidsynth.so.3 with build-id: 696a93f91d7d0936146e031df4be15b4fdbf571a
                                                   Found module libmagic.so.1 with build-id: cccfec8f9dca03a141e1210b460f13b26ab1fe88
                                                   Found module liblo.so.7 with build-id: f6d84b6a2ba20a1dbe0124b8124e7d806ad3cd09
                                                   Found module libexpat.so.1 with build-id: 8850138eae6d9d4d43c5c4b2ac48393bc4279037
                                                   Found module pyexpat.cpython-39-x86_64-linux-gnu.so with build-id: aa06a19b2e6f8c3db83bdd387524b52b60ca7629
                                                   Found module _pickle.cpython-39-x86_64-linux-gnu.so with build-id: 9f2e62f196ad0c8645d229f66a82e65d66a36b6c
                                                   Found module _lzma.cpython-39-x86_64-linux-gnu.so with build-id: 810ecc0bc799b1431f971f658c371651965cf1f4
                                                   Found module _bz2.cpython-39-x86_64-linux-gnu.so with build-id: 291a71ba37b1263e5a0bb233cc2ca14c98b0aa46
                                                   Found module _ssl.cpython-39-x86_64-linux-gnu.so with build-id: 011a5d57dda3cbcfb78950a7c256b2021e5ba234
                                                   Found module array.cpython-39-x86_64-linux-gnu.so with build-id: 20a1a6c616eb6f809526c5337e375f53c052ba45
                                                   Found module _socket.cpython-39-x86_64-linux-gnu.so with build-id: 6849a82a3a1cb3b2d915a23167afce3254a65d9c
                                                   Found module _blake2.cpython-39-x86_64-linux-gnu.so with build-id: 3153e8e3081ce488d099140f1ee469ae457507f9
                                                   Found module _hashlib.cpython-39-x86_64-linux-gnu.so with build-id: 442f61ca2b902f4f3d9a7325df9aabb71dfbdf24
                                                   Found module libuuid.so.1 with build-id: 832a09e0d9568cc6dbe699472218ea2f79dc0f34
                                                   Found module _uuid.cpython-39-x86_64-linux-gnu.so with build-id: e5a6b0cb7da6595f3d8cf0a985765dc772cf680b
                                                   Found module zlib.cpython-39-x86_64-linux-gnu.so with build-id: 7303adf317b00b5db3f6db6ce628b18db7581163
                                                   Found module _opcode.cpython-39-x86_64-linux-gnu.so with build-id: 9baed6bb5e47a8d8844ccc57c63da77ffc858d75
                                                   Found module _elementpath.cpython-39-x86_64-linux-gnu.so with build-id: 7b3fce00ae69d11698c43420502ec5462b667495
                                                   Found module libexslt.so.0 with build-id: f5860828f4d47235745ff64e625bb86a83bd7dc3
                                                   Found module etree.cpython-39-x86_64-linux-gnu.so with build-id: 513d49c6816a02f409222845552bb81206891401
                                                   Found module unicodedata.cpython-39-x86_64-linux-gnu.so with build-id: 343a2326e65a6d05aaeb7b059a895af692b81d8f
                                                   Found module _datetime.cpython-39-x86_64-linux-gnu.so with build-id: a9fc2ac9a090f840b10b9b8bfd500aff4f9c6317
                                                   Found module binascii.cpython-39-x86_64-linux-gnu.so with build-id: aa7d7f4b6a25cf38164f2d63aac7239a363154db
                                                   Found module _contextvars.cpython-39-x86_64-linux-gnu.so with build-id: dfe93463dbf9f0a53f61afc6a46ac2dc5683a9e3
                                                   Found module _sha512.cpython-39-x86_64-linux-gnu.so with build-id: 0ef24c7eda656f4432aa0eabe528fcb6b4f5511e
                                                   Found module _random.cpython-39-x86_64-linux-gnu.so with build-id: 4e1c9cc5fbf3b0f7a3ac3517f0d105973f699538
                                                   Found module _bisect.cpython-39-x86_64-linux-gnu.so with build-id: 845ad369d716991698f2e1f98047de2090c91971
                                                   Found module select.cpython-39-x86_64-linux-gnu.so with build-id: f919c6a735e270da9d9baad6266967711b125892
                                                   Found module _posixsubprocess.cpython-39-x86_64-linux-gnu.so with build-id: 932f794c98cdf02791e254496f65af86ab798704
                                                   Found module grp.cpython-39-x86_64-linux-gnu.so with build-id: 8b73c4492a1f3631399c44dbd8d0c145ca5948ce
                                                   Found module math.cpython-39-x86_64-linux-gnu.so with build-id: e852cc99938cf320db7d96c163a15acf66bd7a6d
                                                   Found module QtXml.abi3.so with build-id: 9b3953c1811df9ffa226b884909511b33ea164f1
                                                   Found module libQt5X11Extras.so.5 with build-id: e41614d2e35852f913bf00633d635cfbf5a90dce
                                                   Found module QtX11Extras.abi3.so with build-id: 0d7d48315a84c390c8c53c1ccf93c34568f3e017
                                                   Found module libQt5WebKitWidgets.so.5 with build-id: dc78a8965deca1b60eca708b6125d9be290c2ea5
                                                   Found module QtWebKitWidgets.abi3.so with build-id: 08d9a0c6466bfeb7fe76bedce483a27a1bb3789a
                                                   Found module libunistring.so.2 with build-id: 015ac6d6bcb60b7d8bea31a80d1941b06e8636ab
                                                   Found module libpsl.so.5 with build-id: 0229a201aaf5652186c9fdc192ebe52baf19d7f1
                                                   Found module libssh2.so.1 with build-id: 7f6d9edd2e793b266cae4f22fc1ba7b6b401c08c
                                                   Found module libidn2.so.0 with build-id: 1ce2b50ad9f9821c2c629b521cf5a3c99593d332
                                                   Found module libnghttp2.so.14 with build-id: 5ca39b42e7cb2770878644d57e88677df6336815
                                                   Found module libcurl.so.4 with build-id: 49c0cb842d0e0dad11c435b7fb88b3d88b8a43ac
                                                   Found module libdebuginfod.so.1 with build-id: 86f71818d2efaeac394288649d3e4f5fd2febc88
                                                   Found module libelf.so.1 with build-id: cc912d9cef94d907317afba5edd9176e9828e776
                                                   Found module libblkid.so.1 with build-id: f03a24e92c9852272bd0049b5bcb7ed6cf0e664f
                                                   Found module liborc-0.4.so.0 with build-id: a95fb07ab70adc17bb91684e07695723aac3a4b8
                                                   Found module libdw.so.1 with build-id: b48e4534fe5c7511a870ee7ee8e448ac21a2b920
                                                   Found module libunwind.so.8 with build-id: de4aafba062ffac19b3a0cedace42d0616ef9c1e
                                                   Found module libmount.so.1 with build-id: ff9a1d99d35cf640d0bfdaba294854372672c29b
                                                   Found module libgmodule-2.0.so.0 with build-id: 1c305e1a08706be35604a78f8d99a567274a0217
                                                   Found module libwoff2common.so.1.0.2 with build-id: 366330fae3eb439543a00a3b2e9a0cf92f3cf36c
                                                   Found module libgobject-2.0.so.0 with build-id: a6d338dd0fd6bb335a4010b838f5173c6cbf953a
                                                   Found module libgstfft-1.0.so.0 with build-id: 0abc2dd501daac8da8ca067e72c44b487fc33b17
                                                   Found module libgstvideo-1.0.so.0 with build-id: e5c9eda0e55e0182493a16055bc1a6ed65ae03c6
                                                   Found module libgsttag-1.0.so.0 with build-id: b3dbfeb24be49ef3e31ac03c098894de6697f7ed
                                                   Found module libgstaudio-1.0.so.0 with build-id: ae1808136012d8f99c1acc300b9c540f9887fe16
                                                   Found module libgstpbutils-1.0.so.0 with build-id: 1ee08ce498e40e292fc4d694cf9b3293ee53f168
                                                   Found module libgstreamer-1.0.so.0 with build-id: 12904c8a66d5a8d3c04fee6aa72fb1fc2bf27309
                                                   Found module libgstbase-1.0.so.0 with build-id: 5e114af375570125e12a5086b458064caefb4879
                                                   Found module libgstapp-1.0.so.0 with build-id: 8db6b20c28ce9a0feb9b24e06a586026c019ae29
                                                   Found module libgio-2.0.so.0 with build-id: 6fb2e9431ef3524f75b1eb28b4ee37aad2405fac
                                                   Found module libsqlite3.so.0 with build-id: b5c21727dd6a9dcb95e6e57c0767158fddcb3245
                                                   Found module libxslt.so.1 with build-id: 6085ceddf5c745052dc31c6dcea8e03b24b9f0f2
                                                   Found module libxml2.so.2 with build-id: b9441ffabb52b50c290152592f17cd78a381d493
                                                   Found module libhyphen.so.0 with build-id: bf921c6bbb4feaa536e29f1ae72d3a9e79b6f98e
                                                   Found module libwebp.so.7 with build-id: 87e81472aa7ff3ed1061cfc13d6960dbe00c35ab
                                                   Found module libjpeg.so.8 with build-id: 5d102b1a7291a621bba049969d25ead0ccecc6cc
                                                   Found module libwoff2dec.so.1.0.2 with build-id: f305ec18581a18e8c83f5c3f5bcbe188eeb1b34c
                                                   Found module libQt5WebKit.so.5 with build-id: a23b0b9fb95bd4c8b5309d753bab8b372c2b36c5
                                                   Found module QtWebKit.abi3.so with build-id: 1f80d271f2523bb91df86c68c72c84c045dcac36
                                                   Found module libQt5WebChannel.so.5 with build-id: 54ffa5c03fdd8d800d13b70f106139e94aa4f3ef
                                                   Found module QtWebChannel.abi3.so with build-id: 58cbe68d18edb1527900e41379e0ece6c25c78a1
                                                   Found module libQt5TextToSpeech.so.5 with build-id: 99b56b543380180d6f5c8c984f01d80487672cff
                                                   Found module QtTextToSpeech.abi3.so with build-id: e72f455d647823d88e15377b6523dde37cb6f0d5
                                                   Found module libQt5Test.so.5 with build-id: 01b1cd3b138ae3a34a40d79a8edb09c5646fc475
                                                   Found module QtTest.abi3.so with build-id: d13a7368692f90d4982b3e9c615ee995161fc127
                                                   Found module libQt5Svg.so.5 with build-id: 926a697e0d991ee22ee414c13c9b75c253fc1d4d
                                                   Found module QtSvg.abi3.so with build-id: 321fb3d4a22798da7e001039483769da344a41a3
                                                   Found module QtSql.abi3.so with build-id: bd60323fed81f8ede27b5f61cd02b516f21dc6a5
                                                   Found module libQt5Sensors.so.5 with build-id: e1b5ed1cea5191ba9970c286e557d30df1ab5bd8
                                                   Found module QtSensors.abi3.so with build-id: cb3d3bb4386581f6e74d8c9ea621d496ef3699c4
                                                   Found module libQt5QuickWidgets.so.5 with build-id: 40ef5bd18aebd12c92e079995c988e63d5225f4b
                                                   Found module QtQuickWidgets.abi3.so with build-id: a65dd4ae88abd672ac2094ac02b184a0c7dd5cf4
                                                   Found module QtQuick.abi3.so with build-id: 29f5f564c8cbb3aae67155cb87b3d6073692a767
                                                   Found module libQt5PrintSupport.so.5 with build-id: 61869125c97f231fbd44f1cf20b2336ac3a492f3
                                                   Found module QtPrintSupport.abi3.so with build-id: 9f8f67e810ad8a903fcb78c5542e07b67780184c
                                                   Found module libQt5QmlModels.so.5 with build-id: d22088cee3e54c1b82a9a876daa1bbc64628d9cd
                                                   Found module libQt5Quick.so.5 with build-id: 1ed6e9d301e83514c8105d6746995de9404ddede
                                                   Found module libQt5PositioningQuick.so.5 with build-id: ca450a8bd07a3ae2f7cbc96701171b699d7f8daa
                                                   Found module libQt5Location.so.5 with build-id: 76fd16016759599a26015592de42c1b11a8aa40c
                                                   Found module QtLocation.abi3.so with build-id: 465873976e93d101293280b4a976a4a3e692d818
                                                   Found module libQt5Positioning.so.5 with build-id: c638af0407ed24d7e28b741fa5605ce6856214df
                                                   Found module QtPositioning.abi3.so with build-id: 687f7241562b05424553de175daaf1bbe986a2e5
                                                   Found module libQt5OpenGL.so.5 with build-id: 2b05019d086acd3325fe2057db510ebb1f1ffeb3
                                                   Found module QtOpenGL.abi3.so with build-id: bf57373c81d5a58272648aad1d3bd96edade0ffa
                                                   Found module libQt5MultimediaWidgets.so.5 with build-id: 9ab7cda9117494d9455ea51036239989cf4879f5
                                                   Found module QtMultimediaWidgets.abi3.so with build-id: e4a7cd79b17b04007fdac652e804fd63d28b1793
                                                   Found module libogg.so.0 with build-id: ca0cae30a809f10db1f16e54a23b4e5ff7b2c54c
                                                   Found module libvorbis.so.0 with build-id: ad0a6c1af8f219b4e314090b6e8847223d424cbe
                                                   Found module libopus.so.0 with build-id: 649d3ddab8764d7caf73648004a35cb13e23a5e1
                                                   Found module libFLAC.so.8 with build-id: e568dc3d434723c72d6d302eb0b2559f27e91faa
                                                   Found module libvorbisenc.so.2 with build-id: 28ed815b8b1d322e6bf2bfdce4b0af2789b74335
                                                   Found module libasyncns.so.0 with build-id: 6acff139d56b5139ce5eb50a66c62b215e1d332d
                                                   Found module libsndfile.so.1 with build-id: 72d5531e74ed3e9afe49e95e449c40cb8984a258
                                                   Found module libpulsecommon-15.0.so with build-id: a2e110b7a0b3bb46e42515afd55a61d78185835b
                                                   Found module libpulse.so.0 with build-id: 10bd0ce0cfbb9405cee189faa1830cf34cab61a8
                                                   Found module libQt5Multimedia.so.5 with build-id: 9e70700469b6663e71a35b573ed819cf63b1feae
                                                   Found module QtMultimedia.abi3.so with build-id: f992b59f3e717c1fb00efbfa83245723352a61db
                                                   Found module libQt5Sql.so.5 with build-id: 9935d05998ac2e09b1c0829aa5ad976d1e7eee5d
                                                   Found module libQt5Help.so.5 with build-id: 9dcd364bc0ffe5d52be1bbf156a9e54b9cf69d4b
                                                   Found module QtHelp.abi3.so with build-id: d77bc6c6b5ebd5651c01fad2fb3ef3efb5827a16
                                                   Found module libQt5Xml.so.5 with build-id: 274f34bf4a381c160f515d585dc700afe84c9e26
                                                   Found module libQt5Designer.so.5 with build-id: 47a30f62ebeb905d089072b6114c23aa26c0522a
                                                   Found module QtDesigner.abi3.so with build-id: 3e83ca87e3f6e89d99d81a7b8cbe6dc4bc5eadd6
                                                   Found module libdbus-1.so.3 with build-id: 74f2ab9c60512f3a93c932c3f627564d42e0b11e
                                                   Found module libQt5DBus.so.5 with build-id: 9b913e483c1701d15899015a4c1d9a065fe09c17
                                                   Found module QtDBus.abi3.so with build-id: 58b8e4910d8e4d7a8eb076ce9fbf9f72e2733d06
                                                   Found module libQt5Qml.so.5 with build-id: 92006af8b04f29d7af10797e88969c614f450203
                                                   Found module QtQml.abi3.so with build-id: 12eab7b5940a43313a72a0806f2847e88228fbe1
                                                   Found module libQt5Widgets.so.5 with build-id: 9d20183c18dfb4310a7f5794068d465159dfec85
                                                   Found module QtWidgets.abi3.so with build-id: c8d1f7ba75fc8aa87d8a38a74a3d93e729900959
                                                   Found module libXdmcp.so.6 with build-id: 8ca0792d23c8b8b4c0864297512349292bea5955
                                                   Found module libXau.so.6 with build-id: 1c67764663e07bec24d8951e5fd93f4d165979ff
                                                   Found module libbrotlicommon.so.1 with build-id: f68934f94312f770550ebc6c5acfd6359b098b07
                                                   Found module libxcb.so.1 with build-id: 0d1ef11740a5daad2ee331e812a51aa6574af222
                                                   Found module libbrotlidec.so.1 with build-id: f871e6f204ab8d48099915126ba01be989a8000f
                                                   Found module libbz2.so.1.0 with build-id: 919597c477c9b2cb9cdbb7745ed6494ac0e6da60
                                                   Found module libX11.so.6 with build-id: e9192497aa39fab51358826d1a1b5fb77edc5081
                                                   Found module libgraphite2.so.3 with build-id: 47761dc11e553f519cde97ed9ee985be12ccdae2
                                                   Found module libfreetype.so.6 with build-id: b6b9c1805ac6ce6807483feb5c7603293ee5ec19
                                                   Found module libGLX.so.0 with build-id: 46506ec29217449396b9ca7fb3fcb434587a1325
                                                   Found module libGLdispatch.so.0 with build-id: 71de43b4607206a0e6d5d3e2d8e9b61dfcf23770
                                                   Found module libmd4c.so.0 with build-id: 2151dba72cdc9960097e6e960a58a2f03c8bb96e
                                                   Found module libharfbuzz.so.0 with build-id: 8463c8048bb22a54aa3ed291097d5952a4063637
                                                   Found module libpng16.so.16 with build-id: 2dc0bce07f199bf983c07a05fb95a6f4af83a9b3
                                                   Found module libGL.so.1 with build-id: c293b92f10cbc9574c45ff4e4c123fec01ab6b78
                                                   Found module libQt5Gui.so.5 with build-id: a8773b7b770b5368f360b24cf53ff7e423050938
                                                   Found module QtGui.abi3.so with build-id: a1afb267be050ff6635a18df43d276a32f570778
                                                   Found module libresolv.so.2 with build-id: c915c72668282861a813f7ea3c0780f37b681dc0
                                                   Found module libkeyutils.so.1 with build-id: ac405ddd17be10ce538da3211415ee50c8f8df79
                                                   Found module libkrb5support.so.0 with build-id: adf65240a4d2aba772d7a0772b4d015469934113
                                                   Found module libcom_err.so.2 with build-id: eb61ef71c8b97846db759fb89a115405cff6dd30
                                                   Found module libk5crypto.so.3 with build-id: eb8220b8f36675aac769450be4cb6bb7f97ec38a
                                                   Found module libkrb5.so.3 with build-id: 72d26767c5cb1097db75a5f5bff88860233c902b
                                                   Found module libcrypto.so.1.1 with build-id: 6d23f0a3f354825868d044684fad31d482cc9210
                                                   Found module libssl.so.1.1 with build-id: 959cd8f1dd43fc31aeb93caac4eda87c907ef18b
                                                   Found module libgssapi_krb5.so.2 with build-id: e6e098ad51ce7bdd3dbe902d7b0f69a90f8a9e08
                                                   Found module libQt5Network.so.5 with build-id: 68bfc5d087c05ee59d5cedd71a4764ce815cf1d9
                                                   Found module QtNetwork.abi3.so with build-id: 2e3b25d3bb46842ebe4fc6c0baa6846865c6aa98
                                                   Found module sip.cpython-39-x86_64-linux-gnu.so with build-id: 1edd1d4e00462ba53150a8a24c66894db323b667
                                                   Found module libgpg-error.so.0 with build-id: ba85170c2d9343ea05eea8fa2048c212ff4ef552
                                                   Found module libpcre.so.1 with build-id: 845483dd0acba86de9f0313102bebbaf3ce52767
                                                   Found module libicudata.so.69 with build-id: 0ab994a49ef1848499c4af333b3266f28432a922
                                                   Found module libgcrypt.so.20 with build-id: db45f5d5e0f7af1e77324fea1885f974619ad268
                                                   Found module libcap.so.2 with build-id: e5698e341f259c990af983244c9368a60d175aac
                                                   Found module liblz4.so.1 with build-id: e63600ab23b2f6997f42fac2fa56e1f02ce159a1
                                                   Found module liblzma.so.5 with build-id: f8d607153b2b315f1aaa1c8e12553d544e661f2d
                                                   Found module librt.so.1 with build-id: 75484da2d6f1515189eefa076e0a40328834cd16
                                                   Found module libgcc_s.so.1 with build-id: 7f8508bb914546ada778809b64b99d234337d835
                                                   Found module libglib-2.0.so.0 with build-id: 059b1bf3efd0a9ccb2beba9fced88e7f7bc4f6ca
                                                   Found module libzstd.so.1 with build-id: 4b10444c1560ebc574af4d5f488b7408b22d450e
                                                   Found module libpcre2-16.so.0 with build-id: 983354d71426f38a37695490499fc89d050d7cc5
                                                   Found module libicuuc.so.69 with build-id: 5cf18c56e2f64efdac32cf61fb9c0c48e9bb1797
                                                   Found module libicui18n.so.69 with build-id: 9cdecde5b2e47a2bd81dc14915cbfefcade76c12
                                                   Found module libdouble-conversion.so.3 with build-id: 5bffb4317594514068e082d4b4e9acd99987ec47
                                                   Found module libz.so.1 with build-id: 81bf6e728a6d6f5b105b0f8b25f6c614ce10452a
                                                   Found module libsystemd.so.0 with build-id: f776aaa16b4e2ba7056d01d928e4b2726ffe2b8b
                                                   Found module libstdc++.so.6 with build-id: 8ab0e57054dd1dcba681f217016afc6a4e639783
                                                   Found module libQt5Core.so.5 with build-id: c64628e7d9f71477150fd382b63907957cc067e3
                                                   Found module QtCore.abi3.so with build-id: 230262db654c39b9eee66efbf0402300e9e6912f
                                                   Found module Qt.abi3.so with build-id: d001f0a3c313d46e26f69530ba65bd513a821936
                                                   Found module _struct.cpython-39-x86_64-linux-gnu.so with build-id: 9e3422b00d5f11fbce0ce6ee94b8bf7e414acfe6
                                                   Found module libffi.so.7 with build-id: de60e99f39569d11d09160bbdcd486cedc87d2b6
                                                   Found module _ctypes.cpython-39-x86_64-linux-gnu.so with build-id: 75ed552ad65a168bee00708636003f04f6d1b6d2
                                                   Found module _json.cpython-39-x86_64-linux-gnu.so with build-id: 12d76791795fd0de167124fa43f7f710fb703956
                                                   Found module _heapq.cpython-39-x86_64-linux-gnu.so with build-id: 1939c6979f41378cc35e731708cfc0086265a5c4
                                                   Found module ld-linux-x86-64.so.2 with build-id: 040cc3dd10461562f177df39e3be2f3704258c3c
                                                   Found module libm.so.6 with build-id: 2b8fd1f869ecab4e0b55e92f2f151897f6818acf
                                                   Found module libutil.so.1 with build-id: af6d8200064ee6e6a01252884d166b44f0a6121b
                                                   Found module libdl.so.2 with build-id: 5abc547e7b0949f89f3c0e21ab0c8331a7440a8a
                                                   Found module libpthread.so.0 with build-id: 07c8f95b4f3251d08550217ad8a1f31066229996
                                                   Found module libc.so.6 with build-id: 4b406737057708c0e4c642345a703c47a61c73dc
                                                   Found module libpython3.9.so.1.0 with build-id: 44da06e8bfa38c81b0cbf272e4904b01563a4ec4
                                                   Found module python3.9 with build-id: f9d7f05cffc4118c683a1820730103ac83e90853
                                                   Stack trace of thread 7490:
                                                   #0  0x00007fbea5d74035 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xb6c035)
                                                   #1  0x00007fbea5dd0fcb n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xbc8fcb)
                                                   #2  0x00007fbea5daa476 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xba2476)
                                                   #3  0x00007fbea5cf8944 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xaf0944)
                                                   #4  0x00007fbea5d0316f n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xafb16f)
                                                   #5  0x00007fbea5cfc4f2 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xaf44f2)
                                                   #6  0x00007fbea5cda914 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xad2914)
                                                   #7  0x00007fbeb3c58acd n/a (libffi.so.7 + 0x6acd)
                                                   #8  0x00007fbeb3c5803a n/a (libffi.so.7 + 0x603a)
                                                   #9  0x00007fbeb2f2ce27 n/a (_ctypes.cpython-39-x86_64-linux-gnu.so + 0x7e27)
                                                   #10 0x00007fbeb2f363df n/a (_ctypes.cpython-39-x86_64-linux-gnu.so + 0x113df)
                                                   #11 0x00007fbeb39a7333 _PyObject_MakeTpCall (libpython3.9.so.1.0 + 0x131333)
                                                   #12 0x00007fbeb39a3218 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x12d218)
                                                   #13 0x00007fbeb39ae96b _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x13896b)
                                                   #14 0x00007fbeb39bd8a4 n/a (libpython3.9.so.1.0 + 0x1478a4)
                                                   #15 0x00007fbeb39a2c71 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x12cc71)
                                                   #16 0x00007fbeb39ae96b _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x13896b)
                                                   #17 0x00007fbeb399e339 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128339)
                                                   #18 0x00007fbeb39ae96b _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x13896b)
                                                   #19 0x00007fbeb399e339 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128339)
                                                   #20 0x00007fbeb399cfd9 n/a (libpython3.9.so.1.0 + 0x126fd9)
                                                   #21 0x00007fbeb399cc41 _PyEval_EvalCodeWithName (libpython3.9.so.1.0 + 0x126c41)
                                                   #22 0x00007fbeb3a53ae3 PyEval_EvalCode (libpython3.9.so.1.0 + 0x1ddae3)
                                                   #23 0x00007fbeb3a639f4 n/a (libpython3.9.so.1.0 + 0x1ed9f4)
                                                   #24 0x00007fbeb3a5f6cb n/a (libpython3.9.so.1.0 + 0x1e96cb)
                                                   #25 0x00007fbeb390d2d3 n/a (libpython3.9.so.1.0 + 0x972d3)
                                                   #26 0x00007fbeb390c761 PyRun_SimpleFileExFlags (libpython3.9.so.1.0 + 0x96761)
                                                   #27 0x00007fbeb3a754a2 Py_RunMain (libpython3.9.so.1.0 + 0x1ff4a2)
                                                   #28 0x00007fbeb3a46009 Py_BytesMain (libpython3.9.so.1.0 + 0x1d0009)
                                                   #29 0x00007fbeb36d1b25 __libc_start_main (libc.so.6 + 0x27b25)
                                                   #30 0x000055583ece504e _start (python3.9 + 0x104e)

                                                   Stack trace of thread 7496:
                                                   #0  0x00007fbeb37a892e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fbea5f0a94c n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd0294c)
                                                   #2  0x00007fbea5f0c44a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd0444a)
                                                   #3  0x00007fbea5f0bf49 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd03f49)
                                                   #4  0x00007fbea5f0cb7a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd04b7a)
                                                   #5  0x00007fbea5f1f6dd n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd176dd)
                                                   #6  0x00007fbea5f7022f n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd6822f)
                                                   #7  0x00007fbea5f6fb85 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd67b85)
                                                   #8  0x00007fbea5f6f6fd n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd676fd)
                                                   #9  0x00007fbea5f6eb5e n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd66b5e)
                                                   #10 0x00007fbea5f6e296 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd66296)
                                                   #11 0x00007fbeb24f43c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                                                   #12 0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #13 0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7495:
                                                   #0  0x00007fbeb369e8ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                                                   #1  0x00007fbeb3698842 pthread_cond_clockwait (libpthread.so.0 + 0xf842)
                                                   #2  0x00007fbea5f0fc75 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd07c75)
                                                   #3  0x00007fbea5f29bb2 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd21bb2)
                                                   #4  0x00007fbea5f27beb n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd1fbeb)
                                                   #5  0x00007fbea5f25ae0 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd1dae0)
                                                   #6  0x00007fbea5f238bc n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd1b8bc)
                                                   #7  0x00007fbea5f1fc63 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd17c63)
                                                   #8  0x00007fbea5f7015d n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd6815d)
                                                   #9  0x00007fbea5f6fabf n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd67abf)
                                                   #10 0x00007fbea5f6f69a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd6769a)
                                                   #11 0x00007fbea5f6eb42 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd66b42)
                                                   #12 0x00007fbea5f6e276 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd66276)
                                                   #13 0x00007fbeb24f43c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                                                   #14 0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #15 0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7499:
                                                   #0  0x00007fbeb3770a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                                                   #1  0x00007fbeb3775c77 __nanosleep (libc.so.6 + 0xcbc77)
                                                   #2  0x00007fbeb37a0a99 usleep (libc.so.6 + 0xf6a99)
                                                   #3  0x00007fbea5d29e9a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xb21e9a)
                                                   #4  0x00007fbea5d2a43f n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xb2243f)
                                                   #5  0x00007fbea5ced625 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xae5625)
                                                   #6  0x00007fbea5ced65c n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xae565c)
                                                   #7  0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #8  0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7498:
                                                   #0  0x00007fbeb37a892e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fbea4b51a41 n/a (libspa-support.so + 0x11a41)
                                                   #2  0x00007fbea4b4ab24 n/a (libspa-support.so + 0xab24)
                                                   #3  0x00007fbea4c46da6 n/a (libpipewire-0.3.so.0 + 0x7bda6)
                                                   #4  0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7500:
                                                   #0  0x00007fbeb3770a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                                                   #1  0x00007fbeb3775c77 __nanosleep (libc.so.6 + 0xcbc77)
                                                   #2  0x00007fbeb37a0a99 usleep (libc.so.6 + 0xf6a99)
                                                   #3  0x00007fbea5d353a3 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xb2d3a3)
                                                   #4  0x00007fbea5d446c2 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xb3c6c2)
                                                   #5  0x00007fbea5ced625 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xae5625)
                                                   #6  0x00007fbea5ced65c n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xae565c)
                                                   #7  0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #8  0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7502:
                                                   #0  0x00007fbeb37a892e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fbea4b51a41 n/a (libspa-support.so + 0x11a41)
                                                   #2  0x00007fbea4b4ab24 n/a (libspa-support.so + 0xab24)
                                                   #3  0x00007fbea4c46da6 n/a (libpipewire-0.3.so.0 + 0x7bda6)
                                                   #4  0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7497:
                                                   #0  0x00007fbeb37a892e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fbea4b51a41 n/a (libspa-support.so + 0x11a41)
                                                   #2  0x00007fbea4b4ab24 n/a (libspa-support.so + 0xab24)
                                                   #3  0x00007fbea4c0ccd0 n/a (libpipewire-0.3.so.0 + 0x41cd0)
                                                   #4  0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7494:
                                                   #0  0x00007fbeb37a892e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fbea5f0a94c n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd0294c)
                                                   #2  0x00007fbea5f0c44a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd0444a)
                                                   #3  0x00007fbea5f0bf49 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd03f49)
                                                   #4  0x00007fbea5f0cb7a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd04b7a)
                                                   #5  0x00007fbea5f1aa30 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd12a30)
                                                   #6  0x00007fbea5f702f2 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd682f2)
                                                   #7  0x00007fbea5f6fc52 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd67c52)
                                                   #8  0x00007fbea5f6f767 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd67767)
                                                   #9  0x00007fbea5f6eb7a n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd66b7a)
                                                   #10 0x00007fbea5f6e2b6 n/a (/tmp/Carla/bin/libcarla_standalone2.so + 0xd662b6)
                                                   #11 0x00007fbeb24f43c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                                                   #12 0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #13 0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7501:
                                                   #0  0x00007fbeb37a892e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fbea4b51a41 n/a (libspa-support.so + 0x11a41)
                                                   #2  0x00007fbea4b4ab24 n/a (libspa-support.so + 0xab24)
                                                   #3  0x00007fbea4c0ccd0 n/a (libpipewire-0.3.so.0 + 0x41cd0)
                                                   #4  0x00007fbeb3692259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fbeb37a85e3 __clone (libc.so.6 + 0xfe5e3)
Sep 11 13:47:59 lbenard-pc systemd[917]: jack-carla-rack.service: Main process exited, code=dumped, status=11/SEGV
Sep 11 13:47:59 lbenard-pc systemd[917]: jack-carla-rack.service: Failed with result 'core-dump'.
Sep 11 13:48:03 lbenard-pc systemd[917]: /home/lbenard/.config/systemd/user/jack-carla-rack.service.d/override.conf:1: Assignment outside of section. Ignoring.
Sep 11 13:48:03 lbenard-pc systemd[917]: /home/lbenard/.config/systemd/user/jack-carla-rack.service.d/override.conf:2: Assignment outside of section. Ignoring.
Sep 11 13:48:03 lbenard-pc systemd[917]: /home/lbenard/.config/systemd/user/jack-carla-rack.service.d/override.conf:3: Assignment outside of section. Ignoring.

Also worth pointing out I'm almost sure I already read a stack trace involving similar malloc functions as the first post. I'll update you once I have time to dig deeper and get a full report from crashing Carla manually and not through loading a rack, because I feel like this might be two unrelated issues.

I have tried PYTHONMALLOC=malloc, while this seemed to work at first, the service kept crashing after a while and I wasn't able to figure out why.

Here's the rack I used with my service, although Carla still randomly crashes when working on a completely blank project after adding plugins and routing to hardware, loading it almost always result in a crash. rack.tar.gz

falkTX commented 3 years ago

Well you dont have to look much, this line is pretty obvious to me:

Carla assertion failure: "nframes == pData->bufferSize" in file CarlaEngineJack.cpp, line 2889, v1 2048, v2 1024

pipewire is calling carla audio process with a number of frames that does not match the currently active buffer size. I dont expect things to work at all while this goes on.

luckily pipewire had a fix for this just a few hours ago. worth trying to update to latest git.

on this specific instance, doesnt look like a carla fault but pipewire. on issues like this, best to try with real jack first before assuming it is a carla issue.

lbenard commented 3 years ago

I updated pipewire and managed to crash and get a core dump (which really differs from the first I sent so maybe a separate issue)

And sorry I wasn't paying that much attention to the assertion failure as I didn't think they could cause a SIGSEGV. The original issue seemed similar enough.

However the buffer size indeed seemed to be the cause as the stack trace comes from a _ZN12CarlaBackend11CarlaEngine17bufferSizeChangedEj function, and everything works now that I've set a fixed buffer size in pipewire.conf. I don't know much about the audio field, I saw that pipewire dynamically changes buffer sizes, is this something that Carla doesn't expect to happen or cannot handle?

Now it's probably less needed but, but here's the stack trace from before I set a fixed buffer size (this time similar to the first post, not loading any project file):

Message: Process 2972 (carla) of user 1000 dumped core.

                Found module linux-vdso.so.1 with build-id: 769e227227c49da74218ef612c41377c30d80327
                Found module UTF-32.so with build-id: d413b912944fa61f9ca6e86efda5c3ee9358bbcb
                Found module libpixman-1.so.0 with build-id: 341f793dcada3a48a306a793d265a517e3f2e7d6
                Found module libcairo.so.2 with build-id: 06820af9cf79c2deb207d9533a61caf04e67a8ad
                Found module lsp-plugins-lv2.so with build-id: f4dd69e4a60bfe6f0503f294c555f8b22297296a
                Found module librnnoise_ladspa.so with build-id: 2c00e77e201b41f4f4bf2bb2ee63ac40e43ab0d9
                Found module libpipewire-module-metadata.so with build-id: bd7b55e2a38361172ab99d98100dd5dd62facb67
                Found module libpipewire-module-client-node.so with build-id: 3f2a393fc75afbb2a1b20802c5ce96986f1de114
                Found module libpipewire-module-protocol-native.so with build-id: 125cf33fe0011de43ad4f0509e660f1d9daa9911
                Found module libpipewire-module-rt.so with build-id: 15c34fc76a6a2c3587dd39c2a5a2e906c37507fe
                Found module libspa-dbus.so with build-id: f5961b87e1f9894bf4a0aca2d5ddb7b275025556
                Found module libedit.so.0 with build-id: ecb6f9683081f815044f095d665d24c4bde1efa8
                Found module libvulkan.so.1 with build-id: 46fc06f6d5b60d01ed1074d5febdcaff5c0e0ce9
                Found module libdrm_nouveau.so.2 with build-id: 90ddb582b57a61a46d1ebf6c993675f70dac7443
                Found module libdrm_amdgpu.so.1 with build-id: a89ceb7c9082e5276f39023716eb4d194e75f6b8
                Found module libdrm_radeon.so.1 with build-id: f6eef9ddb9d1db72080e709ce423f6bad7ea06f7
                Found module libsensors.so.5 with build-id: dc8b2c1c0d8525411aca188ea3cc3fb86d381d30
                Found module libLLVM-12.so with build-id: d1f4954a30a9c39d86e0b944607e0ca8020d651e
                Found module radeonsi_dri.so with build-id: bb431d95f12e0638ba70ef2e4f688c1cc16ad935
                Found module libxshmfence.so.1 with build-id: 8876d9ccf620858795724ca24b9e567585a77cec
                Found module libxcb-present.so.0 with build-id: 68f5465258750e2397b1333b3ffc01ee33caa4e1
                Found module libxcb-dri3.so.0 with build-id: 9407a2480e09dc5a1dd9d9a0652fa8d32b328c91
                Found module libXxf86vm.so.1 with build-id: 01e8243d0c6c971fa9e743e6e53d606b1cb76f6e
                Found module libxcb-dri2.so.0 with build-id: 2dd6e65129a809dab828a1d26215a3f7a363fcc8
                Found module libdrm.so.2 with build-id: 3aeff5403ca8d7589eabc05752eb613937f454a1
                Found module libglapi.so.0 with build-id: 57828fb70af7c1f2aa70b096d748851a1fd39a9c
                Found module libGLX_mesa.so.0 with build-id: ffd19a505596daa4c3a05fb6907a840623438673
                Found module libxcb-glx.so.0 with build-id: 8ad115382ad874165523dc5b4488c99d73bbc3c4
                Found module libqxcb-glx-integration.so with build-id: c87787b08c848c570a350f1274c53dcf4f00f350
                Found module libcrypt.so.2 with build-id: 3743451bdaf36f951f926927633fd964813025d0
                Found module libnss_systemd.so.2 with build-id: 22990ff716d182c427e26b7a3cf94048b55b3e75
                Found module libnss_files.so.2 with build-id: 1a36dfc01d3a1010b2ee79766a24a8090a3266d5
                Found module libqsvg.so with build-id: a64dfbfd7c6cb62e4c72b3061bdca492811c066b
                Found module libQt5Pdf.so.5 with build-id: 63fd654cf69ca1b1d195ddf59d1cae8ab647d08a
                Found module libqpdf.so with build-id: 723f2a276b8172eb6aae3859ae78b58bc9be3e41
                Found module libqjpeg.so with build-id: be7d2ee2552730f90d13df301f1c22b3440b961d
                Found module libqico.so with build-id: bd4dc6042555ad223429b9726ca5844bd98131c2
                Found module libqgif.so with build-id: b0f5c9ab01ee6bc91aae425adc1c237afd198e96
                Found module libcarla_utils.so with build-id: 9910149debd1d3a2978dbae2ffa2b356fc46a023
                Found module libquadmath.so.0 with build-id: 150b56e19c55382453ff358099c27a0b79173c67
                Found module libfftw3q.so.3 with build-id: 379f35239a73f21fbfd3db102975d80218efe259
                Found module libfftw3q_threads.so.3 with build-id: d2a866e1ecb87e42bc58deaf47b7476cb4f86ba9
                Found module libfftw3l.so.3 with build-id: 18a43cd33e6c1ae603ae9a5f7070fbaa01a5d8a2
                Found module libfftw3l_threads.so.3 with build-id: 55cf11625b601401e2b570b3897377bb3d25d67c
                Found module libfftw3f.so.3 with build-id: 54fcd276a00d415f10613e278c9b83fd2f5545c1
                Found module libfftw3f_threads.so.3 with build-id: bd606fb8c9e76390138404cec85e96a269f18744
                Found module libfftw3.so.3 with build-id: 92d83d28091b426f04108d71a38d1cfdc4005ddb
                Found module libfftw3_threads.so.3 with build-id: 6f07a37617e65c97191d5f706120742ddebf8674
                Found module libspa-journal.so with build-id: edee1f739a552b9c34ea0160cd92781e0314b785
                Found module libspa-support.so with build-id: ede3e97ae80a415783c4be0aed82f6a6ed682db7
                Found module libncursesw.so.6 with build-id: 4118a7b0a2a0de8f6359df5b61c6c59a9e13a4d5
                Found module libpipewire-0.3.so.0 with build-id: 6833a9e4b50ad5937888ac1036847473a4e7d98c
                Found module libinstpatch-1.0.so.2 with build-id: be6cf8f475d8e460ce2046e6cb8d822c11008398
                Found module libgomp.so.1 with build-id: 1cb25691b8e34e1ce54698066bce0fb29f5cf9fa
                Found module libreadline.so.8 with build-id: 50c2746af3cf9fa7373e6ba6d9b2bc0a2ef7735a
                Found module libSDL2-2.0.so.0 with build-id: 70c49ed8e8ed7e64426d58d94174682886394c28
                Found module libportaudio.so.2 with build-id: 305f95e5abdce86725f76773b241fbe88342102f
                Found module libjack.so.0 with build-id: 464e12928cc03e488bf012fe31c8defaa75261cf
                Found module libpulse-simple.so.0 with build-id: 5891a9b3e33b7dd638e4ca6839b837e42343c8e2
                Found module libasound.so.2 with build-id: 9288c92ff737b1999761df2018fcd0e7cbf46d5a
                Found module libfluidsynth.so.3 with build-id: 696a93f91d7d0936146e031df4be15b4fdbf571a
                Found module libmagic.so.1 with build-id: cccfec8f9dca03a141e1210b460f13b26ab1fe88
                Found module liblo.so.7 with build-id: f6d84b6a2ba20a1dbe0124b8124e7d806ad3cd09
                Found module libcarla_standalone2.so with build-id: d4679313c21ae134ef606703a2a10e07fb3c1ad6
                Found module libqsvgicon.so with build-id: 0715b2f7d8b7c628eeee54d77af83aef47675dc3
                Found module libcomposeplatforminputcontextplugin.so with build-id: ae32608db6d28ea3ecf23757601228688bb7976a
                Found module libgmp.so.10 with build-id: e58d34ab389d1b649c24195c2d145e3ff2e58290
                Found module libhogweed.so.6 with build-id: 2d70cff7b1841b4d9ca4e8e7726cd4b944c07fdc
                Found module libnettle.so.8 with build-id: 9a878e513c02007598fcf1e2e286c2203f13536e
                Found module libp11-kit.so.0 with build-id: 5314ec746546ada6f442b6fdfae15eab9f6d3cdc
                Found module libwayland-cursor.so.0 with build-id: a8b45436314425ee9a92efaff68bd2b79f870e77
                Found module libusbmuxd-2.0.so.6 with build-id: fd9f05e7f5b0da4e15972f75b61fd9b4b9f06dbe
                Found module libtasn1.so.6 with build-id: 4df18bd1f13772f0956191e137eb00d9bd6238c5
                Found module libgnutls.so.30 with build-id: 8c87466eacaec0041a370df713d0fd200358c94c
                Found module libXi.so.6 with build-id: 0557077390d87019cd9e0b3bb849643eaca73e30
                Found module libXext.so.6 with build-id: d70f24beb4fad748d6becffdcc13e51be0a2ebfa
                Found module libltdl.so.7 with build-id: 64bc54a40a0b6e4209a2c712364b4ae653c3f5b2
                Found module libtdb.so.1 with build-id: bec061530310665480ee91395b4eb0a937750a03
                Found module libvorbisfile.so.3 with build-id: 0010b21da05e318b42e718d90738febf58028141
                Found module libQt5WaylandClient.so.5 with build-id: 5eff48f3ab497b0b39e24d88a53ea011ac39dd7e
                Found module libplist-2.0.so.3 with build-id: b4dd02ee2d5938fd2bfa34070014f4d30a21abd6
                Found module libimobiledevice-1.0.so.6 with build-id: b7197d5ba7e40162e4d3f4eb92b4b589b8e5fe1e
                Found module libudev.so.1 with build-id: 880e57f50a36ddbfe80dbe5f62d43860f960c797
                Found module libKF5Archive.so.5 with build-id: 0e9e336d238f4f443d05e0219bd8256630fbd550
                Found module libKF5GlobalAccel.so.5 with build-id: 1f6941bf121b3ea6560dbe3f5f492f85779b8f67
                Found module libacl.so.1 with build-id: 35319ea4baa70564deddffb113c0961002bc394c
                Found module libKF5AuthCore.so.5 with build-id: 371c3caa7e0ebbe205bff247efc254cef7702a15
                Found module libKF5DBusAddons.so.5 with build-id: 4cdd83aeb01d0486a455c3e2a02ceeea4ec0a5ea
                Found module libKF5Crash.so.5 with build-id: e971aff373671fdcdddc701a87d8abc24a64f6eb
                Found module libQt5QuickTemplates2.so.5 with build-id: df09d36058107f30056e6c79eaa682e9d9e4f2c2
                Found module libwayland-client.so.0 with build-id: 58038363d7ea1fd5e6532f6e5f90b1a3ce09388a
                Found module libdbusmenu-qt5.so.2 with build-id: 82cbd5bfb1d800b5991deb040afbefec7b11fc81
                Found module libXtst.so.6 with build-id: 96411faea62997274e362f263e65082e601a787b
                Found module libcanberra.so.0 with build-id: 379ed64f9d1408a83806cd5d94dc5bb903765615
                Found module libKF5Service.so.5 with build-id: 612a4fd50963ff6394effd7e8828f36e8bbe83c9
                Found module libKF5KIOGui.so.5 with build-id: abcd1845e65fdd4514096286534a7faa6373bfce
                Found module libKF5Codecs.so.5 with build-id: b822ab37637baeae1a24b9fc7f63fb9e2c403a4b
                Found module libKF5GuiAddons.so.5 with build-id: d5db41aba5dbafc801a4450fcd0334c75e98f294
                Found module libKF5ItemViews.so.5 with build-id: 84c3e8bb9ecf21b0aa8820e068f7b0901909a925
                Found module libKF5Solid.so.5 with build-id: b86751459ab0fcfd272bdce737152be09c257704
                Found module libKF5Bookmarks.so.5 with build-id: 08739160e3ce71f2b79ec47898d0363ba166ec88
                Found module libKF5CoreAddons.so.5 with build-id: d833accc5faccd874dad5e883d3a82ca5da1a6e4
                Found module libKF5WindowSystem.so.5 with build-id: 739dd4807fd7ae15f841d35791dbb00d273fae95
                Found module libKF5ConfigCore.so.5 with build-id: 864ed1e04b5e97d635e1c8825019c59923bdf4e2
                Found module libKF5WidgetsAddons.so.5 with build-id: b66c06f65033140b49ef02029723e9e48240fef9
                Found module libKF5I18n.so.5 with build-id: bd4217a9a0522d1dfe9129ca1d2ed4ec42ce7550
                Found module libKF5ConfigGui.so.5 with build-id: dcf45282279df62e81bc7045e92af391aa63e116
                Found module libKF5ConfigWidgets.so.5 with build-id: 16c10b6cb807abcc1b78657b4e6e520f4b8cd4df
                Found module libKF5IconThemes.so.5 with build-id: ed2e2c94e195e71694edc36e518c69528e67ac80
                Found module libKF5XmlGui.so.5 with build-id: fbc118f0632da304efe96d8dd76a8f012fd8e76b
                Found module libKF5Completion.so.5 with build-id: 87b219dce74ae1eb0a1e47e424529ec3e1f4f020
                Found module libKF5JobWidgets.so.5 with build-id: 3832da5a2f2db62a91c8ac3441ab173cd0fe4e30
                Found module libKF5KIOCore.so.5 with build-id: 2ee50d8e7ce11b54833127fb65faef9c99075d80
                Found module libQt5QuickControls2.so.5 with build-id: a5978d717db15098905b6e50b7c83cd507df4c77
                Found module libKF5WaylandClient.so.5 with build-id: 4d50af83311c4d627df7e9a193cce7a3c72989ec
                Found module libKF5Notifications.so.5 with build-id: b7d727f31536ededd0d5ef18115bfaacc46874ea
                Found module libKF5KIOWidgets.so.5 with build-id: 803695fbc13283d83286b270325fcd2eb8abcaaa
                Found module libKF5KIOFileWidgets.so.5 with build-id: 3ed37fc7ce347a47f015f21cd375b96cfd6e1abc
                Found module KDEPlasmaPlatformTheme.so with build-id: d77edfde492553b221b491b2e631ec80aace5093
                Found module libXfixes.so.3 with build-id: 0a05c7e8714522bfbdd7c0027c3e2a94965664b0
                Found module libXrender.so.1 with build-id: 97e0b9ab6ba96ebc86527cc2b3c3078aad8616b3
                Found module libXcursor.so.1 with build-id: eb6315bcd7526aaf51b0a1307efdc587cea0a152
                Found module libxcb-util.so.1 with build-id: 4188ebc629b472b560849c5792a69c1803c3d1a4
                Found module libxkbcommon.so.0 with build-id: 9c297febc9583fd5b65e15f1bd89ec8172e97e50
                Found module libxkbcommon-x11.so.0 with build-id: 0d78d8bcd66ce402d5a7263b71c72c51627e6ab5
                Found module libICE.so.6 with build-id: af53458a64fe1e62a4d95606f7b03c210b2b098c
                Found module libSM.so.6 with build-id: ac7b055fd3f16b4f29373285ab04ed52eebb632d
                Found module libxcb-xinput.so.0 with build-id: 6403174c48f05f40cf7c168beb86f2886b9f09c1
                Found module libxcb-xkb.so.1 with build-id: fce20d2101f3e5439923e9283c489c2cad4420c3
                Found module libxcb-xinerama.so.0 with build-id: b328103ce7502d94fd3a4e2e8773978a9aa84adc
                Found module libxcb-xfixes.so.0 with build-id: a6b197ace5b9b59f913f5969eb419a88d1194f47
                Found module libxcb-sync.so.1 with build-id: dda14591103b01b1311906053bf1ca9e82ade35c
                Found module libxcb-shape.so.0 with build-id: f1b3376c4534fab0469feb1cd19f022ff98df533
                Found module libxcb-render.so.0 with build-id: a37bdb37744b508be9dd29fd9ccb9bb0170d43e5
                Found module libxcb-render-util.so.0 with build-id: c64fb28ea20a320a9754273d9ea3af85f6f74b17
                Found module libxcb-randr.so.0 with build-id: b6c1c7d4b28863b55ade251813db7f246b7ffe8b
                Found module libxcb-keysyms.so.1 with build-id: 333e5eb4075795f947c924a2085f17e2e2ae7147
                Found module libxcb-shm.so.0 with build-id: fb797f299a446f559a95afcc168227482cc800d1
                Found module libxcb-image.so.0 with build-id: ee7f8577926fe7c1d6972036c2f8e6f727e43b1b
                Found module libxcb-icccm.so.4 with build-id: 73f1e12d76af383aa969a60279ed5ed922045f47
                Found module libX11-xcb.so.1 with build-id: 0db4f94d8ae31b8dc9a83f825a9171656f1e532c
                Found module libfontconfig.so.1 with build-id: 1103a641395c7d3b42e49b793d3a9ea927c77bf6
                Found module libQt5XcbQpa.so.5 with build-id: 8b9689410cdfec61a28b6ca994e71328206accd8
                Found module libqxcb.so with build-id: a4c3d9f46783cf41b680a3cea04f04c70a2ec52d
                Found module carlastyle.so with build-id: 937834f2b7c1dc101856dbc20fb987efcd478722
                Found module libexpat.so.1 with build-id: 8850138eae6d9d4d43c5c4b2ac48393bc4279037
                Found module pyexpat.cpython-39-x86_64-linux-gnu.so with build-id: aa06a19b2e6f8c3db83bdd387524b52b60ca7629
                Found module _pickle.cpython-39-x86_64-linux-gnu.so with build-id: 9f2e62f196ad0c8645d229f66a82e65d66a36b6c
                Found module _lzma.cpython-39-x86_64-linux-gnu.so with build-id: 810ecc0bc799b1431f971f658c371651965cf1f4
                Found module _bz2.cpython-39-x86_64-linux-gnu.so with build-id: 291a71ba37b1263e5a0bb233cc2ca14c98b0aa46
                Found module _ssl.cpython-39-x86_64-linux-gnu.so with build-id: 011a5d57dda3cbcfb78950a7c256b2021e5ba234
                Found module array.cpython-39-x86_64-linux-gnu.so with build-id: 20a1a6c616eb6f809526c5337e375f53c052ba45
                Found module _socket.cpython-39-x86_64-linux-gnu.so with build-id: 6849a82a3a1cb3b2d915a23167afce3254a65d9c
                Found module _blake2.cpython-39-x86_64-linux-gnu.so with build-id: 3153e8e3081ce488d099140f1ee469ae457507f9
                Found module _hashlib.cpython-39-x86_64-linux-gnu.so with build-id: 442f61ca2b902f4f3d9a7325df9aabb71dfbdf24
                Found module libuuid.so.1 with build-id: 832a09e0d9568cc6dbe699472218ea2f79dc0f34
                Found module _uuid.cpython-39-x86_64-linux-gnu.so with build-id: e5a6b0cb7da6595f3d8cf0a985765dc772cf680b
                Found module zlib.cpython-39-x86_64-linux-gnu.so with build-id: 7303adf317b00b5db3f6db6ce628b18db7581163
                Found module _opcode.cpython-39-x86_64-linux-gnu.so with build-id: 9baed6bb5e47a8d8844ccc57c63da77ffc858d75
                Found module _elementpath.cpython-39-x86_64-linux-gnu.so with build-id: 7b3fce00ae69d11698c43420502ec5462b667495
                Found module libexslt.so.0 with build-id: f5860828f4d47235745ff64e625bb86a83bd7dc3
                Found module etree.cpython-39-x86_64-linux-gnu.so with build-id: 513d49c6816a02f409222845552bb81206891401
                Found module unicodedata.cpython-39-x86_64-linux-gnu.so with build-id: 343a2326e65a6d05aaeb7b059a895af692b81d8f
                Found module _datetime.cpython-39-x86_64-linux-gnu.so with build-id: a9fc2ac9a090f840b10b9b8bfd500aff4f9c6317
                Found module binascii.cpython-39-x86_64-linux-gnu.so with build-id: aa7d7f4b6a25cf38164f2d63aac7239a363154db
                Found module _contextvars.cpython-39-x86_64-linux-gnu.so with build-id: dfe93463dbf9f0a53f61afc6a46ac2dc5683a9e3
                Found module _sha512.cpython-39-x86_64-linux-gnu.so with build-id: 0ef24c7eda656f4432aa0eabe528fcb6b4f5511e
                Found module _random.cpython-39-x86_64-linux-gnu.so with build-id: 4e1c9cc5fbf3b0f7a3ac3517f0d105973f699538
                Found module _bisect.cpython-39-x86_64-linux-gnu.so with build-id: 845ad369d716991698f2e1f98047de2090c91971
                Found module select.cpython-39-x86_64-linux-gnu.so with build-id: f919c6a735e270da9d9baad6266967711b125892
                Found module _posixsubprocess.cpython-39-x86_64-linux-gnu.so with build-id: 932f794c98cdf02791e254496f65af86ab798704
                Found module grp.cpython-39-x86_64-linux-gnu.so with build-id: 8b73c4492a1f3631399c44dbd8d0c145ca5948ce
                Found module math.cpython-39-x86_64-linux-gnu.so with build-id: e852cc99938cf320db7d96c163a15acf66bd7a6d
                Found module QtXml.abi3.so with build-id: 9b3953c1811df9ffa226b884909511b33ea164f1
                Found module libQt5X11Extras.so.5 with build-id: e41614d2e35852f913bf00633d635cfbf5a90dce
                Found module QtX11Extras.abi3.so with build-id: 0d7d48315a84c390c8c53c1ccf93c34568f3e017
                Found module libQt5WebKitWidgets.so.5 with build-id: dc78a8965deca1b60eca708b6125d9be290c2ea5
                Found module QtWebKitWidgets.abi3.so with build-id: 08d9a0c6466bfeb7fe76bedce483a27a1bb3789a
                Found module libunistring.so.2 with build-id: 015ac6d6bcb60b7d8bea31a80d1941b06e8636ab
                Found module libpsl.so.5 with build-id: 0229a201aaf5652186c9fdc192ebe52baf19d7f1
                Found module libssh2.so.1 with build-id: 7f6d9edd2e793b266cae4f22fc1ba7b6b401c08c
                Found module libidn2.so.0 with build-id: 1ce2b50ad9f9821c2c629b521cf5a3c99593d332
                Found module libnghttp2.so.14 with build-id: 5ca39b42e7cb2770878644d57e88677df6336815
                Found module libcurl.so.4 with build-id: 49c0cb842d0e0dad11c435b7fb88b3d88b8a43ac
                Found module libdebuginfod.so.1 with build-id: 86f71818d2efaeac394288649d3e4f5fd2febc88
                Found module libelf.so.1 with build-id: cc912d9cef94d907317afba5edd9176e9828e776
                Found module libblkid.so.1 with build-id: f03a24e92c9852272bd0049b5bcb7ed6cf0e664f
                Found module liborc-0.4.so.0 with build-id: a95fb07ab70adc17bb91684e07695723aac3a4b8
                Found module libdw.so.1 with build-id: b48e4534fe5c7511a870ee7ee8e448ac21a2b920
                Found module libunwind.so.8 with build-id: de4aafba062ffac19b3a0cedace42d0616ef9c1e
                Found module libmount.so.1 with build-id: ff9a1d99d35cf640d0bfdaba294854372672c29b
                Found module libgmodule-2.0.so.0 with build-id: 1c305e1a08706be35604a78f8d99a567274a0217
                Found module libwoff2common.so.1.0.2 with build-id: 366330fae3eb439543a00a3b2e9a0cf92f3cf36c
                Found module libgobject-2.0.so.0 with build-id: a6d338dd0fd6bb335a4010b838f5173c6cbf953a
                Found module libgstfft-1.0.so.0 with build-id: 0abc2dd501daac8da8ca067e72c44b487fc33b17
                Found module libgstvideo-1.0.so.0 with build-id: e5c9eda0e55e0182493a16055bc1a6ed65ae03c6
                Found module libgsttag-1.0.so.0 with build-id: b3dbfeb24be49ef3e31ac03c098894de6697f7ed
                Found module libgstaudio-1.0.so.0 with build-id: ae1808136012d8f99c1acc300b9c540f9887fe16
                Found module libgstpbutils-1.0.so.0 with build-id: 1ee08ce498e40e292fc4d694cf9b3293ee53f168
                Found module libgstreamer-1.0.so.0 with build-id: 12904c8a66d5a8d3c04fee6aa72fb1fc2bf27309
                Found module libgstbase-1.0.so.0 with build-id: 5e114af375570125e12a5086b458064caefb4879
                Found module libgstapp-1.0.so.0 with build-id: 8db6b20c28ce9a0feb9b24e06a586026c019ae29
                Found module libgio-2.0.so.0 with build-id: 6fb2e9431ef3524f75b1eb28b4ee37aad2405fac
                Found module libsqlite3.so.0 with build-id: b5c21727dd6a9dcb95e6e57c0767158fddcb3245
                Found module libxslt.so.1 with build-id: 6085ceddf5c745052dc31c6dcea8e03b24b9f0f2
                Found module libxml2.so.2 with build-id: b9441ffabb52b50c290152592f17cd78a381d493
                Found module libhyphen.so.0 with build-id: bf921c6bbb4feaa536e29f1ae72d3a9e79b6f98e
                Found module libwebp.so.7 with build-id: 87e81472aa7ff3ed1061cfc13d6960dbe00c35ab
                Found module libjpeg.so.8 with build-id: 5d102b1a7291a621bba049969d25ead0ccecc6cc
                Found module libwoff2dec.so.1.0.2 with build-id: f305ec18581a18e8c83f5c3f5bcbe188eeb1b34c
                Found module libQt5WebKit.so.5 with build-id: a23b0b9fb95bd4c8b5309d753bab8b372c2b36c5
                Found module QtWebKit.abi3.so with build-id: 1f80d271f2523bb91df86c68c72c84c045dcac36
                Found module libQt5WebChannel.so.5 with build-id: 54ffa5c03fdd8d800d13b70f106139e94aa4f3ef
                Found module QtWebChannel.abi3.so with build-id: 58cbe68d18edb1527900e41379e0ece6c25c78a1
                Found module libQt5TextToSpeech.so.5 with build-id: 99b56b543380180d6f5c8c984f01d80487672cff
                Found module QtTextToSpeech.abi3.so with build-id: e72f455d647823d88e15377b6523dde37cb6f0d5
                Found module libQt5Test.so.5 with build-id: 01b1cd3b138ae3a34a40d79a8edb09c5646fc475
                Found module QtTest.abi3.so with build-id: d13a7368692f90d4982b3e9c615ee995161fc127
                Found module libQt5Svg.so.5 with build-id: 926a697e0d991ee22ee414c13c9b75c253fc1d4d
                Found module QtSvg.abi3.so with build-id: 321fb3d4a22798da7e001039483769da344a41a3
                Found module QtSql.abi3.so with build-id: bd60323fed81f8ede27b5f61cd02b516f21dc6a5
                Found module libQt5Sensors.so.5 with build-id: e1b5ed1cea5191ba9970c286e557d30df1ab5bd8
                Found module QtSensors.abi3.so with build-id: cb3d3bb4386581f6e74d8c9ea621d496ef3699c4
                Found module libQt5QuickWidgets.so.5 with build-id: 40ef5bd18aebd12c92e079995c988e63d5225f4b
                Found module QtQuickWidgets.abi3.so with build-id: a65dd4ae88abd672ac2094ac02b184a0c7dd5cf4
                Found module QtQuick.abi3.so with build-id: 29f5f564c8cbb3aae67155cb87b3d6073692a767
                Found module libQt5PrintSupport.so.5 with build-id: 61869125c97f231fbd44f1cf20b2336ac3a492f3
                Found module QtPrintSupport.abi3.so with build-id: 9f8f67e810ad8a903fcb78c5542e07b67780184c
                Found module libQt5QmlModels.so.5 with build-id: d22088cee3e54c1b82a9a876daa1bbc64628d9cd
                Found module libQt5Quick.so.5 with build-id: 1ed6e9d301e83514c8105d6746995de9404ddede
                Found module libQt5PositioningQuick.so.5 with build-id: ca450a8bd07a3ae2f7cbc96701171b699d7f8daa
                Found module libQt5Location.so.5 with build-id: 76fd16016759599a26015592de42c1b11a8aa40c
                Found module QtLocation.abi3.so with build-id: 465873976e93d101293280b4a976a4a3e692d818
                Found module libQt5Positioning.so.5 with build-id: c638af0407ed24d7e28b741fa5605ce6856214df
                Found module QtPositioning.abi3.so with build-id: 687f7241562b05424553de175daaf1bbe986a2e5
                Found module libQt5OpenGL.so.5 with build-id: 2b05019d086acd3325fe2057db510ebb1f1ffeb3
                Found module QtOpenGL.abi3.so with build-id: bf57373c81d5a58272648aad1d3bd96edade0ffa
                Found module libQt5MultimediaWidgets.so.5 with build-id: 9ab7cda9117494d9455ea51036239989cf4879f5
                Found module QtMultimediaWidgets.abi3.so with build-id: e4a7cd79b17b04007fdac652e804fd63d28b1793
                Found module libogg.so.0 with build-id: ca0cae30a809f10db1f16e54a23b4e5ff7b2c54c
                Found module libvorbis.so.0 with build-id: ad0a6c1af8f219b4e314090b6e8847223d424cbe
                Found module libopus.so.0 with build-id: 649d3ddab8764d7caf73648004a35cb13e23a5e1
                Found module libFLAC.so.8 with build-id: e568dc3d434723c72d6d302eb0b2559f27e91faa
                Found module libvorbisenc.so.2 with build-id: 28ed815b8b1d322e6bf2bfdce4b0af2789b74335
                Found module libasyncns.so.0 with build-id: 6acff139d56b5139ce5eb50a66c62b215e1d332d
                Found module libsndfile.so.1 with build-id: 72d5531e74ed3e9afe49e95e449c40cb8984a258
                Found module libpulsecommon-15.0.so with build-id: a2e110b7a0b3bb46e42515afd55a61d78185835b
                Found module libpulse.so.0 with build-id: 10bd0ce0cfbb9405cee189faa1830cf34cab61a8
                Found module libQt5Multimedia.so.5 with build-id: 9e70700469b6663e71a35b573ed819cf63b1feae
                Found module QtMultimedia.abi3.so with build-id: f992b59f3e717c1fb00efbfa83245723352a61db
                Found module libQt5Sql.so.5 with build-id: 9935d05998ac2e09b1c0829aa5ad976d1e7eee5d
                Found module libQt5Help.so.5 with build-id: 9dcd364bc0ffe5d52be1bbf156a9e54b9cf69d4b
                Found module QtHelp.abi3.so with build-id: d77bc6c6b5ebd5651c01fad2fb3ef3efb5827a16
                Found module libQt5Xml.so.5 with build-id: 274f34bf4a381c160f515d585dc700afe84c9e26
                Found module libQt5Designer.so.5 with build-id: 47a30f62ebeb905d089072b6114c23aa26c0522a
                Found module QtDesigner.abi3.so with build-id: 3e83ca87e3f6e89d99d81a7b8cbe6dc4bc5eadd6
                Found module libdbus-1.so.3 with build-id: 74f2ab9c60512f3a93c932c3f627564d42e0b11e
                Found module libQt5DBus.so.5 with build-id: 9b913e483c1701d15899015a4c1d9a065fe09c17
                Found module QtDBus.abi3.so with build-id: 58b8e4910d8e4d7a8eb076ce9fbf9f72e2733d06
                Found module libQt5Qml.so.5 with build-id: 92006af8b04f29d7af10797e88969c614f450203
                Found module QtQml.abi3.so with build-id: 12eab7b5940a43313a72a0806f2847e88228fbe1
                Found module libQt5Widgets.so.5 with build-id: 9d20183c18dfb4310a7f5794068d465159dfec85
                Found module QtWidgets.abi3.so with build-id: c8d1f7ba75fc8aa87d8a38a74a3d93e729900959
                Found module libXdmcp.so.6 with build-id: 8ca0792d23c8b8b4c0864297512349292bea5955
                Found module libXau.so.6 with build-id: 1c67764663e07bec24d8951e5fd93f4d165979ff
                Found module libbrotlicommon.so.1 with build-id: f68934f94312f770550ebc6c5acfd6359b098b07
                Found module libxcb.so.1 with build-id: 0d1ef11740a5daad2ee331e812a51aa6574af222
                Found module libbrotlidec.so.1 with build-id: f871e6f204ab8d48099915126ba01be989a8000f
                Found module libbz2.so.1.0 with build-id: 919597c477c9b2cb9cdbb7745ed6494ac0e6da60
                Found module libX11.so.6 with build-id: e9192497aa39fab51358826d1a1b5fb77edc5081
                Found module libgraphite2.so.3 with build-id: 47761dc11e553f519cde97ed9ee985be12ccdae2
                Found module libfreetype.so.6 with build-id: b6b9c1805ac6ce6807483feb5c7603293ee5ec19
                Found module libGLX.so.0 with build-id: 46506ec29217449396b9ca7fb3fcb434587a1325
                Found module libGLdispatch.so.0 with build-id: 71de43b4607206a0e6d5d3e2d8e9b61dfcf23770
                Found module libmd4c.so.0 with build-id: 2151dba72cdc9960097e6e960a58a2f03c8bb96e
                Found module libharfbuzz.so.0 with build-id: 8463c8048bb22a54aa3ed291097d5952a4063637
                Found module libpng16.so.16 with build-id: 2dc0bce07f199bf983c07a05fb95a6f4af83a9b3
                Found module libGL.so.1 with build-id: c293b92f10cbc9574c45ff4e4c123fec01ab6b78
                Found module libQt5Gui.so.5 with build-id: a8773b7b770b5368f360b24cf53ff7e423050938
                Found module QtGui.abi3.so with build-id: a1afb267be050ff6635a18df43d276a32f570778
                Found module libresolv.so.2 with build-id: c915c72668282861a813f7ea3c0780f37b681dc0
                Found module libkeyutils.so.1 with build-id: ac405ddd17be10ce538da3211415ee50c8f8df79
                Found module libkrb5support.so.0 with build-id: adf65240a4d2aba772d7a0772b4d015469934113
                Found module libcom_err.so.2 with build-id: eb61ef71c8b97846db759fb89a115405cff6dd30
                Found module libk5crypto.so.3 with build-id: eb8220b8f36675aac769450be4cb6bb7f97ec38a
                Found module libkrb5.so.3 with build-id: 72d26767c5cb1097db75a5f5bff88860233c902b
                Found module libcrypto.so.1.1 with build-id: 6d23f0a3f354825868d044684fad31d482cc9210
                Found module libssl.so.1.1 with build-id: 959cd8f1dd43fc31aeb93caac4eda87c907ef18b
                Found module libgssapi_krb5.so.2 with build-id: e6e098ad51ce7bdd3dbe902d7b0f69a90f8a9e08
                Found module libQt5Network.so.5 with build-id: 68bfc5d087c05ee59d5cedd71a4764ce815cf1d9
                Found module QtNetwork.abi3.so with build-id: 2e3b25d3bb46842ebe4fc6c0baa6846865c6aa98
                Found module sip.cpython-39-x86_64-linux-gnu.so with build-id: 1edd1d4e00462ba53150a8a24c66894db323b667
                Found module libgpg-error.so.0 with build-id: ba85170c2d9343ea05eea8fa2048c212ff4ef552
                Found module libpcre.so.1 with build-id: 845483dd0acba86de9f0313102bebbaf3ce52767
                Found module libicudata.so.69 with build-id: 0ab994a49ef1848499c4af333b3266f28432a922
                Found module libgcrypt.so.20 with build-id: db45f5d5e0f7af1e77324fea1885f974619ad268
                Found module libcap.so.2 with build-id: e5698e341f259c990af983244c9368a60d175aac
                Found module liblz4.so.1 with build-id: e63600ab23b2f6997f42fac2fa56e1f02ce159a1
                Found module liblzma.so.5 with build-id: f8d607153b2b315f1aaa1c8e12553d544e661f2d
                Found module librt.so.1 with build-id: 75484da2d6f1515189eefa076e0a40328834cd16
                Found module libgcc_s.so.1 with build-id: 7f8508bb914546ada778809b64b99d234337d835
                Found module libglib-2.0.so.0 with build-id: 059b1bf3efd0a9ccb2beba9fced88e7f7bc4f6ca
                Found module libzstd.so.1 with build-id: 4b10444c1560ebc574af4d5f488b7408b22d450e
                Found module libpcre2-16.so.0 with build-id: 983354d71426f38a37695490499fc89d050d7cc5
                Found module libicuuc.so.69 with build-id: 5cf18c56e2f64efdac32cf61fb9c0c48e9bb1797
                Found module libicui18n.so.69 with build-id: 9cdecde5b2e47a2bd81dc14915cbfefcade76c12
                Found module libdouble-conversion.so.3 with build-id: 5bffb4317594514068e082d4b4e9acd99987ec47
                Found module libz.so.1 with build-id: 81bf6e728a6d6f5b105b0f8b25f6c614ce10452a
                Found module libsystemd.so.0 with build-id: f776aaa16b4e2ba7056d01d928e4b2726ffe2b8b
                Found module libstdc++.so.6 with build-id: 8ab0e57054dd1dcba681f217016afc6a4e639783
                Found module libQt5Core.so.5 with build-id: c64628e7d9f71477150fd382b63907957cc067e3
                Found module QtCore.abi3.so with build-id: 230262db654c39b9eee66efbf0402300e9e6912f
                Found module Qt.abi3.so with build-id: d001f0a3c313d46e26f69530ba65bd513a821936
                Found module _struct.cpython-39-x86_64-linux-gnu.so with build-id: 9e3422b00d5f11fbce0ce6ee94b8bf7e414acfe6
                Found module libffi.so.7 with build-id: de60e99f39569d11d09160bbdcd486cedc87d2b6
                Found module _ctypes.cpython-39-x86_64-linux-gnu.so with build-id: 75ed552ad65a168bee00708636003f04f6d1b6d2
                Found module _json.cpython-39-x86_64-linux-gnu.so with build-id: 12d76791795fd0de167124fa43f7f710fb703956
                Found module _heapq.cpython-39-x86_64-linux-gnu.so with build-id: 1939c6979f41378cc35e731708cfc0086265a5c4
                Found module ld-linux-x86-64.so.2 with build-id: 040cc3dd10461562f177df39e3be2f3704258c3c
                Found module libm.so.6 with build-id: 2b8fd1f869ecab4e0b55e92f2f151897f6818acf
                Found module libutil.so.1 with build-id: af6d8200064ee6e6a01252884d166b44f0a6121b
                Found module libdl.so.2 with build-id: 5abc547e7b0949f89f3c0e21ab0c8331a7440a8a
                Found module libpthread.so.0 with build-id: 07c8f95b4f3251d08550217ad8a1f31066229996
                Found module libc.so.6 with build-id: 4b406737057708c0e4c642345a703c47a61c73dc
                Found module libpython3.9.so.1.0 with build-id: 44da06e8bfa38c81b0cbf272e4904b01563a4ec4
                Found module python3.9 with build-id: f9d7f05cffc4118c683a1820730103ac83e90853
                Stack trace of thread 3003:
                #0  0x00007f223f339d22 raise (libc.so.6 + 0x3cd22)
                #1  0x00007f223f323862 abort (libc.so.6 + 0x26862)
                #2  0x00007f223f383b08 __malloc_assert (libc.so.6 + 0x86b08)
                #3  0x00007f223f385bf3 sysmalloc (libc.so.6 + 0x88bf3)
                #4  0x00007f223f38740e _int_malloc (libc.so.6 + 0x8a40e)
                #5  0x00007f223f3884e1 malloc (libc.so.6 + 0x8b4e1)
                #6  0x00007f223dea044d _Znwm (libstdc++.so.6 + 0xa644d)
                #7  0x00007f222bc7be56 n/a (libcarla_standalone2.so + 0x116e56)
                #8  0x00007f222bbee269 _ZN12CarlaBackend11CarlaEngine17bufferSizeChangedEj (libcarla_standalone2.so + 0x89269)
                #9  0x00007f222bc1fa6e n/a (libcarla_standalone2.so + 0xbaa6e)
                #10 0x00007f22300b7957 n/a (libjack.so.0 + 0x9957)
                #11 0x00007f2230015796 n/a (libspa-support.so + 0x9796)
                #12 0x00007f2230011e3a n/a (libspa-support.so + 0x5e3a)
                #13 0x00007f2230016c3b n/a (libspa-support.so + 0xac3b)
                #14 0x00007f222b78cbb6 n/a (libpipewire-0.3.so.0 + 0x7cbb6)
                #15 0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #16 0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2984:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2977:
                #0  0x00007f223f3f0b2f __poll (libc.so.6 + 0xf3b2f)
                #1  0x00007f223d67eb39 n/a (libglib-2.0.so.0 + 0xa7b39)
                #2  0x00007f223d628871 g_main_context_iteration (libglib-2.0.so.0 + 0x51871)
                #3  0x00007f223e321fe6 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5 + 0x311fe6)
                #4  0x00007f223e2c7d2c _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5 + 0x2b7d2c)
                #5  0x00007f223e0dce12 _ZN7QThread4execEv (libQt5Core.so.5 + 0xcce12)
                #6  0x00007f2238ef5ae8 n/a (libQt5DBus.so.5 + 0x15ae8)
                #7  0x00007f223e0ddfef n/a (libQt5Core.so.5 + 0xcdfef)
                #8  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #9  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2976:
                #0  0x00007f223f3f0b2f __poll (libc.so.6 + 0xf3b2f)
                #1  0x00007f223a17e63b n/a (libxcb.so.1 + 0xc63b)
                #2  0x00007f223a18037b xcb_wait_for_event (libxcb.so.1 + 0xe37b)
                #3  0x00007f22324e1f41 n/a (libQt5XcbQpa.so.5 + 0x61f41)
                #4  0x00007f223e0ddfef n/a (libQt5Core.so.5 + 0xcdfef)
                #5  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #6  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2978:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f223e0e407c _ZN14QWaitCondition4waitEP6QMutex14QDeadlineTimer (libQt5Core.so.5 + 0xd407c)
                #3  0x00007f22398e346d n/a (libQt5Widgets.so.5 + 0x39d46d)
                #4  0x00007f223e0ddfef n/a (libQt5Core.so.5 + 0xcdfef)
                #5  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #6  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2980:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2983:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2972:
                #0  0x00007f223ea07cf9 n/a (sip.cpython-39-x86_64-linux-gnu.so + 0x9cf9)
                #1  0x00007f223ea0dcfa sip_api_convert_from_type (sip.cpython-39-x86_64-linux-gnu.so + 0xfcfa)
                #2  0x00007f223ea0eda5 n/a (sip.cpython-39-x86_64-linux-gnu.so + 0x10da5)
                #3  0x00007f223ea0f4ec n/a (sip.cpython-39-x86_64-linux-gnu.so + 0x114ec)
                #4  0x00007f223ea0f5df n/a (sip.cpython-39-x86_64-linux-gnu.so + 0x115df)
                #5  0x00007f2239d324fd n/a (QtWidgets.abi3.so + 0x1374fd)
                #6  0x00007f2239e3683d n/a (QtWidgets.abi3.so + 0x23b83d)
                #7  0x00007f223e2f642f _ZN7QObject5eventEP6QEvent (libQt5Core.so.5 + 0x2e642f)
                #8  0x00007f2239e369b4 n/a (QtWidgets.abi3.so + 0x23b9b4)
                #9  0x00007f22396a0d62 _ZN19QApplicationPrivate13notify_helperEP7QObjectP6QEvent (libQt5Widgets.so.5 + 0x15ad62)
                #10 0x00007f2239f78ecf n/a (QtWidgets.abi3.so + 0x37decf)
                #11 0x00007f223e2c93ba _ZN16QCoreApplication15notifyInternal2EP7QObjectP6QEvent (libQt5Core.so.5 + 0x2b93ba)
                #12 0x00007f223e32135d _ZN14QTimerInfoList14activateTimersEv (libQt5Core.so.5 + 0x31135d)
                #13 0x00007f223e321c5a n/a (libQt5Core.so.5 + 0x311c5a)
                #14 0x00007f223d62b10c g_main_context_dispatch (libglib-2.0.so.0 + 0x5410c)
                #15 0x00007f223d67eba9 n/a (libglib-2.0.so.0 + 0xa7ba9)
                #16 0x00007f223d628871 g_main_context_iteration (libglib-2.0.so.0 + 0x51871)
                #17 0x00007f223e321fe6 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5 + 0x311fe6)
                #18 0x00007f223e2c7d2c _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5 + 0x2b7d2c)
                #19 0x00007f223e2d0294 _ZN16QCoreApplication4execEv (libQt5Core.so.5 + 0x2c0294)
                #20 0x00007f2239f77baf n/a (QtWidgets.abi3.so + 0x37cbaf)
                #21 0x00007f223f611f08 n/a (libpython3.9.so.1.0 + 0x148f08)
                #22 0x00007f223f5fa333 _PyObject_MakeTpCall (libpython3.9.so.1.0 + 0x131333)
                #23 0x00007f223f5f6218 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x12d218)
                #24 0x00007f223f60196b _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x13896b)
                #25 0x00007f223f5f158e _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x12858e)
                #26 0x00007f223f5effd9 n/a (libpython3.9.so.1.0 + 0x126fd9)
                #27 0x00007f223f5efc41 _PyEval_EvalCodeWithName (libpython3.9.so.1.0 + 0x126c41)
                #28 0x00007f223f6a6ae3 PyEval_EvalCode (libpython3.9.so.1.0 + 0x1ddae3)
                #29 0x00007f223f6b69f4 n/a (libpython3.9.so.1.0 + 0x1ed9f4)
                #30 0x00007f223f6b26cb n/a (libpython3.9.so.1.0 + 0x1e96cb)
                #31 0x00007f223f5602d3 n/a (libpython3.9.so.1.0 + 0x972d3)
                #32 0x00007f223f55f761 PyRun_SimpleFileExFlags (libpython3.9.so.1.0 + 0x96761)
                #33 0x00007f223f6c84a2 Py_RunMain (libpython3.9.so.1.0 + 0x1ff4a2)
                #34 0x00007f223f699009 Py_BytesMain (libpython3.9.so.1.0 + 0x1d0009)
                #35 0x00007f223f324b25 __libc_start_main (libc.so.6 + 0x27b25)
                #36 0x000055eb5ec2604e _start (python3.9 + 0x104e)

                Stack trace of thread 2991:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3043:
                #0  0x00007f223f3c3a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                #1  0x00007f223f3c8c77 __nanosleep (libc.so.6 + 0xcbc77)
                #2  0x00007f223f3f3a99 usleep (libc.so.6 + 0xf6a99)
                #3  0x00007f222bc17e5e n/a (libcarla_standalone2.so + 0xb2e5e)
                #4  0x00007f222bbd09ef n/a (libcarla_standalone2.so + 0x6b9ef)
                #5  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #6  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2987:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2979:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2982:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2986:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2985:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3013:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f223001dbc9 n/a (libspa-support.so + 0x11bc9)
                #2  0x00007f2230016ba4 n/a (libspa-support.so + 0xaba4)
                #3  0x00007f222b78cbb6 n/a (libpipewire-0.3.so.0 + 0x7cbb6)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3001:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f222bd50ffc n/a (libcarla_standalone2.so + 0x1ebffc)
                #2  0x00007f222bd516da n/a (libcarla_standalone2.so + 0x1ec6da)
                #3  0x00007f222bd51c61 n/a (libcarla_standalone2.so + 0x1ecc61)
                #4  0x00007f222bd5311d n/a (libcarla_standalone2.so + 0x1ee11d)
                #5  0x00007f223decd3c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                #6  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #7  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2988:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2989:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2990:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3046:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f223001dbc9 n/a (libspa-support.so + 0x11bc9)
                #2  0x00007f2230016ba4 n/a (libspa-support.so + 0xaba4)
                #3  0x00007f222b78cbb6 n/a (libpipewire-0.3.so.0 + 0x7cbb6)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3005:
                #0  0x00007f223f3c3a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                #1  0x00007f223f3c8c77 __nanosleep (libc.so.6 + 0xcbc77)
                #2  0x00007f223f3f3a99 usleep (libc.so.6 + 0xf6a99)
                #3  0x00007f222bc2b89e n/a (libcarla_standalone2.so + 0xc689e)
                #4  0x00007f222bbd09ef n/a (libcarla_standalone2.so + 0x6b9ef)
                #5  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #6  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3000:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb842 pthread_cond_clockwait (libpthread.so.0 + 0xf842)
                #2  0x00007f222bd44a87 n/a (libcarla_standalone2.so + 0x1dfa87)
                #3  0x00007f223decd3c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2999:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f222bd50ffc n/a (libcarla_standalone2.so + 0x1ebffc)
                #2  0x00007f222bd516da n/a (libcarla_standalone2.so + 0x1ec6da)
                #3  0x00007f222bd51c61 n/a (libcarla_standalone2.so + 0x1ecc61)
                #4  0x00007f222bd51ef1 n/a (libcarla_standalone2.so + 0x1ecef1)
                #5  0x00007f223decd3c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                #6  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #7  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3002:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f223001dbc9 n/a (libspa-support.so + 0x11bc9)
                #2  0x00007f2230016ba4 n/a (libspa-support.so + 0xaba4)
                #3  0x00007f222b7520e7 n/a (libpipewire-0.3.so.0 + 0x420e7)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3012:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f223001dbc9 n/a (libspa-support.so + 0x11bc9)
                #2  0x00007f2230016ba4 n/a (libspa-support.so + 0xaba4)
                #3  0x00007f222b7520e7 n/a (libpipewire-0.3.so.0 + 0x420e7)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3045:
                #0  0x00007f223f3fb92e epoll_wait (libc.so.6 + 0xfe92e)
                #1  0x00007f223001dbc9 n/a (libspa-support.so + 0x11bc9)
                #2  0x00007f2230016ba4 n/a (libspa-support.so + 0xaba4)
                #3  0x00007f222b7520e7 n/a (libpipewire-0.3.so.0 + 0x420e7)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 2981:
                #0  0x00007f223f2f18ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                #1  0x00007f223f2eb270 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0 + 0xf270)
                #2  0x00007f22226c54ec n/a (radeonsi_dri.so + 0x1c84ec)
                #3  0x00007f22226bebc8 n/a (radeonsi_dri.so + 0x1c1bc8)
                #4  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #5  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)

                Stack trace of thread 3006:
                #0  0x00007f223f3c3a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                #1  0x00007f223f3c8c77 __nanosleep (libc.so.6 + 0xcbc77)
                #2  0x00007f223f3f3a99 usleep (libc.so.6 + 0xf6a99)
                #3  0x00007f222bbd17db n/a (libcarla_standalone2.so + 0x6c7db)
                #4  0x00007f222bbd09ef n/a (libcarla_standalone2.so + 0x6b9ef)
                #5  0x00007f223f2e5259 start_thread (libpthread.so.0 + 0x9259)
                #6  0x00007f223f3fb5e3 __clone (libc.so.6 + 0xfe5e3)
falkTX commented 3 years ago

And sorry I wasn't paying that much attention to the assertion failure as I didn't think they could cause a SIGSEGV. The original issue seemed similar enough.

correct they do not, but often indicate something that is wrong.

in any case the segfault crashdump you posted seems to abort during malloc, so I suspect carla requested a too big memory allocation size.

fridtjof commented 2 years ago

I've tried investigating this issue further using AddressSanitizer.

environment

how i reproduced it

I've compiled Carla with:

export CFLAGS="-fsanitize=address"
export CXXFLAGS="-fsanitize=address"
export LDFLAGS="-fsanitize=address"
make debug

then ran it like this:

LD_PRELOAD=/lib/libasan.so ASAN_OPTIONS="logpath=asan.log" CARLA_CAPTURE_CONSOLE_OUTPUT=1 carla

(The LD_PRELOAD was necessary due to a build issue, it might not be necessary if you try and replicate this)

(I used ASAN_OPTIONS and CARLA_CAPTURE_CONSOLE_OUTPUT to get any output in files, because carla (or python) breaks stdout/err at some point during startup)

Finally, I loaded the attached carla project (it's a filter chain to do a sub crossover in software).

To reliably trigger the crash, I join a voice chat in discord, then leave it again. The crash occurs directly after Discord's 'leave' sound finishes playing.

files

(sorry for the file extensions, Github wouldn't let me otherwise)

shp9500_v2_1.carxp.txt asan.log.203584.txt carla.debug.log.txt carla.stderr2.log.txt carla.stdout.log.txt

falkTX commented 2 years ago

carla captures stdout/err to put in the logs tab. just disable this in the settings.

from what you say it happens after disconnect events, and using pipewire, I will have to assume this is yet another pipewire issue. when connections change it seems to change buffer sizes with it too, and not always correctly?

unless the issue happens with regular jack, I cant go with it being a carla issue. do you have a crash if, using jack instead of pipewire, you have this project loaded and change the jack buffer size?

fridtjof commented 2 years ago

Ah, gotcha. I forgot about the logs tab.

It sounds like that to me too. I first suspected Carla wasn't locking things correctly, leading to some race condition, but that's not the case. I saw both callback handlers only go through after acquiring the plugin's master lock, so that shouldn't be a problem. Seeing that the frame count is supplied by jack/pipewire in both cases (carla_jack_process_callback_plugin and carla_jack_bufsize_callback), and the process callback goes through after the buffer sizes have been changed already, it feels like pipewire might have an issue with putting out now invalid process calls (with the wrong buffer size) after having just issued a buffer size change callback? I haven't looked into what pipewire-jack does specifically, yet, so this is just wild speculation. Maybe I'm completely on the wrong track anyway :)

I've never had a proper jack setup before, so I'm probably not going to bother setting it up now. I'm also positive this is much more likely to be a pipewire issue, as Carla's code looked okay to me.

I'm going to link this issue on a similar pipewire issue (https://gitlab.freedesktop.org/pipewire/pipewire/-/issues/1621) that seems to have the same cause. Maybe they have an idea of what's wrong there.

falkTX commented 2 years ago

you should be able to just use the jack dummy driver for testing this. ie, jackd -d dummy. so then loading your patch and doing jack_bufsize 128; sleep 1; jack_bufsize 1024 a bunch of times.

and your assumptions on the threading inside carla jack driver are correct. Typically (I just tried it here to be sure) we can change the jack buffer size at any time, even while notes are playing.

MIDI file rendering and playing through some plugins, while I change the buffer size. There is a small audio cut/pop when buffer size changes, as expected, but no crashes...

Screenshot_20211030_152827

Iwyil commented 2 years ago

I have similar, although different, issue that I tried to debug. Also, I have been having the same issue with same backtrace since at least 4 months. I am on ArchLinux: PipeWire 0.3.40 Carla 0bcd151616fd087ceb6e224fdf8ffba38e790fa8 Carla has been compiled with DEBUG=true and the added flags -g3 -ggdb In my case, I only use a parametric equalizer from LSP while playing a youtube music playlist. In this scenario, going to the next or previous media in the playlist, consistently make Carla crash, apparently due to an heap corruption, with this backtrace:

#0  0x00007f6354cb2d22 in raise () at /usr/lib/libc.so.6
#1  0x00007f6354c9c862 in abort () at /usr/lib/libc.so.6
#2  0x00007f6354cf4d28 in __libc_message () at /usr/lib/libc.so.6
#3  0x00007f6354cfc92a in  () at /usr/lib/libc.so.6
#4  0x00007f6354cfe1bc in _int_free () at /usr/lib/libc.so.6
#5  0x00007f6354d019e8 in free () at /usr/lib/libc.so.6
#6  0x00007f6344bf5af8 in CarlaBackend::CarlaPluginVST2::bufferSizeChanged(unsigned int) (this=0x558ca25865c0, newBufferSize=2048) at CarlaPluginVST2.cpp:1891
#7  0x00007f6344b10293 in CarlaBackend::CarlaEngine::bufferSizeChanged(unsigned int) (this=0x558ca2131450, newBufferSize=2048) at CarlaEngine.cpp:2212
#8  0x00007f6344b50f25 in CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(unsigned int) (this=0x558ca2131450, newBufferSize=2048) at CarlaEngineJack.cpp:2856
#9  0x00007f6344b56405 in CarlaBackend::CarlaEngineJack::carla_jack_bufsize_callback(unsigned int, void*) (newBufferSize=2048, arg=0x558ca2131450) at CarlaEngineJack.cpp:4352
#10 0x00007f633fdadc61 in  () at /usr/lib/pipewire-0.3/jack/libjack.so.0
#11 0x00007f633f90bc29 in  () at /usr/lib/spa-0.2/support/libspa-support.so
#12 0x00007f633f90ad46 in  () at /usr/lib/spa-0.2/support/libspa-support.so
#13 0x00007f633f90c2cb in  () at /usr/lib/spa-0.2/support/libspa-support.so
#14 0x00007f633fa1823a in  () at /usr/lib/libpipewire-0.3.so.0
#15 0x00007f6354c5e259 in start_thread () at /usr/lib/libpthread.so.0
#16 0x00007f6354d745e3 in clone () at /usr/lib/libc.so.6

And it is always consistently the same backtrace. Hacking a bit through the code to insert some debug calls, trying to use valgrind, and adding timestamp to carla_debug, apparently the problem in my case is that somehow, PipeWire first call the process callback with a new, bigger number of frames, and then call the bufsize callback. Output of some logs:

[85415.794469867] CarlaBackend::CarlaPluginVST2::process(audioIn: 0x7f6319352910, audioOut: 0x7f6319352900, cvIn: 0x7f6319352900, -, frames: 1024)
[85415.815770394] carla_jack_process_callback_plugin(frames: 1024, arg: 0x558ca212fcc0)
[85415.815811135] CarlaBackend::CarlaPluginVST2::process(audioIn: 0x7f6319352910, audioOut: 0x7f6319352900, cvIn: 0x7f6319352900, -, frames: 1024)
[85415.837094124] carla_jack_process_callback_plugin(frames: 1024, arg: 0x558ca212fcc0)
[85415.837131758] CarlaBackend::CarlaPluginVST2::process(audioIn: 0x7f6319352910, audioOut: 0x7f6319352900, cvIn: 0x7f6319352900, -, frames: 1024)
[85415.858406787] carla_jack_process_callback_plugin(frames: 1024, arg: 0x558ca212fcc0)
[85415.858469269] CarlaBackend::CarlaPluginVST2::process(audioIn: 0x7f6319352910, audioOut: 0x7f6319352900, cvIn: 0x7f6319352900, -, frames: 1024)
[85415.879753796] carla_jack_process_callback_plugin(frames: 2048, arg: 0x558ca212fcc0)
[85415.879829935] CarlaBackend::CarlaPluginVST2::process(audioIn: 0x7f6319352910, audioOut: 0x7f6319352900, cvIn: 0x7f6319352900, -, frames: 2048)
[85415.879879780] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x558ca2131450)
[85415.879893539] CarlaEngine::bufferSizeChanged(2048)
[85415.880018819] CarlaPluginVST2::bufferSizeChanged(2048) PID: 73032
[85415.880030443] CarlaPluginVST2::dispatcher(72:effStopProcess, 0, 0, (nil), 0.000000)
[85415.880041124] CarlaPluginVST2::dispatcher(12:effMainsChanged, 0, 0, (nil), 0.000000)

It is also happening at start, however, in that case the number of frames is shrinking from 2048 to 1024.

From running valgrind, apparently the heap corruption is happening in the process callback while zeroing the buffer (which at that point has not been updated yet). This is a part of the valgrind log:

==53102== Thread 14:
==53102== Invalid write of size 8
==53102==    at 0x4848194: memset (vg_replace_strmem.c:1270)
==53102==    by 0x17AEB98E: carla_zeroFloats(float*, unsigned long) (CarlaMathUtils.hpp:220)
==53102==    by 0x17AF26B9: CarlaBackend::CarlaPluginVST2::processSingle(float const* const*, float**, unsigned int, unsigned int) (CarlaPluginVST2.cpp:1760)
==53102==    by 0x17AF21BE: CarlaBackend::CarlaPluginVST2::process(float const* const*, float**, float const* const*, float**, unsigned int) (CarlaPluginVST2.cpp:1664)
==53102==    by 0x17A53533: CarlaBackend::CarlaEngineJack::processPlugin(std::shared_ptr<CarlaBackend::CarlaPlugin>&, unsigned int) (CarlaEngineJack.cpp:4112)
==53102==    by 0x17A548C9: CarlaBackend::CarlaEngineJack::carla_jack_process_callback_plugin(unsigned int, void*) (CarlaEngineJack.cpp:4529)
==53102==    by 0x1874C00D: ??? (in /usr/lib/pipewire-0.3/jack/libjack.so.0.340.0)
==53102==    by 0x18BF62CA: ??? (in /usr/lib/spa-0.2/support/libspa-support.so)
==53102==    by 0x18AE358F: ??? (in /usr/lib/libpipewire-0.3.so.0.340.0)
==53102==    by 0x4E1C258: start_thread (in /usr/lib/libpthread-2.33.so)
==53102==    by 0x4D455E2: clone (in /usr/lib/libc-2.33.so)
==53102==  Address 0x2d255790 is 0 bytes after a block of size 4,096 alloc'd
==53102==    at 0x484021F: operator new[](unsigned long) (vg_replace_malloc.c:579)
==53102==    by 0x17AF30DF: CarlaBackend::CarlaPluginVST2::bufferSizeChanged(unsigned int) (CarlaPluginVST2.cpp:1893)
==53102==    by 0x17A0E192: CarlaBackend::CarlaEngine::bufferSizeChanged(unsigned int) (CarlaEngine.cpp:2212)
==53102==    by 0x17A4E9A4: CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(unsigned int) (CarlaEngineJack.cpp:2856)
==53102==    by 0x17A53E67: CarlaBackend::CarlaEngineJack::carla_jack_bufsize_callback(unsigned int, void*) (CarlaEngineJack.cpp:4351)
==53102==    by 0x1873DC60: ??? (in /usr/lib/pipewire-0.3/jack/libjack.so.0.340.0)
==53102==    by 0x18BF5C28: ??? (in /usr/lib/spa-0.2/support/libspa-support.so)
==53102==    by 0x18BF4D45: ??? (in /usr/lib/spa-0.2/support/libspa-support.so)
==53102==    by 0x18BF62CA: ??? (in /usr/lib/spa-0.2/support/libspa-support.so)
==53102==    by 0x18B23239: ??? (in /usr/lib/libpipewire-0.3.so.0.340.0)
==53102==    by 0x4E1C258: start_thread (in /usr/lib/libpthread-2.33.so)
==53102==    by 0x4D455E2: clone (in /usr/lib/libc-2.33.so)

Is all of this an expected behavior? Am I missing something? Anyway, I guess this is a PipeWire bug...

lbenard commented 2 years ago

@Iwyil It's similar to the bug I had. It's apparently caused by Pipewire changing the buffer size on the fly. I've fixed the buffer size in the Pipewire configuration file:

default.clock.min-quantum   = 1024
default.clock.max-quantum   = 1024

(more info here) and I pretty much never had any issue since then. I haven't tried to just set the force-quantum value, but I guess setting the min and max parameter to the same value has a similar effect, at least it works for me.

falkTX commented 2 years ago

Just to be sure.. your pipewire version is up to date right? There were changes made in pipewire related to this, wondering if they still happen with it or not. Changing the buffer size should be fine, in fact I want Carla to have such an option too. Issue that I see here is either:

  1. pipewire calling buf-size change while processing still taking place (or vice-versa)
  2. pipewire calling process with the wrong number of frames
  3. internal carla issue, seems unlikely as I do this from time to time without issues
  4. plugin crash, also unlikely seeing from the logs
lbenard commented 2 years ago
$ pipewire --version
pipewire
Compiled with libpipewire 0.3.40
Linked with libpipewire 0.3.40

Seems to be the last release according to their GitLab. I'll try removing those parameters see if I can make it crash again

lbenard commented 2 years ago

image Still crashes when I load my rack :( I'm compiling a debug version of Carla to get a full stack trace, but it's probably the same issue

[EDIT] Seems to be a different crash, idk what could be the cause this time, but it only happens after I removed the constant buffer size parameter in pipewire:

Dec 02 14:11:49 lbenard-pc systemd-coredump[7377]: [🡕] Process 7225 (carla) of user 1000 dumped core.

                                                   Found module linux-vdso.so.1 with build-id: 6824c12785efac5e64ae9e7af42cd4d100b0d45b
                                                   Found module lsp-plugins-vst-compressor-stereo.so with build-id: e71d0d0d44bf317296ff31a3d6187467ef2771a9
                                                   Found module librnnoise_ladspa.so with build-id: 2c00e77e201b41f4f4bf2bb2ee63ac40e43ab0d9
                                                   Found module lsp-plugins-lv2.so with build-id: 05e63f2f6b260165f8c983b7558e5192ada0f0a1
                                                   Found module lsp-plugins-vst-compressor-mono.so with build-id: 5f55012354ba2989e917a08f89b8a0d911207d26
                                                   Found module lsp-plugins-vst-gate-mono.so with build-id: 3914921fb367d00eca99f8df22012de851b336bd
                                                   Found module lsp-plugins-vst-limiter-mono.so with build-id: 4de8333ea6bf7280ace44ce76ae7619be3c23775
                                                   Found module libpixman-1.so.0 with build-id: 341f793dcada3a48a306a793d265a517e3f2e7d6
                                                   Found module libxcb-shm.so.0 with build-id: fb797f299a446f559a95afcc168227482cc800d1
                                                   Found module libxcb-render.so.0 with build-id: a37bdb37744b508be9dd29fd9ccb9bb0170d43e5
                                                   Found module libXrender.so.1 with build-id: 97e0b9ab6ba96ebc86527cc2b3c3078aad8616b3
                                                   Found module libXext.so.6 with build-id: d70f24beb4fad748d6becffdcc13e51be0a2ebfa
                                                   Found module libfontconfig.so.1 with build-id: 1103a641395c7d3b42e49b793d3a9ea927c77bf6
                                                   Found module libcairo.so.2 with build-id: 06820af9cf79c2deb207d9533a61caf04e67a8ad
                                                   Found module lsp-plugins-vst-core-1.1.30.so with build-id: e064f650c3894c7598d26edd0acd32fadc085264
                                                   Found module lsp-plugins-vst-sc-compressor-stereo.so with build-id: 279fe82ca2cbd86db42eef2d0937e812ee111400
                                                   Found module libpipewire-module-metadata.so with build-id: 69b538ed883934653341a3f265b12ca3387524a1
                                                   Found module libpipewire-module-client-node.so with build-id: 824c6fdefd4f19c229f2b59f5ee9204a2b14a638
                                                   Found module libpipewire-module-protocol-native.so with build-id: 7ecab4978ec8dfeeb972000292d373daca90ed9c
                                                   Found module libpipewire-module-rt.so with build-id: 54ba41bed65b9d541f159a3e23796f39effec8f3
                                                   Found module libnss_files.so.2 with build-id: 1a36dfc01d3a1010b2ee79766a24a8090a3266d5
                                                   Found module libspa-dbus.so with build-id: 8d000da179e54a4c1cc0ef1da9f461a260d5319e
                                                   Found module libcarla_utils.so with build-id: 0f88ab024c4dd8694f00db1497f853d64cb86df7
                                                   Found module libquadmath.so.0 with build-id: 150b56e19c55382453ff358099c27a0b79173c67
                                                   Found module libfftw3q.so.3 with build-id: 12b8aed0d8c97e1d246e63b73fd283c222e0055f
                                                   Found module libfftw3q_threads.so.3 with build-id: f7e553b1ce568a6b1c90c53a0679c11cc90aee68
                                                   Found module libfftw3l.so.3 with build-id: f8b3e23156afe46aa44089a65c27c702c6950b07
                                                   Found module libfftw3l_threads.so.3 with build-id: 0209e3258564bb51e0c3e5ad7396e463239c2bb6
                                                   Found module libfftw3f.so.3 with build-id: a8fd97384627e5ab4738155a74064ad6da571e6e
                                                   Found module libfftw3f_threads.so.3 with build-id: 4fb17e0a026a0245f652af9a11b4de829b22cb7f
                                                   Found module libfftw3.so.3 with build-id: 6d89f409fca4cb2c3e1941515225c0d95d1c39a3
                                                   Found module libfftw3_threads.so.3 with build-id: 4e3617f00006b6bcf26b9e498e4892b15da83ae7
                                                   Found module libspa-journal.so with build-id: b326235d0d3cdf7960d81c85c255ceb1a7e9f536
                                                   Found module libspa-support.so with build-id: 1eb6638aeb61fb72f244ef0cc3442e2aa22998f9
                                                   Found module libncursesw.so.6 with build-id: 859adb8b03a5655151b4da104bc4b326a0d4bc8c
                                                   Found module libpipewire-0.3.so.0 with build-id: 2ef062f025e19926ef385bda58e4174130126737
                                                   Found module libinstpatch-1.0.so.2 with build-id: be6cf8f475d8e460ce2046e6cb8d822c11008398
                                                   Found module libgomp.so.1 with build-id: 1cb25691b8e34e1ce54698066bce0fb29f5cf9fa
                                                   Found module libreadline.so.8 with build-id: 50c2746af3cf9fa7373e6ba6d9b2bc0a2ef7735a
                                                   Found module libSDL2-2.0.so.0 with build-id: b08df2aa73ceedfa0da36fa82294e8a5b5375d7b
                                                   Found module libportaudio.so.2 with build-id: 305f95e5abdce86725f76773b241fbe88342102f
                                                   Found module libjack.so.0 with build-id: d18e8a7c50d5c386c8f434e138d88f43172953ad
                                                   Found module libpulse-simple.so.0 with build-id: 5891a9b3e33b7dd638e4ca6839b837e42343c8e2
                                                   Found module libasound.so.2 with build-id: 9288c92ff737b1999761df2018fcd0e7cbf46d5a
                                                   Found module libfluidsynth.so.3 with build-id: f2a2ebaa3f98851263b76eafccd8d68b8012245a
                                                   Found module libmagic.so.1 with build-id: 529737064771391c29145e5e91a72f91ca4a5424
                                                   Found module liblo.so.7 with build-id: f6d84b6a2ba20a1dbe0124b8124e7d806ad3cd09
                                                   Found module libcarla_standalone2.so with build-id: 61cb29d5c39ed126154e96da6b238f0800e30c64
                                                   Found module carlastyle.so with build-id: 070becb76a4e6cbac93db326bfb6576118d35cac
                                                   Found module libexpat.so.1 with build-id: 8850138eae6d9d4d43c5c4b2ac48393bc4279037
                                                   Found module pyexpat.cpython-39-x86_64-linux-gnu.so with build-id: aa06a19b2e6f8c3db83bdd387524b52b60ca7629
                                                   Found module _pickle.cpython-39-x86_64-linux-gnu.so with build-id: 38cf89fdbc8e07f2e241a49ea45af6d7e1a121b6
                                                   Found module _lzma.cpython-39-x86_64-linux-gnu.so with build-id: 810ecc0bc799b1431f971f658c371651965cf1f4
                                                   Found module _bz2.cpython-39-x86_64-linux-gnu.so with build-id: 291a71ba37b1263e5a0bb233cc2ca14c98b0aa46
                                                   Found module _ssl.cpython-39-x86_64-linux-gnu.so with build-id: 011a5d57dda3cbcfb78950a7c256b2021e5ba234
                                                   Found module array.cpython-39-x86_64-linux-gnu.so with build-id: 20a1a6c616eb6f809526c5337e375f53c052ba45
                                                   Found module _socket.cpython-39-x86_64-linux-gnu.so with build-id: 6849a82a3a1cb3b2d915a23167afce3254a65d9c
                                                   Found module _blake2.cpython-39-x86_64-linux-gnu.so with build-id: ee3af42518ea3acd1d248e678b6a56dc258b1b5f
                                                   Found module _hashlib.cpython-39-x86_64-linux-gnu.so with build-id: 442f61ca2b902f4f3d9a7325df9aabb71dfbdf24
                                                   Found module libuuid.so.1 with build-id: 832a09e0d9568cc6dbe699472218ea2f79dc0f34
                                                   Found module _uuid.cpython-39-x86_64-linux-gnu.so with build-id: e5a6b0cb7da6595f3d8cf0a985765dc772cf680b
                                                   Found module zlib.cpython-39-x86_64-linux-gnu.so with build-id: 7303adf317b00b5db3f6db6ce628b18db7581163
                                                   Found module _opcode.cpython-39-x86_64-linux-gnu.so with build-id: 9baed6bb5e47a8d8844ccc57c63da77ffc858d75
                                                   Found module _elementpath.cpython-39-x86_64-linux-gnu.so with build-id: 1fd0273251f47164cabf06aa280e9deba3baa7b7
                                                   Found module libexslt.so.0 with build-id: f5860828f4d47235745ff64e625bb86a83bd7dc3
                                                   Found module etree.cpython-39-x86_64-linux-gnu.so with build-id: 4bddadc60f71b7f0e64c84d856e7c9977537fff8
                                                   Found module unicodedata.cpython-39-x86_64-linux-gnu.so with build-id: 343a2326e65a6d05aaeb7b059a895af692b81d8f
                                                   Found module _datetime.cpython-39-x86_64-linux-gnu.so with build-id: a9fc2ac9a090f840b10b9b8bfd500aff4f9c6317
                                                   Found module binascii.cpython-39-x86_64-linux-gnu.so with build-id: aa7d7f4b6a25cf38164f2d63aac7239a363154db
                                                   Found module _contextvars.cpython-39-x86_64-linux-gnu.so with build-id: dfe93463dbf9f0a53f61afc6a46ac2dc5683a9e3
                                                   Found module _sha512.cpython-39-x86_64-linux-gnu.so with build-id: 0ef24c7eda656f4432aa0eabe528fcb6b4f5511e
                                                   Found module _random.cpython-39-x86_64-linux-gnu.so with build-id: 4e1c9cc5fbf3b0f7a3ac3517f0d105973f699538
                                                   Found module _bisect.cpython-39-x86_64-linux-gnu.so with build-id: 845ad369d716991698f2e1f98047de2090c91971
                                                   Found module select.cpython-39-x86_64-linux-gnu.so with build-id: db6271756003ddd36a0ba0db53709f40af2536ae
                                                   Found module _posixsubprocess.cpython-39-x86_64-linux-gnu.so with build-id: 932f794c98cdf02791e254496f65af86ab798704
                                                   Found module grp.cpython-39-x86_64-linux-gnu.so with build-id: 8b73c4492a1f3631399c44dbd8d0c145ca5948ce
                                                   Found module math.cpython-39-x86_64-linux-gnu.so with build-id: e852cc99938cf320db7d96c163a15acf66bd7a6d
                                                   Found module QtXml.abi3.so with build-id: 594ea0d79dbb2a4f3752d12aa62cf57d82d82d72
                                                   Found module libQt5X11Extras.so.5 with build-id: e41614d2e35852f913bf00633d635cfbf5a90dce
                                                   Found module QtX11Extras.abi3.so with build-id: e91c91890637467d48ee8aa90fa79f527380a7ed
                                                   Found module libQt5WebKitWidgets.so.5 with build-id: dc78a8965deca1b60eca708b6125d9be290c2ea5
                                                   Found module QtWebKitWidgets.abi3.so with build-id: 249acd7a915e578dec8905b697269246b8319eb3
                                                   Found module libunistring.so.2 with build-id: 015ac6d6bcb60b7d8bea31a80d1941b06e8636ab
                                                   Found module libpsl.so.5 with build-id: 0229a201aaf5652186c9fdc192ebe52baf19d7f1
                                                   Found module libssh2.so.1 with build-id: a4adfe44cc7ebd295b3b783361acc3dcfcea1d50
                                                   Found module libidn2.so.0 with build-id: 1ce2b50ad9f9821c2c629b521cf5a3c99593d332
                                                   Found module libnghttp2.so.14 with build-id: eca975f5266a67fc4895065727647e98ff99a128
                                                   Found module libcurl.so.4 with build-id: 209b680538eb5f3793e41677b991488fb83a4ae6
                                                   Found module libdebuginfod.so.1 with build-id: c2c6f55725384574badcd94ab53b40b77a9a6232
                                                   Found module libelf.so.1 with build-id: 4300a0a24ac790c27ac0fe1fd5253729905ce708
                                                   Found module libblkid.so.1 with build-id: f03a24e92c9852272bd0049b5bcb7ed6cf0e664f
                                                   Found module liborc-0.4.so.0 with build-id: a95fb07ab70adc17bb91684e07695723aac3a4b8
                                                   Found module libdw.so.1 with build-id: 1c530a8055d22a14cf82c8da402a8c4ae966f063
                                                   Found module libunwind.so.8 with build-id: de4aafba062ffac19b3a0cedace42d0616ef9c1e
                                                   Found module libmount.so.1 with build-id: ff9a1d99d35cf640d0bfdaba294854372672c29b
                                                   Found module libgmodule-2.0.so.0 with build-id: 34cabbd12d9baf397a0255f174e4c96165bc329b
                                                   Found module libwoff2common.so.1.0.2 with build-id: 366330fae3eb439543a00a3b2e9a0cf92f3cf36c
                                                   Found module libgobject-2.0.so.0 with build-id: 3e451709a0a5772b9550d3a4c28dcb37a87028fa
                                                   Found module libgstfft-1.0.so.0 with build-id: d0b6d57c5089b8c3cd349a44a5bbb305c7593b39
                                                   Found module libgstvideo-1.0.so.0 with build-id: 1c2d0d2f2a093dce2599e44dbae0b912e7fe2100
                                                   Found module libgsttag-1.0.so.0 with build-id: a1386538852fac69efb02eb00a8a7c642b4d5eda
                                                   Found module libgstaudio-1.0.so.0 with build-id: a2ff6e79056102815723f171db4006ea146b439d
                                                   Found module libgstpbutils-1.0.so.0 with build-id: c7e8a4845c4deeddd7c6b5813a08920e403b9cd1
                                                   Found module libgstreamer-1.0.so.0 with build-id: dc53c6479f551983f392154c5cd15c79bb7157f6
                                                   Found module libgstbase-1.0.so.0 with build-id: 1d604ac8e054577eb20fc8963513d4fc74df83bd
                                                   Found module libgstapp-1.0.so.0 with build-id: 9fc29246748151bc0755b2811e75097921ad8eb6
                                                   Found module libgio-2.0.so.0 with build-id: b3348994e4d526d182becc32821aa3dbe9797149
                                                   Found module libsqlite3.so.0 with build-id: b5c21727dd6a9dcb95e6e57c0767158fddcb3245
                                                   Found module libxslt.so.1 with build-id: 6085ceddf5c745052dc31c6dcea8e03b24b9f0f2
                                                   Found module libxml2.so.2 with build-id: b9441ffabb52b50c290152592f17cd78a381d493
                                                   Found module libhyphen.so.0 with build-id: bf921c6bbb4feaa536e29f1ae72d3a9e79b6f98e
                                                   Found module libwebp.so.7 with build-id: 87e81472aa7ff3ed1061cfc13d6960dbe00c35ab
                                                   Found module libjpeg.so.8 with build-id: 5d102b1a7291a621bba049969d25ead0ccecc6cc
                                                   Found module libwoff2dec.so.1.0.2 with build-id: f305ec18581a18e8c83f5c3f5bcbe188eeb1b34c
                                                   Found module libQt5WebKit.so.5 with build-id: a23b0b9fb95bd4c8b5309d753bab8b372c2b36c5
                                                   Found module QtWebKit.abi3.so with build-id: fd3d1d6e2f03970c455aac35d5e90a04e1ed6445
                                                   Found module libQt5WebChannel.so.5 with build-id: 54ffa5c03fdd8d800d13b70f106139e94aa4f3ef
                                                   Found module QtWebChannel.abi3.so with build-id: 33d38a276783080fe3de31b3cf7e5ac99fcf182b
                                                   Found module libQt5TextToSpeech.so.5 with build-id: 99b56b543380180d6f5c8c984f01d80487672cff
                                                   Found module QtTextToSpeech.abi3.so with build-id: ffdf6b6866b3f29c86574e4b28edd6aacc10843f
                                                   Found module libQt5Test.so.5 with build-id: 01b1cd3b138ae3a34a40d79a8edb09c5646fc475
                                                   Found module QtTest.abi3.so with build-id: bb8c2665f353690f01c7499f2d438287ee2cfdf5
                                                   Found module libQt5Svg.so.5 with build-id: 891060da424e72ee00134ea2d255e93ab598fe06
                                                   Found module QtSvg.abi3.so with build-id: 2f00d4dec6633cd367c6b576b217ea6a8ae14312
                                                   Found module QtSql.abi3.so with build-id: 90b4ad1df3285e48f2f293daf906ea45e44e9b05
                                                   Found module libQt5Sensors.so.5 with build-id: e1b5ed1cea5191ba9970c286e557d30df1ab5bd8
                                                   Found module QtSensors.abi3.so with build-id: a9f95315f6547a82ac05e9f00bcecb009388aeb8
                                                   Found module libQt5QuickWidgets.so.5 with build-id: 40ef5bd18aebd12c92e079995c988e63d5225f4b
                                                   Found module QtQuickWidgets.abi3.so with build-id: 68eca4138edfe469f1ce52ac0acc60c8db27953f
                                                   Found module QtQuick.abi3.so with build-id: c2b91b2da99e497ebe0ec4c10fc8466693f78b8e
                                                   Found module libQt5PrintSupport.so.5 with build-id: e5a9ef096a7fbf7d633a02c9e8e202711b2e4755
                                                   Found module QtPrintSupport.abi3.so with build-id: 6422d4e1cb03203546f22788eec549e9a084719c
                                                   Found module libQt5QmlModels.so.5 with build-id: bb287a9d391c98bf3393f095e115482bf1635d8e
                                                   Found module libQt5Quick.so.5 with build-id: 8f6ab7ac0916394ecb43278f683f6b25b47b4e26
                                                   Found module libQt5PositioningQuick.so.5 with build-id: ca450a8bd07a3ae2f7cbc96701171b699d7f8daa
                                                   Found module libQt5Location.so.5 with build-id: 76fd16016759599a26015592de42c1b11a8aa40c
                                                   Found module QtLocation.abi3.so with build-id: 2dfeb659478a73ff834ea858c98fde88ebba4db5
                                                   Found module libQt5Positioning.so.5 with build-id: c638af0407ed24d7e28b741fa5605ce6856214df
                                                   Found module QtPositioning.abi3.so with build-id: b58785493b416da2a55b40d0c2a8fd6ab692dfb8
                                                   Found module libQt5OpenGL.so.5 with build-id: 2b05019d086acd3325fe2057db510ebb1f1ffeb3
                                                   Found module QtOpenGL.abi3.so with build-id: 049c1aeb79fa0f77fe040c7da403e9d5c4b33402
                                                   Found module libQt5MultimediaWidgets.so.5 with build-id: 9ab7cda9117494d9455ea51036239989cf4879f5
                                                   Found module QtMultimediaWidgets.abi3.so with build-id: c289c42280572113cde89ab17419b58dc8f45bb7
                                                   Found module libogg.so.0 with build-id: ca0cae30a809f10db1f16e54a23b4e5ff7b2c54c
                                                   Found module libvorbis.so.0 with build-id: ad0a6c1af8f219b4e314090b6e8847223d424cbe
                                                   Found module libopus.so.0 with build-id: 649d3ddab8764d7caf73648004a35cb13e23a5e1
                                                   Found module libFLAC.so.8 with build-id: e568dc3d434723c72d6d302eb0b2559f27e91faa
                                                   Found module libvorbisenc.so.2 with build-id: 28ed815b8b1d322e6bf2bfdce4b0af2789b74335
                                                   Found module libasyncns.so.0 with build-id: 6acff139d56b5139ce5eb50a66c62b215e1d332d
                                                   Found module libsndfile.so.1 with build-id: 72d5531e74ed3e9afe49e95e449c40cb8984a258
                                                   Found module libpulsecommon-15.0.so with build-id: a2e110b7a0b3bb46e42515afd55a61d78185835b
                                                   Found module libpulse.so.0 with build-id: 10bd0ce0cfbb9405cee189faa1830cf34cab61a8
                                                   Found module libQt5Multimedia.so.5 with build-id: 9e70700469b6663e71a35b573ed819cf63b1feae
                                                   Found module QtMultimedia.abi3.so with build-id: 6064b8d532a8cbf7039d99a52f31bee4c7fb7c8e
                                                   Found module libQt5Sql.so.5 with build-id: 9935d05998ac2e09b1c0829aa5ad976d1e7eee5d
                                                   Found module libQt5Help.so.5 with build-id: 2f3a7df0f44026339b3cdfb87228b10c60ed79e9
                                                   Found module QtHelp.abi3.so with build-id: a846828da763517d1354853a7aeb3f04f5f7252b
                                                   Found module libQt5Xml.so.5 with build-id: 274f34bf4a381c160f515d585dc700afe84c9e26
                                                   Found module libQt5Designer.so.5 with build-id: b38817166a5dd3545902eacd599db98334f7c6f7
                                                   Found module QtDesigner.abi3.so with build-id: 1a9c039ba0088e298fa296059068c4d4f8a514d6
                                                   Found module libdbus-1.so.3 with build-id: 74f2ab9c60512f3a93c932c3f627564d42e0b11e
                                                   Found module libQt5DBus.so.5 with build-id: 9b913e483c1701d15899015a4c1d9a065fe09c17
                                                   Found module QtDBus.abi3.so with build-id: 2ffe6db0cfa5a3558c27f376fc8b0c67e8ccf6ac
                                                   Found module libQt5Qml.so.5 with build-id: 9e41eb2dc21904fbdbed2aab03156a996251265a
                                                   Found module QtQml.abi3.so with build-id: 8524aecba4d69cc29f0ce1eee74eb5f91eaa0b90
                                                   Found module libQt5Widgets.so.5 with build-id: 3babb191c26c1c58f8773050568aa8303df8a644
                                                   Found module QtWidgets.abi3.so with build-id: f7a419336ecfaccd206a08d8ea17a8b40064a51f
                                                   Found module libXdmcp.so.6 with build-id: 8ca0792d23c8b8b4c0864297512349292bea5955
                                                   Found module libXau.so.6 with build-id: 1c67764663e07bec24d8951e5fd93f4d165979ff
                                                   Found module libbrotlicommon.so.1 with build-id: f68934f94312f770550ebc6c5acfd6359b098b07
                                                   Found module libxcb.so.1 with build-id: 0d1ef11740a5daad2ee331e812a51aa6574af222
                                                   Found module libbrotlidec.so.1 with build-id: f871e6f204ab8d48099915126ba01be989a8000f
                                                   Found module libbz2.so.1.0 with build-id: 919597c477c9b2cb9cdbb7745ed6494ac0e6da60
                                                   Found module libX11.so.6 with build-id: e9192497aa39fab51358826d1a1b5fb77edc5081
                                                   Found module libgraphite2.so.3 with build-id: 47761dc11e553f519cde97ed9ee985be12ccdae2
                                                   Found module libfreetype.so.6 with build-id: 65e7f4a1e5557b0ceeaa433e5356f857fe9c669b
                                                   Found module libGLX.so.0 with build-id: 0f40ceaa036edc65147e9559b94e0219472493fc
                                                   Found module libGLdispatch.so.0 with build-id: 195b34c1bb271f3b1162c897cfbcfb859e656b93
                                                   Found module libmd4c.so.0 with build-id: 2151dba72cdc9960097e6e960a58a2f03c8bb96e
                                                   Found module libharfbuzz.so.0 with build-id: f3507938a0d15efd3c81f0f9f1dd98cfdaf2144f
                                                   Found module libpng16.so.16 with build-id: 2dc0bce07f199bf983c07a05fb95a6f4af83a9b3
                                                   Found module libGL.so.1 with build-id: 8b3028bab286029945569a0dfcf695f0f61d9c3b
                                                   Found module libQt5Gui.so.5 with build-id: 01e2626fd88800dcfe2a611330ad7e65d5008ad6
                                                   Found module QtGui.abi3.so with build-id: 0773a1b27c978e9083965a6c124c054475a0bd24
                                                   Found module libresolv.so.2 with build-id: c915c72668282861a813f7ea3c0780f37b681dc0
                                                   Found module libkeyutils.so.1 with build-id: ac405ddd17be10ce538da3211415ee50c8f8df79
                                                   Found module libkrb5support.so.0 with build-id: adf65240a4d2aba772d7a0772b4d015469934113
                                                   Found module libcom_err.so.2 with build-id: eb61ef71c8b97846db759fb89a115405cff6dd30
                                                   Found module libk5crypto.so.3 with build-id: eb8220b8f36675aac769450be4cb6bb7f97ec38a
                                                   Found module libkrb5.so.3 with build-id: 72d26767c5cb1097db75a5f5bff88860233c902b
                                                   Found module libcrypto.so.1.1 with build-id: 6d23f0a3f354825868d044684fad31d482cc9210
                                                   Found module libssl.so.1.1 with build-id: 959cd8f1dd43fc31aeb93caac4eda87c907ef18b
                                                   Found module libgssapi_krb5.so.2 with build-id: e6e098ad51ce7bdd3dbe902d7b0f69a90f8a9e08
                                                   Found module libQt5Network.so.5 with build-id: a1957a018ad2d70126fc6868ae2184ef1f4cc07b
                                                   Found module QtNetwork.abi3.so with build-id: b2daea4f2c02b0c83fbd8903a15116f499b3b89d
                                                   Found module sip.cpython-39-x86_64-linux-gnu.so with build-id: 1edd1d4e00462ba53150a8a24c66894db323b667
                                                   Found module libgpg-error.so.0 with build-id: 3801187d42c4955bd93c605451430cdf1b164e63
                                                   Found module libpcre.so.1 with build-id: 845483dd0acba86de9f0313102bebbaf3ce52767
                                                   Found module libicudata.so.69 with build-id: 0ab994a49ef1848499c4af333b3266f28432a922
                                                   Found module libgcrypt.so.20 with build-id: db45f5d5e0f7af1e77324fea1885f974619ad268
                                                   Found module libcap.so.2 with build-id: f028e24efdfb362a37fa8dd280c3894b007f88b1
                                                   Found module liblz4.so.1 with build-id: e63600ab23b2f6997f42fac2fa56e1f02ce159a1
                                                   Found module liblzma.so.5 with build-id: 8b615460aa230708c5183f16bede67aa0437d95e
                                                   Found module librt.so.1 with build-id: 75484da2d6f1515189eefa076e0a40328834cd16
                                                   Found module libgcc_s.so.1 with build-id: 7f8508bb914546ada778809b64b99d234337d835
                                                   Found module libglib-2.0.so.0 with build-id: d4aa102e545015a506c3ee06398676b70f65bcbc
                                                   Found module libzstd.so.1 with build-id: 4b10444c1560ebc574af4d5f488b7408b22d450e
                                                   Found module libpcre2-16.so.0 with build-id: 195fbccafbcff538ce13805ba687514fb614c5ed
                                                   Found module libicuuc.so.69 with build-id: 5cf18c56e2f64efdac32cf61fb9c0c48e9bb1797
                                                   Found module libicui18n.so.69 with build-id: 9cdecde5b2e47a2bd81dc14915cbfefcade76c12
                                                   Found module libdouble-conversion.so.3 with build-id: 5bffb4317594514068e082d4b4e9acd99987ec47
                                                   Found module libz.so.1 with build-id: 81bf6e728a6d6f5b105b0f8b25f6c614ce10452a
                                                   Found module libsystemd.so.0 with build-id: 4173ca7f3b7338e7e0b8399eb75d6a7320c5f7f5
                                                   Found module libstdc++.so.6 with build-id: 8ab0e57054dd1dcba681f217016afc6a4e639783
                                                   Found module libQt5Core.so.5 with build-id: f2163e06980626832e075cc2b8b4ccf76b657c04
                                                   Found module QtCore.abi3.so with build-id: cfb9e595f6ccaf5f17bae306a20fa4e4a9fe154c
                                                   Found module Qt.abi3.so with build-id: 8fff6aa066a89a18be2f012892cccdfafc38fcee
                                                   Found module _struct.cpython-39-x86_64-linux-gnu.so with build-id: 9e3422b00d5f11fbce0ce6ee94b8bf7e414acfe6
                                                   Found module libffi.so.8 with build-id: f90d8b734f6de9b25faedb8cbfab7054dafc0a42
                                                   Found module _ctypes.cpython-39-x86_64-linux-gnu.so with build-id: a1bce886a2c2bd16ab02ae0aa8e67525bc34ad20
                                                   Found module _json.cpython-39-x86_64-linux-gnu.so with build-id: 12d76791795fd0de167124fa43f7f710fb703956
                                                   Found module _heapq.cpython-39-x86_64-linux-gnu.so with build-id: efd5a00a8d16b75ce5358c480e70a7901cccec6e
                                                   Found module ld-linux-x86-64.so.2 with build-id: 040cc3dd10461562f177df39e3be2f3704258c3c
                                                   Found module libm.so.6 with build-id: 2b8fd1f869ecab4e0b55e92f2f151897f6818acf
                                                   Found module libutil.so.1 with build-id: af6d8200064ee6e6a01252884d166b44f0a6121b
                                                   Found module libdl.so.2 with build-id: 5abc547e7b0949f89f3c0e21ab0c8331a7440a8a
                                                   Found module libpthread.so.0 with build-id: 07c8f95b4f3251d08550217ad8a1f31066229996
                                                   Found module libc.so.6 with build-id: 4b406737057708c0e4c642345a703c47a61c73dc
                                                   Found module libpython3.9.so.1.0 with build-id: da0da5c22c6b95bfa2c5ce589927f23ae1302754
                                                   Found module python3.9 with build-id: f9d7f05cffc4118c683a1820730103ac83e90853
                                                   Stack trace of thread 7268:
                                                   #0  0x00007fd6e59840d4 _ZNK12CarlaBackend11CarlaPlugin9isEnabledEv (libcarla_standalone2.so + 0xe60d4)
                                                   #1  0x00007fd6e596047c n/a (libcarla_standalone2.so + 0xc247c)
                                                   #2  0x00007fd6e564900e n/a (libjack.so.0 + 0x1800e)
                                                   #3  0x00007fd6e51a82cb n/a (libspa-support.so + 0x72cb)
                                                   #4  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #5  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #6  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7225:
                                                   #0  0x00007fd6f2b94201 __select (libc.so.6 + 0xf6201)
                                                   #1  0x00007fd6f2eb613e n/a (libpython3.9.so.1.0 + 0x24c13e)
                                                   #2  0x00007fd6f2da1ce7 n/a (libpython3.9.so.1.0 + 0x137ce7)
                                                   #3  0x00007fd6f2d92376 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128376)
                                                   #4  0x00007fd6f2da26eb _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x1386eb)
                                                   #5  0x00007fd6f2d92376 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128376)
                                                   #6  0x00007fd6f2da26eb _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x1386eb)
                                                   #7  0x00007fd6f2d92376 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128376)
                                                   #8  0x00007fd6f2d90fd9 n/a (libpython3.9.so.1.0 + 0x126fd9)
                                                   #9  0x00007fd6f2d90c41 _PyEval_EvalCodeWithName (libpython3.9.so.1.0 + 0x126c41)
                                                   #10 0x00007fd6f2e48633 PyEval_EvalCode (libpython3.9.so.1.0 + 0x1de633)
                                                   #11 0x00007fd6f2e58424 n/a (libpython3.9.so.1.0 + 0x1ee424)
                                                   #12 0x00007fd6f2e5414b n/a (libpython3.9.so.1.0 + 0x1ea14b)
                                                   #13 0x00007fd6f2d0145a n/a (libpython3.9.so.1.0 + 0x9745a)
                                                   #14 0x00007fd6f2d00932 PyRun_SimpleFileExFlags (libpython3.9.so.1.0 + 0x96932)
                                                   #15 0x00007fd6f2e69fc2 Py_RunMain (libpython3.9.so.1.0 + 0x1fffc2)
                                                   #16 0x00007fd6f2e3aab9 Py_BytesMain (libpython3.9.so.1.0 + 0x1d0ab9)
                                                   #17 0x00007fd6f2ac5b25 __libc_start_main (libc.so.6 + 0x27b25)
                                                   #18 0x00005569d8b7a04e _start (python3.9 + 0x104e)

                                                   Stack trace of thread 7249:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e5a8ba0c n/a (libcarla_standalone2.so + 0x1eda0c)
                                                   #2  0x00007fd6e5a8c0ea n/a (libcarla_standalone2.so + 0x1ee0ea)
                                                   Found module sip.cpython-39-x86_64-linux-gnu.so with build-id: 1edd1d4e00462ba53150a8a24c66894db323b667
                                                   Found module libgpg-error.so.0 with build-id: 3801187d42c4955bd93c605451430cdf1b164e63
                                                   Found module libpcre.so.1 with build-id: 845483dd0acba86de9f0313102bebbaf3ce52767
                                                   Found module libicudata.so.69 with build-id: 0ab994a49ef1848499c4af333b3266f28432a922
                                                   Found module libgcrypt.so.20 with build-id: db45f5d5e0f7af1e77324fea1885f974619ad268
                                                   Found module libcap.so.2 with build-id: f028e24efdfb362a37fa8dd280c3894b007f88b1
                                                   Found module liblz4.so.1 with build-id: e63600ab23b2f6997f42fac2fa56e1f02ce159a1
                                                   Found module liblzma.so.5 with build-id: 8b615460aa230708c5183f16bede67aa0437d95e
                                                   Found module librt.so.1 with build-id: 75484da2d6f1515189eefa076e0a40328834cd16
                                                   Found module libgcc_s.so.1 with build-id: 7f8508bb914546ada778809b64b99d234337d835
                                                   Found module libglib-2.0.so.0 with build-id: d4aa102e545015a506c3ee06398676b70f65bcbc
                                                   Found module libzstd.so.1 with build-id: 4b10444c1560ebc574af4d5f488b7408b22d450e
                                                   Found module libpcre2-16.so.0 with build-id: 195fbccafbcff538ce13805ba687514fb614c5ed
                                                   Found module libicuuc.so.69 with build-id: 5cf18c56e2f64efdac32cf61fb9c0c48e9bb1797
                                                   Found module libicui18n.so.69 with build-id: 9cdecde5b2e47a2bd81dc14915cbfefcade76c12
                                                   Found module libdouble-conversion.so.3 with build-id: 5bffb4317594514068e082d4b4e9acd99987ec47
                                                   Found module libz.so.1 with build-id: 81bf6e728a6d6f5b105b0f8b25f6c614ce10452a
                                                   Found module libsystemd.so.0 with build-id: 4173ca7f3b7338e7e0b8399eb75d6a7320c5f7f5
                                                   Found module libstdc++.so.6 with build-id: 8ab0e57054dd1dcba681f217016afc6a4e639783
                                                   Found module libQt5Core.so.5 with build-id: f2163e06980626832e075cc2b8b4ccf76b657c04
                                                   Found module QtCore.abi3.so with build-id: cfb9e595f6ccaf5f17bae306a20fa4e4a9fe154c
                                                   Found module Qt.abi3.so with build-id: 8fff6aa066a89a18be2f012892cccdfafc38fcee
                                                   Found module _struct.cpython-39-x86_64-linux-gnu.so with build-id: 9e3422b00d5f11fbce0ce6ee94b8bf7e414acfe6
                                                   Found module libffi.so.8 with build-id: f90d8b734f6de9b25faedb8cbfab7054dafc0a42
                                                   Found module _ctypes.cpython-39-x86_64-linux-gnu.so with build-id: a1bce886a2c2bd16ab02ae0aa8e67525bc34ad20
                                                   Found module _json.cpython-39-x86_64-linux-gnu.so with build-id: 12d76791795fd0de167124fa43f7f710fb703956
                                                   Found module _heapq.cpython-39-x86_64-linux-gnu.so with build-id: efd5a00a8d16b75ce5358c480e70a7901cccec6e
                                                   Found module ld-linux-x86-64.so.2 with build-id: 040cc3dd10461562f177df39e3be2f3704258c3c
                                                   Found module libm.so.6 with build-id: 2b8fd1f869ecab4e0b55e92f2f151897f6818acf
                                                   Found module libutil.so.1 with build-id: af6d8200064ee6e6a01252884d166b44f0a6121b
                                                   Found module libdl.so.2 with build-id: 5abc547e7b0949f89f3c0e21ab0c8331a7440a8a
                                                   Found module libpthread.so.0 with build-id: 07c8f95b4f3251d08550217ad8a1f31066229996
                                                   Found module libc.so.6 with build-id: 4b406737057708c0e4c642345a703c47a61c73dc
                                                   Found module libpython3.9.so.1.0 with build-id: da0da5c22c6b95bfa2c5ce589927f23ae1302754
                                                   Found module python3.9 with build-id: f9d7f05cffc4118c683a1820730103ac83e90853
                                                   Stack trace of thread 7268:
                                                   #0  0x00007fd6e59840d4 _ZNK12CarlaBackend11CarlaPlugin9isEnabledEv (libcarla_standalone2.so + 0xe60d4)
                                                   #1  0x00007fd6e596047c n/a (libcarla_standalone2.so + 0xc247c)
                                                   #2  0x00007fd6e564900e n/a (libjack.so.0 + 0x1800e)
                                                   #3  0x00007fd6e51a82cb n/a (libspa-support.so + 0x72cb)
                                                   #4  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #5  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #6  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7225:
                                                   #0  0x00007fd6f2b94201 __select (libc.so.6 + 0xf6201)
                                                   #1  0x00007fd6f2eb613e n/a (libpython3.9.so.1.0 + 0x24c13e)
                                                   #2  0x00007fd6f2da1ce7 n/a (libpython3.9.so.1.0 + 0x137ce7)
                                                   #3  0x00007fd6f2d92376 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128376)
                                                   #4  0x00007fd6f2da26eb _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x1386eb)
                                                   #5  0x00007fd6f2d92376 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128376)
                                                   #6  0x00007fd6f2da26eb _PyFunction_Vectorcall (libpython3.9.so.1.0 + 0x1386eb)
                                                   #7  0x00007fd6f2d92376 _PyEval_EvalFrameDefault (libpython3.9.so.1.0 + 0x128376)
                                                   #8  0x00007fd6f2d90fd9 n/a (libpython3.9.so.1.0 + 0x126fd9)
                                                   #9  0x00007fd6f2d90c41 _PyEval_EvalCodeWithName (libpython3.9.so.1.0 + 0x126c41)
                                                   #10 0x00007fd6f2e48633 PyEval_EvalCode (libpython3.9.so.1.0 + 0x1de633)
                                                   #11 0x00007fd6f2e58424 n/a (libpython3.9.so.1.0 + 0x1ee424)
                                                   #12 0x00007fd6f2e5414b n/a (libpython3.9.so.1.0 + 0x1ea14b)
                                                   #13 0x00007fd6f2d0145a n/a (libpython3.9.so.1.0 + 0x9745a)
                                                   #14 0x00007fd6f2d00932 PyRun_SimpleFileExFlags (libpython3.9.so.1.0 + 0x96932)
                                                   #15 0x00007fd6f2e69fc2 Py_RunMain (libpython3.9.so.1.0 + 0x1fffc2)
                                                   #16 0x00007fd6f2e3aab9 Py_BytesMain (libpython3.9.so.1.0 + 0x1d0ab9)
                                                   #17 0x00007fd6f2ac5b25 __libc_start_main (libc.so.6 + 0x27b25)
                                                   #18 0x00005569d8b7a04e _start (python3.9 + 0x104e)

                                                   Stack trace of thread 7249:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e5a8ba0c n/a (libcarla_standalone2.so + 0x1eda0c)
                                                   #2  0x00007fd6e5a8c0ea n/a (libcarla_standalone2.so + 0x1ee0ea)
                                                   #3  0x00007fd6e5a8c671 n/a (libcarla_standalone2.so + 0x1ee671)
                                                   #4  0x00007fd6e5a8c901 n/a (libcarla_standalone2.so + 0x1ee901)
                                                   #5  0x00007fd6f166b3c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                                                   #6  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #7  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7259:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7250:
                                                   #0  0x00007fd6f2a928ca __futex_abstimed_wait_common64 (libpthread.so.0 + 0x158ca)
                                                   #1  0x00007fd6f2a8c842 pthread_cond_clockwait (libpthread.so.0 + 0xf842)
                                                   #2  0x00007fd6e5a7f497 n/a (libcarla_standalone2.so + 0x1e1497)
                                                   #3  0x00007fd6f166b3c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7251:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e5a8ba0c n/a (libcarla_standalone2.so + 0x1eda0c)
                                                   #2  0x00007fd6e5a8c0ea n/a (libcarla_standalone2.so + 0x1ee0ea)
                                                   #3  0x00007fd6e5a8c671 n/a (libcarla_standalone2.so + 0x1ee671)
                                                   #4  0x00007fd6e5a8db2d n/a (libcarla_standalone2.so + 0x1efb2d)
                                                   #5  0x00007fd6f166b3c4 execute_native_thread_routine (libstdc++.so.6 + 0xd33c4)
                                                   #6  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #7  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7253:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7266:
                                                   #0  0x00007fd6e4afb540 pitch_search (librnnoise_ladspa.so + 0x7540)
                                                   #1  0x00007fd6e4af9177 rnnoise_process_frame (librnnoise_ladspa.so + 0x5177)
                                                   #2  0x00007fd6e4af7e0c _ZN19RnNoiseCommonPlugin7processEPKfPfif (librnnoise_ladspa.so + 0x3e0c)
                                                   #3  0x00007fd6e59b45b1 n/a (libcarla_standalone2.so + 0x1165b1)
                                                   #4  0x00007fd6e59bdae7 n/a (libcarla_standalone2.so + 0x11fae7)
                                                   #5  0x00007fd6e595e91e n/a (libcarla_standalone2.so + 0xc091e)
                                                   #6  0x00007fd6e5960534 n/a (libcarla_standalone2.so + 0xc2534)
                                                   #7  0x00007fd6e564900e n/a (libjack.so.0 + 0x1800e)
                                                   #8  0x00007fd6e51a82cb n/a (libspa-support.so + 0x72cb)
                                                   #9  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #10 0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #11 0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7255:
                                                   #0  0x00007fd6f2b64a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                                                   #1  0x00007fd6f2b69c77 __nanosleep (libc.so.6 + 0xcbc77)
                                                   #2  0x00007fd6f2b94a99 usleep (libc.so.6 + 0xf6a99)
                                                   #3  0x00007fd6e5964ace n/a (libcarla_standalone2.so + 0xc6ace)
                                                   #4  0x00007fd6e59099ef n/a (libcarla_standalone2.so + 0x6b9ef)
                                                   #5  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #6  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7263:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7264:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7257:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7265:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7254:
                                                   #0  0x00007fd6f2b64a95 clock_nanosleep@@GLIBC_2.17 (libc.so.6 + 0xc6a95)
                                                   #1  0x00007fd6f2b69c77 __nanosleep (libc.so.6 + 0xcbc77)
                                                   #2  0x00007fd6f2b94a99 usleep (libc.so.6 + 0xf6a99)
                                                   #3  0x00007fd6e595108e n/a (libcarla_standalone2.so + 0xb308e)
                                                   #4  0x00007fd6e59099ef n/a (libcarla_standalone2.so + 0x6b9ef)
                                                   #5  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #6  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7252:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7260:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7258:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7261:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7262:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7256:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e5274590 n/a (libpipewire-0.3.so.0 + 0x43590)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7269:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)

                                                   Stack trace of thread 7267:
                                                   #0  0x00007fd6f2b9c92e epoll_wait (libc.so.6 + 0xfe92e)
                                                   #1  0x00007fd6e51b4571 n/a (libspa-support.so + 0x13571)
                                                   #2  0x00007fd6e51a8234 n/a (libspa-support.so + 0x7234)
                                                   #3  0x00007fd6e52b423a n/a (libpipewire-0.3.so.0 + 0x8323a)
                                                   #4  0x00007fd6f2a86259 start_thread (libpthread.so.0 + 0x9259)
                                                   #5  0x00007fd6f2b9c5e3 __clone (libc.so.6 + 0xfe5e3)
Iwyil commented 2 years ago

My version of PipeWire was the latest one, to my knowledge. However, while trying to debug PipeWire further (without luck) I recompiled their master branch with debug infos. The problem still remain, and is the same. At this point, seeing the function callbacks in the wrong order, I am much more willing to think that, at least in my case, this is not a problem of Carla, but rather a bug in PipeWire.

Just for the sake of completeness, here are the new backtraces which include the PipeWire debug infos, in case anyone is interested: Backtrace from Valgrind, when the heap gets corrupted:

==121325== Thread 14:
==121325== Invalid write of size 8
==121325==    at 0x4848194: memset (vg_replace_strmem.c:1270)
==121325==    by 0x17A293C8: carla_zeroFloats(float*, unsigned long) (CarlaMathUtils.hpp:220)
==121325==    by 0x17A30129: CarlaBackend::CarlaPluginVST2::processSingle(float const* const*, float**, unsigned int, unsigned int) (CarlaPluginVST2.cpp:1761)
==121325==    by 0x17A2FC2D: CarlaBackend::CarlaPluginVST2::process(float const* const*, float**, float const* const*, float**, unsigned int) (CarlaPluginVST2.cpp:1665)
==121325==    by 0x17990AB3: CarlaBackend::CarlaEngineJack::processPlugin(std::shared_ptr<CarlaBackend::CarlaPlugin>&, unsigned int) (CarlaEngineJack.cpp:4112)
==121325==    by 0x17991E83: CarlaBackend::CarlaEngineJack::carla_jack_process_callback_plugin(unsigned int, void*) (CarlaEngineJack.cpp:4531)
==121325==    by 0x1868B0D5: on_rtsocket_condition (pipewire-jack.c:1407)
==121325==    by 0x18B3536A: loop_iterate (loop.c:335)
==121325==    by 0x18A22956: do_loop (data-loop.c:81)
==121325==    by 0x4E1C258: start_thread (in /usr/lib/libpthread-2.33.so)
==121325==    by 0x4D455E2: clone (in /usr/lib/libc-2.33.so)
==121325==  Address 0x5162ba0 is 0 bytes after a block of size 4,096 alloc'd
==121325==    at 0x484021F: operator new[](unsigned long) (vg_replace_malloc.c:579)
==121325==    by 0x17A30B1C: CarlaBackend::CarlaPluginVST2::bufferSizeChanged(unsigned int) (CarlaPluginVST2.cpp:1892)
==121325==    by 0x1794B292: CarlaBackend::CarlaEngine::bufferSizeChanged(unsigned int) (CarlaEngine.cpp:2212)
==121325==    by 0x1798BF24: CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(unsigned int) (CarlaEngineJack.cpp:2856)
==121325==    by 0x17991404: CarlaBackend::CarlaEngineJack::carla_jack_bufsize_callback(unsigned int, void*) (CarlaEngineJack.cpp:4352)
==121325==    by 0x1867CC80: do_buffer_frames (pipewire-jack.c:1196)
==121325==    by 0x18B34CC8: flush_items (loop.c:144)
==121325==    by 0x18B33DB9: source_event_func (loop.c:490)
==121325==    by 0x18B3536A: loop_iterate (loop.c:335)
==121325==    by 0x18A62D09: do_loop (thread-loop.c:262)
==121325==    by 0x4E1C258: start_thread (in /usr/lib/libpthread-2.33.so)
==121325==    by 0x4D455E2: clone (in /usr/lib/libc-2.33.so)

Backtrace when Carla crash:

#0  0x00007f93a7dcdd22 in raise () at /usr/lib/libc.so.6
#1  0x00007f93a7db7862 in abort () at /usr/lib/libc.so.6
#2  0x00007f93a7e0fd28 in __libc_message () at /usr/lib/libc.so.6
#3  0x00007f93a7e1792a in  () at /usr/lib/libc.so.6
#4  0x00007f93a7e191bc in _int_free () at /usr/lib/libc.so.6
#5  0x00007f93a7e1c9e8 in free () at /usr/lib/libc.so.6
#6  0x00007f93935e0af8 in CarlaBackend::CarlaPluginVST2::bufferSizeChanged(unsigned int) (this=0x55dea10af090, newBufferSize=2048) at CarlaPluginVST2.cpp:1891
#7  0x00007f93934fb293 in CarlaBackend::CarlaEngine::bufferSizeChanged(unsigned int) (this=0x55dea0b61a10, newBufferSize=2048) at CarlaEngine.cpp:2212
#8  0x00007f939353bf25 in CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(unsigned int) (this=0x55dea0b61a10, newBufferSize=2048) at CarlaEngineJack.cpp:2856
#9  0x00007f9393541405 in CarlaBackend::CarlaEngineJack::carla_jack_bufsize_callback(unsigned int, void*) (newBufferSize=2048, arg=0x55dea0b61a10) at CarlaEngineJack.cpp:4352
#10 0x00007f93984ddc81 in do_buffer_frames (loop=<optimized out>, async=<optimized out>, seq=<optimized out>, data=<optimized out>, size=<optimized out>, user_data=0x55dea100bf70) at ../pipewire/pipewire-jack/src/pipewire-jack.c:1196
#11 0x00007f939803bcc9 in flush_items (impl=0x55dea10104e8) at ../pipewire/spa/plugins/support/loop.c:144
#12 0x00007f939803adba in source_event_func (source=0x55dea0b6b8e0) at ../pipewire/spa/plugins/support/loop.c:490
#13 0x00007f939803c36b in loop_iterate (object=0x55dea10104e8, timeout=<optimized out>) at ../pipewire/spa/plugins/support/loop.c:335
#14 0x00007f9398148d0a in do_loop (user_data=0x55dea0b64a10) at ../pipewire/src/pipewire/thread-loop.c:262
#15 0x00007f93a7d79259 in start_thread () at /usr/lib/libpthread.so.0
#16 0x00007f93a7e8f5e3 in clone () at /usr/lib/libc.so.6

Also, as to be expected, if some condition or application is preventing PipeWire from changing the buffer size (in my case I found it to be another stream already playing), then there is no problem. As a workaround, I will try to force a single buffer size.

falkTX commented 2 years ago

ok so this is useful. Please add some prints to ensure the pipewire buffer size is being done correctly.

In CarlaEngineJack::processPlugin and CarlaEngineJack::handleJackBufferSizeCallback print the num-frames. Run again and paste the values. I suspect pipewire changes buffer sizes but then calls process with a higher number than expected.

Iwyil commented 2 years ago
[108235.280597756] carla_jack_process_callback_plugin(frames: 1024, arg: 0x5570767b06e0)
[108235.280624353] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024)
[108235.280649895] CarlaBackend::CarlaPluginVST2::process(frames: 1024)
[108235.301947519] carla_jack_process_callback_plugin(frames: 2048, arg: 0x5570767b06e0)
[108235.301968042] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x557076880f20)
[108235.301978119] CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(frames: 2048)
[108235.301986229] CarlaEngine::bufferSizeChanged(2048)
[108235.301979678] CarlaBackend::CarlaEngineJack::processPlugin(frames: 2048)
[108235.302030535] CarlaBackend::CarlaPluginVST2::process(frames: 2048)
[108235.302191743] CarlaPluginVST2::bufferSizeChanged(2048) PID: 165556
[108235.302202071] CarlaPluginVST2::dispatcher(72:effStopProcess, 0, 0, (nil), 0.000000)
[108235.302211412] CarlaPluginVST2::dispatcher(12:effMainsChanged, 0, 0, (nil), 0.000000)

I removed some of the arguments in the printing of the call, since they were just pointers and a lot of noise.

To me the issue looks that PipeWire call the callback to change the size of the buffers after having called the function for processing with the new buffer size. The timestamps are the system uptime in seconds.nanoseconds as returned from clock_gettime(2) on Linux

EDIT: In this case I have been to reproduce this issue with my system under load, to create a bit more difference in time:

[109517.577664666] carla_jack_process_callback_plugin(frames: 1024, arg: 0x55cf1c7d54b0)
[109517.577692465] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024)
[109517.577723487] CarlaBackend::CarlaPluginVST2::process(frames: 1024)
[109517.599660926] carla_jack_process_callback_plugin(frames: 2048, arg: 0x55cf1c7d54b0)
[109517.599691795] CarlaBackend::CarlaEngineJack::processPlugin(frames: 2048)
[109517.599742457] CarlaBackend::CarlaPluginVST2::process(frames: 2048)
[109517.600229163] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x55cf1c833f70)
[109517.600240042] CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(frames: 2048)
[109517.600245796] CarlaEngine::bufferSizeChanged(2048)
[109517.600256613] CarlaPluginVST2::bufferSizeChanged(2048) PID: 181252

However, in my tests sometimes the two callbacks, carla_jack_process_callback_plugin and carla_jack_bufsize_callback, were so near in time that in some crashes they have been logged on the same line.

In both of those cases (and any other crash that I have tested), the starting size of the buffer, as in the first call of carla_jack_process_callback_plugin in the logs, is of 1024

falkTX commented 2 years ago

hmm I think these are the 3 critical lines:

[109517.577664666] carla_jack_process_callback_plugin(frames: 1024, arg: 0x55cf1c7d54b0)
...
[109517.599660926] carla_jack_process_callback_plugin(frames: 2048, arg: 0x55cf1c7d54b0)
...
[109517.600229163] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x55cf1c833f70)

Assuming the timing info is correct, seems like pipewire is calling process with the new and bigger 2048 frames before the bufsize callback, thus leading into crashes.

@wtay can you look into this please?

falkTX commented 2 years ago

This is likely now fixed in 0.3.41 version of pipewire. Testing would be much appreciated!

Iwyil commented 2 years ago

At a first glance and without extensive testing, in my use case, the issue seems solved. When changing buffer size the callbacks are well ordered, and there is no heap corruption anymore, nor any crash. Thank you. Will update in case of any news.

falkTX commented 2 years ago

Ok will recheck this next week if I dont forget.. If there are no news by then, will consider this fixed.

Iwyil commented 2 years ago

For me the problem is definitely still sneaking around, unfortunately, except this time is 100 time harder to catch (this makes the application definitely usable for me, with a crash every so often) While playing a playlist, the buffer size changes a lot, and I got only 2 crash in a total of around 10h. The stacktrace is almost a copy paste of the one I already posted. The logs also are quite similar: now it looks like when there is a crash, is because PipeWire mix the timing of the calls to process data and to change buffer size (see the logs).

Carla: (last) commit 8c8efd2b1eeec5cf80cb6cd6739cbc70cbbc9bee Pipewire: tag 0.3.41 (commit 717fb64e4e4477b5a3bfb2d6f8def273b52b7259) (this one at the time of writing is not the last commit available anymore)

Stacktrace Same for both crashes

#0 0x00007fd42bb29d22 in raise () at /usr/lib/libc.so.6 #1 0x00007fd42bb13862 in abort () at /usr/lib/libc.so.6 #2 0x00007fd42bb6bd28 in __libc_message () at /usr/lib/libc.so.6 #3 0x00007fd42bb7392a in () at /usr/lib/libc.so.6 #4 0x00007fd42bb751bc in _int_free () at /usr/lib/libc.so.6 #5 0x00007fd42bb789e8 in free () at /usr/lib/libc.so.6 #6 0x00007fd4175e0ca2 in CarlaBackend::CarlaPluginVST2::bufferSizeChanged(unsigned int) (this=0x55f32e1bb050, newBufferSize=2048) at CarlaPluginVST2.cpp:1891 #7 0x00007fd4174fb293 in CarlaBackend::CarlaEngine::bufferSizeChanged(unsigned int) (this=0x55f32d9efed0, newBufferSize=2048) at CarlaEngine.cpp:2212 #8 0x00007fd41753bf3e in CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(unsigned int) (this=0x55f32d9efed0, newBufferSize=2048) at CarlaEngineJack.cpp:2857 #9 0x00007fd417541439 in CarlaBackend::CarlaEngineJack::carla_jack_bufsize_callback(unsigned int, void*) (newBufferSize=2048, arg=0x55f32d9efed0) at CarlaEngineJack.cpp:4354 #10 0x00007fd41c183433 in do_buffer_frames (loop=, async=, seq=, data=, size=, user_data=0x55f32e106d30) at ../pipewire/pipewire-jack/src/pipewire-jack.c:1230 #11 0x00007fd41c01e2d9 in flush_items (impl=0x55f32e10b2a8) at ../pipewire/spa/plugins/support/loop.c:144 #12 0x00007fd41c01d3ca in source_event_func (source=0x55f32dd04dc0) at ../pipewire/spa/plugins/support/loop.c:490 #13 0x00007fd41c01e97b in loop_iterate (object=0x55f32e10b2a8, timeout=) at ../pipewire/spa/plugins/support/loop.c:335 #14 0x00007fd41674224a in do_loop (user_data=0x55f32dbc6170) at ../pipewire/src/pipewire/thread-loop.c:262 #15 0x00007fd42bad5259 in start_thread () at /usr/lib/libpthread.so.0 #16 0x00007fd42bbeb5e3 in clone () at /usr/lib/libc.so.6

Here are all the logs Most of the calls change the buffer are logged like this (which I think is how they should be) [pseudo graph added by me, in hope to help to better show how things mix together, in my opinion]: ``` ┌─[92836.927883268] carla_jack_process_callback_plugin(frames: 1024, arg: 0x55f32e320580) ├─[92836.927907949] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024) └─[92836.927934669] CarlaBackend::CarlaPluginVST2::process(frames: 1024) ┌─[92836.949213579] carla_jack_process_callback_plugin(frames: 1024, arg: 0x55f32e320580) ├─[92836.949242404] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024) └─[92836.949268472] CarlaBackend::CarlaPluginVST2::process(frames: 1024) ┌[92836.970560265] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x55f32d9efed0) ├[92836.970577122] CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(frames: 2048) ├[92836.970582736] CarlaEngine::bufferSizeChanged(2048) └[92836.970595168] CarlaPluginVST2::bufferSizeChanged(2048) PID: 116648 ``` This excerpt is **not** where the crash happened (the buffer is shrinking), but to me it looks like PipeWire is playing on the edge of "not wait" before the next process call: ``` ┌─ [92834.624288953] carla_jack_process_callback_plugin(frames: 2048, arg: 0x55f32e320580) ├─ [92834.624373760] CarlaBackend::CarlaEngineJack::processPlugin(frames: 2048) └─ [92834.624482532] CarlaBackend::CarlaPluginVST2::process(frames: 2048) ┌─ [92834.666542469] carla_jack_process_callback_plugin(frames: 1024, arg: 0x55f32e320580) ├─ [92834.666584300] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024) │┌ [92834.666598485] carla_jack_bufsize_callback(newBufferSize: 1024, arg: 0x55f32d9efed0) │├ [92834.666608841] CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(frames: 1024) └─ [92834.666612646] CarlaBackend::CarlaPluginVST2::process(frames: 1024) ├ [92834.666614106] CarlaEngine::bufferSizeChanged(1024) └ [92834.666901274] CarlaPluginVST2::bufferSizeChanged(1024) PID: 116648 ``` This is the excerpt from the before the one crash: ``` ┌─[92931.221011845] carla_jack_process_callback_plugin(frames: 1024, arg: 0x55f32e320580) ├─[92931.221054715] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024) └─[92931.221075601] CarlaBackend::CarlaPluginVST2::process(frames: 1024) ┌[92931.242549869] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x55f32d9efed0) ┌─[92931.242560535] carla_jack_process_callback_plugin(frames: 2048, arg: 0x55f32e320580) │├[92931.242600089] CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(frames: 2048) │├[92931.242613044] CarlaEngine::bufferSizeChanged(2048) ├─[92931.242617437] CarlaBackend::CarlaEngineJack::processPlugin(frames: 2048) └─[92931.242659838] CarlaBackend::CarlaPluginVST2::process(frames: 2048) └[92931.242909936] CarlaPluginVST2::bufferSizeChanged(2048) PID: 116648 ``` This is from the other one (there is enough time complete the process call with wrong buffer size): ``` ┌─[45981.780337864] carla_jack_process_callback_plugin(frames: 1024, arg: 0x56413ff3b460) ├─[45981.780368171] CarlaBackend::CarlaEngineJack::processPlugin(frames: 1024) └─[45981.780392466] CarlaBackend::CarlaPluginVST2::process(frames: 1024) ┌─[45981.801704672] carla_jack_process_callback_plugin(frames: 2048, arg: 0x56413ff3b460) ├─[45981.801746484] CarlaBackend::CarlaEngineJack::processPlugin(frames: 2048) └─[45981.801793129] CarlaBackend::CarlaPluginVST2::process(frames: 2048) ┌[45981.801827085] carla_jack_bufsize_callback(newBufferSize: 2048, arg: 0x56413fdecb00) ├[45981.801839929] CarlaBackend::CarlaEngineJack::handleJackBufferSizeCallback(frames: 2048) ├[45981.801847420] CarlaEngine::bufferSizeChanged(2048) └[45981.802360839] CarlaPluginVST2::bufferSizeChanged(2048) PID: 77323 ``` I am pretty confident that I could identify more points where the flow of those callback get mixed.

I don't know where to look for more info or data for debugging, but I am open to suggestion. However, I wonder if this issue is worth keeping open anyway, given that it doesn't seem to me that Carla is doing something particularly wrong.

lbenard commented 2 years ago

I can try on my end this weekend if that would be of any help

falkTX commented 2 years ago

this seems like a race condition, the buffer size callback happening while process still active or something.

I would keep this open as a way to gather more info, but seems indeed like a pw bug.

maybe we can have carla running with jack2 with a few plugins and a script that changes buffer size every couple of seconds... that could test-proof this.

wtay commented 2 years ago

FYI, The fix in PipeWire is just to make it less likely but the problem is fundamentally still there.

I'm still thinking about a good way to pause multiple processing threads until all clients have handled the buffersize callback.