Closed SipSeb closed 6 years ago
rfuchs
commented
6 years ago Yes, and this one is just as puzzling as the other one. Are you sure you don't have an inconsistent build or something like that? Like updated the sources but didn't recompile everything?
SipSeb
commented
6 years ago We have a Jenkins system which builds the packages for us. And it always uses a fresh checkout for building packages. There is no caching of whatsoever.
The only thing we have changed from the original sources is we remove the g729 lib from the control file as we don't use transcoding. And the only commit missing is yours from yesterday.
We have setup this machine from scratch before installing the packages generated by Jenkins yesterday. So there can't be any leftovers from an old installation.
rfuchs
commented
6 years ago Both of these aborted during memory allocation, which is very unusual. Are you able to run this under valgrind to catch memory access issues?
SipSeb
commented
6 years ago I have started it with valgrind now, but will enable traffic either later or tomorrow. I'll get back to you with results.
SipSeb
commented
6 years ago After eliminating an open files issue after starting rtpengine with valgrind, it is now running with traffic.
Command line: ulimit -n 40000 ; valgrind --log-file=/tmp/valgrind-rtpengine2.log /usr/sbin/rtpengine --pidfile /var/run/ngcp-rtpengine-daemon.pid --config-file /etc/rtpengine/rtpengine.conf --table 0
So far I see this from startup:
==14149== Memcheck, a memory error detector
==14149== Copyright (C) 2002-2015, and GNU GPL'd, by Julian Seward et al.
==14149== Using Valgrind-3.12.0.SVN and LibVEX; rerun with -h for copyright info
==14149== Command: /usr/sbin/rtpengine --pidfile /var/run/ngcp-rtpengine-daemon.pid --config-file /etc/rtpengine/rtpengine.conf --table 0
==14149== Parent PID: 13127
==14149==
==14149==
==14149== HEAP SUMMARY:
==14149== in use at exit: 275,979 bytes in 4,492 blocks
==14149== total heap usage: 6,750 allocs, 2,258 frees, 1,107,468 bytes allocated
==14149==
==14149== LEAK SUMMARY:
==14149== definitely lost: 3,436 bytes in 17 blocks
==14149== indirectly lost: 5,812 bytes in 101 blocks
==14149== possibly lost: 2,247 bytes in 26 blocks
==14149== still reachable: 264,484 bytes in 4,348 blocks
==14149== of which reachable via heuristic:
==14149== newarray : 1,536 bytes in 16 blocks
==14149== suppressed: 0 bytes in 0 blocks
==14149== Rerun with --leak-check=full to see details of leaked memory
==14149==
==14149== For counts of detected and suppressed errors, rerun with: -v
==14149== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0)After some seconds it starts looging lines like these:
==14156== Thread 10:
==14156== Conditional jump or move depends on uninitialised value(s)
==14156== at 0x4C31D21: __memcmp_sse4_1 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==14156== by 0x132B6D: __output_add (stun.c:282)
==14156== by 0x132B6D: software.isra.0 (stun.c:311)
==14156== by 0x134012: stun_binding_request (stun.c:662)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EE1: __do_ice_checks (ice.c:806)
==14156== by 0x148B0B: ice_update (ice.c:445)
==14156== by 0x11E195: monologue_offer_answer (call.c:1748)
==14156== by 0x13A7F8: call_offer_answer_ng (call_interfaces.c:906)
==14156== by 0x12C4CF: control_ng_incoming (control_ng.c:192)
==14156== by 0x12B6A1: udp_listener_incoming (udp_listener.c:54)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156==
==14156== Use of uninitialised value of size 8
==14156== at 0x5654F96: crc32 (in /lib/x86_64-linux-gnu/libz.so.1.2.8)
==14156== by 0x132C2D: fingerprint.isra.3 (stun.c:326)
==14156== by 0x1341FD: stun_binding_request (stun.c:680)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EE1: __do_ice_checks (ice.c:806)
==14156== by 0x148B0B: ice_update (ice.c:445)
==14156== by 0x11E195: monologue_offer_answer (call.c:1748)
==14156== by 0x13A7F8: call_offer_answer_ng (call_interfaces.c:906)
==14156== by 0x12C4CF: control_ng_incoming (control_ng.c:192)
==14156== by 0x12B6A1: udp_listener_incoming (udp_listener.c:54)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156==This repeats for different threads.
Then:
==14156==
==14156== Syscall param sendmsg(msg.msg_iov[2]) points to uninitialised byte(s)
==14156== at 0xA68FE90: sendmsg (sendmsg.c:28)
==14156== by 0x14A88B: __ip_sendmsg (socket.c:348)
==14156== by 0x134226: stun_binding_request (stun.c:683)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EE1: __do_ice_checks (ice.c:806)
==14156== by 0x148B0B: ice_update (ice.c:445)
==14156== by 0x11E195: monologue_offer_answer (call.c:1748)
==14156== by 0x13A7F8: call_offer_answer_ng (call_interfaces.c:906)
==14156== by 0x12C4CF: control_ng_incoming (control_ng.c:192)
==14156== by 0x12B6A1: udp_listener_incoming (udp_listener.c:54)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156== Address 0x25949857 is on thread 10's stack
==14156== in frame #2, created by stun_binding_request (stun.c:647)
==14156==
==14156== Syscall param sendmsg(msg.msg_iov[7]) points to uninitialised byte(s)
==14156== at 0xA68FE90: sendmsg (sendmsg.c:28)
==14156== by 0x14A88B: __ip_sendmsg (socket.c:348)
==14156== by 0x134226: stun_binding_request (stun.c:683)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EE1: __do_ice_checks (ice.c:806)
==14156== by 0x148B0B: ice_update (ice.c:445)
==14156== by 0x11E195: monologue_offer_answer (call.c:1748)
==14156== by 0x13A7F8: call_offer_answer_ng (call_interfaces.c:906)
==14156== by 0x12C4CF: control_ng_incoming (control_ng.c:192)
==14156== by 0x12B6A1: udp_listener_incoming (udp_listener.c:54)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156== Address 0x25949804 is on thread 10's stack
==14156== in frame #2, created by stun_binding_request (stun.c:647)
==14156==
==14156== Syscall param write(buf) points to uninitialised byte(s)
==14156== at 0xA68F1AD: ??? (syscall-template.S:84)
==14156== by 0x1193F7: kernel_add_stream (kernel.c:134)
==14156== by 0x14D5D0: kernelize (media_socket.c:1069)
==14156== by 0x14D81B: media_packet_kernel_check.isra.3 (media_socket.c:1545)
==14156== by 0x14E7E9: stream_packet (media_socket.c:1680)
==14156== by 0x14E7E9: stream_fd_readable (media_socket.c:1791)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156== by 0x11A6E8: thread_detach_func (aux.c:209)
==14156== by 0xA686493: start_thread (pthread_create.c:333)
==14156== by 0xA984ACE: clone (clone.S:97)
==14156== Address 0x25957764 is on thread 10's stack
==14156== in frame #1, created by kernel_add_stream (kernel.c:123)
==14156==
==14156== Thread 9:
==14156== Conditional jump or move depends on uninitialised value(s)
==14156== at 0x4C31D21: __memcmp_sse4_1 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==14156== by 0x134104: __output_add (stun.c:282)
==14156== by 0x134104: stun_binding_request (stun.c:668)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EE1: __do_ice_checks (ice.c:806)
==14156== by 0x148B0B: ice_update (ice.c:445)
==14156== by 0x11E195: monologue_offer_answer (call.c:1748)
==14156== by 0x13A7F8: call_offer_answer_ng (call_interfaces.c:906)
==14156== by 0x12C4CF: control_ng_incoming (control_ng.c:192)
==14156== by 0x12B6A1: udp_listener_incoming (udp_listener.c:54)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156== by 0x11A6E8: thread_detach_func (aux.c:209)
==14156==
==14156== Syscall param sendmsg(msg.msg_iov[4]) points to uninitialised byte(s)
==14156== at 0xA68FE90: sendmsg (sendmsg.c:28)
==14156== by 0x14A88B: __ip_sendmsg (socket.c:348)
==14156== by 0x134226: stun_binding_request (stun.c:683)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EE1: __do_ice_checks (ice.c:806)
==14156== by 0x148B0B: ice_update (ice.c:445)
==14156== by 0x11E195: monologue_offer_answer (call.c:1748)
==14156== by 0x13A7F8: call_offer_answer_ng (call_interfaces.c:906)
==14156== by 0x12C4CF: control_ng_incoming (control_ng.c:192)
==14156== by 0x12B6A1: udp_listener_incoming (udp_listener.c:54)
==14156== by 0x11A227: poller_poll (poller.c:350)
==14156== by 0x11A5CC: poller_loop (poller.c:505)
==14156== Address 0x2514895e is on thread 9's stack
==14156== in frame #2, created by stun_binding_request (stun.c:647)
==14156==
==14156== Thread 5:
==14156== Conditional jump or move depends on uninitialised value(s)
==14156== at 0x4C31D21: __memcmp_sse4_1 (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==14156== by 0x134104: __output_add (stun.c:282)
==14156== by 0x134104: stun_binding_request (stun.c:668)
==14156== by 0x1476C0: __do_ice_check (ice.c:654)
==14156== by 0x147EEF: __do_ice_checks (ice.c:809)
==14156== by 0x14A006: ice_thread_run (ice.c:1352)
==14156== by 0x11A6E8: thread_detach_func (aux.c:209)
==14156== by 0xA686493: start_thread (pthread_create.c:333)
==14156== by 0xA984ACE: clone (clone.S:97)
==14156==Now I'm waiting for the crash.
SipSeb
commented
6 years ago Couldn't reproduce it running with valgrind. But since it only has about half the traffic of the other rtpengines running next to it and our voice quality monitoring says, there's a service degradation on this rtpengine, I'm going to stop the experiment.
Do you have any other ideas?
rfuchs
commented
6 years ago Hm ok, I'll investigate those first, maybe there's an obscure bug lurking that's actually causing this. What output do you get from rtpengine --version ?
And yeah, running within valgrind gives you horrible performance, so I'm not surprised it doesn't hold much traffic.
SipSeb
commented
6 years ago I guess, rtpengine --version doesn't help a lot. Our jenkins generates its own version and discards the debian/changelog.
But the commit we build from is: 4c672ac5c4715de289aa862034fb9c0ca090fcf8
rfuchs
commented
6 years ago No, I do need the output from --version as this is what's going into the STUN SOFTWARE attribute.
SipSeb
commented
6 years ago Version: 1:6.4+0~20180730132417.6.c4c9b49+stretch694e9d8 gets rid of these warnings. But I'm afraid this is purely cosmetic and doesn't actually solve anything.
rfuchs
commented
6 years ago Another option to catch potential memory access problems: Set the environment variables MALLOC_CHECK_=1 and G_SLICE=always-malloc and then run the daemon. These should have only negligible performance impact.
SipSeb
commented
6 years ago Just as a status: I installed an older package built from Commit https://github.com/sipwise/rtpengine/commit/22431f5 yesterday afternoon, and this instance is doing about 80Mbit traffic right now and has been running stable for 17 hours now.
I just started one of the boxes with the new version again, this time with MALLOC_CHECK and G_SLICE environment variables set, and enabled it. We'll see how this works out.
SipSeb
commented
6 years ago Okay, while the 6.2.0 is still running, the 6.4.0 crashed again after about an hour.
gdb output:
GNU gdb (Debian 7.12-6) 7.12.0.20161007-git
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/rtpengine...Reading symbols from /usr/lib/debug/.build-id/19/a9fe93f6e2d9f2675b08a9459905d213d3ebd0.debug...done.
done.
[New LWP 12574]
[New LWP 12572]
[New LWP 12573]
[New LWP 12575]
[New LWP 12580]
[New LWP 12579]
[New LWP 12576]
[New LWP 12583]
[New LWP 12582]
[New LWP 12577]
[New LWP 12578]
[New LWP 12581]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/rtpengine --pidfile /var/run/ngcp-rtpengine-daemon.pid --config-file'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00007f4bd485d90f in _int_free (av=av@entry=0x7f4bd4b7fb00 <main_arena>, p=0x5562f4641df0, have_lock=have_lock@entry=1) at malloc.c:4052
4052 malloc.c: No such file or directory.
[Current thread is 1 (Thread 0x7f4bbdecc700 (LWP 12574))]
Thread 12 (Thread 0x7f4bba6c5700 (LWP 12581)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a0ee0) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bba6c5700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 11 (Thread 0x7f4bbbec8700 (LWP 12578)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a08b0) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbbec8700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 10 (Thread 0x7f4bbc6c9700 (LWP 12577)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a06a0) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbc6c9700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 9 (Thread 0x7f4bb9ec4700 (LWP 12582)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a10f0) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bb9ec4700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 8 (Thread 0x7f4bb96c3700 (LWP 12583)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a1300) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bb96c3700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 7 (Thread 0x7f4bbceca700 (LWP 12576)):
#0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
#1 0x00005562f25a90fe in __cond_timedwait_tv (tv=<synthetic pointer>, m=0x5562f27db560 <ice_agents_timers_lock>, c=0x5562f27db520 <ice_agents_timers_cond>) at ../include/aux.h:301
#2 ice_thread_run (p=<optimized out>) at ice.c:1367
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a0490) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbceca700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 6 (Thread 0x7f4bbb6c7700 (LWP 12579)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a0ac0) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbb6c7700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 5 (Thread 0x7f4bbaec6700 (LWP 12580)):
#0 0x00007f4bd48cf0c3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#1 0x00005562f25790ad in poller_poll (p=p@entry=0x5562f319b160, timeout=timeout@entry=100) at poller.c:304
#2 0x00005562f25795cd in poller_loop (d=0x5562f319b160) at poller.c:505
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a0cd0) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbaec6700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 4 (Thread 0x7f4bbd6cb700 (LWP 12575)):
#0 0x00007f4bd489e28d in nanosleep () at ../sysdeps/unix/syscall-template.S:84
#1 0x00007f4bd48c7b84 in usleep (useconds=useconds@entry=500000) at ../sysdeps/posix/usleep.c:32
#2 0x00005562f25b83c4 in load_thread (dummy=<optimized out>) at load.c:51
#3 0x00005562f25796e9 in thread_detach_func (d=0x5562f31a0010) at aux.c:209
#4 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbd6cb700) at pthread_create.c:333
#5 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 3 (Thread 0x7f4bbe6cd700 (LWP 12573)):
#0 0x00007f4bd4819dcc in __GI___sigtimedwait (set=<optimized out>, info=0x0, timeout=0x7f4bbe6cc880) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:54
#1 0x00005562f2575b43 in sighandler (x=<optimized out>) at main.c:88
#2 0x00005562f25796e9 in thread_detach_func (d=0x5562f319fdd0) at aux.c:209
#3 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbe6cd700) at pthread_create.c:333
#4 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97
Thread 2 (Thread 0x7f4bda7be480 (LWP 12572)):
#0 0x00007f4bd489e28d in nanosleep () at ../sysdeps/unix/syscall-template.S:84
#1 0x00007f4bd48c7b84 in usleep (useconds=<optimized out>) at ../sysdeps/posix/usleep.c:32
#2 0x00005562f2575332 in main (argc=<optimized out>, argv=<optimized out>) at main.c:825
Thread 1 (Thread 0x7f4bbdecc700 (LWP 12574)):
#0 0x00007f4bd485d90f in _int_free (av=av@entry=0x7f4bd4b7fb00 <main_arena>, p=0x5562f4641df0, have_lock=have_lock@entry=1) at malloc.c:4052
#1 0x00007f4bd485fdb9 in free_check (mem=0x5562f4641e00, caller=<optimized out>) at hooks.c:324
#2 0x00007f4bda0097c9 in ?? () from /lib/x86_64-linux-gnu/libglib-2.0.so.0
#3 0x00007f4bda00a5f3 in g_hash_table_remove_all () from /lib/x86_64-linux-gnu/libglib-2.0.so.0
#4 0x00007f4bda00a65e in g_hash_table_destroy () from /lib/x86_64-linux-gnu/libglib-2.0.so.0
#5 0x00005562f25b6f55 in codec_handlers_free (m=m@entry=0x5562f35a80e0) at codec.c:504
#6 0x00005562f257b732 in __call_free (p=0x5562f58a87f0) at call.c:2066
#7 0x00005562f257ec96 in __obj_put (o=0x5562f58a87f0) at ../include/obj.h:189
#8 log_info_clear () at log_funcs.h:22
#9 kill_calls_timer (list=0x5562f531a580, url=url@entry=0x0) at call.c:467
#10 0x00005562f257f294 in call_timer (ptr=<optimized out>) at call.c:677
#11 0x00005562f257952a in poller_timers_run (p=0x5562f319b160) at poller.c:278
#12 poller_timer_loop (d=0x5562f319b160) at poller.c:497
#13 0x00005562f25796e9 in thread_detach_func (d=0x5562f319ffe0) at aux.c:209
#14 0x00007f4bd4b8c494 in start_thread (arg=0x7f4bbdecc700) at pthread_create.c:333
#15 0x00007f4bd48ceacf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97Meanwhile, the 6.2.0 rtpengine crashed as well. :(
SipSeb
commented
6 years ago Just to exclude a build system fuckup, do you have a public Debian stretch repository where we could install a recent version from? Then I could try running it again.
taurus-forever
commented
6 years ago ... do you have a public Debian stretch repository where we could install a recent version from?
The latest publicly available release is mr6.3.1, you can find it here: https://deb.sipwise.com/spce/mr6.3.1/ mr6.4.1 is coming, ETA 1 week.
SipSeb
commented
6 years ago To follow up this bug: A 6.3.1 installed from debian packages coming from your repository has been running since Wednesday now, has not crashed until now. I actually have no clue how to deal with that or where to search for the error. The only change we made before building our own rtpengine was disabling the g729 build dependency because we didn't want to import that lib into our system.
Of course we have some customers using G729 for their calls, but we don't do any transcoding. Could this part of the code where the lib is used or not have a memory problem?
rfuchs
commented
6 years ago Unlikely. The G.729 lib is only engaged when transcoding is actually used. There should be zero difference in behaviour between a build with G.729 and without it if no transcoding is used.
rfuchs
commented
6 years ago If you send me one of your builds (or the entire set of Debian packages), perhaps I can attempt to reproduce it.
SipSeb
commented
6 years ago Did that. You should have gotten an email with a link. Hope you can find something. In the meantime, I'm gonna install your mr6.3.1 on all our systems.
rfuchs
commented
6 years ago Can you post (or send) the output of your runtime dpkg -l?
Also can you share some of your use cases (you already mentioned no transcoding)
SipSeb
commented
6 years ago Of course.
dpkg -l:
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
+++-======================================================-================================-================================-==================================================================================================================
ii acpi-support-base 0.142-8 all scripts for handling base ACPI events such as the power button
ii acpid 1:2.0.28-1+b1 amd64 Advanced Configuration and Power Interface event daemon
ii adduser 3.115 all add and remove users and groups
ii apt 1.4.8 amd64 commandline package manager
ii apt-listchanges 3.10 all package change history notification tool
ii apt-transport-https 1.4.8 amd64 https download transport for APT
ii apt-utils 1.4.8 amd64 package management related utility programs
ii aptitude 0.8.7-1 amd64 terminal-based package manager
ii aptitude-common 0.8.7-1 all architecture independent files for the aptitude package manager
ii autoconf 2.69-10 all automatic configure script builder
ii automake 1:1.15-6 all Tool for generating GNU Standards-compliant Makefiles
ii autotools-dev 20161112.1 all Update infrastructure for config.{guess,sub} files
ii base-files 9.9+deb9u5 amd64 Debian base system miscellaneous files
ii base-passwd 3.5.43 amd64 Debian base system master password and group files
ii bash 4.4-5 amd64 GNU Bourne Again SHell
ii bash-completion 1:2.1-4.3 all programmable completion for the bash shell
ii bind9-host 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 Version of 'host' bundled with BIND 9.X
ii binutils 2.28-5 amd64 GNU assembler, linker and binary utilities
ii bsdmainutils 9.0.12+nmu1 amd64 collection of more utilities from FreeBSD
ii bsdutils 1:2.29.2-1+deb9u1 amd64 basic utilities from 4.4BSD-Lite
ii busybox 1:1.22.0-19+b3 amd64 Tiny utilities for small and embedded systems
ii bzip2 1.0.6-8.1 amd64 high-quality block-sorting file compressor - utilities
ii ca-certificates 20161130+nmu1+deb9u1 all Common CA certificates
ii configure-debian 1.0.3 all central configuration program for packages using debconf
ii console-setup 1.164 all console font and keymap setup program
ii console-setup-linux 1.164 all Linux specific part of console-setup
ii coreutils 8.26-3 amd64 GNU core utilities
ii cpio 2.11+dfsg-6 amd64 GNU cpio -- a program to manage archives of files
ii cpp 4:6.3.0-4 amd64 GNU C preprocessor (cpp)
ii cpp-6 6.3.0-18+deb9u1 amd64 GNU C preprocessor
ii cron 3.0pl1-128+deb9u1 amd64 process scheduling daemon
ii curl 7.52.1-5+deb9u6 amd64 command line tool for transferring data with URL syntax
ii dash 0.5.8-2.4 amd64 POSIX-compliant shell
ii dbus 1.10.26-0+deb9u1 amd64 simple interprocess messaging system (daemon and utilities)
ii debaux-debconf 0.1.12-1 all Perl Interface to Debconf
ii debconf 1.5.61 all Debian configuration management system
ii debconf-i18n 1.5.61 all full internationalization support for debconf
ii debconf-utils 1.5.61 all debconf utilities
ii debian-archive-keyring 2017.5 all GnuPG archive keys of the Debian archive
ii debian-faq 8.1 all Debian Frequently Asked Questions
ii debianutils 4.8.1.1 amd64 Miscellaneous utilities specific to Debian
ii dh-python 2.20170125 all Debian helper tools for packaging Python libraries and applications
ii dictionaries-common 1.27.2 all spelling dictionaries - common utilities
ii diffutils 1:3.5-3 amd64 File comparison utilities
ii dirmngr 2.1.18-8~deb9u2 amd64 GNU privacy guard - network certificate management service
ii discover 2.1.2-7.1+deb9u1 amd64 hardware identification system
ii discover-data 2.2013.01.11 all Data lists for Discover hardware detection system
ii distro-info-data 0.36 all information about the distributions' releases (data files)
ii dkms 2.3-2 all Dynamic Kernel Module Support Framework
ii dmidecode 3.0-4 amd64 SMBIOS/DMI table decoder
ii dmsetup 2:1.02.137-2 amd64 Linux Kernel Device Mapper userspace library
ii doc-debian 6.4 all Debian Project documentation and other documents
ii dpkg 1.18.25 amd64 Debian package management system
ii e2fslibs:amd64 1.43.4-2 amd64 ext2/ext3/ext4 file system libraries
ii e2fsprogs 1.43.4-2 amd64 ext2/ext3/ext4 file system utilities
ii eject 2.1.5+deb1+cvs20081104-13.2 amd64 ejects CDs and operates CD-Changers under Linux
ii emacsen-common 2.0.8 all Common facilities for all emacsen
ii ethtool 1:4.8-1+b1 amd64 display or change Ethernet device settings
ii exim4-base 4.89-2+deb9u3 amd64 support files for all Exim MTA (v4) packages
ii exim4-config 4.89-2+deb9u3 all configuration for the Exim MTA (v4)
ii exim4-daemon-light 4.89-2+deb9u3 amd64 lightweight Exim MTA (v4) daemon
ii facter 2.4.6-1 all collect and display facts about the system
ii file 1:5.30-1+deb9u2 amd64 Recognize the type of data in a file using "magic" numbers
ii findutils 4.6.0+git+20161106-2 amd64 utilities for finding files--find, xargs
ii firmware-bnx2 20161130-3 all Binary firmware for Broadcom NetXtremeII
ii fontconfig-config 2.11.0-6.7 all generic font configuration library - configuration
ii fonts-dejavu-core 2.37-1 all Vera font family derivate with additional characters
ii fwbuilder-init 1:1.0.0+0~20180320161457.7.ccb6d amd64 fwbuilder init script and conntrack monitoring
ii gcc 4:6.3.0-4 amd64 GNU C compiler
ii gcc-6 6.3.0-18+deb9u1 amd64 GNU C compiler
ii gcc-6-base:amd64 6.3.0-18+deb9u1 amd64 GCC, the GNU Compiler Collection (base package)
ii gdb 7.12-6 amd64 GNU Debugger
ii geoip-database 20170512-1 all IP lookup command line tools that use the GeoIP library (country database)
ii gettext-base 0.19.8.1-2 amd64 GNU Internationalization utilities for the base system
ii git 1:2.11.0-3+deb9u3 amd64 fast, scalable, distributed revision control system
ii git-core 1:2.11.0-3+deb9u3 all fast, scalable, distributed revision control system (obsolete)
ii git-man 1:2.11.0-3+deb9u3 all fast, scalable, distributed revision control system (manual pages)
ii gnupg 2.1.18-8~deb9u2 amd64 GNU privacy guard - a free PGP replacement
ii gnupg-agent 2.1.18-8~deb9u2 amd64 GNU privacy guard - cryptographic agent
ii gpgv 2.1.18-8~deb9u2 amd64 GNU privacy guard - signature verification tool
ii grep 2.27-2 amd64 GNU grep, egrep and fgrep
ii groff-base 1.22.3-9 amd64 GNU troff text-formatting system (base system components)
ii grub-common 2.02~beta3-5 amd64 GRand Unified Bootloader (common files)
ii grub-pc 2.02~beta3-5 amd64 GRand Unified Bootloader, version 2 (PC/BIOS version)
ii grub-pc-bin 2.02~beta3-5 amd64 GRand Unified Bootloader, version 2 (PC/BIOS binaries)
ii grub2-common 2.02~beta3-5 amd64 GRand Unified Bootloader (common files for version 2)
ii guile-2.0-libs:amd64 2.0.13+1-4 amd64 Core Guile libraries
ii gzip 1.6-5+b1 amd64 GNU compression utilities
ii hdparm 9.51+ds-1 amd64 tune hard disk parameters for high performance
ii hostname 3.18+b1 amd64 utility to set/show the host name or domain name
ii htop 2.0.2-1 amd64 interactive processes viewer
ii iamerican 3.4.00-5 all American English dictionary for ispell (standard version)
ii ibritish 3.4.00-5 all British English dictionary for ispell (standard version)
ii ienglish-common 3.4.00-5 all Common files for British and American ispell dictionaries
ii ifenslave 2.9 all configure network interfaces for parallel routing (bonding)
ii ifenslave-2.6 2.9 all transitional package, use "ifenslave"
ii iftop 1.0~pre4-4 amd64 displays bandwidth usage information on an network interface
ii ifupdown 0.8.19 amd64 high level tools to configure network interfaces
ii init 1.48 amd64 metapackage ensuring an init system is installed
ii init-system-helpers 1.48 all helper tools for all init systems
ii initramfs-tools 0.130 all generic modular initramfs generator (automation)
ii initramfs-tools-core 0.130 all generic modular initramfs generator (core tools)
ii installation-report 2.62 all system installation report
ii iotop 0.6-2 amd64 simple top-like I/O monitor
ii ipcalc 0.41-5 all parameter calculator for IPv4 addresses
ii iproute 1:4.9.0-1+deb9u1 all transitional dummy package for iproute2
ii iproute2 4.9.0-1+deb9u1 amd64 networking and traffic control tools
ii ipset 6.30-2 amd64 administration tool for kernel IP sets
ii iptables 1.6.0+snapshot20161117-6 amd64 administration tools for packet filtering and NAT
ii iptraf 1:1.1.4-6 all transitional package to iptraf-ng
ii iptraf-ng 1:1.1.4-6 amd64 Next Generation Interactive Colorful IP LAN Monitor
ii iputils-ping 3:20161105-1 amd64 Tools to test the reachability of network hosts
ii isc-dhcp-client 4.3.5-3+deb9u1 amd64 DHCP client for automatically obtaining an IP address
ii isc-dhcp-common 4.3.5-3+deb9u1 amd64 common manpages relevant to all of the isc-dhcp packages
ii iso-codes 3.75-1 all ISO language, territory, currency, script codes and their translations
ii ispell 3.4.00-5 amd64 International Ispell (an interactive spelling corrector)
ii kbd 2.0.3-2+b1 amd64 Linux console font and keytable utilities
ii keyboard-configuration 1.164 all system-wide keyboard preferences
ii keyutils 1.5.9-9 amd64 Linux Key Management Utilities
ii klibc-utils 2.0.4-9 amd64 small utilities built with klibc for early boot
ii kmod 23-2 amd64 tools for managing Linux kernel modules
ii krb5-config 2.6 all Configuration files for Kerberos Version 5
ii krb5-locales 1.15-1+deb9u1 all internationalization support for MIT Kerberos
ii kstart 4.2-1 amd64 Kerberos kinit supporting AFS and ticket refreshing
ii laptop-detect 0.13.8 amd64 system chassis type checker
ii ldap-utils 2.4.44+dfsg-5+deb9u2 amd64 OpenLDAP utilities
ii less 481-2.1 amd64 pager program similar to more
ii libacl1:amd64 2.2.52-3+b1 amd64 Access control list shared library
ii libapparmor1:amd64 2.11.0-3+deb9u2 amd64 changehat AppArmor library
ii libapt-inst2.0:amd64 1.4.8 amd64 deb package format runtime library
ii libapt-pkg5.0:amd64 1.4.8 amd64 package management runtime library
ii libasan3:amd64 6.3.0-18+deb9u1 amd64 AddressSanitizer -- a fast memory error detector
ii libasn1-8-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - ASN.1 library
ii libasound2:amd64 1.1.3-5 amd64 shared library for ALSA applications
ii libasound2-data 1.1.3-5 all Configuration files and profiles for ALSA drivers
ii libass5:amd64 1:0.13.4-2 amd64 library for SSA/ASS subtitles rendering
ii libassuan0:amd64 2.4.3-2 amd64 IPC library for the GnuPG components
ii libatomic1:amd64 6.3.0-18+deb9u1 amd64 support library providing __atomic built-in functions
ii libattr1:amd64 1:2.4.47-2+b2 amd64 Extended attribute shared library
ii libaudit-common 1:2.6.7-2 all Dynamic library for security auditing - common files
ii libaudit1:amd64 1:2.6.7-2 amd64 Dynamic library for security auditing
ii libavcodec57:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library with de/encoders for audio/video codecs - runtime files
ii libavfilter6:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library containing media filters - runtime files
ii libavformat57:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library with (de)muxers for multimedia containers - runtime files
ii libavresample3:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg compatibility library for resampling - runtime files
ii libavutil55:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library with functions for simplifying programming - runtime files
ii libb-hooks-op-check-perl 0.19-3+b1 amd64 Perl wrapper for OP check callbacks
ii libbabeltrace-ctf1:amd64 1.5.1-1 amd64 Common Trace Format (CTF) library
ii libbabeltrace1:amd64 1.5.1-1 amd64 Babeltrace conversion libraries
ii libbcg729-0:amd64 1.0.4+git20180222-0.1~bpo9+1 amd64 ITU G.729 Annex A compatible audio codec
ii libbencode-perl 1.402-1 all Perl module for BitTorrent serialisation format
ii libbind9-140:amd64 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 BIND9 Shared Library used by BIND
ii libblkid1:amd64 2.29.2-1+deb9u1 amd64 block device ID library
ii libbluray1:amd64 1:0.9.3-3 amd64 Blu-ray disc playback support library (shared library)
ii libboost-filesystem1.62.0:amd64 1.62.0+dfsg-4 amd64 filesystem operations (portable paths, iteration over directories, etc) in C++
ii libboost-iostreams1.62.0:amd64 1.62.0+dfsg-4 amd64 Boost.Iostreams Library
ii libboost-system1.62.0:amd64 1.62.0+dfsg-4 amd64 Operating system (e.g. diagnostics support) library
ii libbs2b0:amd64 3.1.0+dfsg-2.2 amd64 Bauer stereophonic-to-binaural DSP library
ii libbsd0:amd64 0.8.3-1 amd64 utility functions from BSD systems - shared library
ii libbson-1.0-0 1.4.2-1 amd64 Library to parse and generate BSON documents - runtime files
ii libbz2-1.0:amd64 1.0.6-8.1 amd64 high-quality block-sorting file compressor library - runtime
ii libc-bin 2.24-11+deb9u3 amd64 GNU C Library: Binaries
ii libc-dev-bin 2.24-11+deb9u3 amd64 GNU C Library: Development binaries
ii libc-l10n 2.24-11+deb9u3 all GNU C Library: localization files
ii libc6:amd64 2.24-11+deb9u3 amd64 GNU C Library: Shared libraries
ii libc6-dbg:amd64 2.24-11+deb9u3 amd64 GNU C Library: detached debugging symbols
ii libc6-dev:amd64 2.24-11+deb9u3 amd64 GNU C Library: Development Libraries and Header Files
ii libcairo2:amd64 1.14.8-1 amd64 Cairo 2D vector graphics library
ii libcap-ng0:amd64 0.7.7-3+b1 amd64 An alternate POSIX capabilities library
ii libcap2:amd64 1:2.25-1 amd64 POSIX 1003.1e capabilities (library)
ii libcc1-0:amd64 6.3.0-18+deb9u1 amd64 GCC cc1 plugin for GDB
ii libchromaprint1:amd64 1.4.2-1 amd64 audio fingerprint library
ii libcilkrts5:amd64 6.3.0-18+deb9u1 amd64 Intel Cilk Plus language extensions (runtime)
ii libclass-isa-perl 0.36-5 all report the search path for a class's ISA tree
ii libcomerr2:amd64 1.43.4-2 amd64 common error description library
ii libcrypt-rijndael-perl 1.13-1+b2 amd64 Perl module implementing the Rijndael algorithm
ii libcryptsetup4:amd64 2:1.7.3-4 amd64 disk encryption support - shared library
ii libcrystalhd3:amd64 1:0.0~git20110715.fdd2f19-12 amd64 Crystal HD Video Decoder (shared library)
ii libcurl3:amd64 7.52.1-5+deb9u6 amd64 easy-to-use client-side URL transfer library (OpenSSL flavour)
ii libcurl3-gnutls:amd64 7.52.1-5+deb9u6 amd64 easy-to-use client-side URL transfer library (GnuTLS flavour)
ii libcwidget3v5:amd64 0.5.17-4+b1 amd64 high-level terminal interface library for C++ (runtime files)
ii libdb5.3:amd64 5.3.28-12+deb9u1 amd64 Berkeley v5.3 Database Libraries [runtime]
ii libdbi1:amd64 0.9.0-4+deb9u1 amd64 DB Independent Abstraction Layer for C -- shared library
ii libdbus-1-3:amd64 1.10.26-0+deb9u1 amd64 simple interprocess messaging system (library)
ii libdebconfclient0:amd64 0.227 amd64 Debian Configuration Management System (C-implementation library)
ii libdevmapper1.02.1:amd64 2:1.02.137-2 amd64 Linux Kernel Device Mapper userspace library
ii libdigest-hmac-perl 1.03+dfsg-1 all module for creating standard message integrity checks
ii libdiscover2 2.1.2-7.1+deb9u1 amd64 hardware identification library
ii libdns-export162 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 Exported DNS Shared Library
ii libdns162:amd64 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 DNS Shared Library used by BIND
ii libdrm2:amd64 2.4.74-1 amd64 Userspace interface to kernel DRM services -- runtime
ii libdw1:amd64 0.168-1 amd64 library that provides access to the DWARF debug information
ii libebur128-1:amd64 1.2.2-2 amd64 implementation of the EBU R128 loudness standard
ii libedit2:amd64 3.1-20160903-3 amd64 BSD editline and history libraries
ii libelf1:amd64 0.168-1 amd64 library to read and write ELF files
ii liberror-perl 0.17024-1 all Perl module for error/exception handling in an OO-ish way
ii libestr0 0.1.10-2 amd64 Helper functions for handling strings (lib)
ii libevent-2.0-5:amd64 2.0.21-stable-3 amd64 Asynchronous event notification library
ii libevent-core-2.0-5:amd64 2.0.21-stable-3 amd64 Asynchronous event notification library (core)
ii libevent-pthreads-2.0-5:amd64 2.0.21-stable-3 amd64 Asynchronous event notification library (pthreads)
ii libevtlog0:amd64 0.2.12-7+b2 amd64 Syslog event logger library
ii libexpat1:amd64 2.2.0-2+deb9u1 amd64 XML parsing C library - runtime library
ii libexporter-tidy-perl 0.08-1 all another way of exporting symbols
ii libfastjson4:amd64 0.99.4-1 amd64 fast json library for C
ii libfdisk1:amd64 2.29.2-1+deb9u1 amd64 fdisk partitioning library
ii libffi6:amd64 3.2.1-6 amd64 Foreign Function Interface library runtime
ii libfftw3-double3:amd64 3.3.5-3 amd64 Library for computing Fast Fourier Transforms - Double precision
ii libflite1:amd64 2.0.0-release-3+b1 amd64 Small run-time speech synthesis engine - shared libraries
ii libfontconfig1:amd64 2.11.0-6.7+b1 amd64 generic font configuration library - runtime
ii libfreetype6:amd64 2.6.3-3.2 amd64 FreeType 2 font engine, shared library files
ii libfribidi0:amd64 0.19.7-1+b1 amd64 Free Implementation of the Unicode BiDi algorithm
ii libfuse2:amd64 2.9.7-1+deb9u1 amd64 Filesystem in Userspace (library)
ii libgc1c2:amd64 1:7.4.2-8 amd64 conservative garbage collector for C and C++
ii libgcc-6-dev:amd64 6.3.0-18+deb9u1 amd64 GCC support library (development files)
ii libgcc1:amd64 1:6.3.0-18+deb9u1 amd64 GCC support library
ii libgcrypt20:amd64 1.7.6-2+deb9u3 amd64 LGPL Crypto library - runtime library
ii libgdbm3:amd64 1.8.3-14 amd64 GNU dbm database routines (runtime version)
ii libgeoip1:amd64 1.6.9-4 amd64 non-DNS IP-to-country resolver library
ii libglib2.0-0:amd64 2.50.3-2 amd64 GLib library of C routines
ii libgme0:amd64 0.6.0-4 amd64 Playback library for video game music files - shared library
ii libgmp10:amd64 2:6.1.2+dfsg-1 amd64 Multiprecision arithmetic library
ii libgnutls30:amd64 3.5.8-5+deb9u3 amd64 GNU TLS library - main runtime library
ii libgomp1:amd64 6.3.0-18+deb9u1 amd64 GCC OpenMP (GOMP) support library
ii libgpg-error0:amd64 1.26-2 amd64 library for common error values and messages in GnuPG components
ii libgpm2:amd64 1.20.4-6.2+b1 amd64 General Purpose Mouse - shared library
ii libgraphite2-3:amd64 1.3.10-1 amd64 Font rendering engine for Complex Scripts -- library
ii libgsasl7 1.8.0-8+b2 amd64 GNU SASL library
ii libgsm1:amd64 1.0.13-4+b2 amd64 Shared libraries for GSM speech compressor
ii libgssapi-krb5-2:amd64 1.15-1+deb9u1 amd64 MIT Kerberos runtime libraries - krb5 GSS-API Mechanism
ii libharfbuzz0b:amd64 1.4.2-1 amd64 OpenType text shaping engine (shared library)
ii libhcrypto4-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - crypto library
ii libheimbase1-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - Base library
ii libhiredis0.13:amd64 0.13.3-2 amd64 minimalistic C client library for Redis
ii libhogweed4:amd64 3.3-1+b2 amd64 low level cryptographic library (public-key cryptos)
ii libhx509-5-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - X509 support library
ii libicu57:amd64 57.1-6+deb9u2 amd64 International Components for Unicode
ii libidn11:amd64 1.33-1 amd64 GNU Libidn library, implementation of IETF IDN specifications
ii libidn2-0:amd64 0.16-1+deb9u1 amd64 Internationalized domain names (IDNA2008) library
ii libio-socket-inet6-perl 2.72-2 all object interface for AF_INET6 domain sockets
ii libip4tc0:amd64 1.6.0+snapshot20161117-6 amd64 netfilter libip4tc library
ii libip6tc0:amd64 1.6.0+snapshot20161117-6 amd64 netfilter libip6tc library
ii libipset3:amd64 6.30-2 amd64 library for IP sets
ii libiptc0:amd64 1.6.0+snapshot20161117-6 amd64 netfilter libiptc library
ii libisc-export160 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 Exported ISC Shared Library
ii libisc160:amd64 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 ISC Shared Library used by BIND
ii libisccc140:amd64 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 Command Channel Library used by BIND
ii libisccfg140:amd64 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 Config File Handling Library used by BIND
ii libisl15:amd64 0.18-1 amd64 manipulating sets and relations of integer points bounded by linear constraints
ii libitm1:amd64 6.3.0-18+deb9u1 amd64 GNU Transactional Memory Library
ii libivykis0:amd64 0.36.2-4 amd64 Asynchronous I/O readiness notification library
ii libjansson4:amd64 2.9-1 amd64 C library for encoding, decoding and manipulating JSON data
ii libjson-c3:amd64 0.12.1-1.1 amd64 JSON manipulation library - shared library
ii libjson-glib-1.0-0:amd64 1.2.6-1 amd64 GLib JSON manipulation library
ii libjson-glib-1.0-common 1.2.6-1 all GLib JSON manipulation library (common files)
ii libk5crypto3:amd64 1.15-1+deb9u1 amd64 MIT Kerberos runtime libraries - Crypto Library
ii libkeyutils1:amd64 1.5.9-9 amd64 Linux Key Management Utilities (library)
ii libklibc 2.0.4-9 amd64 minimal libc subset for use with initramfs
ii libkmod2:amd64 23-2 amd64 libkmod shared library
ii libkrb5-26-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - libraries
ii libkrb5-3:amd64 1.15-1+deb9u1 amd64 MIT Kerberos runtime libraries
ii libkrb5support0:amd64 1.15-1+deb9u1 amd64 MIT Kerberos runtime libraries - Support library
ii libksba8:amd64 1.3.5-2 amd64 X.509 and CMS support library
ii libkyotocabinet16v5:amd64 1.2.76-4.2+b1 amd64 Straightforward implementation of DBM - shared library
ii libldap-2.4-2:amd64 2.4.44+dfsg-5+deb9u2 amd64 OpenLDAP libraries
ii libldap-common 2.4.44+dfsg-5+deb9u2 all OpenLDAP common files for libraries
ii liblocale-gettext-perl 1.07-3+b1 amd64 module using libc functions for internationalization in Perl
ii liblockfile-bin 1.14-1+b1 amd64 support binaries for and cli utilities based on liblockfile
ii liblogging-stdlog0:amd64 1.0.5-2+b2 amd64 easy to use and lightweight logging library
ii liblognorm5:amd64 2.0.1-1.1+b1 amd64 log normalizing library
ii liblsan0:amd64 6.3.0-18+deb9u1 amd64 LeakSanitizer -- a memory leak detector (runtime)
ii libltdl7:amd64 2.4.6-2 amd64 System independent dlopen wrapper for GNU libtool
ii liblwres141:amd64 1:9.10.3.dfsg.P4-12.3+deb9u4 amd64 Lightweight Resolver Library used by BIND
ii liblz4-1:amd64 0.0~r131-2+b1 amd64 Fast LZ compression algorithm library - runtime
ii liblzma5:amd64 5.2.2-1.2+b1 amd64 XZ-format compression library
ii liblzo2-2:amd64 2.08-1.2+b2 amd64 data compression library
ii libmagic-mgc 1:5.30-1+deb9u2 amd64 File type determination library using "magic" numbers (compiled magic file)
ii libmagic1:amd64 1:5.30-1+deb9u2 amd64 Recognize the type of data in a file using "magic" numbers - library
ii libmailutils5:amd64 1:3.1.1-1 amd64 GNU Mail abstraction library
ii libmariadbclient18:amd64 10.1.26-0+deb9u1 amd64 MariaDB database client library
ii libmnl0:amd64 1.0.4-2 amd64 minimalistic Netlink communication library
ii libmongoc-1.0-0 1.4.2-1+b1 amd64 MongoDB C client library - runtime files
ii libmount1:amd64 2.29.2-1+deb9u1 amd64 device mounting library
ii libmp3lame0:amd64 3.99.5+repack1-9+b2 amd64 MP3 encoding library
ii libmpc3:amd64 1.0.3-1+b2 amd64 multiple precision complex floating-point library
ii libmpdec2:amd64 2.4.2-1 amd64 library for decimal floating point arithmetic (runtime library)
ii libmpfr4:amd64 3.1.5-1 amd64 multiple precision floating-point computation
ii libmpg123-0:amd64 1.23.8-1+b1 amd64 MPEG layer 1/2/3 audio decoder (shared library)
ii libmpx2:amd64 6.3.0-18+deb9u1 amd64 Intel memory protection extensions (runtime)
ii libncurses5:amd64 6.0+20161126-1+deb9u2 amd64 shared libraries for terminal handling
ii libncursesw5:amd64 6.0+20161126-1+deb9u2 amd64 shared libraries for terminal handling (wide character support)
ii libnet1:amd64 1.1.6+dfsg-3 amd64 library for the construction and handling of network packets
ii libnetfilter-conntrack3:amd64 1.0.6-2 amd64 Netfilter netlink-conntrack library
ii libnettle6:amd64 3.3-1+b2 amd64 low level cryptographic library (symmetric and one-way cryptos)
ii libnewt0.52:amd64 0.52.19-1+b1 amd64 Not Erik's Windowing Toolkit - text mode windowing with slang
ii libnfnetlink0:amd64 1.0.1-3 amd64 Netfilter netlink library
ii libnfsidmap2:amd64 0.25-5.1 amd64 NFS idmapping library
ii libnghttp2-14:amd64 1.18.1-1 amd64 library implementing HTTP/2 protocol (shared library)
ii libnpth0:amd64 1.3-1 amd64 replacement for GNU Pth using system threads
ii libnss-ldapd:amd64 0.9.7-2+deb9u1 amd64 NSS module for using LDAP as a naming service
ii libntlm0:amd64 1.4-8 amd64 NTLM authentication library
ii libnuma1:amd64 2.0.11-2.1 amd64 Libraries for controlling NUMA policy
ii libogg0:amd64 1.3.2-1 amd64 Ogg bitstream library
ii libopencv-core2.4v5:amd64 2.4.9.1+dfsg1-2 amd64 computer vision core library
ii libopencv-imgproc2.4v5:amd64 2.4.9.1+dfsg1-2 amd64 computer vision Image Processing library
ii libopenjp2-7:amd64 2.1.2-1.1+deb9u2 amd64 JPEG 2000 image compression/decompression library
ii libopenmpt0:amd64 0.2.7386~beta20.3-3+deb9u2 amd64 module music library based on OpenMPT -- shared library
ii libopus0:amd64 1.2~alpha2-1 amd64 Opus codec runtime library
ii libp11-kit0:amd64 0.23.3-2 amd64 library for loading and coordinating access to PKCS#11 modules - runtime
ii libpam-heimdal:amd64 4.7-4 amd64 PAM module for Heimdal Kerberos
ii libpam-modules:amd64 1.1.8-3.6 amd64 Pluggable Authentication Modules for PAM
ii libpam-modules-bin 1.1.8-3.6 amd64 Pluggable Authentication Modules for PAM - helper binaries
ii libpam-runtime 1.1.8-3.6 all Runtime support for the PAM library
ii libpam-systemd:amd64 232-25+deb9u4 amd64 system and service manager - PAM module
ii libpam0g:amd64 1.1.8-3.6 amd64 Pluggable Authentication Modules library
ii libpcap0.8:amd64 1.8.1-3 amd64 system interface for user-level packet capture
ii libpci-dev 1:3.5.2-1 amd64 Linux PCI Utilities (development files)
ii libpci3:amd64 1:3.5.2-1 amd64 Linux PCI Utilities (shared library)
ii libpcre3:amd64 2:8.39-3 amd64 Old Perl 5 Compatible Regular Expression Library - runtime files
ii libperl5.24:amd64 5.24.1-3+deb9u4 amd64 shared Perl library
ii libpgm-5.2-0:amd64 5.2.122~dfsg-2 amd64 OpenPGM shared library
ii libpipeline1:amd64 1.4.1-2 amd64 pipeline manipulation library
ii libpixman-1-0:amd64 0.34.0-1 amd64 pixel-manipulation library for X and cairo
ii libpng16-16:amd64 1.6.28-1 amd64 PNG library - runtime (version 1.6)
ii libpopt0:amd64 1.16-10+b2 amd64 lib for parsing cmdline parameters
ii libpostproc54:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library for post processing - runtime files
ii libprocps6:amd64 2:3.3.12-3+deb9u1 amd64 library for accessing process information from /proc
ii libpsl5:amd64 0.17.0-3 amd64 Library for Public Suffix List (shared libraries)
ii libpython-stdlib:amd64 2.7.13-2 amd64 interactive high-level object-oriented language (default python version)
ii libpython2.7:amd64 2.7.13-2+deb9u2 amd64 Shared Python runtime library (version 2.7)
ii libpython2.7-minimal:amd64 2.7.13-2+deb9u2 amd64 Minimal subset of the Python language (version 2.7)
ii libpython2.7-stdlib:amd64 2.7.13-2+deb9u2 amd64 Interactive high-level object-oriented language (standard library, version 2.7)
ii libpython3-stdlib:amd64 3.5.3-1 amd64 interactive high-level object-oriented language (default python3 version)
ii libpython3.5:amd64 3.5.3-1 amd64 Shared Python runtime library (version 3.5)
ii libpython3.5-minimal:amd64 3.5.3-1 amd64 Minimal subset of the Python language (version 3.5)
ii libpython3.5-stdlib:amd64 3.5.3-1 amd64 Interactive high-level object-oriented language (standard library, version 3.5)
ii libquadmath0:amd64 6.3.0-18+deb9u1 amd64 GCC Quad-Precision Math Library
ii libreadline7:amd64 7.0-3 amd64 GNU readline and history libraries, run-time libraries
ii libroken18-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - roken support library
ii librtmp1:amd64 2.4+20151223.gitfa8646d.1-1+b1 amd64 toolkit for RTMP streams (shared library)
ii librubberband2:amd64 1.8.1-7 amd64 audio time-stretching and pitch-shifting library
ii libruby2.3:amd64 2.3.3-1+deb9u3 amd64 Libraries necessary to run Ruby 2.3
ii libsamplerate0:amd64 0.1.8-8+b2 amd64 Audio sample rate conversion library
ii libsasl2-2:amd64 2.1.27~101-g0780600+dfsg-3 amd64 Cyrus SASL - authentication abstraction library
ii libsasl2-modules:amd64 2.1.27~101-g0780600+dfsg-3 amd64 Cyrus SASL - pluggable authentication modules
ii libsasl2-modules-db:amd64 2.1.27~101-g0780600+dfsg-3 amd64 Cyrus SASL - pluggable authentication modules (DB)
ii libsasl2-modules-gssapi-heimdal:amd64 2.1.27~101-g0780600+dfsg-3 amd64 Pluggable Authentication Modules for SASL (GSSAPI)
ii libseccomp2:amd64 2.3.1-2.1 amd64 high level interface to Linux seccomp filter
ii libselinux1:amd64 2.6-3+b3 amd64 SELinux runtime shared libraries
ii libsemanage-common 2.6-2 all Common files for SELinux policy management libraries
ii libsemanage1:amd64 2.6-2 amd64 SELinux policy management library
ii libsensors4:amd64 1:3.4.0-4 amd64 library to read temperature/voltage/fan sensors
ii libsensors4-dev 1:3.4.0-4 amd64 lm-sensors development kit
ii libsepol1:amd64 2.6-2 amd64 SELinux library for manipulating binary security policies
ii libshine3:amd64 3.1.0-5 amd64 Fixed-point MP3 encoding library - runtime files
ii libsigc++-2.0-0v5:amd64 2.10.0-1 amd64 type-safe Signal Framework for C++ - runtime
ii libsigsegv2:amd64 2.10-5 amd64 Library for handling page faults in a portable way
ii libslang2:amd64 2.3.1-5 amd64 S-Lang programming library - runtime version
ii libsmartcols1:amd64 2.29.2-1+deb9u1 amd64 smart column output alignment library
ii libsnappy1v5:amd64 1.1.3-3 amd64 fast compression/decompression library
ii libsnmp-base 5.7.3+dfsg-1.7 all SNMP configuration script, MIBs and documentation
ii libsnmp-dev 5.7.3+dfsg-1.7 amd64 SNMP (Simple Network Management Protocol) development files
ii libsnmp30:amd64 5.7.3+dfsg-1.7 amd64 SNMP (Simple Network Management Protocol) library
ii libsocket6-perl 0.27-1+b1 amd64 Perl extensions for IPv6
ii libsodium18:amd64 1.0.11-2 amd64 Network communication, cryptography and signaturing library
ii libsoxr0:amd64 0.1.2-2 amd64 High quality 1D sample-rate conversion library
ii libspeex1:amd64 1.2~rc1.2-1+b2 amd64 The Speex codec runtime library
ii libsqlite3-0:amd64 3.16.2-5+deb9u1 amd64 SQLite 3 shared library
ii libss2:amd64 1.43.4-2 amd64 command-line interface parsing library
ii libssh-gcrypt-4:amd64 0.7.3-2 amd64 tiny C SSH library (gcrypt flavor)
ii libssh2-1:amd64 1.7.0-1 amd64 SSH2 client-side library
ii libssl1.0.2:amd64 1.0.2l-2+deb9u3 amd64 Secure Sockets Layer toolkit - shared libraries
ii libssl1.1:amd64 1.1.0f-3+deb9u2 amd64 Secure Sockets Layer toolkit - shared libraries
ii libstdc++6:amd64 6.3.0-18+deb9u1 amd64 GNU Standard C++ Library v3
ii libswitch-perl 2.17-2 all switch statement for Perl
ii libswresample2:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library for audio resampling, rematrixing etc. - runtime files
ii libswscale4:amd64 7:3.2.12-1~deb9u1 amd64 FFmpeg library for image scaling and various conversions - runtime files
ii libsystemd0:amd64 232-25+deb9u4 amd64 systemd utility library
ii libtasn1-6:amd64 4.10-1.1+deb9u1 amd64 Manage ASN.1 structures (runtime)
ii libtbb2:amd64 4.3~20150611-2 amd64 parallelism library for C++ - runtime files
ii libtext-charwidth-perl 0.04-7+b5 amd64 get display widths of characters on the terminal
ii libtext-iconv-perl 1.7-5+b4 amd64 converts between character sets in Perl
ii libtext-wrapi18n-perl 0.06-7.1 all internationalized substitute of Text::Wrap
ii libtheora0:amd64 1.1.1+dfsg.1-14+b1 amd64 Theora Video Compression Codec
ii libtinfo5:amd64 6.0+20161126-1+deb9u2 amd64 shared low-level terminfo library for terminal handling
ii libtirpc1:amd64 0.2.5-1.2 amd64 transport-independent RPC library
ii libtool 2.4.6-2 all Generic library support script
ii libtsan0:amd64 6.3.0-18+deb9u1 amd64 ThreadSanitizer -- a Valgrind-based detector of data races (runtime)
ii libtwolame0:amd64 0.3.13-2 amd64 MPEG Audio Layer 2 encoding library
ii libubsan0:amd64 6.3.0-18+deb9u1 amd64 UBSan -- undefined behaviour sanitizer (runtime)
ii libudev-dev:amd64 232-25+deb9u4 amd64 libudev development files
ii libudev1:amd64 232-25+deb9u4 amd64 libudev shared library
ii libunistring0:amd64 0.9.6+really0.9.3-0.1 amd64 Unicode string library for C
ii libusb-0.1-4:amd64 2:0.1.12-30 amd64 userspace USB programming library
ii libusb-1.0-0:amd64 2:1.0.21-1 amd64 userspace USB programming library
ii libustr-1.0-1:amd64 1.0.4-6 amd64 Micro string library: shared library
ii libuuid1:amd64 2.29.2-1+deb9u1 amd64 Universally Unique ID library
ii libva-drm1:amd64 1.7.3-2 amd64 Video Acceleration (VA) API for Linux -- DRM runtime
ii libva-x11-1:amd64 1.7.3-2 amd64 Video Acceleration (VA) API for Linux -- X11 runtime
ii libva1:amd64 1.7.3-2 amd64 Video Acceleration (VA) API for Linux -- runtime
ii libvdpau1:amd64 1.1.1-6 amd64 Video Decode and Presentation API for Unix (libraries)
ii libvorbis0a:amd64 1.3.5-4+deb9u2 amd64 decoder library for Vorbis General Audio Compression Codec
ii libvorbisenc2:amd64 1.3.5-4+deb9u2 amd64 encoder library for Vorbis General Audio Compression Codec
ii libvorbisfile3:amd64 1.3.5-4+deb9u2 amd64 high-level API for Vorbis General Audio Compression Codec
ii libvpx4:amd64 1.6.1-3+deb9u1 amd64 VP8 and VP9 video codec (shared library)
ii libwavpack1:amd64 5.0.0-2+deb9u2 amd64 audio codec (lossy and lossless) - library
ii libwebp6:amd64 0.5.2-1 amd64 Lossy compression of digital photographic images.
ii libwebpmux2:amd64 0.5.2-1 amd64 Lossy compression of digital photographic images.
ii libwind0-heimdal:amd64 7.1.0+dfsg-13+deb9u2 amd64 Heimdal Kerberos - stringprep implementation
ii libwrap0:amd64 7.6.q-26 amd64 Wietse Venema's TCP wrappers library
ii libwrap0-dev:amd64 7.6.q-26 amd64 Wietse Venema's TCP wrappers library, development files
ii libx11-6:amd64 2:1.6.4-3 amd64 X11 client-side library
ii libx11-data 2:1.6.4-3 all X11 client-side library
ii libx264-148:amd64 2:0.148.2748+git97eaef2-1 amd64 x264 video coding library
ii libx265-95:amd64 2.1-2+b2 amd64 H.265/HEVC video stream encoder (shared library)
ii libxapian30:amd64 1.4.3-2+deb9u1 amd64 Search engine library
ii libxau6:amd64 1:1.0.8-1 amd64 X11 authorisation library
ii libxcb-render0:amd64 1.12-1 amd64 X C Binding, render extension
ii libxcb-shm0:amd64 1.12-1 amd64 X C Binding, shm extension
ii libxcb1:amd64 1.12-1 amd64 X C Binding
ii libxdmcp6:amd64 1:1.1.2-3 amd64 X11 Display Manager Control Protocol library
ii libxext6:amd64 2:1.3.3-1+b2 amd64 X11 miscellaneous extension library
ii libxfixes3:amd64 1:5.0.3-1 amd64 X11 miscellaneous 'fixes' extension library
ii libxml2:amd64 2.9.4+dfsg1-2.2+deb9u2 amd64 GNOME XML library
ii libxmlrpc-core-c3 1.33.14-4 amd64 lightweight RPC library based on XML and HTTP [C runtime libraries]
ii libxmuu1:amd64 2:1.1.2-2 amd64 X11 miscellaneous micro-utility library
ii libxrender1:amd64 1:0.9.10-1 amd64 X Rendering Extension client library
ii libxtables12:amd64 1.6.0+snapshot20161117-6 amd64 netfilter xtables library
ii libxvidcore4:amd64 2:1.3.4-1+b2 amd64 Open source MPEG-4 video codec (library)
ii libyajl2:amd64 2.1.0-2+b3 amd64 Yet Another JSON Library
ii libyaml-0-2:amd64 0.1.7-2 amd64 Fast YAML 1.1 parser and emitter library
ii libzmq5:amd64 4.2.1-4 amd64 lightweight messaging kernel (shared library)
ii libzvbi-common 0.2.35-13 all Vertical Blanking Interval decoder (VBI) - common files
ii libzvbi0:amd64 0.2.35-13 amd64 Vertical Blanking Interval decoder (VBI) - runtime files
ii linux-base 4.5 all Linux image base package
ii linux-compiler-gcc-6-x86 4.9.110-3+deb9u1 amd64 Compiler for Linux on x86 (meta-package)
ii linux-headers-4.9.0-7-amd64 4.9.110-3+deb9u1 amd64 Header files for Linux 4.9.0-7-amd64
ii linux-headers-4.9.0-7-common 4.9.110-3+deb9u1 all Common header files for Linux 4.9.0-7
ii linux-headers-amd64 4.9+80+deb9u5 amd64 Header files for Linux amd64 configuration (meta-package)
ii linux-image-4.9.0-7-amd64 4.9.110-3+deb9u1 amd64 Linux 4.9 for 64-bit PCs
ii linux-image-amd64 4.9+80+deb9u5 amd64 Linux for 64-bit PCs (meta-package)
ii linux-kbuild-4.9 4.9.110-3+deb9u1 amd64 Kbuild infrastructure for Linux 4.9
ii linux-libc-dev:amd64 4.9.110-3+deb9u1 amd64 Linux support headers for userspace development
ii lldpd 0.9.6-1 amd64 implementation of IEEE 802.1ab (LLDP)
ii locales 2.24-11+deb9u3 all GNU C Library: National Language (locale) data [support]
ii login 1:4.4-4.1 amd64 system login tools
ii logrotate 3.11.0-0.1 amd64 Log rotation utility
ii lsb-base 9.20161125 all Linux Standard Base init script functionality
ii lsb-release 9.20161125 all Linux Standard Base version reporting utility
ii lsof 4.89+dfsg-0.1 amd64 Utility to list open files
ii m4 1.4.18-1 amd64 macro processing language
ii mailutils 1:3.1.1-1 amd64 GNU mailutils utilities for handling mail
ii mailutils-common 1:3.1.1-1 all Common files for GNU mailutils
ii make 4.1-9.1 amd64 utility for directing compilation
ii man-db 2.7.6.1-2 amd64 on-line manual pager
ii manpages 4.10-2 all Manual pages about using a GNU/Linux system
ii mawk 1.3.3-17+b3 amd64 a pattern scanning and text processing language
ii memtest86+ 5.01-3 amd64 thorough real-mode memory tester
ii mime-support 3.60 all MIME files 'mime.types' & 'mailcap', and support programs
ii mount 2.29.2-1+deb9u1 amd64 tools for mounting and manipulating filesystems
ii multiarch-support 2.24-11+deb9u3 amd64 Transitional package to ensure multiarch compatibility
ii mysql-common 5.8+1.0.2 all MySQL database common files, e.g. /etc/mysql/my.cnf
ii nano 2.7.4-1 amd64 small, friendly text editor inspired by Pico
ii ncdu 1.12-1+b1 amd64 ncurses disk usage viewer
ii ncurses-base 6.0+20161126-1+deb9u2 all basic terminal type definitions
ii ncurses-bin 6.0+20161126-1+deb9u2 amd64 terminal-related programs and man pages
ii ncurses-term 6.0+20161126-1+deb9u2 all additional terminal type definitions
ii net-tools 1.60+git20161116.90da8a0-1 amd64 NET-3 networking toolkit
ii netbase 5.4 all Basic TCP/IP networking system
ii netcat 1.10-41 all TCP/IP swiss army knife -- transitional package
ii netcat-traditional 1.10-41+b1 amd64 TCP/IP swiss army knife
ii nfs-common 1:1.3.4-2.1 amd64 NFS support files common to client and server
ii ngcp-keyring 2016.01.12+0~mr6.3.1.1 all GnuPG archive key for NGCP repositories
hi ngcp-rtpengine 6.3.1.1+0~mr6.3.1.1 all NGCP RTP/media proxy - meta package.
hi ngcp-rtpengine-daemon 6.3.1.1+0~mr6.3.1.1 amd64 Proxy for RTP and media streams used in NGCP, userspace part.
hi ngcp-rtpengine-daemon-dbgsym 6.3.1.1+0~mr6.3.1.1 amd64 Debug symbols for ngcp-rtpengine-daemon
hi ngcp-rtpengine-iptables 6.3.1.1+0~mr6.3.1.1 amd64 IPtables extension module for the kernel-space NGCP media proxy.
ii ngcp-rtpengine-kernel-dkms 6.3.1.1+0~mr6.3.1.1 all IPtables kernel module for the NGCP media proxy - DKMS.
hi ngcp-rtpengine-recording-daemon 6.3.1.1+0~mr6.3.1.1 amd64 Recording daemon for RTP and media streams
hi ngcp-rtpengine-utils 6.3.1.1+0~mr6.3.1.1 all Scripts and Perl modules for NGCP rtpengine
ii ngrep 1.45.ds2-14 amd64 grep for network traffic
ii nslcd 0.9.7-2+deb9u1 amd64 daemon for NSS and PAM lookups using LDAP
ii openntpd 1:6.0p1-2 amd64 OpenBSD NTP daemon
ii openssh-client 1:7.4p1-10+deb9u3 amd64 secure shell (SSH) client, for secure access to remote machines
ii openssh-server 1:7.4p1-10+deb9u3 amd64 secure shell (SSH) server, for secure access from remote machines
ii openssh-sftp-server 1:7.4p1-10+deb9u3 amd64 secure shell (SSH) sftp server module, for SFTP access from remote machines
ii openssl 1.1.0f-3+deb9u2 amd64 Secure Sockets Layer toolkit - cryptographic utility
ii passwd 1:4.4-4.1 amd64 change and administer password and group data
ii patch 2.7.5-1+deb9u1 amd64 Apply a diff file to an original
ii pciutils 1:3.5.2-1 amd64 Linux PCI Utilities
ii perl 5.24.1-3+deb9u4 amd64 Larry Wall's Practical Extraction and Report Language
ii perl-base 5.24.1-3+deb9u4 amd64 minimal Perl system
ii perl-modules-5.24 5.24.1-3+deb9u4 all Core Perl modules
ii pinentry-curses 1.0.0-2 amd64 curses-based PIN or pass-phrase entry dialog for GnuPG
ii powermgmt-base 1.31+nmu1 all Common utils and configs for power management
ii procps 2:3.3.12-3+deb9u1 amd64 /proc file system utilities
ii psmisc 22.21-2.1+b2 amd64 utilities that use the proc file system
ii pwgen 2.07-1.1+b1 amd64 Automatic Password generation
ii python 2.7.13-2 amd64 interactive high-level object-oriented language (default version)
ii python-apt 1.4.0~beta3 amd64 Python interface to libapt-pkg
ii python-apt-common 1.4.0~beta3 all Python interface to libapt-pkg (locales)
ii python-minimal 2.7.13-2 amd64 minimal subset of the Python language (default version)
ii python2.7 2.7.13-2+deb9u2 amd64 Interactive high-level object-oriented language (version 2.7)
ii python2.7-minimal 2.7.13-2+deb9u2 amd64 Minimal subset of the Python language (version 2.7)
ii python3 3.5.3-1 amd64 interactive high-level object-oriented language (default python3 version)
ii python3-apt 1.4.0~beta3 amd64 Python 3 interface to libapt-pkg
ii python3-chardet 2.3.0-2 all universal character encoding detector for Python3
ii python3-debian 0.1.30 all Python 3 modules to work with Debian-related data formats
ii python3-debianbts 2.6.1 all Python interface to Debian's Bug Tracking System
ii python3-httplib2 0.9.2+dfsg-1 all comprehensive HTTP client library written for Python3
ii python3-minimal 3.5.3-1 amd64 minimal subset of the Python language (default python3 version)
ii python3-pkg-resources 33.1.1-1 all Package Discovery and Resource Access using pkg_resources
ii python3-pycurl 7.43.0-2 amd64 Python bindings to libcurl (Python 3)
ii python3-pysimplesoap 1.16-2 all simple and lightweight SOAP Library (Python 3)
ii python3-reportbug 7.1.7+deb9u2 all Python modules for interacting with bug tracking systems
ii python3-requests 2.12.4-1 all elegant and simple HTTP library for Python3, built for human beings
ii python3-six 1.10.0-3 all Python 2 and 3 compatibility library (Python 3 interface)
ii python3-urllib3 1.19.1-1 all HTTP library with thread-safe connection pooling for Python3
ii python3.5 3.5.3-1 amd64 Interactive high-level object-oriented language (version 3.5)
ii python3.5-minimal 3.5.3-1 amd64 Minimal subset of the Python language (version 3.5)
ii rake 10.5.0-2 all ruby make-like utility
ii readline-common 7.0-3 all GNU readline and history libraries, common files
ii rename 0.20-4 all Perl extension for renaming multiple files
ii reportbug 7.1.7+deb9u2 all reports bugs in the Debian distribution
ii rpcbind 0.2.3-0.6 amd64 converts RPC program numbers into universal addresses
ii rsync 3.1.2-1+deb9u1 amd64 fast, versatile, remote (and local) file-copying tool
ii ruby 1:2.3.3 amd64 Interpreter of object-oriented scripting language Ruby (default version)
ii ruby-did-you-mean 1.0.0-2 all smart error messages for Ruby > 2.3
ii ruby-json 2.0.1+dfsg-3 amd64 JSON library for Ruby
ii ruby-minitest 5.9.0-1 all Ruby test tools supporting TDD, BDD, mocking, and benchmarking
ii ruby-net-telnet 0.1.1-2 all telnet client library
ii ruby-power-assert 0.3.0-1 all library showing values of variables and method calls in an expression
ii ruby-test-unit 3.1.7-2 all unit testing framework for Ruby
ii ruby2.3 2.3.3-1+deb9u3 amd64 Interpreter of object-oriented scripting language Ruby
ii rubygems-integration 1.11 all integration of Debian Ruby packages with Rubygems
ii sash 3.8-3+b6 amd64 Stand-alone shell
ii screen 4.5.0-6 amd64 terminal multiplexer with VT100/ANSI terminal emulation
ii sed 4.4-1 amd64 GNU stream editor for filtering/transforming text
ii sensible-utils 0.0.9+deb9u1 all Utilities for sensible alternative selection
ii sgml-base 1.29 all SGML infrastructure and SGML catalog file support
ii sharutils 1:4.15.2-2+deb9u1 amd64 shar, unshar, uuencode, uudecode
ii snmp 5.7.3+dfsg-1.7 amd64 SNMP (Simple Network Management Protocol) applications
ii snmpd 5.7.3+dfsg-1.7 amd64 SNMP (Simple Network Management Protocol) agents
ii ssl-cert 1.0.39 all simple debconf wrapper for OpenSSL
ii sudo 1.8.19p1-2.1 amd64 Provide limited super user privileges to specific users
ii syslog-ng 3.8.1-10 all Enhanced system logging daemon (metapackage)
ii syslog-ng-core 3.8.1-10 amd64 Enhanced system logging daemon (core)
ii syslog-ng-mod-journal 3.8.1-10 amd64 Enhanced system logging daemon (systemd journal plugin)
ii syslog-ng-mod-json 3.8.1-10 amd64 Enhanced system logging daemon (JSON plugin)
ii syslog-ng-mod-mongodb 3.8.1-10 amd64 Enhanced system logging daemon (MongoDB plugin)
ii syslog-ng-mod-sql 3.8.1-10 amd64 Enhanced system logging daemon (SQL plugin)
ii systemd 232-25+deb9u4 amd64 system and service manager
ii systemd-sysv 232-25+deb9u4 amd64 system and service manager - SysV links
ii sysvinit-utils 2.88dsf-59.9 amd64 System-V-like utilities
ii tar 1.29b-1.1 amd64 GNU version of the tar archiving utility
ii task-english 3.39 all General English environment
ii tasksel 3.39 all tool for selecting tasks for installation on Debian systems
ii tasksel-data 3.39 all official tasks used for installation of Debian systems
ii tcpdump 4.9.2-1~deb9u1 amd64 command-line network traffic analyzer
ii telegraf 1.7.3-1 amd64 Plugin-driven server agent for reporting metrics into InfluxDB.
ii telnet 0.17-41 amd64 basic telnet client
ii traceroute 1:2.1.0-2 amd64 Traces the route taken by packets over an IPv4/IPv6 network
ii tsocks 1.8beta5+ds1-1 amd64 transparent network access through a SOCKS 4 or 5 proxy
ii tzdata 2018e-0+deb9u1 all time zone and daylight-saving time data
ii ucf 3.0036 all Update Configuration File(s): preserve user changes to config files
ii udev 232-25+deb9u4 amd64 /dev/ and hotplug management daemon
ii unscd 0.52-1+b4 amd64 Micro Name Service Caching Daemon
ii unzip 6.0-21 amd64 De-archiver for .zip files
ii usbutils 1:007-4+b1 amd64 Linux USB utilities
ii util-linux 2.29.2-1+deb9u1 amd64 miscellaneous system utilities
ii util-linux-locales 2.29.2-1+deb9u1 all locales files for util-linux
ii valgrind 1:3.12.0~svn20160714-1+b1 amd64 instrumentation framework for building dynamic analysis tools
ii vim 2:8.0.0197-4+deb9u1 amd64 Vi IMproved - enhanced vi editor
ii vim-common 2:8.0.0197-4+deb9u1 all Vi IMproved - Common files
ii vim-runtime 2:8.0.0197-4+deb9u1 all Vi IMproved - Runtime files
ii vim-tiny 2:8.0.0197-4+deb9u1 amd64 Vi IMproved - enhanced vi editor - compact version
ii vlan 1.9-3.2+b1 amd64 user mode programs to enable VLANs on your ethernet devices
ii wamerican 7.1-1 all American English dictionary words for /usr/share/dict
ii wget 1.18-5+deb9u2 amd64 retrieves files from the web
ii whiptail 0.52.19-1+b1 amd64 Displays user-friendly dialog boxes from shell scripts
ii xauth 1:1.0.9-1+b2 amd64 X authentication utility
ii xkb-data 2.19-1+deb9u1 all X Keyboard Extension (XKB) configuration data
ii xml-core 0.17 all XML infrastructure and XML catalog file support
ii xxd 2:8.0.0197-4+deb9u1 amd64 tool to make (or reverse) a hex dump
ii xz-utils 5.2.2-1.2+b1 amd64 XZ-format compression utilities
ii zlib1g:amd64 1:1.2.8.dfsg-5 amd64 compression library - runtime
ii zlib1g-dev:amd64 1:1.2.8.dfsg-5 amd64 compression library - development
ii zsh 5.3.1-4+b2 amd64 shell with lots of features
ii zsh-common 5.3.1-4 all architecture independent files for ZshUse cases: These are the only commands we use for setting up and destroying sessions:
loadmodule "rtpengine.so"
modparam("rtpengine", "rtpengine_disable_tout", 120)
modparam("rtpengine", "setid_avp", "$avp(rtpsetid)")
modparam("rtpengine", "rtpengine_sock", "0 == {{ kamailio_rtpengines[kamailio_role] }}")
modparam("rtpengine", "rtpengine_sock", "1 == {{ kamailio_rtpengines_experimental[kamailio_role] }}")
if ( rtpengine_manage("force-answer ICE=remove") ) {
rtpengine_delete();
rtpengine_delete();
rtpengine_delete();
if(!rtpengine_answer("trust-address ICE=remove")) {
rtpengine_manage("force trust-address replace-origin replace-session-connection ICE=force RTP/SAVPF rtcp-mux-offer SDES-off");
rtpengine_manage("force trust-address replace-origin replace-session-connection ICE=remove RTP/AVP rtcp-mux-demux");
rtpengine_answer("trust-address RTP/SAVP ICE=remove");
rtpengine_answer("trust-address RTP/AVP ICE=remove");
rtpengine_answer("trust-address ICE=remove");
# use default set rtpengines
rtpengine_manage("force trust-address replace-origin replace-session-connection ICE=force RTP/SAVPF rtcp-mux-offer SDES-off");
rtpengine_manage("force trust-address replace-origin replace-session-connection ICE=remove RTP/AVP rtcp-mux-demux");
rtpengine_offer("trust-address RTP/AVP ICE=remove");
rtpengine_offer("trust-address RTP/SAVP ICE=remove");
rtpengine_offer("trust-address ICE=remove");
rtpengine_delete();
rtpengine_delete();The Websocket stuff is only called on set 1, this one has not been updated and crashed. So you can ignore those.
rfuchs
commented
6 years ago Do you use the Redis options at all? Can you post some details of your configuration?
SipSeb
commented
6 years ago No, we don't use Redis. This is our rtpengine.conf:
[rtpengine]
table = 0
### a single interface:
interface = 5.5.5.5
listen-udp = 5.5.5.5:9000
listen-ng = 5.5.5.5:9001
listen-cli = 9900
timeout = 120
silent-timeout = 3600
tos = 184
delete-delay = 30
final-timeout = 21600
port-min = 15000
port-max = 30000
log-level = 7
log-facility = local7
# log-facility-cdr = local0
# log-facility-rtcp = local1
homer = 1.2.3.4:9060
homer-protocol = udp
homer-id = 2001
dtls-passive = true
After my last report #583 seemed to be related to Homer code, I disabled sending packets to Homer. This time it ran for about an hour before crashing again. This is what gdb says:
Can you read anything from that output?