Closed rastawarez closed 2 years ago
If need some additional data or explanation feel free to contact me. Thank you
18 Mar 2021 03:04:26 8151968 6128324 139328 1652 1884316 1750688 52 52 52 18 Mar 2021 03:04:58 8151968 6131036 141792 1652 1879140 1748080 52 52 52 18 Mar 2021 03:05:29 8151968 6134024 132712 1652 1885232 1745164 52 52 52 18 Mar 2021 03:06:01 8151968 6126484 139640 1652 1885844 1752568 52 52 52 18 Mar 2021 03:06:33 8151968 6135296 135772 1652 1880900 1743604 52 52 52 18 Mar 2021 03:07:04 8151968 6134308 142900 1652 1874760 1744628 52 52 52 18 Mar 2021 03:07:36 8151968 6137720 133084 1652 1881164 1741176 52 52 52 18 Mar 2021 03:08:08 8151968 6134132 137556 1652 1880280 1744640 52 52 52 18 Mar 2021 03:08:39 8151968 6134856 139932 1652 1877180 1743740 52 52 52 18 Mar 2021 03:09:11 8151968 6138748 141320 1652 1871900 1740080 52 52 52 18 Mar 2021 03:09:43 8151968 6142796 141324 1652 1867848 1736036 52 52 52 18 Mar 2021 03:10:14 8151968 6141228 133804 1652 1876936 1737504 52 52 52 18 Mar 2021 03:10:46 8151968 6142776 133648 1652 1875544 1735852 52 52 52 18 Mar 2021 03:11:18 8151968 6142904 141320 1652 1867744 1735784 52 52 52 18 Mar 2021 03:11:49 8151968 6142856 139908 1652 1869204 1735932 52 52 52 18 Mar 2021 03:12:21 8151968 6149700 133792 1652 1868476 1728884 52 52 52 18 Mar 2021 03:12:52 8151968 6144788 137576 1652 1869604 1733656 52 52 52 18 Mar 2021 03:13:24 8151968 6150136 142352 1652 1859480 1728272 52 52 52 18 Mar 2021 03:13:56 8151968 6152820 137468 1652 1861680 1725584 52 52 52 18 Mar 2021 03:14:27 8151968 6148792 134528 1652 1868648 1729540 52 52 52 18 Mar 2021 03:14:59 8151968 6146580 136972 1652 1868416 1731732 52 52 52 18 Mar 2021 03:15:31 8151968 6152884 137772 1652 1861312 1725376 52 52 52 18 Mar 2021 03:16:02 8151968 6157596 133232 1652 1861140 1720624 52 52 52 18 Mar 2021 03:16:34 8151968 6153888 134728 1652 1863352 1724204 52 52 52 18 Mar 2021 03:17:06 8151968 6156236 133792 1652 1861940 1721980 52 52 52 18 Mar 2021 03:17:37 8151968 6159868 142496 1652 1849604 1718456 52 52 52 18 Mar 2021 03:18:09 8151968 6160756 140228 1652 1850984 1717308 52 52 52 18 Mar 2021 03:18:40 8151968 6161972 132572 1652 1857424 1715656 52 52 52 18 Mar 2021 03:19:12 8151968 6158444 136492 1652 1857032 1719436 52 52 52 18 Mar 2021 03:19:44 8151968 6159532 143324 1652 1849112 1718372 52 52 52 18 Mar 2021 03:20:15 8151968 6163124 139016 1652 1849828 1714732 52 52 52 18 Mar 2021 03:20:47 8151968 6165724 131336 1652 1854908 1712124 52 52 52 18 Mar 2021 03:21:19 8151968 6164628 133064 1652 1854276 1713184 52 52 52 18 Mar 2021 03:21:50 8151968 6163284 141196 1652 1847488 1714504 52 52 52 18 Mar 2021 03:22:22 8151968 6169192 137632 1652 1845144 1708588 52 52 52 18 Mar 2021 03:22:54 8151968 6161640 136504 1652 1853824 1715924 52 52 52 18 Mar 2021 03:23:25 8151968 6162080 135760 1652 1854128 1715076 52 52 52 18 Mar 2021 03:23:57 8151968 6167772 143064 1652 1841132 1709796 52 52 52 18 Mar 2021 03:24:29 8151968 6175368 138100 1652 1838500 1702228 52 52 52 18 Mar 2021 03:25:00 8151968 6170944 133616 1652 1847408 1706600 52 52 52 18 Mar 2021 03:25:32 8151968 6182964 133632 1652 1835372 1694556 52 52 52 18 Mar 2021 03:26:03 8151968 6194124 134796 1652 1823048 1683340 52 52 52 18 Mar 2021 03:26:35 8151968 6193296 130012 1652 1828660 1684168 52 52 52 18 Mar 2021 03:27:07 8151968 6191080 131564 1652 1829324 1686320 52 52 52 18 Mar 2021 03:27:38 8151968 6187540 134948 1652 1829480 1689524 52 52 52 18 Mar 2021 03:28:10 8151968 6198120 134580 1652 1819268 1679216 52 52 52 18 Mar 2021 03:28:42 8151968 6195792 127224 1652 1828952 1681364 52 52 52 18 Mar 2021 03:29:13 8151968 6162788 160768 1652 1828412 1712264 52 52 52 18 Mar 2021 03:29:45 8151968 6162160 164396 1652 1825412 1712900 52 52 52 18 Mar 2021 03:30:17 8151968 6169388 162756 1652 1819824 1705604 52 52 52 18 Mar 2021 03:30:48 8151968 6167416 155620 1652 1828932 1709420 52 52 52 18 Mar 2021 03:31:20 8151968 6169996 154520 1652 1827452 1706908 52 52 52 18 Mar 2021 03:31:51 8151968 6170152 161960 1652 1819856 1706696 52 52 52 18 Mar 2021 03:32:23 8151968 6172836 160908 1652 1818224 1704424 52 52 52 18 Mar 2021 03:32:55 8151968 6167864 155576 1652 1828528 1708880 52 52 52 18 Mar 2021 03:33:26 8151968 6172468 155272 1652 1824228 1704348 52 52 52 18 Mar 2021 03:33:58 8151968 6180856 160676 1652 1810436 1695992 52 52 52 18 Mar 2021 03:34:30 8151968 6185568 160404 1652 1805996 1691140 52 52 52 18 Mar 2021 03:35:01 8151968 6178804 157552 1652 1815612 1697768 52 52 52 18 Mar 2021 03:35:33 8151968 6177656 158584 1652 1815728 1698976 52 52 52 18 Mar 2021 03:36:05 8151968 6187040 159856 1652 1805072 1689436 52 52 52 18 Mar 2021 03:36:36 8151968 6180884 157156 1652 1813928 1695616 52 52 52 18 Mar 2021 03:37:08 8151968 6180120 159324 1652 1812524 1696380 52 52 52 18 Mar 2021 03:37:40 8151968 6182640 165364 1652 1803964 1693836 52 52 52 18 Mar 2021 03:38:11 8151968 6187564 162564 1652 1801840 1688796 52 52 52 18 Mar 2021 03:38:43 8151968 6189552 156568 1652 1805848 1686884 52 52 52 18 Mar 2021 03:39:14 8151968 6186484 162856 1652 1802628 1689568 52 52 52 18 Mar 2021 03:39:46 8151968 6192936 164140 1652 1794892 1683328 52 52 52 18 Mar 2021 03:40:18 8151968 6195168 156284 1652 1800516 1681064 52 52 52 18 Mar 2021 03:40:49 8151968 6191980 160640 1652 1799348 1684248 52 52 52 18 Mar 2021 03:41:21 8151968 6195636 162952 1652 1793380 1680584 52 52 52 18 Mar 2021 03:41:53 8151968 6196220 154612 1652 1801136 1679724 52 52 52 18 Mar 2021 03:42:24 8151968 6198484 156664 1652 1796820 1677636 52 52 52 18 Mar 2021 03:42:56 8151968 6200732 162072 1652 1789164 1675348 52 52 52 18 Mar 2021 03:43:28 8151968 6201684 157524 1652 1792760 1673644 52 52 52 18 Mar 2021 03:43:59 8151968 6199336 162632 1652 1790000 1676552 52 52 52 18 Mar 2021 03:44:31 8151968 6206488 156180 1652 1789300 1669140 52 52 52 18 Mar 2021 03:45:02 8151968 6200772 155172 1652 1796024 1674824 52 52 52 18 Mar 2021 03:45:34 8151968 6204792 151856 1652 1795320 1670644 52 52 52 18 Mar 2021 03:46:06 8151968 6235316 126180 1652 1790472 1640904 52 52 52 18 Mar 2021 03:46:37 8151968 6282040 132132 1656 1737796 1593076 52 52 52 18 Mar 2021 03:47:09 8151968 6281756 137580 1656 1732632 1593648 52 52 52 18 Mar 2021 03:47:41 8151968 6283140 134184 1656 1734644 1593540 52 52 52 18 Mar 2021 03:48:12 8151968 6284564 139412 1656 1727992 1592140 52 52 52 18 Mar 2021 03:48:44 8151968 6291072 135756 1656 1725140 1585752 52 52 52 18 Mar 2021 03:49:16 8151968 6282660 133696 1656 1735612 1593764 52 52 52 18 Mar 2021 03:49:47 8151968 6290272 132160 1656 1729536 1586404 52 52 52 18 Mar 2021 03:50:19 8151968 6289812 153420 1656 1708736 1586288 52 52 52 18 Mar 2021 03:50:51 8151968 6284804 149728 1656 1717436 1591436 52 52 52 18 Mar 2021 03:51:22 8151968 6284244 150660 1656 1717064 1592004 52 52 52 18 Mar 2021 03:51:54 8151968 6284264 154328 1656 1713376 1592036 52 52 52 18 Mar 2021 03:52:26 8151968 6288380 156216 1656 1707372 1587900 52 52 52 18 Mar 2021 03:52:57 8151968 6286640 148980 1656 1716348 1589620 52 52 52 18 Mar 2021 03:53:29 8151968 6297296 133888 1656 1720784 1579036 52 52 52 18 Mar 2021 03:54:01 8151968 6299756 138976 1656 1713236 1576592 52 52 52 18 Mar 2021 03:54:32 8151968 6294516 136208 1656 1721244 1581840 52 52 52 18 Mar 2021 03:55:04 8151968 6295980 134284 1656 1721704 1580292 52 52 52 18 Mar 2021 03:55:35 8151968 6304772 139456 1656 1707740 1571400 52 52 52 18 Mar 2021 03:56:07 8151968 6305212 137396 1656 1709360 1571064 52 52 52 18 Mar 2021 03:56:39 8151968 6301320 133940 1656 1716708 1574920 52 52 52 18 Mar 2021 03:57:10 8151968 6304016 131780 1656 1716172 1572432 52 52 52 18 Mar 2021 03:57:42 8151968 6306772 137872 1656 1707324 1569652 52 52 52 18 Mar 2021 03:58:14 8151968 6307992 130956 1656 1713020 1568548 52 52 52 18 Mar 2021 03:58:45 8151968 6304108 133436 1656 1714424 1572204 52 52 52 18 Mar 2021 03:59:17 8151968 6307884 134636 1656 1709448 1568376 52 52 52 18 Mar 2021 03:59:49 8151968 6307300 139280 1656 1705388 1568972 52 52 52 18 Mar 2021 04:00:20 8151968 6312584 134492 1656 1704892 1563688 52 52 52 18 Mar 2021 04:00:52 8151968 6306816 142944 1656 1702208 1569400 52 52 52 18 Mar 2021 04:01:23 8151968 6313612 140740 1656 1697616 1562608 52 52 52 18 Mar 2021 04:01:55 8151968 6313528 133564 1656 1704876 1562236 52 52 52 18 Mar 2021 04:02:27 8151968 6319956 133488 1664 1698524 1555936 52 52 52 18 Mar 2021 04:02:59 8151968 6290528 172952 1656 1688488 1584160 52 52 52 18 Mar 2021 04:03:30 8151968 6312232 140056 1664 1699680 1562812 52 52 52 18 Mar 2021 04:04:02 8151968 6310336 141116 1664 1700516 1564820 52 52 52 18 Mar 2021 04:04:34 8151968 6318832 141516 1664 1691620 1556484 52 52 52 18 Mar 2021 04:05:05 8151968 6313752 137304 1664 1700912 1561516 52 52 52 18 Mar 2021 04:05:37 8151968 6318632 137544 1664 1695792 1556420 52 52 52 18 Mar 2021 04:06:09 8151968 6328304 137580 1664 1686084 1547100 52 52 52 18 Mar 2021 04:06:40 8151968 6322736 134152 1664 1695080 1552340 52 52 52 18 Mar 2021 04:07:12 8151968 6320624 136596 1664 1694748 1554508 52 52 52 18 Mar 2021 04:07:43 8151968 6330008 134524 1664 1687436 1544968 52 52 52
One hour consumption available mem 1750688 to 1544968
Old version 1.3.1 with the same media is working. I am using s = request.dynamic(id="s",get_request) . Anyway, I tested the old script with a new liquidsoap and Linux but with the same memory leak result. I tested remove part of scripts drop metadata, Redis client call but always sam result.
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# /usr/local/bin/liquidsoap --version
Liquidsoap 1.3.1
Copyright (c) 2003-2017 Savonet team
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# cat /etc/issue
Ubuntu 16.04.7 LTS \n \l
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# free -mh
total used free shared buff/cache available
Mem: 8.0G 6.0G 33M 1.1G 1.9G 2.0G
Swap: 16G 4.0G 11G
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# free -m
total used free shared buff/cache available
Mem: 8192 6152 35 1077 2003 2039
Swap: 16384 4119 12264
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# free -m
total used free shared buff/cache available
Mem: 8192 6165 14 1075 2012 2026
Swap: 16384 4120 12263
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# who -b
system boot Feb 26 12:38
root@test-liquidsoad2:/opt/stream-producer/nodes/console-streams-range-1# ps ax | grep liquid | wc -l
123
Thanks for this report. Could you provide some log extracts as well? Thanks!
I will set logger on diff level and start it again,
Thank you for your response R.
On Thu, Mar 18, 2021 at 10:55 PM Romain Beauxis @.***> wrote:
Thanks for this report. Could you provide some log extracts as well? Thanks!
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/savonet/liquidsoap/issues/1539#issuecomment-802330481, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABHTQUWSQX5FQ2OATVYK6MLTEJZFZANCNFSM4ZMVUI2A .
Thanks for this report. Could you provide some log extracts as well? Thanks! log level 4 > lq.log
I try to build an image with valgrind with output to file and send you log files. if you want
I try to build an image with valgrind with output to file and send you log files. if you want
That would be great.
I try to build an image with valgrind with output to file and send you log files. if you want
That would be great.
I hope I will provide logs this night or tomorrow. I need to finish the current running tests. I want to use the same machine to perform valgrind test reports.
here is one log but I don't know if it is useful https://www.dropbox.com/s/y9jmswvpf4hv4p6/vstreams_3.log?dl=0
Sorry I haven't had time to look at this so far. Will try to get to it shortly.
Sorry I haven't had time to look at this so far. Will try to get to it shortly.
No problem. anyway, thank you. I changed the output to HLS instead of Icecast but memory is still growing up.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
We've been investigating memory usage in the past 3 releases. I'd suggest to try with the latest released version and report/reopen if it is still happening. Thanks!
I will make a new test and i will trace memory consuption. I will send report. Anyway thank you
Describe the bug probably memory leak streaming mp3 files to Icecast server
annotate:liq_fade_in=5.,liq_fade_out=5.,liq_cue_in=0,liq_cue_out=198.90900000000000000000:/nfsshare/mp3/9000/9601.MP3
PUSH snippet
LOG fragment during push
Thu Mar 18 13:49:04 UTC 2021 STREAM 7 ALREADY EXIST CHECK PUSH MEDIA with prmaeterss ok /opt/stream-producer/sockets/BOXP001:xmx_7 script stream_template/get-next-media-cms.sh streamid 7 !!!!!!! annotate:liq_fade_in=5.,liq_fade_out=5.,liq_cue_in=3.00000000000000000000,liq_cue_out=301.00000000000000000000:/nfsshare/mp3/219000/219608.MP3 4 END Bye! !!!!!!!!!
MP3 FILE INFO EXAMPL ONE REAL FILE
ANNOTATION INFO CONNECTED TO SOURCE
To Reproduce My script liquidsoap
Expected behavior
FIRST RECORD OF MY MEMORY TRACE LOG administrator@docker1:~$ cat 17-18mar5200M.cvs | head -n 1
MEMORY TRACE LOG RECORDS - FILTERED ROWS WHEN PROCESS DOWN ( see 51 streams form 52 )
administrator@docker1:~$ cat 17-18mar5200M.cvs | grep " 51 " # 51 mean one stream is missing ( down )
Today report
Version details
HOST SYSTEM
Static hostname: docker1 Icon name: computer-vm Chassis: vm Machine ID: 7777fd9ae38842329ab865cc2406e54e Boot ID: 80f05781f7554def81e73da030816740 Virtualization: vmware Operating System: Ubuntu 20.04.2 LTS Kernel: Linux 5.4.0-66-generic Architecture: x86-64
DOCKER VERSION administrator@docker1:~$ docker -v Docker version 20.10.5, build 55c4c88
DOCKER IMAGE [ image from docker hub 1.4.4 ]
root@9c3f0f3f4db8:/opt/stream-producer# cat /etc/issue Debian GNU/Linux bullseye/sid \n \l
root@9c3f0f3f4db8:/opt/stream-producer# liquidsoap --version Liquidsoap 1.4.4 Copyright (c) 2003-2019 Savonet team Liquidsoap is open-source software, released under GNU General Public License. See http://liquidsoap.info for more information
Install method docker 1.4.4
Common issues All is running correctly except memory growing consumption.