gilou
commented
6 years ago I removed all outputs but the one streaming the piped stream, as I suspect it's the culprit, it froze again after 1h40, smart_crossfade managed to squeeze one more line:
2018/08/22 12:06:31 [smart_crossfade:3] new >= old + margin, old <= medium and new <= high.
This time I had a socket connected before, and it's responding...
uptime
0d 01h 53m 51s
restart
restart calledbut it's not doing anything the external process is still running, hasn't crashed, doesn't complain on stderr If I attach strace to liq, I get:
sudo strace -fp 29444
strace: Process 29444 attached with 7 threads
[pid 29454] futex(0x56309c3428a0, FUTEX_WAIT_PRIVATE, 2, NULL <unfinished ...>
[pid 29449] futex(0x7f93d8000b48, FUTEX_WAIT_PRIVATE, 0, NULL <unfinished ...>
[pid 29448] futex(0x7f93dc000b48, FUTEX_WAIT_PRIVATE, 0, NULL <unfinished ...>
[pid 29447] restart_syscall(<... resuming interrupted poll ...> <unfinished ...>
[pid 29446] select(0, NULL, NULL, NULL, {tv_sec=0, tv_usec=21809} <unfinished ...>
[pid 29445] futex(0x56309c3428a0, FUTEX_WAIT_PRIVATE, 2, NULL <unfinished ...>
[pid 29444] futex(0x56309c3428a0, FUTEX_WAIT_PRIVATE, 2, NULL <unfinished ...>
[pid 29446] <... select resumed> ) = 0 (Timeout)
[pid 29446] select(0, NULL, NULL, NULL, {tv_sec=0, tv_usec=50000}) = 0 (Timeout)
[pid 29446] select(0, NULL, NULL, NULL, {tv_sec=0, tv_usec=50000}) = 0 (Timeout)
[pid 29446] select(0, NULL, NULL, NULL, {tv_sec=0, tv_usec=50000}) = 0 (Timeout)
[pid 29446] select(0, NULL, NULL, NULL, {tv_sec=0, tv_usec=50000}) = 0 (Timeout)
[pid 29446] select(0, NULL, NULL, NULL, {tv_sec=0, tv_usec=50000}) = 0 (Timeout)If I kill the external process, liq uses 100% of CPU. I'll try and monitor the external process next time. I added merge_tracks and drop_metadata to try making stereotool happier, but I don't think that's the issue ☹
toots
Hi, So running most components from master (cry, dtools, duppy, faad, mad, mm). Thing is, that script is quite complex, but if I remove each part, the bug is really hard to reproduce... All parts have been tested stand alone though.
The script combines:
at the moment I had it freeze, it was outputting 3 streams to icecast:
This is really frustrating, and I'm now back to investigating this again, trying to strip all parts... I'm dumping here as a "reference" until I can narrow it down. The "freeze" means stdout is stuck, the server doesn't answer the socket. The process is alive, but seems stuck polling for something, doesn't respond to QUIT/^C.
Script is run using liquidsoap -v full.liq, and is here with supporting functions.liq: https://gist.github.com/gilou/43133d2619202791e153211471aff6a1 liq.log contains the end of the log, timestamp is hours before I killed it.
bt.txt is the backtrace from the core I got using kill -ABORT on it
It's running on a cheap VPS, using Ubuntu 18.04 on KVM. On this version it crashes in less than an hour.