search

meetecho / janus-gateway

Janus WebRTC Server
https://janus.conf.meetecho.com
GNU General Public License v3.0
8k stars 2.45k forks source link

Janus was died unexpectedly. #1544

Closed kuzm1ch closed 5 years ago

kuzm1ch commented 5 years ago

I've noticed a problem similar to this issue:
https://github.com/cargomedia/janus-gateway-audioroom/issues/38

FYI: In videoroom some users was in audio only mode.

"commit-hash": "0f1dcfd7a18c5dc13e91ee7e5ec92270560f91d7",

Main log message from Janus: 

[ERR] [ice.c:janus_ice_setup_local:3154] [2843602597985776] Error getting list of interfaces...Creating new handle in session 3858213444827961: 2876604454104094; 0x7f114c1a8c00 0x7f115050b440

And main log message from journactl: 

systemd[1]: janus.service: Main process exited, code=killed, status=5/TRAP

More useful logs about the crash from journalctl: https://pastebin.com/rtLDwD0c

Also, CPU metric ( iowait ) jumped extremely high before this crash and I think that this jump was related to janus process, because only janus runs on this machine. FYI: As you can from screenshoot, Janus was restarted imediatly because it is managed by systemd. Thanks. Screenshot from 2019-03-07 15-21-35

lminiero commented 5 years ago

Please try master, that commit is from 3 months ago.

lminiero commented 5 years ago

Make also sure you're using the master version of libnice and not a repo one.

kuzm1ch commented 5 years ago

@lminiero There aren't not many changes since commit 0f1dcfd7a18c5dc13e91ee7e5ec92270560f91d7 . Also, seems like this issue is related to glib (https://pastebin.com/rtLDwD0c ): 

Mar 07 12:55:37 janus-prod env[19735]: (process:19744): GLib-ERROR **: 12:55:37.408: Creating pipes for GWakeup: Too many open files
Mar 07 12:55:37 janus-prod env[19735]: (process:19744): GLib-ERROR **: 12:55:37.408: Creating pipes for GWakeup: Too many open files
Mar 07 12:55:37 janus-prod kernel: do_trap: 46 callbacks suppressed
Mar 07 12:55:37 janus-prod kernel: traps: janus[19753] trap int3 ip:7f116dc80855 sp:7f1147ffd180 error:0
Mar 07 12:55:37 janus-prod kernel: traps: janus[19747] trap int3 ip:7f116dc80855 sp:7f115f7fd190 error:0

From my side I've rebuild janus according to your advise and ping if it will reproduce, but seems that this issue is not occur frequenly ( cargomedia/janus-gateway-audioroom#38 ).

lminiero commented 5 years ago

Addressed in the FAQ, closing. https://janus.conf.meetecho.com/docs/FAQ#ulimit