signalwire / freeswitch

FreeSWITCH is a Software Defined Telecom Stack enabling the digital transformation from proprietary telecom switches to a versatile software implementation that runs on any commodity hardware. From a Raspberry PI to a multi-core server, FreeSWITCH can unlock the telecommunications potential of any device.
https://freeswitch.com/#getting-started
Other
3.54k stars 1.41k forks source link

Crash app on Freeswitch v1.10.9 #2520

Open phamhieptel4vn opened 3 months ago

phamhieptel4vn commented 3 months ago

Describe the bug Some of our production servers running FusionPBX and FreeSWITCH v1.10.9 experienced service crashes that required a reboot, resulting in the loss of active calls and call detail records.

To Reproduce Steps to reproduce the behavior: I haven't been able to reproduce this issue as it crashes a few times without a known root cause.

Version: v1.10.9 UP 0 years, 0 days, 1 hour, 46 minutes, 7 seconds, 58 milliseconds, 132 microseconds FreeSWITCH (Version 1.10.9-release git a615e85 2023-02-03 20:07:30Z 64bit) is ready 8489 session(s) since startup 42 session(s) - peak 82, last 5min 52 0 session(s) per Sec out of max 500, peak 10, last 5min 8 10000 session(s) max min idle cpu 0.00/71.53 Current Stack Size/Max 240K/8192K

Trace logs: Jul 4 15:04:52 db freeswitch[14644]: 2024-07-04 15:04:52.339167 69.30% [WARNING] sofia_reg.c:1846 SIP auth challenge (INVITE) on sofia profile 'internal' for [02866802217@voip-admin.nhanlucsieuviet.com] from ip 119.82.141.206 Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p]: Received command 'offer' from 119.82.141.206:35223 Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p]: Replying to 'offer' from 119.82.141.206:35223 (elapsed time 0.000368 sec) Jul 4 15:04:52 db app.exe[26536]: #033[36mINFO#033[0m[2024-07-04T15:04:52+07:00] CallUuid : [09bb38f1-612f-4ce3-974d-d335a8798ca4] #033[36mmeta#033[0m="event.go:81" Jul 4 15:04:52 db freeswitch[14644]: 2024-07-04 15:04:52.441303 69.30% [WARNING] sofia_reg.c:1846 SIP auth challenge (REGISTER) on sofia profile 'internal' for [5002@voip-admin.nhanlucsieuviet.com] from ip 123.25.21.169 Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p]: Received command 'answer' from 119.82.141.206:44562 Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p]: Replying to 'answer' from 119.82.141.206:44562 (elapsed time 0.000248 sec) Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p port 61276]: ICE negotiated: peer for component 1 is 183.91.22.14:51273 Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p port 61276]: ICE negotiated: local interface 119.82.141.206 Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p port 61276]: DTLS: Peer certificate accepted Jul 4 15:04:52 db app.exe[26536]: #033[33mWARN#033[0m[2024-07-04T15:04:52+07:00] non-string property (variable_DP_MATCH) Jul 4 15:04:52 db app.exe[26536]: #033[36mINFO#033[0m[2024-07-04T15:04:52+07:00] CallUuid : [7a77026f-5f70-4738-beb5-b117bb3f30b0] #033[36mmeta#033[0m="event.go:81" Jul 4 15:04:52 db app.exe[26536]: #033[36mINFO#033[0m[2024-07-04T15:04:52+07:00] CallUuid : [09bb38f1-612f-4ce3-974d-d335a8798ca4] #033[36mmeta#033[0m="event.go:81" Jul 4 15:04:52 db app.exe[26536]: #033[36mINFO#033[0m[2024-07-04T15:04:52+07:00] data callcenter : [map[call_id:7a77026f-5f70-4738-beb5-b117bb3f30b0 direction:outbound domain:voip-admin.nhanlucsieuviet.com from_number:3027 hotline:02873029970 lead_uuid: state:ringing to_number:0919467653]] #033[36mmeta#033[0m="event.go:601" Jul 4 15:04:52 db app.exe[26536]: #033[36mINFO#033[0m[2024-07-04T15:04:52+07:00] PostAuth | url : http://localhost:8003/v3/websocket/event | header : pitel2021 | body : map[call_id:7a77026f-5f70-4738-beb5-b117bb3f30b0 direction:outbound domain:voip-admin.nhanlucsieuviet.com from_number:3027 hotline:02873029970 lead_uuid: state:ringing to_number:0919467653] Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p port 61276]: DTLS-SRTP successfully negotiated Jul 4 15:04:52 db rtpengine[1068]: INFO: [e2ak3tcmcrfivjec945p port 61276]: DTLS-SRTP successfully negotiated Jul 4 15:04:52 db app.exe[26508]: time="2024-07-04T15:04:52+07:00" level=info host="::1" latency=273 method=POST path=/v3/websocket/event status=200 user-agent="go-resty/2.7.0 (https://github.com/go-resty/resty)" Jul 4 15:04:52 db app.exe[26508]: time="2024-07-04T15:04:52+07:00" level=info msg="hook => event: ringing domain voip-admin.nhanlucsieuviet.com extension : 3027 mobile : 0919467653 callId : 7a77026f-5f70-4738-beb5-b117bb3f30b0 leadUuid : " meta="subscriber.go:238" Jul 4 15:04:52 db app.exe[26508]: time="2024-07-04T15:04:52+07:00" level=info msg="extension : 3027 is not in subscribers" meta="subscriber.go:284" Jul 4 15:04:52 db freeswitch[14644]: 2024-07-04 15:04:52.539244 69.30% [ERR] switch_cpp.cpp:1465 sip_number:842871068657 Jul 4 15:04:52 db freeswitch[14644]: 2024-07-04 15:04:52.539244 69.30% [ERR] switch_cpp.cpp:1465 extension:2505 Jul 4 15:04:52 db app.exe[26536]: #033[36mINFO#033[0m[2024-07-04T15:04:52+07:00] CallUuid : [09bb38f1-612f-4ce3-974d-d335a8798ca4] #033[36mmeta#033[0m="event.go:81" Jul 4 15:04:52 db rtpengine[1068]: INFO: [khnlhid8re1ri22rihke port 61071]: Confirmed peer address as 119.82.141.206:31863 Jul 4 15:04:52 db freeswitch[14644]: 2024-07-04 15:04:52.719154 69.30% [WARNING] sofia_reg.c:1846 SIP auth challenge (REGISTER) on sofia profile 'internal' for [9026@voip-admin.nhanlucsieuviet.com] from ip 101.99.32.209 Jul 4 15:04:52 db app.exe[26508]: time="2024-07-04T15:04:52+07:00" level=info host="::1" latency=1193 method=POST path=/v3/webhook/hangup status=200 user-agent=freeswitch-curl/1.0 Jul 4 15:04:52 db kernel: [1442929.069908] traps: freeswitch[14971] general protection ip:7f258fe57985 sp:7f251e109b00 error:0 Jul 4 15:04:52 db kernel: [1442929.069930] in libcrypto.so.1.0.2[7f258fd26000+239000] Jul 4 15:04:52 db app.exe[26508]: time="2024-07-04T15:04:52+07:00" level=info msg="[lead_uuid is nil => skip]" meta="webhook.go:36"

phungnguyentel4vn commented 1 week ago

Sounds sad untill now because I am too and I still do not know that how can I fix it? :(