search

AllStarLink / app_rpt

Refactoring and upgrade of AllStarLink's app_rpt, etc.
4 stars 2 forks source link

rpt_manager_do_xstat: Memory violations #251

Closed tsawyer closed 6 months ago

tsawyer commented 7 months ago

The HXO system reported this problem this evening.

Just FYI. Had to stop and start asterisk. RTCMs where working okay but nodes connected to the server were not passing audio. Been running solid for over a month. They keyed up the network but it was just a dead carrier.

Found an old unreported core but it won't dump.

root@LVRA-Hub ➜  / ll
-rw-------   1 root root  84M Oct 21 16:59 core
root@LVRA-Hub ➜  / /var/lib/asterisk/scripts/ast_coredumper  core
No coredumps found

Any thoughts on why? Should Asterisk be reinstalled?

InterLinked1 commented 7 months ago

The HXO system reported this problem this evening.

Just FYI. Had to stop and start asterisk. RTCMs where working okay but nodes connected to the server were not passing audio. Been running solid for over a month. They keyed up the network but it was just a dead carrier.

Found an old unreported core but it won't dump.

root@LVRA-Hub ➜  / ll
-rw-------   1 root root  84M Oct 21 16:59 core
root@LVRA-Hub ➜  / /var/lib/asterisk/scripts/ast_coredumper  core
No coredumps found

Any thoughts on why? Should Asterisk be reinstalled?

Try applying the PR here, which did the trick for me: https://github.com/asterisk/asterisk/pull/446

tsawyer commented 7 months ago

From the PR

There is still a case for using --asterisk-bin and/or --libdir: If you've updated asterisk since the coredump was taken, the binary, libraries and modules won't match the coredump which will render it useless.

Is that saying there is another way to do this? iTerm2 Session Dec 2, 2023 at 6:56:17 AM.txt

InterLinked1 commented 7 months ago

From the PR

There is still a case for using --asterisk-bin and/or --libdir: If you've updated asterisk since the coredump was taken, the binary, libraries and modules won't match the coredump which will render it useless.

Is that saying there is another way to do this? iTerm2 Session Dec 2, 2023 at 6:56:17 AM.txt

I haven't really looked at the details. Did you replace your ast_coredumper with the version in the PR and try dumping it?

tsawyer commented 7 months ago

I don't think we can pull that PR. gh pr checkout 446 don't have Asterisk source.

InterLinked1 commented 7 months ago

I don't think we can pull that PR. gh pr checkout 446 don't have Asterisk source.

Just get the raw file from the PR and replace your version with it: https://github.com/asterisk/asterisk/blob/bebfc2e6e34787d50c0a6d219f1685b3d928c15f/contrib/scripts/ast_coredumper

Replace contrib/scripts/ast_coredumper in the source dir with that, and then do a make install to install the script.

tsawyer commented 7 months ago

Success... core-asterisk-2023-10-21T23-59-15Z-full.txt

InterLinked1 commented 7 months ago

"rpt_manager_do_xstat: Memory violations" might describe this.

But I think you've conflated two separate issues. The memory violations caused the crash on October 21, but probably have nothing to do with the server not passing audio.

tsawyer commented 7 months ago

But I think you've conflated two separate issues. The memory violations caused the crash on October 21, but probably have nothing to do with the server not passing audio

That's likely. The core is old as I mentioned in the OP.

InterLinked1 commented 6 months ago

After looking at this further, I've determined this duplicates #217.