Closed JayCue702 closed 3 weeks ago
now i dont have issue of statpost after changing this node to iax2 registration :/ instead of http_registrations.
So if someone can help with making http_registrations work then let me know what info you need on my part.
Can you please switch back to HTTP registrations and look for any errors in the log as well as display rpt show registrations
here?
ASL61952*CLI> rpt show registrations
Host Username Perceived Refresh State
34.105.111.212:443 61952
[2024-07-06 18:00:17.776] Asterisk 20.8.1+asl3-3.0.0-1.deb12 built by builder @ allstarlink.org on a aarch64 running Linux on 2024-06-13 23:09:36 UTC
[2024-07-06 18:00:17.856] NOTICE[152644] loader.c: 69 modules will be loaded.
[2024-07-06 18:00:17.963] NOTICE[152644] cdr.c: CDR simple logging enabled.
[2024-07-06 18:00:17.969] NOTICE[152644] dnsmgr.c: Managed DNS entries will be refreshed every 300 seconds.
[2024-07-06 18:00:18.020] NOTICE[152644] indications.c: Default country for indication tones: us
[2024-07-06 18:00:18.020] NOTICE[152644] indications.c: Setting default indication country to 'us'
[2024-07-06 18:00:18.188] NOTICE[152644] res_smdi.c: No SMDI interfaces are available to listen on, not starting SMDI listener.
[2024-07-06 18:00:18.205] WARNING[152644] chan_dahdi.c: Only FXO signalled channels may belong to a call group
[2024-07-06 18:00:18.205] WARNING[152644] chan_dahdi.c: Only FXO signalled channels may belong to a pickup group
[2024-07-06 18:00:18.205] NOTICE[152644] chan_dahdi.c: Ignoring any changes to 'userbase' (on reload) at line 23.
[2024-07-06 18:00:18.205] NOTICE[152644] chan_dahdi.c: Ignoring any changes to 'vmsecret' (on reload) at line 31.
[2024-07-06 18:00:18.205] NOTICE[152644] chan_dahdi.c: Ignoring any changes to 'hassip' (on reload) at line 35.
[2024-07-06 18:00:18.205] NOTICE[152644] chan_dahdi.c: Ignoring any changes to 'hasiax' (on reload) at line 39.
[2024-07-06 18:00:18.205] NOTICE[152644] chan_dahdi.c: Ignoring any changes to 'hasmanager' (on reload) at line 47.
[2024-07-06 18:00:18.205] WARNING[152644] chan_dahdi.c: Only FXO signalled channels may belong to a call group
[2024-07-06 18:00:18.205] WARNING[152644] chan_dahdi.c: Only FXO signalled channels may belong to a pickup group
[2024-07-06 18:00:23.708] WARNING[152644] loader.c: Module 'res_adsi' has been loaded but may be removed in a future release.
[2024-07-06 18:00:24.030] NOTICE[152687] app_rpt.c: Normal Repeater Init 61952
[2024-07-06 18:00:28.634] WARNING[152688] res_rpt_http_registrations.c: Resolving timed out after 1000 milliseconds
[2024-07-06 18:00:28.635] WARNING[152688] res_rpt_http_registrations.c: Failed to curl URL 'https://register.allstarlink.org/'
[2024-07-06 18:03:29.030] WARNING[152688] res_rpt_http_registrations.c: Resolving timed out after 1000 milliseconds
[2024-07-06 18:03:29.030] WARNING[152688] res_rpt_http_registrations.c: Failed to curl URL 'https://register.allstarlink.org/'
[2024-07-06 18:05:23.099] NOTICE[152668] dnsmgr.c: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443
I see that we are passing a connect timeout of 1000ms (1s). This may be a bit too short. Should we extend the timeout(s)?
@JayCue702 What type of network connection does this node have? Do you have generally good connectivity? DSL, Cable, Fiber, Satellite? What are the ping times from your node to "register.allstarlink.org" ?
here is ping results from the two servers linked to register.allstarlink.org
PING register.allstarlink.org (162.248.92.131) 56(84) bytes of data. 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=1 ttl=51 time=58.9 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=2 ttl=51 time=67.2 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=3 ttl=51 time=58.8 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=4 ttl=51 time=66.0 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=5 ttl=51 time=65.9 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=6 ttl=51 time=64.4 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=7 ttl=51 time=66.7 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=8 ttl=51 time=63.9 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=9 ttl=51 time=65.6 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=10 ttl=51 time=67.1 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=11 ttl=51 time=64.9 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=12 ttl=51 time=65.8 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=13 ttl=51 time=67.0 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=14 ttl=51 time=67.4 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=15 ttl=51 time=66.6 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=16 ttl=51 time=71.4 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=17 ttl=51 time=65.6 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=18 ttl=51 time=73.0 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=19 ttl=51 time=75.2 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=20 ttl=51 time=65.3 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=21 ttl=51 time=66.6 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=22 ttl=51 time=67.1 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=23 ttl=51 time=67.1 ms 64 bytes from v-162-248-92-131.unman-vds.premium-chicago.nfoservers.com (162.248.92.131): icmp_seq=24 ttl=51 time=63.8 ms ^C --- register.allstarlink.org ping statistics --- 24 packets transmitted, 24 received, 0% packet loss, time 23033ms rtt min/avg/max/mdev = 58.752/66.306/75.201/3.455 ms
PING register.allstarlink.org (34.105.111.212) 56(84) bytes of data. 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=1 ttl=53 time=50.4 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=2 ttl=53 time=61.7 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=3 ttl=53 time=81.5 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=4 ttl=53 time=56.2 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=5 ttl=53 time=52.3 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=6 ttl=53 time=51.4 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=7 ttl=53 time=52.6 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=8 ttl=53 time=51.4 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=9 ttl=53 time=52.6 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=10 ttl=53 time=57.1 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=11 ttl=53 time=56.7 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=12 ttl=53 time=71.1 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=13 ttl=53 time=53.1 ms 64 bytes from register-west1-b.allstarlink.org (34.105.111.212): icmp_seq=14 ttl=53 time=54.9 ms ^C --- register.allstarlink.org ping statistics --- 14 packets transmitted, 14 received, 0% packet loss, time 13018ms rtt min/avg/max/mdev = 50.358/57.365/81.537/8.484 ms
speedtest.net results 602 Mbps download, 545.05 Mbps upload
changed my dns to see if it helped, still same error
Well, it looks like you've got excellent network connectivity. We'll keep thinking.
so one thing to think about. im behind double nat. i can register with the older iax2 way but cannot register this way. If i use openvpn to get me to connect to vpn server then im able to do http_registrations.
Interesting and most certainly something we need to investigate.
Does something in your upstream ISP do some sort of proxying or content inspection? That could be slowing down the HTTP POST request. Can you post the results of running this from your node:
time curl --header "Content-Type: application/json" \
--request POST \
--data "{}" \
https://repo.allstarlink.org/usage/usage
real 0m5.615s user 0m0.324s sys 0m0.028s
Yeah that isn't right AT ALL. Your "real" time should be within a few millis of user. Something is terribly killing your upload network connectivity.
probably this double nat :/ is there way to give it more time before timeout for my setup?
Definitely something we should look at. 1s is probably too aggressive.
But to be honest, this is not going to be a priority at the moment. We won’t lose track of it, but I would suggest rolling back to IAX registrations for now.
sounds good! thanks for keeping me in the loop
Is it really a simple double-NAT? or have you got something else that's trying to do content filtering?
Allan yeah unfortunately my isp is known for this issue. WELINK. I can not do any port forwarding. The only way i could get around it was by putting my node through openvpn to vpn that supports port forwarding.
And, while I don't expect the following command to tell us much more than we already know, you might want to try the curl
again with the "--verbose" option.
time curl --verbose --header "Content-Type: application/json" \
--request POST \
--data "{}" \
https://repo.allstarlink.org/usage/usage
POST /usage/usage HTTP/2 Host: repo.allstarlink.org user-agent: curl/7.88.1 accept: / content-type: application/json content-length: 2
real 0m5.664s user 0m0.364s sys 0m0.034s
The fix for this issue has been incorporated into ASL3-Asterisk 20.9.1+asl3-3.0.4-1
rpi3b+ w/ latest ASL 3 build image
Have two nodes. Both have issues using http_registrations. I disabled it and turned back on iax2 registrations at the moment to get working. One node has issues doing stat post. The other does not. Both are new clean ASL3 build image for raspberry pi 3b+.
[2024-07-03 22:56:06.651] WARNING[59590]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072566&seqno=4&keyed=0&keytime=42' failed with code 401 [2024-07-03 22:56:06.651] WARNING[59589]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072566&seqno=3&nodes=&apprptvers=3.0.0&apprptuptime=31&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:56:38.277] WARNING[59594]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072598&seqno=5&nodes=&apprptvers=3.0.0&apprptuptime=63&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:56:38.278] WARNING[59595]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072598&seqno=6&keyed=0&keytime=74' failed with code 401 [2024-07-03 22:57:09.954] WARNING[59617]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072629&seqno=7&nodes=&apprptvers=3.0.0&apprptuptime=94&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:57:09.954] WARNING[59618]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072629&seqno=8&keyed=0&keytime=105' failed with code 401 [2024-07-03 22:57:41.557] WARNING[59623]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072661&seqno=10&keyed=0&keytime=137' failed with code 401 [2024-07-03 22:57:41.558] WARNING[59622]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072661&seqno=9&nodes=&apprptvers=3.0.0&apprptuptime=126&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:58:13.357] WARNING[59628]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072693&seqno=11&nodes=&apprptvers=3.0.0&apprptuptime=158&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:58:13.358] WARNING[59629]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072693&seqno=12&keyed=0&keytime=169' failed with code 401 [2024-07-03 22:58:45.118] WARNING[59654]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072724&seqno=14&keyed=0&keytime=200' failed with code 401 [2024-07-03 22:58:45.119] WARNING[59653]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072724&seqno=13&nodes=&apprptvers=3.0.0&apprptuptime=189&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:59:16.896] WARNING[59658]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072756&seqno=15&nodes=&apprptvers=3.0.0&apprptuptime=221&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:59:16.896] WARNING[59659]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072756&seqno=16&keyed=0&keytime=232' failed with code 401 [2024-07-03 22:59:48.593] WARNING[59681]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072788&seqno=17&nodes=&apprptvers=3.0.0&apprptuptime=253&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401 [2024-07-03 22:59:48.593] WARNING[59682]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072788&seqno=18&keyed=0&keytime=264' failed with code 401 [2024-07-03 23:00:20.341] WARNING[59687]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072820&seqno=20&keyed=0&keytime=296' failed with code 401 [2024-07-03 23:00:20.341] WARNING[59686]: app_rpt.c:1008 perform_statpost: statpost to URL 'http://stats.allstarlink.org/uhandler?node=61952&time=1720072820&seqno=19&nodes=&apprptvers=3.0.0&apprptuptime=285&totalkerchunks=0&totalkeyups=0&totaltxtime=0&timeouts=0&totalexecdcommands=0' failed with code 401