search

AllStarLink / app_rpt

Refactoring and upgrade of AllStarLink's app_rpt, etc.
3 stars 2 forks source link

res-rpt-http-registrations periodic "SSL connection timeout" #332

Open W6HBR opened 1 month ago

W6HBR commented 1 month ago

I'm seeing several registration timeout warnings being logged on my console. Don't know if this is expected behavior, so thought I would open an issue to document it. I left the DNS queries listed in the log below so you can see that connectivity is normally fine.

[2024-05-22 19:41:19.106] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: SSL connection timeout [2024-05-22 19:41:19.106] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/'

[2024-05-22 19:42:47.468] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 19:42:47.469] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 19:42:47.469] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 19:42:47.470] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 19:42:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 19:50:22.675] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: Failed to connect to register.allstarlink.org port 443 after 1000 ms: Timeout was reached [2024-05-22 19:50:22.675] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/' [2024-05-22 19:52:47.470] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 19:52:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 19:52:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 19:52:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 19:52:47.473] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 19:56:24.133] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: Failed to connect to register.allstarlink.org port 443 after 1000 ms: Timeout was reached [2024-05-22 19:56:24.133] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/' [2024-05-22 19:56:25.262] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: Failed to connect to register.allstarlink.org port 443 after 1000 ms: Timeout was reached [2024-05-22 19:56:25.262] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/' [2024-05-22 20:12:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:12:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:12:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:12:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:12:47.466] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:17:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:17:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:17:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:17:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:17:47.466] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:22:47.470] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:22:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:22:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:22:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:22:47.473] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:27:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:27:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:27:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:27:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:27:47.466] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:41:39.635] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: Failed to connect to register.allstarlink.org port 443 after 1000 ms: Timeout was reached [2024-05-22 20:41:39.635] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/' [2024-05-22 20:42:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:42:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:42:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:42:47.473] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:42:47.474] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:47:47.469] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:47:47.470] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:47:47.470] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:47:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:47:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:52:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:52:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:52:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 20:52:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 20:52:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:02:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:02:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:02:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:02:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:02:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:07:47.470] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:07:47.471] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:07:47.472] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:07:47.473] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:07:47.473] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:12:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:12:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:12:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:12:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:12:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:14:50.992] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: SSL connection timeout [2024-05-22 21:14:50.992] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/' [2024-05-22 21:22:47.462] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:22:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:22:47.463] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:22:47.464] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:22:47.465] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:32:47.473] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:32:47.474] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:32:47.475] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:32:47.475] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 34.105.111.212:443 to 162.248.92.131:443 [2024-05-22 21:32:47.476] NOTICE[162148]: dnsmgr.c:225 dnsmgr_refresh: dnssrv: host 'register.allstarlink.org' changed from 162.248.92.131:443 to 34.105.111.212:443 [2024-05-22 21:35:58.249] WARNING[162170]: res_rpt_http_registrations.c:147 curl_post: Failed to connect to register.allstarlink.org port 443 after 1000 ms: Timeout was reached [2024-05-22 21:35:58.249] WARNING[162170]: res_rpt_http_registrations.c:149 curl_post: Failed to curl URL 'https://register.allstarlink.org/'

tsawyer commented 1 month ago

Not sure what is causing that. Problem might be on the client side. Might be from AllStarLink servers. It dose seem to happen most on my servers that have multiple nodes. @W6HBR thoughts?

W6HBR commented 1 month ago

This is from my 5 node (single server) in the EOC, so I would assume connectivity is solid. Interestingly, I've not seen it again since this report.

My main concern was that if there were timeouts happening on the server side, that the problem may escalate once ASL3 is released and more nodes are using the http registration.

I'll try to monitor my logs to see if it starts reoccurring and report back if it does.

tsawyer commented 1 month ago

I would assume connectivity is solid.

My thought on the client side is maybe adding a couple hundred milliseconds between registrations and also waiting a bit for responses would help matters.

W6HBR commented 1 month ago

Yeah, since it's a non-interactive process, I can't see where a little padding would hurt.