search

CDCgov / prime-reportstream

ReportStream is a public intermediary tool for delivery of data between different parts of the healthcare ecosystem.
https://reportstream.cdc.gov
Creative Commons Zero v1.0 Universal
72 stars 40 forks source link

Troubleshoot outbound connectivity issues #15714

Open jeremy-page opened 2 months ago

jeremy-page commented 2 months ago

We are intermittently unable to communicate with the following SFTP based receiver:

10:14:~ % dig +short sftp-east.inductivehealth.com 
transfer.inductivehealth.com.
ih-prod-sftp-67c0287157bc3dec.elb.us-east-2.amazonaws.com.
3.142.29.114
18.189.5.199
10:14:~ % dig +short sftp-west.inductivehealth.com 
transfer.inductivehealth.com.
ih-prod-sftp-67c0287157bc3dec.elb.us-east-2.amazonaws.com.
3.142.29.114
18.189.5.199
jeremy-page commented 2 months ago

Per Victor "We found the reason why the CA REST API calls are failing sometimes. We updated the REST transport authentication logic, but didn't update the logic on the REST transport check function that runs every 15 minutes."

Cut out the HTTP part of the ticket.

devopsmatt commented 1 week ago

Taking ownership of this, since this seems to be unresolved, showing large packet loss:

Matts-MBP-3.home (192.168.254.183) -> sftp-east.inductivehealth.com (18.189.5.199)                              2024-10-21T15:04:17-0700
Keys:  Help   Display mode   Restart statistics   Order of fields   quit
                                                                                                Packets               Pings
 Host                                                                                         Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. gateway.home                                                                               0.0%    23    4.9   6.1   4.8  16.2   2.9
 2. 47-144-192-1.lsan.ca.frontiernet.net                                                       0.0%    23    9.9  10.1   6.4  18.4   2.7
 3. ae39--100.ber01.snmn.ca.frontiernet.net                                                    0.0%    23   14.1  15.6  11.7  50.9   7.8
 4. ae9---0.scr03.lsan.ca.frontiernet.net                                                      0.0%    23   30.5  15.6  12.8  30.5   3.4
 5. (waiting for reply)
 6. ae1.3501.edge7.losangeles1.net.lumen.tech                                                 56.5%    23   24.2  24.0  11.8  47.3  12.1
 7. 99.83.64.96                                                                                0.0%    23   13.2  16.9  10.8  49.5   8.6
 8. (waiting for reply)
 9. (waiting for reply)
10. 108.166.252.8                                                                             19.0%    22  1618. 1576. 1365. 1654.  82.8
11. (waiting for reply)
12. 108.166.244.3                                                                              0.0%    22   68.5  73.5  68.5 106.7   9.9
13. (waiting for reply)