search

chuot / rdio-scanner

Rdio Scanner is an open source software that ingest and distribute audio files generated by various software-defined radio recorders. Its interface tries to reproduce the user experience of a real police scanner, while adding its own touch.
GNU General Public License v3.0
422 stars 59 forks source link

Downstream timing out #330

Closed cpg178-kcd closed 1 year ago

cpg178-kcd commented 1 year ago

Out of the blue I am constantly getting a "connectex: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond."

I have rebooted the internet connection, and servers on both ends. It will successfully pass 1 file to the downstream but then everything else after fails. Nothing has changed on either device.

cpg178-kcd commented 1 year ago

Did some sniffing with wireshark and there is clear communication between both devices, but what is interesting is every packet appears to be UDP, whereas the error keeps saying "Dial TCP" and rarely "read TCP"

**I have preformed further troubleshooting going as far as blowing away the default DB and installed a MariaDB. Still no change

*** I set up a downstream going the opposite way and it works flawlessly. ( I guess you could call this one a upstream lol) Also of note is that every 10 minutes of so I can get one file to properly downstream to my remote server, but everything after that throws the error shown below in the screenshot until ~10 minutes have passed then the cycle repeats Sporadically I also get a "context deadline exceeded (Client.Timeout exceeded while awaiting headers)"

cpg178-kcd commented 1 year ago

image

chuot commented 1 year ago

The context expiration time is 30 seconds. This could be due to many factors such as a problematic proxy between the two, insufficient systems resources, problem with the network and so on.

More investigation is needed. Look at the system logs for something that could explain this.

cpg178-kcd commented 1 year ago

So interestingly enough after 4 hours of troubleshooting last night, I gave up for the evening and discovered this morning it is working fine. Looking back in the logs this has happend on and off for about a week now, but I have had this setup in place for close to a month. so not sure what the deal is

I will look deeper into any network issues, my initial suspicions was the limitations of SQLite trying to ingest multiple files from the very active trunking system along with multiple downstream coming in at the same time, but moving to MariaDB did not make any change.

infecticide commented 1 year ago

Do you have any form of IDS/IPS on either network?

I had to disable some SIDs in Suricata on my network to fix an issue where it would trip and block the other end.